Dataset Information

Multisensory simultaneity judgment and proximity to the body.

ABSTRACT: The integration of information across different sensory modalities is known to be dependent upon the statistical characteristics of the stimuli to be combined. For example, the spatial and temporal proximity of stimuli are important determinants with stimuli that are close in space and time being more likely to be bound. These multisensory interactions occur not only for singular points in space/time, but over "windows" of space and time that likely relate to the ecological statistics of real-world stimuli. Relatedly, human psychophysical work has demonstrated that individuals are highly prone to judge multisensory stimuli as co-occurring over a wide range of time--a so-called simultaneity window (SW). Similarly, there exists a spatial representation of peripersonal space (PPS) surrounding the body in which stimuli related to the body and to external events occurring near the body are highly likely to be jointly processed. In the current study, we sought to examine the interaction between these temporal and spatial dimensions of multisensory representation by measuring the SW for audiovisual stimuli through proximal-distal space (i.e., PPS and extrapersonal space). Results demonstrate that the audiovisual SWs within PPS are larger than outside PPS. In addition, we suggest that this effect is likely due to an automatic and additional computation of these multisensory events in a body-centered reference frame. We discuss the current findings in terms of the spatiotemporal constraints of multisensory interactions and the implication of distinct reference frames on this process.

SUBMITTER: Noel JP

PROVIDER: S-EPMC4777235 | biostudies-other | 2016

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Multisensory simultaneity judgment and proximity to the body.

Noel Jean-Paul JP Lukowska Marta M Wallace Mark M Serino Andrea A

Journal of vision 20160101 3

The integration of information across different sensory modalities is known to be dependent upon the statistical characteristics of the stimuli to be combined. For example, the spatial and temporal proximity of stimuli are important determinants with stimuli that are close in space and time being more likely to be bound. These multisensory interactions occur not only for singular points in space/time, but over "windows" of space and time that likely relate to the ecological statistics of real-wo ...[more]

PMID: 26891828

Similar Datasets

Project description:Percepts of verticality are thought to be constructed as a weighted average of multisensory inputs, but the observed weights differ considerably between studies. In the present study, we evaluate whether this can be explained by differences in how visual, somatosensory and proprioceptive cues contribute to representations of the Head In Space (HIS) and Body In Space (BIS). Participants (10) were standing on a force plate on top of a motion platform while wearing a visualization device that allowed us to artificially tilt their visual surroundings. They were presented with (in)congruent combinations of visual, platform, and head tilt, and performed Rod & Frame Test (RFT) and Subjective Postural Vertical (SPV) tasks. We also recorded postural responses to evaluate the relation between perception and balance. The perception data shows that body tilt, head tilt, and visual tilt affect the HIS and BIS in both experimental tasks. For the RFT task, visual tilt induced considerable biases (? 10° for 36° visual tilt) in the direction of the vertical expressed in the visual scene; for the SPV task, participants also adjusted platform tilt to correct for illusory body tilt induced by the visual stimuli, but effects were much smaller (? 0.25°). Likewise, postural data from the SPV task indicate participants slightly shifted their weight to counteract visual tilt (0.3° for 36° visual tilt). The data reveal a striking dissociation of visual effects between the two tasks. We find that the data can be explained well using a model where percepts of the HIS and BIS are constructed from direct signals from head and body sensors, respectively, and indirect signals based on body and head signals but corrected for perceived neck tilt. These findings show that perception of the HIS and BIS derive from the same sensory signals, but see profoundly different weighting factors. We conclude that observations of different weightings between studies likely result from querying of distinct latent constructs referenced to the body or head in space.

Project description:ObjectiveRecent studies have reported that skilled tennis players are likely to use proximal body information for anticipating the direction of their opponent's forehand shot. However, in these studies, the visual stimuli did not include visual information about the ball. Skilled players may have used proximal information owing to the lack of distal information. To address this issue, we developed a novel methodological approach using computer graphics (CG) images in which the entire body was presented by a combination of point-light display (i.e., poor graphical information, PLD) and polygons (i.e., rich graphical information). Using our novel methodological approach, we examined whether skilled tennis players use proximal body information when anticipating shot directions.Methods and resultsFifteen skilled tennis players and fifteen novice players tried to anticipate shot directions by observing four CG forehand strokes (ALPOL: all body parts were represented with polygon; RAPLD: racket and arm were represented with PLD; BOPLD: body parts without racket and arm were represented with PLD; and ALPLD: all body parts were represented with PLD). Our intention in creating CG models with such combinations (i.e., RAPLD and BOPLD) was that because of the richer graphical information provided by polygons compared to PLD, the participant's anticipatory judgment would be influenced more by body parts expressed with polygons. The results showed that for skilled players, anticipatory judgment was more accurate when they observed RAPLD than when they observed BOPLD and ALPLD. In contrast, for novice players, there were no differences in the accuracy of anticipatory judgments with the four CG models.ConclusionsOnly skilled players made more accurate anticipatory judgments when body regions were expressed with rich graphical information, and the racket and arm were expressed with poor graphical information. These suggest that skilled players used proximal information to effectively anticipate shot directions.

Dataset Information

Multisensory simultaneity judgment and proximity to the body.

Publications

Multisensory simultaneity judgment and proximity to the body.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets