Predicting the length of volleyball serves: The role of early auditory and visual information.
Ontology highlight
ABSTRACT:
SUBMITTER: Sors F
PROVIDER: S-EPMC6277097 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:What happens if a visual cue misleads auditory expectations? Previous studies revealed an early visuo-auditory incongruency effect, so-called incongruency response (IR) of the auditory event-related brain potential (ERP), occurring 100 ms after onset of the sound being incongruent to the preceding visual cue. So far, this effect has been ascribed to reflect the mismatch between auditory sensory expectation activated by visual predictive information and the actual sensory input. Thus, an IR should be confined to an asynchronous presentation of visual cue and sound. Alternatively, one could argue that frequently presented congruent visual-cue-sound combinations are integrated into a bimodal representation whereby violation of the visual-auditory relationship results in a bimodal feature mismatch (the IR should be obtained with asynchronous and with synchronous presentation). In an asynchronous condition, an either high-pitched or low-pitched sound was preceded by a visual note symbol presented above or below a fixation cross (90% congruent; 10% incongruent), while in a synchronous condition, both were presented simultaneously. High-pitched and low-pitched sounds were presented with different probabilities (83% vs. 17%) to form a strong association between bimodal stimuli. In both conditions, tones with pitch incongruent with the location of the note symbols elicited incongruency effects in the N2 and P3 ERPs; however, the IR was only elicited in the asynchronous condition. This finding supports the sensorial prediction error hypothesis stating that the amplitude of the auditory ERP 100 ms after sound onset is enhanced in response to unexpected compared with expected but otherwise identical sounds.
| S-EPMC8084811 | biostudies-literature
Project description:BackgroundVision provides the most salient information with regard to the stimulus motion. However, it has recently been demonstrated that static visual stimuli are perceived as moving laterally by alternating left-right sound sources. The underlying mechanism of this phenomenon remains unclear; it has not yet been determined whether auditory motion signals, rather than auditory positional signals, can directly contribute to visual motion perception.Methodology/principal findingsStatic visual flashes were presented at retinal locations outside the fovea together with a lateral auditory motion provided by a virtual stereo noise source smoothly shifting in the horizontal plane. The flash appeared to move by means of the auditory motion when the spatiotemporal position of the flashes was in the middle of the auditory motion trajectory. Furthermore, the lateral auditory motion altered visual motion perception in a global motion display where different localized motion signals of multiple visual stimuli were combined to produce a coherent visual motion perception.Conclusions/significanceThese findings suggest there exist direct interactions between auditory and visual motion signals, and that there might be common neural substrates for auditory and visual motion processing.
| S-EPMC3052321 | biostudies-literature
Project description:Serve and serve-reception performance have predicted success in volleyball. Given the impact of serve-reception on the game, we aimed at understanding what it is in the serve and receiver's actions that determines the selection of the type of pass used in serve-reception and its efficacy. Four high-level volleyball players received jump-float serves from four servers in two reception zones-zone 1 and 5. The ball and the receiver's head were tracked with two video cameras, allowing 3D world-coordinates reconstruction. Logistic-regression models were used to predict the type of pass used (overhand or underhand) and serve-reception efficacy (error, out, or effective) from variables related with the serve kinematics and related with the receiver's on-court positioning and movement. Receivers' initial position was different when in zone 1 and 5. This influenced the serve-related variables as well as the type of pass used. Strong predictors of using an underhand rather than overhand pass were higher ball contact of the server, reception in zone 1, receiver's initial position more to the back of the court and backward receiver movement. Receiver's larger longitudinal displacements and an initial position more to the back of the court had a strong relationship with the decreasing of the serve-reception efficacy. Receivers' positioning and movement were the factors with the largest impact on the type of pass used and the efficacy of the reception. Reception zone affected the variance in the ball's kinematics (with the exception of the ball's lateral displacement), as well as in the receivers' positioning (distances from the net and from the target). Also the reception zone was associated with the type of pass used by the receiver but not with reception efficacy. Given volleyball's rotation rule, the receiver needs to master receiving in the different reception zones; he/she needs to adapt to the diverse constraints of each zone to maintain performance efficacy. Thus, being able to flexibly vary positioning and passing, given local (zone) constraints, can yield an advantage in high-level volleyball serve-reception. Further, research needs to consider other serve modes (e.g., power-jump serve) and a full-court context of performance to support the present study's findings.
| S-EPMC5089979 | biostudies-literature
Project description:In face-to-face conversations, when listeners process and combine information obtained from hearing and seeing a speaker, they mostly look at the eyes rather than at the more informative mouth region. Measuring event-related potentials, we tested whether fixating the speaker's eyes is sufficient for gathering enough visual speech information to modulate early auditory processing, or whether covert attention to the speaker's mouth is needed. Results showed that when listeners fixated the eye region of the speaker, the amplitudes of the auditory evoked N1 and P2 were reduced when listeners heard and saw the speaker than when they only heard her. These cross-modal interactions also occurred when, in addition, attention was restricted to the speaker's eye region. Fixating the speaker's eyes thus provides listeners with sufficient visual information to facilitate early auditory processing. The spread of covert attention to the mouth area is not needed to observe audiovisual interactions.
| S-EPMC6719704 | biostudies-literature
Project description:How and where in the brain audio-visual signals are bound to create multimodal objects remains unknown. One hypothesis is that temporal coherence between dynamic multisensory signals provides a mechanism for binding stimulus features across sensory modalities. Here, we report that when the luminance of a visual stimulus is temporally coherent with the amplitude fluctuations of one sound in a mixture, the representation of that sound is enhanced in auditory cortex. Critically, this enhancement extends to include both binding and non-binding features of the sound. We demonstrate that visual information conveyed from visual cortex via the phase of the local field potential is combined with auditory information within auditory cortex. These data provide evidence that early cross-sensory binding provides a bottom-up mechanism for the formation of cross-sensory objects and that one role for multisensory binding in auditory cortex is to support auditory scene analysis.
| S-EPMC5814679 | biostudies-literature
Project description:Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explained by sensory (i.e., 'Early') processing benefits or post-sensory (i.e., 'Late') changes in decision dynamics. Here, we employ a well-established visual object categorisation task in which early sensory and post-sensory decision evidence can be dissociated using multivariate pattern analysis of the electroencephalogram (EEG). We capitalize on these distinct neural components to identify when and how complementary auditory information influences the encoding of decision-relevant visual evidence in a multisensory context. We show that it is primarily the post-sensory, rather than the early sensory, EEG component amplitudes that are being amplified during rapid audiovisual decision-making. Using a neurally informed drift diffusion model we demonstrate that a multisensory behavioral improvement in accuracy arises from an enhanced quality of the relevant decision evidence, as captured by the post-sensory EEG component, consistent with the emergence of multisensory evidence in higher-order brain areas.
| S-EPMC7595090 | biostudies-literature
Project description:Eye blinks are influenced by external sensory and internal cognitive factors, as mainly shown in the visual domain. In previous studies, these factors corresponded to the time period of task-relevant sensory information and were often linked to a motor response. Our aim was to dissociate the influence of overall sensory input duration, task-relevant information duration, and the motor response to further understand how the temporal modulation of blinks compares among sensory modalities. Using a visual and an auditory temporal judgment task, we found that blinks were suppressed during stimulus presentation in both domains and that the overall input length had a significant positive relationship with the length of this suppression (i.e., with the latency of the first blink after stimulus onset). Importantly, excluding the influence of the overall sensory input duration we could show that the duration of task-relevant input had an additional influence on blink latency in the visual and the auditory domain. Our findings further suggest that this influence was not based on sensory input but on top-down processes. We could exclude task difficulty and the timing of the motor response as driving factors in the blink modulation. Our results suggest a sensory domain-independent modulation of blink latencies, introduced by changes in the length of the task-relevant, attended period. Therefore, not only do blinks mark the timing of sensory input or the preparation of the motor output, but they can also act as precise indicators of periods of cognitive processing.
| S-EPMC8196427 | biostudies-literature
Project description:Early electroencephalographic studies that focused on finding brain correlates of psychic events led to the discovery of the P300. Since then, the P300 has become the focus of many basic and clinical neuroscience studies. However, despite its wide applications, the underlying function of the P300 is not yet clearly understood. One line of research among the many studies that have attempted to elucidate the underlying subroutine of the P300 in the brain has suggested that the physiological function of the P300 is related to inhibition. While some intracranial, behavioral, and event-related potential studies have provided support for this theory, little is known about the inhibitory mechanism. In this study, using alpha event-related desynchronization (ERD) and effective connectivity, based on the causal (one-way directed) relationship between alpha ERD and P300 sources, we demonstrated that P300's associated inhibition is implemented at a higher information processing stage in a localized brain region. We discuss how inhibition as the primary function of the P300 is not inconsistent with 'resource allocation' and 'working memory updating' theories about its cognitive function. In light of our findings regarding the scope and information processing stage of inhibition of the P300, we reconcile the inhibitory account of the P300 with working memory updating theory. Finally, based on the compensatory behavior of alpha ERD at the time of suppression of the P300, we propose two distinct yet complementary working memory mechanisms (inhibition and desynchronizing excitation) that render target perception possible.
| S-EPMC7899349 | biostudies-literature
Project description:A variety of perceptual correspondences between auditory and visual features have been reported, but few studies have investigated how rhythm, an auditory feature defined purely by dynamics relevant to speech and music, interacts with visual features. Here, we demonstrate a novel crossmodal association between auditory rhythm and visual clutter. Participants were shown a variety of visual scenes from diverse categories and asked to report the auditory rhythm that perceptually matched each scene by adjusting the rate of amplitude modulation (AM) of a sound. Participants matched each scene to a specific AM rate with surprising consistency. A spatial-frequency analysis showed that scenes with greater contrast energy in midrange spatial frequencies were matched to faster AM rates. Bandpass-filtering the scenes indicated that greater contrast energy in this spatial-frequency range was associated with an abundance of object boundaries and contours, suggesting that participants matched more cluttered scenes to faster AM rates. Consistent with this hypothesis, AM-rate matches were strongly correlated with perceived clutter. Additional results indicated that both AM-rate matches and perceived clutter depend on object-based (cycles per object) rather than retinal (cycles per degree of visual angle) spatial frequency. Taken together, these results suggest a systematic crossmodal association between auditory rhythm, representing density in the temporal domain, and visual clutter, representing object-based density in the spatial domain. This association may allow for the use of auditory rhythm to influence how visual clutter is perceived and attended.
| S-EPMC3706496 | biostudies-literature
Project description:The ability to use temporal relationships between cross-modal cues facilitates perception and behavior. Previously we observed that temporally correlated changes in the size of a visual stimulus and the intensity in an auditory stimulus influenced the ability of listeners to perform an auditory selective attention task (Maddox, Atilgan, Bizley, & Lee, 2015). Participants detected timbral changes in a target sound while ignoring those in a simultaneously presented masker. When the visual stimulus was temporally coherent with the target sound, performance was significantly better than when the visual stimulus was temporally coherent with the masker, despite the visual stimulus conveying no task-relevant information. Here, we trained observers to detect audiovisual temporal coherence and asked whether this changed the way in which they were able to exploit visual information in the auditory selective attention task. We observed that after training, participants were able to benefit from temporal coherence between the visual stimulus and both the target and masker streams, relative to the condition in which the visual stimulus was coherent with neither sound. However, we did not observe such changes in a second group that were trained to discriminate modulation rate differences between temporally coherent audiovisual streams, although they did show an improvement in their overall performance. A control group did not change their performance between pretest and post-test and did not change how they exploited visual information. These results provide insights into how crossmodal experience may optimize multisensory integration.
| S-EPMC7868888 | biostudies-literature