Dataset Information

Efficient visual search from synchronized auditory signals requires transient audiovisual events.

ABSTRACT:

Background

A prevailing view is that audiovisual integration requires temporally coincident signals. However, a recent study failed to find any evidence for audiovisual integration in visual search even when using synchronized audiovisual events. An important question is what information is critical to observe audiovisual integration.

Methodology/principal findings

Here we demonstrate that temporal coincidence (i.e., synchrony) of auditory and visual components can trigger audiovisual interaction in cluttered displays and consequently produce very fast and efficient target identification. In visual search experiments, subjects found a modulating visual target vastly more efficiently when it was paired with a synchronous auditory signal. By manipulating the kind of temporal modulation (sine wave vs. square wave vs. difference wave; harmonic sine-wave synthesis; gradient of onset/offset ramps) we show that abrupt visual events are required for this search efficiency to occur, and that sinusoidal audiovisual modulations do not support efficient search.

Conclusions/significance

Thus, audiovisual temporal alignment will only lead to benefits in visual search if the changes in the component signals are both synchronized and transient. We propose that transient signals are necessary in synchrony-driven binding to avoid spurious interactions with unrelated signals when these occur close together in time.

SUBMITTER: Van der Burg E

PROVIDER: S-EPMC2871056 | biostudies-literature | 2010 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Efficient visual search from synchronized auditory signals requires transient audiovisual events.

Van der Burg Erik E Cass John J Olivers Christian N L CN Theeuwes Jan J Alais David D

PloS one 20100514 5

<h4>Background</h4>A prevailing view is that audiovisual integration requires temporally coincident signals. However, a recent study failed to find any evidence for audiovisual integration in visual search even when using synchronized audiovisual events. An important question is what information is critical to observe audiovisual integration.<h4>Methodology/principal findings</h4>Here we demonstrate that temporal coincidence (i.e., synchrony) of auditory and visual components can trigger audiovi ...[more]

PMID: 20498844

Similar Datasets

Project description:ObjectivesEfficient multisensory speech detection is critical for children who must quickly detect/encode a rapid stream of speech to participate in conversations and have access to the audiovisual cues that underpin speech and language development, yet multisensory speech detection remains understudied in children with hearing loss (CHL). This research assessed detection, along with vigilant/goal-directed attention, for multisensory versus unisensory speech in CHL versus children with normal hearing (CNH).DesignParticipants were 60 CHL who used hearing aids and communicated successfully aurally/orally and 60 age-matched CNH. Simple response times determined how quickly children could detect a preidentified easy-to-hear stimulus (70 dB SPL, utterance "buh" presented in auditory only [A], visual only [V], or audiovisual [AV] modes). The V mode formed two facial conditions: static versus dynamic face. Faster detection for multisensory (AV) than unisensory (A or V) input indicates multisensory facilitation. We assessed mean responses and faster versus slower responses (defined by first versus third quartiles of response-time distributions), which were respectively conceptualized as: faster responses (first quartile) reflect efficient detection with efficient vigilant/goal-directed attention and slower responses (third quartile) reflect less efficient detection associated with attentional lapses. Finally, we studied associations between these results and personal characteristics of CHL.ResultsUnisensory A versus V modes: Both groups showed better detection and attention for A than V input. The A input more readily captured children's attention and minimized attentional lapses, which supports A-bound processing even by CHL who were processing low fidelity A input. CNH and CHL did not differ in ability to detect A input at conversational speech level. Multisensory AV versus A modes: Both groups showed better detection and attention for AV than A input. The advantage for AV input was facial effect (both static and dynamic faces), a pattern suggesting that communication is a social interaction that is more than just words. Attention did not differ between groups; detection was faster in CHL than CNH for AV input, but not for A input. Associations between personal characteristics/degree of hearing loss of CHL and results: CHL with greatest deficits in detection of V input had poorest word recognition skills and CHL with greatest reduction of attentional lapses from AV input had poorest vocabulary skills. Both outcomes are consistent with the idea that CHL who are processing low fidelity A input depend disproportionately on V and AV input to learn to identify words and associate them with concepts. As CHL aged, attention to V input improved. Degree of HL did not influence results.ConclusionsUnderstanding speech-a daily challenge for CHL-is a complex task that demands efficient detection of and attention to AV speech cues. Our results support the clinical importance of multisensory approaches to understand and advance spoken communication by CHL.

Project description:BackgroundMajor depressive disorder has been associated with specific attentional biases in processing emotional facial expressions: heightened attention for negative and decreased attention for positive faces. However, using visual search paradigms, previous reaction-time-based research failed, in general, to find evidence for increased spatial attention toward negative facial expressions and reduced spatial attention toward positive facial expressions in depressed individuals. Eye-tracking analyses allow for a more detailed examination of visual search processes over time during the perception of multiple stimuli and can provide more specific insights into the attentional processing of multiple emotional stimuli.MethodsGaze behavior of 38 clinically depressed individuals and 38 gender matched healthy controls was compared in a face-in-the-crowd task. Pictures of happy, angry, and neutral facial expressions were utilized as target and distractor stimuli. Four distinct measures of eye gaze served as dependent variables: (a) latency to the target face, (b) number of distractor faces fixated prior to fixating the target, (c) mean fixation time per distractor face before fixating the target and (d) mean fixation time on the target.ResultsDepressed and healthy individuals did not differ in their manual response times. Our eye-tracking data revealed no differences between study groups in attention guidance to emotional target faces as well as in the duration of attention allocation to emotional distractor and target faces. However, depressed individuals fixated fewer distractor faces before fixating the target than controls, regardless of valence of expressions.ConclusionsDepressed individuals seem to process angry and happy expressions in crowds of faces mainly in the same way as healthy individuals. Our data indicate no biased attention guidance to emotional targets and no biased processing of angry and happy distractors and targets in depression during visual search. Under conditions of clear task demand depressed individuals seem to be able to allocate and guide their attention in crowds of angry and happy faces as efficiently as healthy individuals.

Dataset Information

Efficient visual search from synchronized auditory signals requires transient audiovisual events.

Background

Methodology/principal findings

Conclusions/significance

Publications

Efficient visual search from synchronized auditory signals requires transient audiovisual events.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets