Dataset Information

Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments.

ABSTRACT: Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.

SUBMITTER: Love SA

PROVIDER: S-EPMC6037859 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments.

Love Scott A SA Petrini Karin K Pernet Cyril R CR Latinus Marianne M Pollick Frank E FE

Frontiers in human neuroscience 20180703

Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to ...[more]

PMID: 30018545

Similar Datasets

Project description:A considerable body of sensory research has addressed the rules governing simultaneity judgments (SJs) and temporal order judgments (TOJs). In principle, neural events that register stimulus-arrival-time differences at an early sensory stage could set the limit on SJs and TOJs alike. Alternatively, distinct limits on SJs and TOJs could arise from task-specific neural events occurring after the stimulus-driven stage. To distinguish between these possibilities, we developed a novel reaction-time (RT) measure and tested it in a perceptual-learning procedure. The stimuli comprised dual-stream Rapid Serial Visual Presentation (RSVP) displays. Participants judged either the simultaneity or temporal order of red-letter and black-number targets presented in opposite lateral hemifield streams of black-letter distractors. Despite identical visual stimulation across-tasks, the SJ and TOJ tasks generated distinct RT patterns. SJs exhibited significantly faster RTs to synchronized targets than to subtly asynchronized targets; TOJs exhibited the opposite RT pattern. These task-specific RT patterns cannot be attributed to the early, stimulus-driven stage and instead match what one would predict if the limits on SJs and TOJs arose from task-specific decision spaces. That is, synchronized targets generate strong evidence for simultaneity, which hastens SJ RTs. By contrast, synchronized targets provide no information about temporal order, which slows TOJ RTs. Subtly asynchronizing the targets reverses this information pattern, and the corresponding RT patterns. In addition to investigating RT patterns, we also investigated training-transfer between the tasks. Training to improve SJ precision failed to improve TOJ precision, and vice versa, despite identical visual stimulation across tasks. This, too, argues against early, stimulus-driven limits on SJs and TOJs. Taken together, the present study offers novel evidence that distinct rules set the limits on SJs and TOJs.

Dataset Information

Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments.

Publications

Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets