Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Correlation detection as a general mechanism for multisensory integration.

ABSTRACT: The brain efficiently processes multisensory information by selectively combining related signals across the continuous stream of multisensory inputs. To do so, it needs to detect correlation, lag and synchrony across the senses; optimally integrate related information; and dynamically adapt to spatiotemporal conflicts across the senses. Here we show that all these aspects of multisensory perception can be jointly explained by postulating an elementary processing unit akin to the Hassenstein-Reichardt detector-a model originally developed for visual motion perception. This unit, termed the multisensory correlation detector (MCD), integrates related multisensory signals through a set of temporal filters followed by linear combination. Our model can tightly replicate human perception as measured in a series of empirical studies, both novel and previously published. MCDs provide a unified general theory of multisensory processing, which simultaneously explains a wide spectrum of phenomena with a simple, yet physiologically plausible model.

SUBMITTER: Parise CV

PROVIDER: S-EPMC4897755 | biostudies-literature | 2016 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Correlation detection as a general mechanism for multisensory integration.

Parise Cesare V CV Ernst Marc O MO

Nature communications 20160606

The brain efficiently processes multisensory information by selectively combining related signals across the continuous stream of multisensory inputs. To do so, it needs to detect correlation, lag and synchrony across the senses; optimally integrate related information; and dynamically adapt to spatiotemporal conflicts across the senses. Here we show that all these aspects of multisensory perception can be jointly explained by postulating an elementary processing unit akin to the Hassenstein-Rei ...[more]

PMID: 27265526

Similar Datasets

A cellular mechanism for inverse effectiveness in multisensory integration.

Project description:To build a coherent view of the external world, an organism needs to integrate multiple types of sensory information from different sources, a process known as multisensory integration (MSI). Previously, we showed that the temporal dependence of MSI in the optic tectum of Xenopus laevis tadpoles is mediated by the network dynamics of the recruitment of local inhibition by sensory input (Felch et al., 2016). This was one of the first cellular-level mechanisms described for MSI. Here, we expand this cellular level view of MSI by focusing on the principle of inverse effectiveness, another central feature of MSI stating that the amount of multisensory enhancement observed inversely depends on the size of unisensory responses. We show that non-linear summation of crossmodal synaptic responses, mediated by NMDA-type glutamate receptor (NMDARs) activation, form the cellular basis for inverse effectiveness, both at the cellular and behavioral levels.

| S-EPMC5375642 | biostudies-literature

A normalization model of multisensory integration.

Project description:Responses of neurons that integrate multiple sensory inputs are traditionally characterized in terms of a set of empirical principles. However, a simple computational framework that accounts for these empirical features of multisensory integration has not been established. We propose that divisive normalization, acting at the stage of multisensory integration, can account for many of the empirical principles of multisensory integration shown by single neurons, such as the principle of inverse effectiveness and the spatial principle. This model, which uses a simple functional operation (normalization) for which there is considerable experimental support, also accounts for the recent observation that the mathematical rule by which multisensory neurons combine their inputs changes with cue reliability. The normalization model, which makes a strong testable prediction regarding cross-modal suppression, may therefore provide a simple unifying computational account of the important features of multisensory integration by neurons.

| S-EPMC3102778 | biostudies-literature

Multisensory integration in the mouse striatum.

Project description:The basal ganglia are involved in sensorimotor functions and action selection, both of which require the integration of sensory information. In order to determine how such sensory inputs are integrated, we obtained whole-cell recordings in mouse dorsal striatum during presentation of tactile and visual stimuli. All recorded neurons responded to bilateral whisker stimulation, and a subpopulation also responded to visual stimulation. Neurons responding to both visual and tactile stimuli were located in dorsomedial striatum, whereas those responding only to whisker deflections were located dorsolaterally. Responses were mediated by overlapping excitation and inhibition, with excitation onset preceding that of inhibition by several milliseconds. Responses differed according to the type of neuron, with direct pathway MSNs having larger responses and longer latencies between ipsilateral and contralateral responses than indirect pathway MSNs. Our results suggest that striatum acts as a sensory "hub" with specialized functional roles for the different neuron types.

| S-EPMC4157575 | biostudies-literature

Neural Basis of Anticipatory Multisensory Integration.

Project description:The brain is able to gather different sensory information to enhance salient event perception, thus yielding a unified perceptual experience of multisensory events. Multisensory integration has been widely studied, and the literature supports the hypothesis that it can occur across various stages of stimulus processing, including both bottom-up and top-down control. However, evidence on anticipatory multisensory integration occurring in the fore period preceding the presentation of the expected stimulus in passive tasks, is missing. By means of event-related potentials (ERPs), it has been recently proposed that visual and auditory unimodal stimulations are preceded by sensory-specific readiness activities. Accordingly, in the present study, we tested the occurrence of multisensory integration in the endogenous anticipatory phase of sensory processing, combining visual and auditory stimuli during unimodal and multimodal passive ERP paradigms. Results showed that the modality-specific pre-stimulus ERP components (i.e., the auditory positivity -aP- and the visual negativity -vN-) started earlier and were larger in the multimodal stimulation compared with the sum of the ERPs elicited by the unimodal stimulations. The same amplitude effect was also present for the early auditory N1 and visual P1 components. This anticipatory multisensory effect seems to influence stimulus processing, boosting the magnitude of early stimulus processing. This paves the way for new perspectives on the neural basis of multisensory integration.

| S-EPMC8301880 | biostudies-literature

Crossmodal associations modulate multisensory spatial integration.

Project description:According to the Bayesian framework of multisensory integration, audiovisual stimuli associated with a stronger prior belief that they share a common cause (i.e., causal prior) are predicted to result in a greater degree of perceptual binding and therefore greater audiovisual integration. In the present psychophysical study, we systematically manipulated the causal prior while keeping sensory evidence constant. We paired auditory and visual stimuli during an association phase to be spatiotemporally either congruent or incongruent, with the goal of driving the causal prior in opposite directions for different audiovisual pairs. Following this association phase, every pairwise combination of the auditory and visual stimuli was tested in a typical ventriloquism-effect (VE) paradigm. The size of the VE (i.e., the shift of auditory localization towards the spatially discrepant visual stimulus) indicated the degree of multisensory integration. Results showed that exposure to an audiovisual pairing as spatiotemporally congruent compared to incongruent resulted in a larger subsequent VE (Experiment 1). This effect was further confirmed in a second VE paradigm, where the congruent and the incongruent visual stimuli flanked the auditory stimulus, and a VE in the direction of the congruent visual stimulus was shown (Experiment 2). Since the unisensory reliabilities for the auditory or visual components did not change after the association phase, the observed effects are likely due to changes in multisensory binding by association learning. As suggested by Bayesian theories of multisensory processing, our findings support the existence of crossmodal causal priors that are flexibly shaped by experience in a changing world.

| S-EPMC7536156 | biostudies-literature

Multisensory integration of redundant trisensory stimulation.

Project description:Integration of sensory information across modalities can confer behavioral advantages by decreasing perceptual ambiguity, increasing reaction time, and increasing detection accuracy relative to unisensory stimuli. We asked how combinations of auditory, visual, and somatosensory events alter response time. Participants detected stimulation on one side of space (right or left) while ignoring stimulation on the other side of space. There were seven types of suprathreshold stimuli: auditory (tones from speakers), visual (sinusoidal contrast gratings), somatosensory (fingertip vibrations), audio-visual, somato-visual, audio-somatosensory, and audio-somato-visual. Response enhancement and race model analysis confirmed that bisensory and trisensory trials enhanced response time relative to unisensory trials. Exploratory analysis of individual differences in intersensory facilitation revealed that participants fit into one of two groups: those who benefitted from trisensory information and those who did not.

| S-EPMC5564512 | biostudies-other

Multisensory integration for timing engages different brain networks.

Project description:How does the brain integrate information from different senses into a unitary percept? What factors influence such multisensory integration? Using a rhythmic behavioral paradigm and functional magnetic resonance imaging, we identified networks of brain regions for perceptions of physically synchronous and asynchronous auditory-visual events. Measures of behavioral performance revealed the existence of three distinct perceptual states. Perception of asynchrony activated a network of the primary sensory, prefrontal, and inferior parietal cortices, perception of synchrony disengaged the inferior parietal cortex and further recruited the superior colliculus, and when no clear percept was established, only the residual areas comprised of prefrontal and sensory areas were active. These results indicate that distinct percepts arise within specific brain sub-networks, the components of which are differentially engaged and disengaged depending on the timing of environmental signals.

| S-EPMC2214902 | biostudies-literature

Optimal multisensory integration leads to optimal time estimation.

Project description:Our brain compensates sensory uncertainty by combining multisensory information derived from an event, and by integrating the current sensory signal with the prior knowledge about the statistical structure of previous events. There is growing evidence that both strategies are statistically optimal; however, how these two stages of information integration interact and shape an optimal percept remains an open question. In the present study, we investigated the perception of time as an amodal perceptual attribute. The central tendency, a phenomenon of biasing the current percept toward previous stimuli, is used to quantify and model how the prior information affects the current timing behavior. We measured the timing sensitivity and the central tendency for unisensory and multisensory stimuli with sensory uncertainty systematically manipulated by adding noise. Psychophysical results demonstrate that the central tendency increases as the uncertainty increases, and that the multisensory timing improves both the timing sensitivity and the central tendency bias compared to the unisensory timing. Computational models indicate that the optimal multisensory integration precedes the optimal integration of prior information causing the central tendency. Our findings suggest that our brain incorporates the multisensory information and prior knowledge in a statistically optimal manner to realize precise and accurate timing behavior.

| S-EPMC6117357 | biostudies-literature

Multisensory integration in virtual interactions with distant objects.

Project description:Statistically optimal integration of multimodal signals is known to take place in direct interactions with environmental objects. In the present study we tested whether the same mechanism is responsible for perceptual biases observed in a task, in which participants enclose visual objects by manually controlled visual cursors. We manipulated the relative reliability of visual object information and measured the impact of body-related information on object perception as well as the perceptual variability. The results were qualitatively consistent with statistically optimal sensory integration. However, quantitatively, the observed bias and variability measures systematically differed from the model predictions. This outcome indicates a compensatory mechanism similar to the reliability-based weighting of multisensory signals which could underlie action's effects in visual perception reported in diverse context conditions.

| S-EPMC6874595 | biostudies-literature

A bio-inspired visuotactile neuron for multisensory integration.

Project description:Multisensory integration is a salient feature of the brain which enables better and faster responses in comparison to unisensory integration, especially when the unisensory cues are weak. Specialized neurons that receive convergent input from two or more sensory modalities are responsible for such multisensory integration. Solid-state devices that can emulate the response of these multisensory neurons can advance neuromorphic computing and bridge the gap between artificial and natural intelligence. Here, we introduce an artificial visuotactile neuron based on the integration of a photosensitive monolayer MoS2 memtransistor and a triboelectric tactile sensor which minutely captures the three essential features of multisensory integration, namely, super-additive response, inverse effectiveness effect, and temporal congruency. We have also realized a circuit which can encode visuotactile information into digital spiking events, with probability of spiking determined by the strength of the visual and tactile cues. We believe that our comprehensive demonstration of bio-inspired and multisensory visuotactile neuron and spike encoding circuitry will advance the field of neuromorphic computing, which has thus far primarily focused on unisensory intelligence and information processing.

| S-EPMC10504285 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data