Multisensory integration for timing engages different brain networks.
Ontology highlight
ABSTRACT:
SUBMITTER: Dhamala M
PROVIDER: S-EPMC2214902 | biostudies-literature | 2007 Jan
REPOSITORIES: biostudies-literature
Publications
Multisensory integration for timing engages different brain networks.
Dhamala Mukeshwar M Assisi Collins G CG Jirsa Viktor K VK Steinberg Fred L FL Kelso J A Scott JA
NeuroImage 20061113 2
How does the brain integrate information from different senses into a unitary percept? What factors influence such multisensory integration? Using a rhythmic behavioral paradigm and functional magnetic resonance imaging, we identified networks of brain regions for perceptions of physically synchronous and asynchronous auditory-visual events. Measures of behavioral performance revealed the existence of three distinct perceptual states. Perception of asynchrony activated a network of the primary s ...[more]
Similar Datasets
Project description:The underwater sensory world and the sensory systems of aquatic animals have become better understood in recent decades, but typically have been studied one sense at a time. A comprehensive analysis of multisensory interactions during complex behavioral tasks has remained a subject of discussion without experimental evidence. We set out to generate a general model of multisensory information extraction by aquatic animals. For our model we chose to analyze the hierarchical, integrative, and sometimes alternate use of various sensory systems during the feeding sequence in three species of sharks that differ in sensory anatomy and behavioral ecology. By blocking senses in different combinations, we show that when some of their normal sensory cues were unavailable, sharks were often still capable of successfully detecting, tracking and capturing prey by switching to alternate sensory modalities. While there were significant species differences, odor was generally the first signal detected, leading to upstream swimming and wake tracking. Closer to the prey, as more sensory cues became available, the preferred sensory modalities varied among species, with vision, hydrodynamic imaging, electroreception, and touch being important for orienting to, striking at, and capturing the prey. Experimental deprivation of senses showed how sharks exploit the many signals that comprise their sensory world, each sense coming into play as they provide more accurate information during the behavioral sequence of hunting. The results may be applicable to aquatic hunting in general and, with appropriate modification, to other types of animal behavior.
| S-EPMC3973673 | biostudies-other
Project description:Diverse cognitive processes set different demands on locally segregated and globally integrated brain activity. However, it remains an open question how resting brains configure their functional organization to balance the demands on network segregation and integration to best serve cognition. Here we use an eigenmode-based approach to identify hierarchical modules in functional brain networks and quantify the functional balance between network segregation and integration. In a large sample of healthy young adults (n = 991), we combine the whole-brain resting state functional magnetic resonance imaging (fMRI) data with a mean-filed model on the structural network derived from diffusion tensor imaging and demonstrate that resting brain networks are on average close to a balanced state. This state allows for a balanced time dwelling at segregated and integrated configurations and highly flexible switching between them. Furthermore, we employ structural equation modeling to estimate general and domain-specific cognitive phenotypes from nine tasks and demonstrate that network segregation, integration, and their balance in resting brains predict individual differences in diverse cognitive phenotypes. More specifically, stronger integration is associated with better general cognitive ability, stronger segregation fosters crystallized intelligence and processing speed, and an individual's tendency toward balance supports better memory. Our findings provide a comprehensive and deep understanding of the brain's functioning principles in supporting diverse functional demands and cognitive abilities and advance modern network neuroscience theories of human cognition.
| S-EPMC8201916 | biostudies-literature
Project description:An outstanding problem in neuroscience is to understand how information is integrated across the many modules of the brain. While classic information-theoretic measures have transformed our understanding of feedforward information processing in the brain's sensory periphery, comparable measures for information flow in the massively recurrent networks of the rest of the brain have been lacking. To address this, recent work in information theory has produced a sound measure of network-wide "integrated information", which can be estimated from time-series data. But, a computational hurdle has stymied attempts to measure large-scale information integration in real brains. Specifically, the measurement of integrated information involves a combinatorial search for the informational "weakest link" of a network, a process whose computation time explodes super-exponentially with network size. Here, we show that spectral clustering, applied on the correlation matrix of time-series data, provides an approximate but robust solution to the search for the informational weakest link of large networks. This reduces the computation time for integrated information in large systems from longer than the lifespan of the universe to just minutes. We evaluate this solution in brain-like systems of coupled oscillators as well as in high-density electrocortigraphy data from two macaque monkeys, and show that the informational "weakest link" of the monkey cortex splits posterior sensory areas from anterior association areas. Finally, we use our solution to provide evidence in support of the long-standing hypothesis that information integration is maximized by networks with a high global efficiency, and that modular network structures promote the segregation of information.
| S-EPMC6382174 | biostudies-literature
Project description:Human minds often wander away from their immediate sensory environment. It remains unknown whether such mind wandering is unsystematic or whether it lawfully relates to an individual's tendency to attend to salient stimuli such as pain and their associated brain structure/function. Studies of pain-cognition interactions typically examine explicit manipulation of attention rather than spontaneous mind wandering. Here we sought to better represent natural fluctuations in pain in daily life, so we assessed behavioral and neural aspects of spontaneous disengagement of attention from pain. We found that an individual's tendency to attend to pain related to the disruptive effect of pain on his or her cognitive task performance. Next, we linked behavioral findings to neural networks with strikingly convergent evidence from functional magnetic resonance imaging during pain coupled with thought probes of mind wandering, dynamic resting state activity fluctuations, and diffusion MRI. We found that (i) pain-induced default mode network (DMN) deactivations were attenuated during mind wandering away from pain; (ii) functional connectivity fluctuations between the DMN and periaqueductal gray (PAG) dynamically tracked spontaneous attention away from pain; and (iii) across individuals, stronger PAG-DMN structural connectivity and more dynamic resting state PAG-DMN functional connectivity were associated with the tendency to mind wander away from pain. These data demonstrate that individual tendencies to mind wander away from pain, in the absence of explicit manipulation, are subserved by functional and structural connectivity within and between default mode and antinociceptive descending modulation networks.
| S-EPMC3832014 | biostudies-literature
Project description:Speech provides a powerful means for sharing emotions. Here we implement novel intersubject phase synchronization and whole-brain dynamic connectivity measures to show that networks of brain areas become synchronized across participants who are listening to emotional episodes in spoken narratives. Twenty participants' hemodynamic brain activity was measured with functional magnetic resonance imaging (fMRI) while they listened to 45-s narratives describing unpleasant, neutral, and pleasant events spoken in neutral voice. After scanning, participants listened to the narratives again and rated continuously their feelings of pleasantness-unpleasantness (valence) and of arousal-calmness. Instantaneous intersubject phase synchronization (ISPS) measures were computed to derive both multi-subject voxel-wise similarity measures of hemodynamic activity and inter-area functional dynamic connectivity (seed-based phase synchronization, SBPS). Valence and arousal time series were subsequently used to predict the ISPS and SBPS time series. High arousal was associated with increased ISPS in the auditory cortices and in Broca's area, and negative valence was associated with enhanced ISPS in the thalamus, anterior cingulate, lateral prefrontal, and orbitofrontal cortices. Negative valence affected functional connectivity of fronto-parietal, limbic (insula, cingulum) and fronto-opercular circuitries, and positive arousal affected the connectivity of the striatum, amygdala, thalamus, cerebellum, and dorsal frontal cortex. Positive valence and negative arousal had markedly smaller effects. We propose that high arousal synchronizes the listeners' sound-processing and speech-comprehension networks, whereas negative valence synchronizes circuitries supporting emotional and self-referential processing.
| S-EPMC4229500 | biostudies-literature
Project description:Responses of neurons that integrate multiple sensory inputs are traditionally characterized in terms of a set of empirical principles. However, a simple computational framework that accounts for these empirical features of multisensory integration has not been established. We propose that divisive normalization, acting at the stage of multisensory integration, can account for many of the empirical principles of multisensory integration shown by single neurons, such as the principle of inverse effectiveness and the spatial principle. This model, which uses a simple functional operation (normalization) for which there is considerable experimental support, also accounts for the recent observation that the mathematical rule by which multisensory neurons combine their inputs changes with cue reliability. The normalization model, which makes a strong testable prediction regarding cross-modal suppression, may therefore provide a simple unifying computational account of the important features of multisensory integration by neurons.
| S-EPMC3102778 | biostudies-literature
Project description:The basal ganglia are involved in sensorimotor functions and action selection, both of which require the integration of sensory information. In order to determine how such sensory inputs are integrated, we obtained whole-cell recordings in mouse dorsal striatum during presentation of tactile and visual stimuli. All recorded neurons responded to bilateral whisker stimulation, and a subpopulation also responded to visual stimulation. Neurons responding to both visual and tactile stimuli were located in dorsomedial striatum, whereas those responding only to whisker deflections were located dorsolaterally. Responses were mediated by overlapping excitation and inhibition, with excitation onset preceding that of inhibition by several milliseconds. Responses differed according to the type of neuron, with direct pathway MSNs having larger responses and longer latencies between ipsilateral and contralateral responses than indirect pathway MSNs. Our results suggest that striatum acts as a sensory "hub" with specialized functional roles for the different neuron types.
| S-EPMC4157575 | biostudies-literature
Project description:The brain is able to gather different sensory information to enhance salient event perception, thus yielding a unified perceptual experience of multisensory events. Multisensory integration has been widely studied, and the literature supports the hypothesis that it can occur across various stages of stimulus processing, including both bottom-up and top-down control. However, evidence on anticipatory multisensory integration occurring in the fore period preceding the presentation of the expected stimulus in passive tasks, is missing. By means of event-related potentials (ERPs), it has been recently proposed that visual and auditory unimodal stimulations are preceded by sensory-specific readiness activities. Accordingly, in the present study, we tested the occurrence of multisensory integration in the endogenous anticipatory phase of sensory processing, combining visual and auditory stimuli during unimodal and multimodal passive ERP paradigms. Results showed that the modality-specific pre-stimulus ERP components (i.e., the auditory positivity -aP- and the visual negativity -vN-) started earlier and were larger in the multimodal stimulation compared with the sum of the ERPs elicited by the unimodal stimulations. The same amplitude effect was also present for the early auditory N1 and visual P1 components. This anticipatory multisensory effect seems to influence stimulus processing, boosting the magnitude of early stimulus processing. This paves the way for new perspectives on the neural basis of multisensory integration.
| S-EPMC8301880 | biostudies-literature
Project description:According to the Bayesian framework of multisensory integration, audiovisual stimuli associated with a stronger prior belief that they share a common cause (i.e., causal prior) are predicted to result in a greater degree of perceptual binding and therefore greater audiovisual integration. In the present psychophysical study, we systematically manipulated the causal prior while keeping sensory evidence constant. We paired auditory and visual stimuli during an association phase to be spatiotemporally either congruent or incongruent, with the goal of driving the causal prior in opposite directions for different audiovisual pairs. Following this association phase, every pairwise combination of the auditory and visual stimuli was tested in a typical ventriloquism-effect (VE) paradigm. The size of the VE (i.e., the shift of auditory localization towards the spatially discrepant visual stimulus) indicated the degree of multisensory integration. Results showed that exposure to an audiovisual pairing as spatiotemporally congruent compared to incongruent resulted in a larger subsequent VE (Experiment 1). This effect was further confirmed in a second VE paradigm, where the congruent and the incongruent visual stimuli flanked the auditory stimulus, and a VE in the direction of the congruent visual stimulus was shown (Experiment 2). Since the unisensory reliabilities for the auditory or visual components did not change after the association phase, the observed effects are likely due to changes in multisensory binding by association learning. As suggested by Bayesian theories of multisensory processing, our findings support the existence of crossmodal causal priors that are flexibly shaped by experience in a changing world.
| S-EPMC7536156 | biostudies-literature
Project description:Integration of sensory information across modalities can confer behavioral advantages by decreasing perceptual ambiguity, increasing reaction time, and increasing detection accuracy relative to unisensory stimuli. We asked how combinations of auditory, visual, and somatosensory events alter response time. Participants detected stimulation on one side of space (right or left) while ignoring stimulation on the other side of space. There were seven types of suprathreshold stimuli: auditory (tones from speakers), visual (sinusoidal contrast gratings), somatosensory (fingertip vibrations), audio-visual, somato-visual, audio-somatosensory, and audio-somato-visual. Response enhancement and race model analysis confirmed that bisensory and trisensory trials enhanced response time relative to unisensory trials. Exploratory analysis of individual differences in intersensory facilitation revealed that participants fit into one of two groups: those who benefitted from trisensory information and those who did not.
| S-EPMC5564512 | biostudies-other