Interactions between auditory statistics processing and visual experience emerge only in late development
Ontology highlight
ABSTRACT:
SUBMITTER: Berto M
PROVIDER: S-EPMC8593607 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Visual perception is strongly influenced by contextual information. A good example is reference repulsion, where subjective reports about the direction of motion of a stimulus are significantly biased by the presence of an explicit reference. These perceptual biases could arise early, during sensory encoding, or alternatively, they may reflect decision-related processes occurring relatively late in the task sequence. To separate these two competing possibilities, we asked (human) subjects to perform a fine motion-discrimination task and then estimate the direction of motion in the presence or absence of an oriented reference line. When subjects performed the discrimination task with the reference, but subsequently estimated motion direction in its absence, direction estimates were unbiased. However, when subjects viewed the same stimuli but performed the estimation task only, with the orientation of the reference line jittered on every trial, the directions estimated by subjects were biased and yoked to the orientation of the shifted reference line. These results show that judgements made relative to a reference are subject to late, decision-related biases A model in which information about motion is integrated with that of an explicit reference cue, resulting in a late, decision-related re-weighting of the sensory representation, can account for these results.
| S-EPMC4936027 | biostudies-literature
Project description:Cross-modal correspondences refer to associations between apparently unrelated stimulus features in different senses. For example, high and low auditory pitches are associated with high and low visual elevations, respectively. Here we examined how this crossmodal correspondence between visual elevation and auditory pitch relates to auditory elevation. We used audiovisual combinations of high- or low-frequency bursts of white noise and a visual stimulus comprising a white circle. Auditory and visual stimuli could each occur at high or low elevations. These multisensory stimuli could be congruent or incongruent for three correspondence types: cross-modal featural (auditory pitch/visual elevation), within-modal featural (auditory pitch/auditory elevation) and cross-modal spatial (auditory and visual elevation). Participants performed a 2AFC speeded classification (high or low) task while attending to auditory pitch, auditory elevation, or visual elevation. We tested for modulatory interactions between the three correspondence types. Modulatory interactions were absent when discriminating visual elevation. However, the within-modal featural correspondence affected the cross-modal featural correspondence during discrimination of auditory elevation and pitch, while the reverse modulation was observed only during discrimination of auditory pitch. The cross-modal spatial correspondence modulated the other two correspondences only when auditory elevation was being attended, was modulated by the cross-modal featural correspondence only during attention to auditory pitch, and was modulated by the within-modal featural correspondence while performing discrimination of either auditory elevation or pitch. We conclude that the cross-modal correspondence between auditory pitch and visual elevation interacts strongly with auditory elevation.
| S-EPMC7877490 | biostudies-literature
Project description:We investigate how the neural processing in auditory cortex is shaped by the statistics of natural sounds. Hypothesising that auditory cortex (A1) represents the structural primitives out of which sounds are composed, we employ a statistical model to extract such components. The input to the model are cochleagrams which approximate the non-linear transformations a sound undergoes from the outer ear, through the cochlea to the auditory nerve. Cochleagram components do not superimpose linearly, but rather according to a rule which can be approximated using the max function. This is a consequence of the compression inherent in the cochleagram and the sparsity of natural sounds. Furthermore, cochleagrams do not have negative values. Cochleagrams are therefore not matched well by the assumptions of standard linear approaches such as sparse coding or ICA. We therefore consider a new encoding approach for natural sounds, which combines a model of early auditory processing with maximal causes analysis (MCA), a sparse coding model which captures both the non-linear combination rule and non-negativity of the data. An efficient truncated EM algorithm is used to fit the MCA model to cochleagram data. We characterize the generative fields (GFs) inferred by MCA with respect to in vivo neural responses in A1 by applying reverse correlation to estimate spectro-temporal receptive fields (STRFs) implied by the learned GFs. Despite the GFs being non-negative, the STRF estimates are found to contain both positive and negative subfields, where the negative subfields can be attributed to explaining away effects as captured by the applied inference method. A direct comparison with ferret A1 shows many similar forms, and the spectral and temporal modulation tuning of both ferret and model STRFs show similar ranges over the population. In summary, our model represents an alternative to linear approaches for biological auditory encoding while it captures salient data properties and links inhibitory subfields to explaining away effects.
| S-EPMC6382252 | biostudies-literature
Project description:Current theories suggest that disrupting cortical information integration may account for the mechanism of general anesthesia in suppressing consciousness. Human cognitive operations take place in hierarchically structured neural organizations in the brain. The process of low-order neural representation of sensory stimuli becoming integrated in high-order cortices is also known as cognitive binding. Combining neuroimaging, cognitive neuroscience, and anesthetic manipulation, we examined how cognitive networks involved in auditory verbal memory are maintained in wakefulness, disrupted in propofol-induced deep sedation, and re-established in recovery. Inspired by the notion of cognitive binding, an functional magnetic resonance imaging-guided connectivity analysis was utilized to assess the integrity of functional interactions within and between different levels of the task-defined brain regions. Task-related responses persisted in the primary auditory cortex (PAC), but vanished in the inferior frontal gyrus (IFG) and premotor areas in deep sedation. For connectivity analysis, seed regions representing sensory and high-order processing of the memory task were identified in the PAC and IFG. Propofol disrupted connections from the PAC seed to the frontal regions and thalamus, but not the connections from the IFG seed to a set of widely distributed brain regions in the temporal, frontal, and parietal lobes (with exception of the PAC). These later regions have been implicated in mediating verbal comprehension and memory. These results suggest that propofol disrupts cognition by blocking the projection of sensory information to high-order processing networks and thus preventing information integration. Such findings contribute to our understanding of anesthetic mechanisms as related to information and integration in the brain.
| S-EPMC3244539 | biostudies-literature
Project description:Bayesian models propose that multisensory integration depends on both sensory evidence (the likelihood) and priors indicating whether or not two inputs belong to the same event. The present study manipulated the prior for dynamic auditory and visual stimuli to co-occur and tested the predicted enhancement of multisensory binding as assessed with a simultaneity judgment task. In an initial learning phase participants were exposed to a subset of auditory-visual combinations. In the test phase the previously encountered audio-visual stimuli were presented together with new combinations of the auditory and visual stimuli from the learning phase, audio-visual stimuli containing one learned and one new sensory component, and audio-visual stimuli containing completely new auditory and visual material. Auditory-visual asynchrony was manipulated. A higher proportion of simultaneity judgements was observed for the learned cross-modal combinations than for new combinations of the same auditory and visual elements, as well as for all other conditions. This result suggests that prior exposure to certain auditory-visual combinations changed the expectation (i.e., the prior) that their elements belonged to the same event. As a result, multisensory binding became more likely despite unchanged sensory evidence of the auditory and visual elements.
| S-EPMC5431144 | biostudies-literature
Project description:Crossmodal plasticity refers to the reorganization of sensory cortices in the absence of their typical main sensory input. Understanding this phenomenon provides insights into brain function and its potential for change and enhancement. Using functional MRI, we investigated how early deafness influences crossmodal plasticity and the organization of executive functions in the adult human brain. Deaf (n = 25; age: mean = 41.68, range = 19-66, SD = 14.38; 16 female, 9 male) and hearing (n = 20; age: mean = 37.50, range = 18-66, SD = 16.85; 15 female, 5 male) participants performed four visual tasks tapping into different components of executive processing: task switching, working memory, planning and inhibition. Our results show that deaf individuals specifically recruit 'auditory' regions during task switching. Neural activity in superior temporal regions, most significantly in the right hemisphere, are good predictors of behavioural performance during task switching in the group of deaf individuals, highlighting the functional relevance of the observed cortical reorganization. Our results show executive processing in typically sensory regions, suggesting that the development and ultimate role of brain regions are influenced by perceptual environmental experience.
| S-EPMC9586534 | biostudies-literature
Project description:Sensory systems influence one another during development and deprivation can lead to cross-modal plasticity. As auditory function begins before vision, we investigate the effect of manipulating visual experience during auditory cortex critical periods (CPs) by assessing the influence of early, normal and delayed eyelid opening on hearing loss-induced changes to membrane and inhibitory synaptic properties. Early eyelid opening closes the auditory cortex CPs precociously and dark rearing prevents this effect. In contrast, delayed eyelid opening extends the auditory cortex CPs by several additional days. The CP for recovery from hearing loss is also closed prematurely by early eyelid opening and extended by delayed eyelid opening. Furthermore, when coupled with transient hearing loss that animals normally fully recover from, very early visual experience leads to inhibitory deficits that persist into adulthood. Finally, we demonstrate a functional projection from the visual to auditory cortex that could mediate these effects.
| S-EPMC4736048 | biostudies-other
Project description:It is widely accepted that vision plays a key role in the development of spatial skills of the other senses. Recent works have shown that blindness is often associated with auditory spatial deficits. The majority of previous studies have focused on understanding the representation of the upper frontal body space where vision and actions have a central role in mapping the space, however less research has investigated the back space and the space around the legs. Here we investigate space perception around the legs and the role of previous visual experience, by studying sighted and blind participants in an audio localization task (front-back discrimination). Participants judged if a sound was delivered in their frontal or back space. The results showed that blindfolded sighted participants were more accurate than blind participants in the frontal space. However, both groups were similarly accurate when auditory information was delivered in the back space. Blind individuals performed the task with similar accuracy for sounds delivered in the frontal and back space, while sighted people performed better in the frontal space. These results suggest that visual experience influences auditory spatial representations around the legs. Moreover, these results suggest that hearing and vision play different roles in different spaces.
| S-EPMC6662833 | biostudies-literature
Project description:Sensory signals are transduced at high resolution, but their structure must be stored in a more compact format. Here we provide evidence that the auditory system summarizes the temporal details of sounds using time-averaged statistics. We measured discrimination of 'sound textures' that were characterized by particular statistical properties, as normally result from the superposition of many acoustic features in auditory scenes. When listeners discriminated examples of different textures, performance improved with excerpt duration. In contrast, when listeners discriminated different examples of the same texture, performance declined with duration, a paradoxical result given that the information available for discrimination grows with duration. These results indicate that once these sounds are of moderate length, the brain's representation is limited to time-averaged statistics, which, for different examples of the same texture, converge to the same values with increasing duration. Such statistical representations produce good categorical discrimination, but limit the ability to discern temporal detail.
| S-EPMC4143328 | biostudies-literature
Project description:Stress can fundamentally alter neural responses to incoming information. Recent research suggests that stress and anxiety shift the balance of attention away from a task-directed mode, governed by prefrontal cortex, to a sensory-vigilance mode, governed by the amygdala and other threat-sensitive regions. A key untested prediction of this framework is that stress exerts dissociable effects on different stages of information processing. This study exploited the temporal resolution afforded by event-related potentials to disentangle the impact of stress on vigilance, indexed by early perceptual activity, from its impact on task-directed cognition, indexed by later postperceptual activity in humans. Results indicated that threat of shock amplified stress, measured using retrospective ratings and concurrent facial electromyography. Stress also double-dissociated early sensory-specific processing from later task-directed processing of emotionally neutral stimuli: stress amplified N1 (184-236 ms) and attenuated P3 (316-488 ms) activity. This demonstrates that stress can have strikingly different consequences at different processing stages. Consistent with recent suggestions, stress amplified earlier extrastriate activity in a manner consistent with vigilance for threat (N1), but disrupted later activity associated with the evaluation of task-relevant information (P3). These results provide a novel basis for understanding how stress can modulate information processing in everyday life and stress-sensitive disorders.
| S-EPMC3037336 | biostudies-literature