Representations of naturalistic stimulus complexity in early and associative visual and auditory cortices.
Ontology highlight
ABSTRACT:
SUBMITTER: Gucluturk Y
PROVIDER: S-EPMC5821852 | biostudies-other | 2018 Feb
REPOSITORIES: biostudies-other
Publications
Representations of naturalistic stimulus complexity in early and associative visual and auditory cortices.
Güçlütürk Yağmur Y Güçlü Umut U van Gerven Marcel M van Lier Rob R
Scientific reports 20180221 1
The complexity of sensory stimuli has an important role in perception and cognition. However, its neural representation is not well understood. Here, we characterize the representations of naturalistic visual and auditory stimulus complexity in early and associative visual and auditory cortices. This is realized by means of encoding and decoding analyses of two fMRI datasets in the visual and auditory modalities. Our results implicate most early and some associative sensory areas in representing ...[more]
Similar Datasets
Project description:In associative learning (AL), cues and/or outcome events are coupled together. AL is typically tested in visual learning paradigms. Recently, our group developed various AL tests based on the Rutgers Acquired Equivalence Test (RAET), both visual and audiovisual, keeping the structure and logic of RAET but with different stimuli. In this study, 55 volunteers were tested in two of our audiovisual tests, SoundFace (SF) and SoundPolygon (SP). The antecedent stimuli in both tests are sounds, and the consequent stimuli are images. The consequents in SF are cartoon faces, while in SP, they are simple geometric shapes. The aim was to test how the complexity of the applied consequent stimuli influences performance regarding the various aspects of learning the tests assess (stimulus pair learning, retrieval, and generalization of the previously learned associations to new but predictable stimulus pairs). In SP, behavioral performance was significantly poorer than in SF, and the reaction times were significantly longer, for all phases of the test. The results suggest that audiovisual associative learning is significantly influenced by the complexity of the consequent stimuli.
| S-EPMC9587981 | biostudies-literature
Project description:Vision often requires attending to, and integrating information from, distant parts of the visual field. However, the neural basis for such long-range integration is not clearly understood. Here, we demonstrate a specific neural signature of attentional integration between stimuli in different parts of the visual field. Using functional MRI, we found that a task requiring the integration of information between two attended but spatially separated stimuli actively modulated the degree of functional integration (in terms of effective connectivity) between their retinotopic representations in visual cortical areas V1, V2, and V4. Spatial attention enhanced long-distance coupling between distinct neuronal populations that represented the attended visual stimuli, even at the earliest stages of cortical processing. In contrast, unattended stimulus representations were decoupled both from attended representations and particularly strongly from each other. Furthermore, enhanced functional integration between cortical representations was associated with enhanced behavioral performance. Attention may thus serve to "bind" together cortical loci at multiple levels of the visual hierarchy that are commonly involved in processing attended stimuli, promoting integration between otherwise functionally isolated cortical loci.
| S-EPMC1253541 | biostudies-literature
Project description:While a delicious dessert being presented to us may elicit strong feelings of happiness and excitement, the same treat falling slowly away can lead to sadness and disappointment. Our emotional response to the item depends on its visual motion direction. Despite this importance, it remains unclear whether (and how) cortical areas devoted to decoding motion direction represents or integrates emotion with perceived motion direction. Motion-selective visual area V5/MT+ sits, both functionally and anatomically, at the nexus of dorsal and ventral visual streams. These pathways, however, differ in how they are modulated by emotional cues. The current study was designed to disentangle how emotion and motion perception interact, as well as use emotion-dependent modulation of visual cortices to understand the relation of V5/MT+ to canonical processing streams. During functional magnetic resonance imaging (fMRI), approaching, receding, or static motion after-effects (MAEs) were induced on stationary positive, negative, and neutral stimuli. An independent localizer scan was conducted to identify the visual-motion area V5/MT+. Through univariate and multivariate analyses, we demonstrated that emotion representations in V5/MT+ share a more similar response profile to that observed in ventral visual than dorsal, visual structures. Specifically, V5/MT+ and ventral structures were sensitive to the emotional content of visual stimuli, whereas dorsal visual structures were not. Overall, this work highlights the critical role of V5/MT+ in the representation and processing of visually acquired emotional content. It further suggests a role for this region in utilizing affectively salient visual information to augment motion perception of biologically relevant stimuli.
| S-EPMC10545642 | biostudies-literature
Project description:When the brain tries to acquire an elaborate model of the world, multisensory integration should contribute to building predictions based on the various pieces of information, and deviance detection should repeatedly update these predictions by detecting "errors" from the actual sensory inputs. Accumulating evidence such as a hierarchical organization of the deviance-detection system indicates that the deviance-detection system can be interpreted in the predictive coding framework. Herein, we targeted mismatch negativity (MMN) as a type of prediction-error signal and investigated the relationship between multisensory integration and MMN. In particular, we studied whether and how cross-modal information processing affected MMN in rodents. We designed a new surface microelectrode array and simultaneously recorded visual and auditory evoked potentials from the visual and auditory cortices of rats under anesthesia. Then, we mapped MMNs for five types of deviant stimuli: single-modal deviants in (i) the visual oddball and (ii) auditory oddball paradigms, eliciting single-modal MMN; (iii) congruent audio-visual deviants, (iv) incongruent visual deviants, and (v) incongruent auditory deviants in the audio-visual oddball paradigm, eliciting cross-modal MMN. First, we demonstrated that visual MMN exhibited deviance detection properties and that the first-generation focus of visual MMN was localized in the visual cortex, as previously reported in human studies. Second, a comparison of MMN amplitudes revealed a non-linear relationship between single-modal and cross-modal MMNs. Moreover, congruent audio-visual MMN exhibited characteristics of both visual and auditory MMNs-its latency was similar to that of auditory MMN, whereas local blockage of N-methyl-D-aspartic acid receptors in the visual cortex diminished it as well as visual MMN. These results indicate that cross-modal information processing affects MMN without involving strong top-down effects, such as those of prior knowledge and attention. The present study is the first electrophysiological evidence of cross-modal MMN in animal models, and future studies on the neural mechanisms combining multisensory integration and deviance detection are expected to provide electrophysiological evidence to confirm the links between MMN and predictive coding theory.
| S-EPMC8484534 | biostudies-literature
Project description:The brain's capacity to process unexpected events is key to cognitive flexibility. The most well-known effect of unexpected events is the interruption of attentional engagement (distraction). We tested whether unexpected events interrupt attentional representations by activating a neural mechanism for inhibitory control. This mechanism is most well characterized within the motor system. However, recent work showed that it is automatically activated by unexpected events and can explain some of their nonmotor effects (e.g., on working memory representations). Here, human participants attended to lateralized flickering visual stimuli, producing steady-state visual evoked potentials (SSVEPs) in the scalp electroencephalogram. After unexpected sounds, the SSVEP was rapidly suppressed. Using a functional localizer (stop-signal) task and independent component analysis, we then identified a fronto-central EEG source whose activity indexes inhibitory motor control. Unexpected sounds in the SSVEP task also activated this source. Using single-trial analyses, we found that subcomponents of this source differentially relate to sound-induced SSVEP changes: While its N2 component predicted the subsequent suppression of the attended-stimulus SSVEP, the P3 component predicted the suppression of the SSVEP to the unattended stimulus. These results shed new light on the processes underlying fronto-central control signals and have implications for phenomena such as distraction and the attentional blink.
| S-EPMC7869093 | biostudies-literature
Project description:The present study investigated the function of the brain activity underlying the visual mismatch negativity (vMMN) event-related potential (ERP) component. Snowflake patterns (complex stimuli) were presented as deviants and oblique bar patterns (simple stimuli) as standards, and vice versa in a passive oddball paradigm. Control (equiprobable) sequences of either complex shape patterns or oblique bar patterns with various orientations were also presented. VMMN appeared as the difference between the ERP to the oddball deviant and the ERP to the control (deviant minus control ERP difference). Apart from the shorter latency of the vMMN to the oblique bar pattern as deviant, vMMN to both deviants was similar, i.e., there was no amplitude difference. We attributed the function of the brain processes underlying vMMN to the detection of the infrequent stimulus type (also represented in memory) instead of a call for further processing (a possibility for acquiring more precise representation) of the deviant. An unexpected larger adaptation (control minus standard ERP difference) to the snowflake pattern was also obtained. We suggest that this was due to the acquisition of a more elaborate memory representation of the more complex stimulus.
| S-EPMC6557884 | biostudies-literature
Project description:The potential for neuronal representations of external stimuli to be modified by previous experience is critical for efficient sensory processing and improved behavioral outcomes. To investigate how repeated exposure to a visual stimulus affects its representation in mouse primary visual cortex (V1), we performed two-photon calcium imaging of layer 2/3 neurons and assessed responses before, during, and after the presentation of a repetitive stimulus over 5 consecutive days. We found a stimulus-specific enhancement of the neuronal representation of the repetitively presented stimulus when it was associated with a reward. This was observed both after mice actively learned a rewarded task and when the reward was randomly received. Stimulus-specific enhanced representation resulted both from neurons gaining selectivity and from increased response reliability in previously selective neurons. In the absence of reward, there was either no change in stimulus representation or a decreased representation when the stimulus was viewed at a fixed temporal frequency. Pairing a second stimulus with a reward led to a similar enhanced representation and increased discriminability between the equally rewarded stimuli. Single-neuron responses showed that separate subpopulations discriminated between the two rewarded stimuli depending on whether the stimuli were displayed in a virtual environment or viewed on a single screen. We suggest that reward-associated responses enable the generalization of enhanced stimulus representation across these V1 subpopulations. We propose that this dynamic regulation of visual processing based on the behavioral relevance of sensory input ultimately enhances and stabilizes the representation of task-relevant features while suppressing responses to non-relevant stimuli.
| S-EPMC7237886 | biostudies-literature
Project description:Since the dawn of experimental psychology, researchers have sought an understanding of the fundamental relationship between the amplitude of sensory stimuli and the magnitudes of their perceptual representations. Contemporary theories support the view that magnitude is encoded by a linear increase in firing rate established in the primary afferent pathways. In the present study, we have investigated sound intensity coding in the rat primary auditory cortex (AI) and describe its plasticity by following paired stimulus reinforcement and instrumental conditioning paradigms. In trained animals, population-response strengths in AI became more strongly nonlinear with increasing stimulus intensity. Individual AI responses became selective to more restricted ranges of sound intensities and, as a population, represented a broader range of preferred sound levels. These experiments demonstrate that the representation of stimulus magnitude can be powerfully reshaped by associative learning processes and suggest that the code for sound intensity within AI can be derived from intensity-tuned neurons that change, rather than simply increase, their firing rates in proportion to increases in sound intensity.
| S-EPMC528983 | biostudies-literature
Project description:The intricate relationship between multisensory integration and attention has been extensively researched in the multisensory field; however, the necessity of attention for the binding of multisensory stimuli remains contested. In the current study, we investigated whether diverting attention from well-known multisensory tasks would disrupt integration and whether the complexity of the stimulus and task modulated this interaction. A secondary objective of this study was to investigate individual differences in the interaction of attention and multisensory integration. Participants completed a simple audiovisual speeded detection task and McGurk task under various perceptual load conditions: no load (multisensory task while visual distractors present), low load (multisensory task while detecting the presence of a yellow letter in the visual distractors), and high load (multisensory task while detecting the presence of a number in the visual distractors). Consistent with prior studies, we found that increased perceptual load led to decreased reports of the McGurk illusion, thus confirming the necessity of attention for the integration of speech stimuli. Although increased perceptual load led to longer response times for all stimuli in the speeded detection task, participants responded faster on multisensory trials than unisensory trials. However, the increase in multisensory response times violated the race model for no and low perceptual load conditions only. Additionally, a geometric measure of Miller's inequality showed a decrease in multisensory integration for the speeded detection task with increasing perceptual load. Surprisingly, we found diverging changes in multisensory integration with increasing load for participants who did not show integration for the no load condition: no changes in integration for the McGurk task with increasing load but increases in integration for the detection task. The results of this study indicate that attention plays a crucial role in multisensory integration for both highly complex and simple multisensory tasks and that attention may interact differently with multisensory processing in individuals who do not strongly integrate multisensory information.
| S-EPMC5247431 | biostudies-literature
Project description:Spike count correlations (SCCs) are ubiquitous in sensory cortices, are characterized by rich structure, and arise from structured internal dynamics. However, most theories of visual perception treat contributions of neurons to the representation of stimuli independently and focus on mean responses. Here, we argue that, in a functional model of visual perception, featuring probabilistic inference over a hierarchy of features, inferences about high-level features modulate inferences about low-level features ultimately introducing structured internal dynamics and patterns in SCCs. Specifically, high-level inferences for complex stimuli establish the local context in which neurons in the primary visual cortex (V1) interpret stimuli. Since the local context differentially affects multiple neurons, this conjecture predicts specific modulations in the fine structure of SCCs as stimulus identity and, more importantly, stimulus complexity varies. We designed experiments with natural and synthetic stimuli to measure the fine structure of SCCs in V1 of awake behaving macaques and assessed their dependence on stimulus identity and stimulus statistics. We show that the fine structure of SCCs is specific to the identity of natural stimuli and changes in SCCs are independent of changes in response mean. Critically, we demonstrate that stimulus specificity of SCCs in V1 can be directly manipulated by altering the amount of high-order structure in synthetic stimuli. Finally, we show that simple phenomenological models of V1 activity cannot account for the observed SCC patterns and conclude that the stimulus dependence of SCCs is a natural consequence of structured internal dynamics in a hierarchical probabilistic model of natural images.
| S-EPMC6377442 | biostudies-literature