Electrophysiological evidence of different neural processing between visual and audiovisual inhibition of return.
Ontology highlight
ABSTRACT:
SUBMITTER: Tang X
PROVIDER: S-EPMC8044137 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Incongruent audiovisual speech stimuli can lead to perceptual illusions such as fusions or combinations. Here, we investigated the underlying audiovisual integration process by measuring ERPs. We observed that visual speech-induced suppression of P2 amplitude (which is generally taken as a measure of audiovisual integration) for fusions was similar to suppression obtained with fully congruent stimuli, whereas P2 suppression for combinations was larger. We argue that these effects arise because the phonetic incongruency is solved differently for both types of stimuli.
| S-EPMC5725699 | biostudies-literature
Project description:Selective attention-related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both electroencephalography (EEG) (high temporal resolution) and functional magnetic resonance imaging (fMRI) (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilise the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention-related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention-related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.
| S-EPMC10957087 | biostudies-literature
Project description:This article investigates the cross-modal correspondences between musical timbre and shapes. Previously, such features as pitch, loudness, light intensity, visual size, and color characteristics have mostly been used in studies of audio-visual correspondences. Moreover, in most studies, simple stimuli e.g., simple tones have been utilized. In this experiment, 23 musical sounds varying in fundamental frequency and timbre but fixed in loudness were used. Each sound was presented once against colored shapes and once against grayscale shapes. Subjects had to select the visual equivalent of a given sound i.e., its shape, color (or grayscale) and vertical position. This scenario permitted studying the associations between normalized timbre and visual shapes as well as some of the previous findings for more complex stimuli. One hundred and nineteen subjects (31 females and 88 males) participated in the online experiment. Subjects included 36 claimed professional musicians, 47 claimed amateur musicians, and 36 claimed non-musicians. Thirty-one subjects have also claimed to have synesthesia-like experiences. A strong association between timbre of envelope normalized sounds and visual shapes was observed. Subjects have strongly associated soft timbres with blue, green or light gray rounded shapes, harsh timbres with red, yellow or dark gray sharp angular shapes and timbres having elements of softness and harshness together with a mixture of the two previous shapes. Color or grayscale had no effect on timbre-shape associations. Fundamental frequency was not associated with height, grayscale or color. The significant correspondence between timbre and shape revealed by the present work allows designing substitution systems which might help the blind to perceive shapes through timbre.
| S-EPMC4038957 | biostudies-literature
Project description:BackgroundMaladaptive reactivity to sensory inputs is commonly observed in neurodevelopmental disorders (e.g., autism, ADHD). Little is known, however, about the underlying neural mechanisms. For some children, atypical sensory reactivity is the primary complaint, despite absence of another identifiable neurodevelopmental diagnosis. Studying Sensory Processing Disorder (SPD) may well provide a window into the neuropathology of these symptoms. It has been proposed that a deficit in sensory integration underlies the SPD phenotype, but objective quantification of sensory integration is lacking. Here we used neural and behavioral measures of multisensory integration (MSI), which would be affected by impaired sensory integration and for which there are well accepted objective measures, to test whether failure to integrate across the senses is associated with atypical sensory reactivity in SPD. An autism group served to determine if observed differences were unique to SPD.MethodsWe tested whether children aged 6-16 years with SPD (N = 14) integrate multisensory inputs differently from age-matched typically developing controls (TD: N = 54), or from children with an autism spectrum disorder (ASD: N = 44). Participants performed a simple reaction-time task to the occurrence of auditory, visual, and audiovisual stimuli presented in random order, while high-density recordings of electrical brain activity were made.ResultsChildren with SPD showed large reductions in the extent to which they benefited from multisensory inputs compared to TDs. The ASD group showed similarly reduced response speeding to multisensory relative to unisensory inputs. Neural evidence for MSI was seen across all three groups, with the multisensory response differing from the sum of the unisensory responses. Post hoc tests suggested the possibility of enhanced MSI in SPD in timeframes consistent with cortical sensory registration (∼60 ms), followed by reduced MSI during a timeframe consistent with object formation (∼130 ms). The ASD group also showed reduced MSI in the later timeframe.ConclusionChildren with SPD showed reduction in their ability to benefit from redundant audio-visual inputs, similar to children with ASD. Neurophysiological recordings, on the other hand, showed that major indices of MSI were largely intact, although post hoc testing pointed to periods of potential differential processing. While these exploratory electrophysiological observations point to potential sensory-perceptual differences in multisensory processing in SPD, it remains equally plausible at this stage that later attentional processing differences may yet prove responsible for the multisensory behavioral deficits uncovered here.
| S-EPMC7026671 | biostudies-literature
Project description:Numerous studies have reported both cortical and functional changes for visual, tactile, and auditory brain areas in musicians, which have been attributed to long-term training induced neuroplasticity. Previous investigations have reported advantages for musicians in multisensory processing at the behavioural level, however, multisensory integration with tasks requiring higher level cognitive processing has not yet been extensively studied. Here, we investigated the association between musical expertise and the processing of audiovisual crossmodal correspondences in a decision reaction-time task. The visual display varied in three dimensions (elevation, symbolic and non-symbolic magnitude), while the auditory stimulus varied in pitch. Congruency was based on a set of newly learned abstract rules: "The higher the spatial elevation, the higher the tone", "the more dots presented, the higher the tone", and "the higher the number presented, the higher the tone", and accuracy and reaction times were recorded. Musicians were significantly more accurate in their responses than non-musicians, suggesting an association between long-term musical training and audiovisual integration. Contrary to what was hypothesized, no differences in reaction times were found. The musicians' advantage on accuracy was also observed for rule-based congruency in seemingly unrelated stimuli (pitch-magnitude). These results suggest an interaction between implicit and explicit processing-as reflected on reaction times and accuracy, respectively. This advantage was generalised on congruency in otherwise unrelated stimuli (pitch-magnitude pairs), suggesting an advantage on processes requiring higher order cognitive functions. The results support the notion that accuracy and latency measures may reflect different processes.
| S-EPMC10079049 | biostudies-literature
Project description:BackgroundFunctional near-infrared spectroscopy (fNIRS) studies have demonstrated associations between hearing outcomes after cochlear implantation and plastic brain changes. However, inconsistent results make it difficult to draw conclusions. A major problem is that many variables need to be controlled. To gain further understanding, a careful preparation and planning of such a functional neuroimaging task is key.ObjectiveUsing fNIRS, our main objective is to develop a well-controlled audiovisual speech comprehension task to study brain activation in individuals with normal hearing and hearing impairment (including cochlear implant users). The task should be deductible from clinically established tests, induce maximal cortical activation, use optimal coverage of relevant brain regions, and be reproducible by other research groups.MethodsThe protocol will consist of a 5-minute resting state and 2 stimulation periods that are 12 minutes each. During the stimulation periods, 13-second video recordings of the clinically established Oldenburg Sentence Test (OLSA) will be presented. Stimuli will be presented in 4 different modalities: (1) speech in quiet, (2) speech in noise, (3) visual only (ie, lipreading), and (4) audiovisual speech. Each stimulus type will be repeated 10 times in a counterbalanced block design. Interactive question windows will monitor speech comprehension during the task. After the measurement, we will perform a 3D scan to digitize optode positions and verify the covered anatomical locations.ResultsThis paper reports the study protocol. Enrollment for the study started in August 2021. We expect to publish our first results by the end of 2022.ConclusionsThe proposed audiovisual speech comprehension task will help elucidate neural correlates to speech understanding. The comprehensive study will have the potential to provide additional information beyond the conventional clinical standards about the underlying plastic brain changes of a hearing-impaired person. It will facilitate more precise indication criteria for cochlear implantation and better planning of rehabilitation.International registered report identifier (irrid)DERR1-10.2196/38407.
| S-EPMC9239541 | biostudies-literature
Project description:BackgroundAlthough ample evidence suggests that emotion and response inhibition are interrelated at the behavioral and neural levels, neural substrates of response inhibition to negative facial information remain unclear. Thus we used event-related potential (ERP) methods to explore the effects of explicit and implicit facial expression processing in response inhibition.MethodsWe used implicit (gender categorization) and explicit emotional Go/Nogo tasks (emotion categorization) in which neutral and sad faces were presented. Electrophysiological markers at the scalp and the voxel level were analyzed during the two tasks.ResultsWe detected a task, emotion and trial type interaction effect in the Nogo-P3 stage. Larger Nogo-P3 amplitudes during sad conditions versus neutral conditions were detected with explicit tasks. However, the amplitude differences between the two conditions were not significant for implicit tasks. Source analyses on P3 component revealed that right inferior frontal junction (rIFJ) was involved during this stage. The current source density (CSD) of rIFJ was higher with sad conditions compared to neutral conditions for explicit tasks, rather than for implicit tasks.ConclusionsThe findings indicated that response inhibition was modulated by sad facial information at the action inhibition stage when facial expressions were processed explicitly rather than implicitly. The rIFJ may be a key brain region in emotion regulation.
| S-EPMC4199673 | biostudies-literature
Project description:A fundamental unsettled dispute concerns how fast the brain generates subjective visual experiences. Both early visual cortical activation and later activity in fronto-parietal global neuronal workspace correlate with conscious vision, but resolving which of the correlates causally triggers conscious vision has proved a methodological impasse. We show that participants can report whether or not they consciously perceived a stimulus in just over 200?ms. These fast consciousness reports were extremely reliable, and did not include reflexive, unconscious responses. The neural events that causally generate conscious vision must have occurred before these behavioral reports. Analyses on single-trial neural correlates of consciousness revealed that the late cortical processing in fronto-parietal global neuronal workspace (?300?ms) started after the fastest consciousness reports, ruling out the possibility that this late activity directly reflects the emergence of visual consciousness. The consciousness reports were preceded by a negative amplitude difference (?160-220?ms) that spread from occipital to frontal cortex, suggesting that this correlate underlies the emergence of conscious vision.
| S-EPMC6368270 | biostudies-literature
Project description:Several studies assumed that the analysis of numerical information happens in a fast and automatic manner in the human brain. Utilizing the high temporal resolution of electroencephalography (EEG) in a passive oddball adaptation paradigm, we compared event-related brain potentials (ERPs) evoked by unattended shape changes and unattended numerosity changes. We controlled visual stimulus properties in a stringent manner. Unattended changes in shape elicited significant, gradual adaptation effects in the range of early visual components, indicating the fast and automatic processing of shapes. Changes in numerosity did not elicit significant changes in these early ERP components. The lack of early number-specific effects was qualified by a significant interaction between Shape and Number conditions. Number change elicited gradual ERP effects only on late ERP components. We conclude that numerosity is a higher-level property assembled from naturally correlating perceptual cues and hence, it is identified later in the cognitive processing stream.
| S-EPMC4266538 | biostudies-literature
Project description:When exogenously cued, attention reflexively reorients towards the cued position. After a brief dwelling time, attention is released and then persistently inhibited from returning to this position for up to three seconds, a phenomenon coined 'inhibition of return' (IOR). This inhibitory interpretation has shaped our understanding of the spatio-temporal dynamics of the attentional spotlight after an exogenous visual cue for more than three decades. However, a recent theory refines this traditional view and predicts that attention rhythmically alternates between possible target locations at a theta frequency, implying occasional returns of attention to the cued position. Unfortunately, previous IOR studies have only probed performance at a few, temporally wide-spread cue-target onset asynchronies (CTOAs) rendering a comparison of these contradictory predictions impossible. We therefore used a temporally fine-grained adaptation of the Posner paradigm with 25 equally and densely spaced CTOAs, which yielded a robust IOR effect in the reaction time difference between valid and invalidly cued trials. We modelled the time course of this effect across CTOAs as a linear or exponential decay (traditional IOR model), sinusoidal rhythm (rhythmic model) and a combination of both (hybrid model). Model comparison by means of goodness-of-fit indices provided strong evidence in favor of traditional IOR models, and against theta-rhythmic attentional sampling contributing to IOR. This finding was supported by an FFT analysis, which also revealed no significant theta rhythm. We therefore conclude that the spatio-temporal dynamics of attention following an exogenous cue cannot be explained by rhythmic attentional sampling.
| S-EPMC10545570 | biostudies-literature