Attention and speech-processing related functional brain networks activated in a multi-speaker environment.
Ontology highlight
ABSTRACT:
SUBMITTER: Toth B
PROVIDER: S-EPMC6394951 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Focusing attention on one speaker on the background of other irrelevant speech can be a challenging feat. A longstanding question in attention research is whether and how frequently individuals shift their attention towards task-irrelevant speech, arguably leading to occasional detection of words in a so-called unattended message. However, this has been difficult to gauge empirically, particularly when participants attend to continuous natural speech, due to the lack of appropriate metrics for detecting shifts in internal attention. Here we introduce a new experimental platform for studying the dynamic deployment of attention among concurrent speakers, utilizing a unique combination of Virtual Reality (VR) and Eye-Tracking technology. We created a Virtual Café in which participants sit across from and attend to the narrative of a target speaker. We manipulated the number and location of distractor speakers by placing additional characters throughout the Virtual Café. By monitoring participant's eye-gaze dynamics, we studied the patterns of overt attention-shifts among concurrent speakers as well as the consequences of these shifts on speech comprehension. Our results reveal important individual differences in the gaze-pattern displayed during selective attention to speech. While some participants stayed fixated on a target speaker throughout the entire experiment, approximately 30% of participants frequently shifted their gaze toward distractor speakers or other locations in the environment, regardless of the severity of audiovisual distraction. Critically, preforming frequent gaze-shifts negatively impacted the comprehension of target speech, and participants made more mistakes when looking away from the target speaker. We also found that gaze-shifts occurred primarily during gaps in the acoustic input, suggesting that momentary reductions in acoustic masking prompt attention-shifts between competing speakers, in line with "glimpsing" theories of processing speech in noise. These results open a new window into understanding the dynamics of attention as they wax and wane over time, and the different listening patterns employed for dealing with the influx of sensory input in multisensory environments. Moreover, the novel approach developed here for tracking the locus of momentary attention in a naturalistic virtual-reality environment holds high promise for extending the study of human behavior and cognition and bridging the gap between the laboratory and real-life.
| S-EPMC6857110 | biostudies-literature
Project description:Speech perception in crowded environments is challenging for hearing-impaired listeners. Assistive hearing devices cannot lower interfering speakers without knowing which speaker the listener is focusing on. One possible solution is auditory attention decoding in which the brainwaves of listeners are compared with sound sources to determine the attended source, which can then be amplified to facilitate hearing. In realistic situations, however, only mixed audio is available. We utilize a novel speech separation algorithm to automatically separate speakers in mixed audio, with no need for the speakers to have prior training. Our results show that auditory attention decoding with automatically separated speakers is as accurate and fast as using clean speech sounds. The proposed method significantly improves the subjective and objective quality of the attended speaker. Our study addresses a major obstacle in actualization of auditory attention decoding that can assist hearing-impaired listeners and reduce listening effort for normal-hearing subjects.
| S-EPMC6520028 | biostudies-literature
Project description:BackgroundMany patients with attention-deficit/hyperactivity disorder (ADHD) display aberrant reward-related behavior. Task-based fMRI studies have related atypical reward processing in ADHD to altered BOLD activity in regions underlying reward processing such as ventral striatum and orbitofrontal cortex. However, it remains unclear whether the observed effects are region-specific or related to changes in functional connectivity of networks supporting reward processing. Here we use resting-state fMRI to comprehensively delineate the functional connectivity architecture underlying aberrant reward processing in ADHD.MethodsWe assessed resting-state functional connectivity of four networks that support reward processing. These networks showed high spatial overlap with the default mode, fronto-parietal, lateral visual, and salience networks, yet only activity within the salience network was effectively sensitive to reward value. We parcelled these networks into their functional cortical and subcortical subregions and obtained functional connectivity matrices by computing Pearson correlations between the regional time series. We compared functional connectivity within each of the four networks between participants with ADHD and controls, and related functional connectivity to dimensional ADHD symptom scores across all participants (N = 444; age range: 8.5-30.5; mean age: 17.7).ResultsWe did not observe significant ADHD-related alterations in functional connectivity of the salience network, which included key reward regions. Instead, levels of inattention symptoms modulated functional connectivity of the default-mode and fronto-parietal networks, which supported general task processing.ConclusionsThe present study does not corroborate previous childhood evidence for functional connectivity alterations between key reward processing regions in adolescents and young adults with ADHD. Our findings could point to developmental normalization or indicate that reward-processing deficits result from functional connectivity alterations in general task-related networks.
| S-EPMC5081416 | biostudies-literature
Project description:Humans possess a remarkable ability to attend to a single speaker's voice in a multi-talker background. How the auditory system manages to extract intelligible speech under such acoustically complex and adverse listening conditions is not known, and, indeed, it is not clear how attended speech is internally represented. Here, using multi-electrode surface recordings from the cortex of subjects engaged in a listening task with two simultaneous speakers, we demonstrate that population responses in non-primary human auditory cortex encode critical features of attended speech: speech spectrograms reconstructed based on cortical responses to the mixture of speakers reveal the salient spectral and temporal features of the attended speaker, as if subjects were listening to that speaker alone. A simple classifier trained solely on examples of single speakers can decode both attended words and speaker identity. We find that task performance is well predicted by a rapid increase in attention-modulated neural selectivity across both single-electrode and population-level cortical responses. These findings demonstrate that the cortical representation of speech does not merely reflect the external acoustic environment, but instead gives rise to the perceptual aspects relevant for the listener's intended goal.
| S-EPMC3870007 | biostudies-literature
Project description:Disappearance of a voice or other sound source may often go unnoticed when the auditory scene is crowded. We explored the role of selective attention for this change deafness with magnetoencephalography in multi-speaker scenes. Each scene was presented two times in direct succession, and one target speaker was frequently omitted in Scene 2. When listeners were previously cued to the target speaker, activity in auditory cortex time locked to the target speaker's sound envelope was selectively enhanced in Scene 1, as was determined by a cross-correlation analysis. Moreover, the response was stronger for hit trials than for miss trials, confirming that selective attention played a role for subsequent change detection. If selective attention to the streams where the change occurred was generally required for successful change detection, neural enhancement of this stream would also be expected without cue in hit compared to miss trials. However, when listeners were not previously cued to the target, no enhanced activity for the target speaker was observed for hit trials, and there was no significant difference between hit and miss trials. These results, first, confirm a role for attention in change detection for situations where the target source is known. Second, they suggest that the omission of a speaker, or more generally an auditory stream, can alternatively be detected without selective attentional enhancement of the target stream. Several models and strategies could be envisaged for change detection in this case, including global comparison of the subsequent scenes.
| S-EPMC6866511 | biostudies-literature
Project description:Traumatic brain injury (TBI) is highly prevalent in adults. TBI-related functional brain alterations have been linked with common post-TBI neurobehavioral sequelae, with unknown neural substrates. This study examined the systems-level functional brain alterations in white matter (WM) and gray matter (GM) for visual sustained-attention processing, and their interactions and contributions to post-TBI attention deficits. Task-based functional MRI data were collected from 42 adults with TBI and 43 group-matched normal controls (NCs), and analyzed using the graph theoretic technique. Global and nodal topological properties were calculated and compared between the two groups. Correlation analyses were conducted between the neuroimaging measures that showed significant between-group differences and the behavioral symptom measures in attention domain in the groups of TBI and NCs, respectively. Significantly altered nodal efficiencies and/or degrees in several WM and GM nodes were reported in the TBI group, including the posterior corona radiata (PCR), posterior thalamic radiation (PTR), postcentral gyrus (PoG), and superior temporal sulcus (STS). Subjects with TBI also demonstrated abnormal systems-level functional synchronization between the PTR and STS in the right hemisphere, hypo-interaction between the PCR and PoG in the left hemisphere, as well as the involvement of systems-level functional aberrances in the PCR in TBI-related behavioral impairments in the attention domain. The findings of the current study suggest that TBI-related systems-level functional alterations associated with these two major-association WM tracts, and their anatomically connected GM regions may play critical role in TBI-related behavioral deficits in attention domains.
| S-EPMC8774280 | biostudies-literature
Project description:A fundamental question regarding music processing is its degree of independence from speech processing, in terms of their underlying neuroanatomy and influence of cognitive traits and abilities. Although a straight answer to that question is still lacking, a large number of studies have described where in the brain and in which contexts (tasks, stimuli, populations) this independence is, or is not, observed. We examined the independence between music and speech processing using functional magnetic resonance imagining and a stimulation paradigm with different human vocal sounds produced by the same voice. The stimuli were grouped as Speech (spoken sentences), Hum (hummed melodies), and Song (sung sentences); the sentences used in Speech and Song categories were the same, as well as the melodies used in the two musical categories. Each category had a scrambled counterpart which allowed us to render speech and melody unintelligible, while preserving global amplitude and frequency characteristics. Finally, we included a group of musicians to evaluate the influence of musical expertise. Similar global patterns of cortical activity were related to all sound categories compared to baseline, but important differences were evident. Regions more sensitive to musical sounds were located bilaterally in the anterior and posterior superior temporal gyrus (planum polare and temporale), the right supplementary and premotor areas, and the inferior frontal gyrus. However, only temporal areas and supplementary motor cortex remained music-selective after subtracting brain activity related to the scrambled stimuli. Speech-selective regions mainly affected by intelligibility of the stimuli were observed on the left pars opecularis and the anterior portion of the medial temporal gyrus. We did not find differences between musicians and non-musicians Our results confirmed music-selective cortical regions in associative cortices, independent of previous musical training.
| S-EPMC6786620 | biostudies-other
Project description:Existing whole-brain models are generally tailored to the modelling of a particular data modality (e.g., fMRI or MEG/EEG). We propose that despite the differing aspects of neural activity each modality captures, they originate from shared network dynamics. Building on the universal principles of self-organising delay-coupled nonlinear systems, we aim to link distinct features of brain activity - captured across modalities - to the dynamics unfolding on a macroscopic structural connectome. To jointly predict connectivity, spatiotemporal and transient features of distinct signal modalities, we consider two large-scale models - the Stuart Landau and Wilson and Cowan models - which generate short-lived 40 Hz oscillations with varying levels of realism. To this end, we measure features of functional connectivity and metastable oscillatory modes (MOMs) in fMRI and MEG signals - and compare them against simulated data. We show that both models can represent MEG functional connectivity (FC), functional connectivity dynamics (FCD) and generate MOMs to a comparable degree. This is achieved by adjusting the global coupling and mean conduction time delay and, in the WC model, through the inclusion of balance between excitation and inhibition. For both models, the omission of delays dramatically decreased the performance. For fMRI, the SL model performed worse for FCD and MOMs, highlighting the importance of balanced dynamics for the emergence of spatiotemporal and transient patterns of ultra-slow dynamics. Notably, optimal working points varied across modalities and no model was able to achieve a correlation with empirical FC higher than 0.4 across modalities for the same set of parameters. Nonetheless, both displayed the emergence of FC patterns that extended beyond the constraints of the anatomical structure. Finally, we show that both models can generate MOMs with empirical-like properties such as size (number of brain regions engaging in a mode) and duration (continuous time interval during which a mode appears). Our results demonstrate the emergence of static and dynamic properties of neural activity at different timescales from networks of delay-coupled oscillators at 40 Hz. Given the higher dependence of simulated FC on the underlying structural connectivity, we suggest that mesoscale heterogeneities in neural circuitry may be critical for the emergence of parallel cross-modal functional networks and should be accounted for in future modelling endeavours.
| S-EPMC10958139 | biostudies-literature
Project description:The speech we hear every day is typically "degraded" by competing sounds and the idiosyncratic vocal characteristics of individual speakers. While the comprehension of "degraded" speech is normally automatic, it depends on dynamic and adaptive processing across distributed neural networks. This presents the brain with an immense computational challenge, making degraded speech processing vulnerable to a range of brain disorders. Therefore, it is likely to be a sensitive marker of neural circuit dysfunction and an index of retained neural plasticity. Considering experimental methods for studying degraded speech and factors that affect its processing in healthy individuals, we review the evidence for altered degraded speech processing in major neurodegenerative diseases, traumatic brain injury and stroke. We develop a predictive coding framework for understanding deficits of degraded speech processing in these disorders, focussing on the "language-led dementias"-the primary progressive aphasias. We conclude by considering prospects for using degraded speech as a probe of language network pathophysiology, a diagnostic tool and a target for therapeutic intervention.
| S-EPMC8003678 | biostudies-literature
Project description:Healthy aging leads to complex changes in the functional network of speech processing in a noisy environment. The dual-route neural architecture has been applied to the study of speech processing. Although evidence suggests that senescent increases activity in the brain regions across the dorsal and ventral stream regions to offset reduced periphery, the regulatory mechanism of dual-route functional networks underlying such compensation remains largely unknown. Here, by utilizing functional near-infrared spectroscopy (fNIRS), we investigated the compensatory mechanism of the dual-route functional connectivity, and its relationship with healthy aging by using a speech perception task at varying signal-to-noise ratios (SNR) in healthy individuals (young adults, middle-aged adults, and older adults). Results showed that the speech perception scores showed a significant age-related decrease with the reduction of the SNR. The analysis results of dual-route speech processing networks showed that the functional connection of Wernicke's area and homolog Wernicke's area were age-related increases. Further to clarify the age-related characteristics of the dual-route speech processing networks, graph-theoretical network analysis revealed an age-related increase in the efficiency of the networks, and the age-related differences in nodal characteristics were found both in Wernicke's area and homolog Wernicke's area under noise environment. Thus, Wernicke's area might be a key network hub to maintain efficient information transfer across the speech process network with healthy aging. Moreover, older adults would recruit more resources from the homologous Wernicke's area in a noisy environment. The recruitment of the homolog of Wernicke's area might provide a means of compensation for older adults for decoding speech in an adverse listening environment. Together, our results characterized dual-route speech processing networks at varying noise environments and provided new insight for the compensatory theories of how aging modulates the dual-route speech processing functional networks.
| S-EPMC10789214 | biostudies-literature