Shared neural correlates for building phrases in signed and spoken language.
Ontology highlight
ABSTRACT:
SUBMITTER: Blanco-Elorrieta E
PROVIDER: S-EPMC5882945 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Linguistic phrases are tracked in sentences even though there is no one-to-one acoustic phrase marker in the physical signal. This phenomenon suggests an automatic tracking of abstract linguistic structure that is endogenously generated by the brain. However, all studies investigating linguistic tracking compare conditions where either relevant information at linguistic timescales is available, or where this information is absent altogether (e.g., sentences versus word lists during passive listening). It is therefore unclear whether tracking at phrasal timescales is related to the content of language, or rather, results as a consequence of attending to the timescales that happen to match behaviourally relevant information. To investigate this question, we presented participants with sentences and word lists while recording their brain activity with magnetoencephalography (MEG). Participants performed passive, syllable, word, and word-combination tasks corresponding to attending to four different rates: one they would naturally attend to, syllable-rates, word-rates, and phrasal-rates, respectively. We replicated overall findings of stronger phrasal-rate tracking measured with mutual information for sentences compared to word lists across the classical language network. However, in the inferior frontal gyrus (IFG) we found a task effect suggesting stronger phrasal-rate tracking during the word-combination task independent of the presence of linguistic structure, as well as stronger delta-band connectivity during this task. These results suggest that extracting linguistic information at phrasal rates occurs automatically with or without the presence of an additional task, but also that IFG might be important for temporal integration across various perceptual domains.
| S-EPMC9282854 | biostudies-literature
Project description:To investigate the impact of sensory-motor systems on the neural organization for language, we conducted an H2 (15)O-PET study of sign and spoken word production (picture-naming) and an fMRI study of sign and audio-visual spoken language comprehension (detection of a semantically anomalous sentence) with hearing bilinguals who are native users of American Sign Language (ASL) and English. Directly contrasting speech and sign production revealed greater activation in bilateral parietal cortex for signing, while speaking resulted in greater activation in bilateral superior temporal cortex (STC) and right frontal cortex, likely reflecting auditory feedback control. Surprisingly, the language production contrast revealed a relative increase in activation in bilateral occipital cortex for speaking. We speculate that greater activation in visual cortex for speaking may actually reflect cortical attenuation when signing, which functions to distinguish self-produced from externally generated visual input. Directly contrasting speech and sign comprehension revealed greater activation in bilateral STC for speech and greater activation in bilateral occipital-temporal cortex for sign. Sign comprehension, like sign production, engaged bilateral parietal cortex to a greater extent than spoken language. We hypothesize that posterior parietal activation in part reflects processing related to spatial classifier constructions in ASL and that anterior parietal activation may reflect covert imitation that functions as a predictive model during sign comprehension. The conjunction analysis for comprehension revealed that both speech and sign bilaterally engaged the inferior frontal gyrus (with more extensive activation on the left) and the superior temporal sulcus, suggesting an invariant bilateral perisylvian language system. We conclude that surface level differences between sign and spoken languages should not be dismissed and are critical for understanding the neurobiology of language.
| S-EPMC4033845 | biostudies-literature
Project description:Recent neuroimaging studies suggest that monolingual infants activate a left-lateralized frontotemporal brain network in response to spoken language, which is similar to the network involved in processing spoken and signed language in adulthood. However, it is unclear how brain activation to language is influenced by early experience in infancy. To address this question, we present functional near-infrared spectroscopy (fNIRS) data from 60 hearing infants (4 to 8 months of age): 19 monolingual infants exposed to English, 20 unimodal bilingual infants exposed to two spoken languages, and 21 bimodal bilingual infants exposed to English and British Sign Language (BSL). Across all infants, spoken language elicited activation in a bilateral brain network including the inferior frontal and posterior temporal areas, whereas sign language elicited activation in the right temporoparietal area. A significant difference in brain lateralization was observed between groups. Activation in the posterior temporal region was not lateralized in monolinguals and bimodal bilinguals, but right lateralized in response to both language modalities in unimodal bilinguals. This suggests that the experience of two spoken languages influences brain activation for sign language when experienced for the first time. Multivariate pattern analyses (MVPAs) could classify distributed patterns of activation within the left hemisphere for spoken and signed language in monolinguals (proportion correct = 0.68; p = 0.039) but not in unimodal or bimodal bilinguals. These results suggest that bilingual experience in infancy influences brain activation for language and that unimodal bilingual experience has greater impact on early brain lateralization than bimodal bilingual experience.
| S-EPMC7145445 | biostudies-literature
Project description:Code-blends (simultaneous words and signs) are a unique characteristic of bimodal bilingual communication. Using fMRI, we investigated code-blend comprehension in hearing native ASL-English bilinguals who made a semantic decision (edible?) about signs, audiovisual words, and semantically equivalent code-blends. English and ASL recruited a similar fronto-temporal network with expected modality differences: stronger activation for English in auditory regions of bilateral superior temporal cortex, and stronger activation for ASL in bilateral occipitotemporal visual regions and left parietal cortex. Code-blend comprehension elicited activity in a combination of these regions, and no cognitive control regions were additionally recruited. Furthermore, code-blends elicited reduced activation relative to ASL presented alone in bilateral prefrontal and visual extrastriate cortices, and relative to English alone in auditory association cortex. Consistent with behavioral facilitation observed during semantic decisions, the findings suggest that redundant semantic content induces more efficient neural processing in language and sensory regions during bimodal language integration.
| S-EPMC5769874 | biostudies-literature
Project description:Studies of patients with acquired cognitive deficits following brain damage and studies using contemporary neuroimaging techniques form two distinct streams of research on the neural basis of cognition. In this study, we combine high-quality structural neuroimaging analysis techniques and extensive behavioural assessment of patients with persistent acquired language deficits to study the neural basis of language. Our results reveal two major divisions within the language system-meaning versus form and recognition versus production-and their instantiation in the brain. Phonological form deficits are associated with lesions in peri-Sylvian regions, whereas semantic production and recognition deficits are associated with damage to the left anterior temporal lobe and white matter connectivity with frontal cortex, respectively. These findings provide a novel synthesis of traditional and contemporary views of the cognitive and neural architecture of language processing, emphasizing dual routes for speech processing and convergence of white matter tracts for semantic control and/or integration.
| S-EPMC4400840 | biostudies-literature
Project description:BackgroundCommunication between people who are deaf and sign and people who use a spoken language is possible by means of an interpreter. Interpreting in real time can be performed at a distance, which differs from interpreting face-to-face. Due to COVID-19, interpretation at a distance has increased.ObjectiveThe objective of this study was to map the existing literature to identify key characteristics by addressing the following question: What is known about interpreted mediated interactions between people using a signed respective spoken language across distances in real time?DesignEight online databases, complemented by a search in one nonindexed journal of relevance to the review, were used to identify original studies published in 2010-2020, and 17 publications met the inclusion criteria. Charting of the data revealed insight from 17 original studies that were extracted, summarized, and reported.ResultsFour key characteristics were identified: (1) advantages and challenges in remote interpreting; (2) the need for training in remote interpreting and video relay service (VRS); (3) regulations and organizational structures of VRS; and (4) the interpreter as an active party in VRS.ConclusionRemote interpreting has several challenges but also advantages. Knowledge of these kinds of interactions is limited, and further research must be initiated and realized, not least due to technological developments and the increased number of interpreting events.
| S-EPMC8943107 | biostudies-literature
Project description:While morphology constitutes a crucial component of the human language system, the neural bases of morphological processing in the human brain remains to be elucidated. The current study aims at exploring the extent to which the second language (L2) morphological processing would resemble or differ from that of their first language (L1) in adult Chinese-English bilinguals. Bilingual participants were asked to complete a morphological priming lexical decision task drawing on derivational morphology, which is present for both Chinese and English, when their electrophysiological and optical responses were recorded concurrently. Functional near-infrared spectroscopy (fNIRS) revealed a neural dissociation between morphological and semantic priming effects in the left fronto-temporal network, while L1 Chinese engaged enhanced activation in the left prefrontal cortex for morphological parsing relative to L2 English. In the early stage of lexical processing, cross-language morphological processing manifested a difference in degree, not in kind, as revealed by the early left anterior negativity (ELAN) effect. In addition, L1 and L2 shared both early and late structural parsing processes (P250 and 300 ~ 500 ms negativity, respectively). Therefore, the current results support a unified competition model for bilingual development, where bilinguals would primarily employ L1 neural resources for L2 morphological representation and processing.
| S-EPMC10477180 | biostudies-literature
Project description:Symbolic gestures, such as pantomimes that signify actions (e.g., threading a needle) or emblems that facilitate social transactions (e.g., finger to lips indicating "be quiet"), play an important role in human communication. They are autonomous, can fully take the place of words, and function as complete utterances in their own right. The relationship between these gestures and spoken language remains unclear. We used functional MRI to investigate whether these two forms of communication are processed by the same system in the human brain. Responses to symbolic gestures, to their spoken glosses (expressing the gestures' meaning in English), and to visually and acoustically matched control stimuli were compared in a randomized block design. General Linear Models (GLM) contrasts identified shared and unique activations and functional connectivity analyses delineated regional interactions associated with each condition. Results support a model in which bilateral modality-specific areas in superior and inferior temporal cortices extract salient features from vocal-auditory and gestural-visual stimuli respectively. However, both classes of stimuli activate a common, left-lateralized network of inferior frontal and posterior temporal regions in which symbolic gestures and spoken words may be mapped onto common, corresponding conceptual representations. We suggest that these anterior and posterior perisylvian areas, identified since the mid-19th century as the core of the brain's language system, are not in fact committed to language processing, but may function as a modality-independent semiotic system that plays a broader role in human communication, linking meaning with symbols whether these are words, gestures, images, sounds, or objects.
| S-EPMC2779203 | biostudies-literature
Project description:It has long been speculated whether communication between humans and machines based on natural speech related cortical activity is possible. Over the past decade, studies have suggested that it is feasible to recognize isolated aspects of speech from neural signals, such as auditory features, phones or one of a few isolated words. However, until now it remained an unsolved challenge to decode continuously spoken speech from the neural substrate associated with speech and language processing. Here, we show for the first time that continuously spoken speech can be decoded into the expressed words from intracranial electrocorticographic (ECoG) recordings.Specifically, we implemented a system, which we call Brain-To-Text that models single phones, employs techniques from automatic speech recognition (ASR), and thereby transforms brain activity while speaking into the corresponding textual representation. Our results demonstrate that our system can achieve word error rates as low as 25% and phone error rates below 50%. Additionally, our approach contributes to the current understanding of the neural basis of continuous speech production by identifying those cortical regions that hold substantial information about individual phones. In conclusion, the Brain-To-Text system described in this paper represents an important step toward human-machine communication based on imagined speech.
| S-EPMC4464168 | biostudies-literature
Project description:Brain structure can predict many aspects of human behavior, though the extent of this relationship in healthy adults, particularly for language-related skills, remains largely unknown. The objective of the present study was to explore this relation using magnetic resonance imaging (MRI) on a group of 21 healthy young adults who completed two language tasks: (1) semantic fluency and (2) sentence generation. For each region of interest, cortical thickness, surface area, and volume were calculated. The results show that verbal fluency scores correlated mainly with measures of brain morphology in the left inferior frontal cortex and bilateral insula. Sentence generation scores correlated with structure of the left inferior parietal and right inferior frontal regions. These results reveal that the anatomy of several structures in frontal and parietal lobes is associated with spoken language performance. The presence of both negative and positive correlations highlights the complex relation between brain and language.
| S-EPMC4587378 | biostudies-literature