The Bilingual Language Interaction Network for Comprehension of Speech.
Ontology highlight
ABSTRACT:
SUBMITTER: Shook A
PROVIDER: S-EPMC3866103 | biostudies-literature | 2013 Apr
REPOSITORIES: biostudies-literature
Publications
The Bilingual Language Interaction Network for Comprehension of Speech.
Shook Anthony A Marian Viorica V
Bilingualism (Cambridge, England) 20130401 2
During speech comprehension, bilinguals co-activate both of their languages, resulting in cross-linguistic interaction at various levels of processing. This interaction has important consequences for both the structure of the language system and the mechanisms by which the system processes spoken language. Using computational modeling, we can examine how cross-linguistic interaction affects language processing in a controlled, simulated environment. Here we present a connectionist model of bilin ...[more]
Similar Datasets
Project description:Most empirical evidence on switch costs is based on bilingual production and interpreted as a result of inhibitory control. It is unclear whether such a top-down control process exists in language switching during comprehension. This study investigates whether a non-lexical switch cost is involved in reading code-switched sentences and its relation to language dominance with cross-script bilingual readers. A maze task is adopted in order to separate top-down inhibitory effects, from lexical effects driven by input. The key findings are: (1) switch costs were observed in both L1-L2 and L2-L1 directions; (2) these effects were driven by two mechanisms: lexical activation and inhibitory control; (3) language dominance modulated the lexical effects, but did not affect the inhibitory effects. These results suggest that a language control mechanism is involved in bilingual reading, even though the control process is not driven by selection as in production. At the theoretical level, these results lend support for the Inhibitory Control model during language switching in comprehension; while the BIA/BIA+ model needs to incorporate a top-down control mechanism to be able to explain the current findings.
| S-EPMC4543796 | biostudies-literature
Project description:Research on bilingualism has grown exponentially in recent years. However, the comprehension of speech in noise, given the ubiquity of both bilingualism and noisy environments, has seen only limited focus. Electroencephalogram (EEG) studies in monolinguals show an increase in alpha power when listening to speech in noise, which, in the theoretical context where alpha power indexes attentional control, is thought to reflect an increase in attentional demands. In the current study, English/French bilinguals with similar second language (L2) proficiency and who varied in terms of age of L2 acquisition (AoA) from 0 (simultaneous bilinguals) to 15 years completed a speech perception in noise task. Participants were required to identify the final word of high and low semantically constrained auditory sentences such as "Stir your coffee with a spoon" vs. "Bob could have known about the spoon" in both of their languages and in both noise (multi-talker babble) and quiet during electrophysiological recording. We examined the effects of language, AoA, semantic constraint, and listening condition on participants' induced alpha power during speech comprehension. Our results show an increase in alpha power when participants were listening in their L2, suggesting that listening in an L2 requires additional attentional control compared to the first language, particularly early in processing during word identification. Additionally, despite similar proficiency across participants, our results suggest that under difficult processing demands, AoA modulates the amount of attention required to process the second language.
| S-EPMC9083356 | biostudies-literature
Project description:To examine the neural signatures of language co-activation and control during bilingual spoken word comprehension, Korean-English bilinguals and English monolinguals were asked to make overt or covert semantic relatedness judgments on auditorily-presented English word pairs. In two critical conditions, participants heard word pairs consisting of an English-Korean interlingual homophone (e.g., the sound /mu:n/ means "moon" in English and "door" in Korean) as the prime and an English word as the target. In the homophone-related condition, the target (e.g., "lock") was related to the homophone's Korean meaning, but not related to the homophone's English meaning. In the homophone-unrelated condition, the target was unrelated to either the homophone's Korean meaning or the homophone's English meaning. In overtly responded situations, ERP results revealed that the reduced N400 effect in bilinguals for homophone-related word pairs correlated positively with the amount of their daily exposure to Korean. In covertly responded situations, ERP results showed a reduced late positive component for homophone-related word pairs in the right hemisphere, and this late positive effect was related to the neural efficiency of suppressing interference in a non-linguistic task. Together, these findings suggest 1) that the degree of language co-activation in bilingual spoken word comprehension is modulated by the amount of daily exposure to the non-target language; and 2) that bilinguals who are less influenced by cross-language activation may also have greater efficiency in suppressing interference in a non-linguistic task.
| S-EPMC5568634 | biostudies-literature
Project description:The main goal of the present study was to explore the involvement of inhibition in resolution of cross-language activation in bilingual comprehension and a possible modulatory effect of L2 proficiency. We used a semantic relatedness judgment task in L2 English that included Polish-English interlingual homographs and English translations of the Polish homographs' meanings. Based on previous studies using the same paradigm, we expected a strong homograph interference and inhibition of the homographs' Polish meanings translations. In addition, we predicted that participants with lower L2 proficiency would experience greater interference and stronger inhibitory effects. The reported results confirm a strong homograph interference effect. In addition, our results indicate that the scope of inhibition generalized from the homograph's irrelevant meaning to a whole semantic category, indicating the flexibility of the inhibitory mechanisms. Contrary to our expectations, L2 proficiency did not modulate the effects of interference and inhibition, possibly due to a relatively low variability in proficiency within our participant sample.
| S-EPMC4792378 | biostudies-literature
Project description:Diverse bilingual experiences have implications for language comprehension, including pragmatic elements such as verbal irony. Irony comprehension is shaped by an interplay of linguistic, cognitive, and social factors, including individual differences in bilingual experience. We examined the relationship between individual differences related to bilingualism, specifically, the capacity to understand others' mental states and ambient exposure to language diversity, on irony comprehension. We tested 54 healthy bilingual adults, living in a linguistically diverse region-Montréal, Canada-on an irony comprehension task. This task involved reading positive and negative short stories that concluded with an ironic or literal statement, which were rated on appropriateness and perceived irony. While both irony forms were rated as less appropriate and more ironic than literal statements, ironic criticisms (following a negative context) were rated as more appropriate and higher in perceived irony than ironic compliments (following a positive context). As expected, these ratings varied as a function of individual differences in mentalizing and neighborhood language diversity. Greater mentalizing patterned with more appropriate ratings to ironic statements in high language diversity neighborhoods and with less appropriate ratings to ironic statements in low language diversity neighborhoods. Perceived irony ratings to ironic compliments increased with mentalizing as neighborhood language diversity increased. These results indicate that pragmatic language comprehension and its social cognitive underpinnings may be environmentally contextualized processes.
| S-EPMC9402273 | biostudies-literature
Project description:IntroductionDuring speech comprehension, multiple sources of information are available to listeners, which are combined to guide the recognition process. Models of speech comprehension posit that when the acoustic speech signal is obscured, listeners rely more on information from other sources. However, these models take into account only word frequency information and local contexts (surrounding syllables), but not sentence-level information. To date, empirical studies investigating predictability effects in noise did not carefully control the tested speech sounds, while the literature investigating the effect of background noise on the recognition of speech sounds does not manipulate sentence predictability. Additionally, studies on the effect of background noise show conflicting results regarding which noise type affects speech comprehension most. We address this in the present experiment.MethodsWe investigate how listeners combine information from different sources when listening to sentences embedded in background noise. We manipulate top-down predictability, type of noise, and characteristics of the acoustic signal, thus creating conditions which differ in the extent to which a specific speech sound is masked in a way that is grounded in prior work on the confusability of speech sounds in noise. Participants complete an online word recognition experiment.Results and discussionThe results show that participants rely more on the provided sentence context when the acoustic signal is harder to process. This is the case even when interactions of the background noise and speech sounds lead to small differences in intelligibility. Listeners probabilistically combine top-down predictions based on context with noisy bottom-up information from the acoustic signal, leading to a trade-off between the different types of information that is dependent on the combination of a specific type of background noise and speech sound.
| S-EPMC9802670 | biostudies-literature
Project description:Half of the global population can be considered bilingual. Nevertheless when faced with patients with aphasia, clinicians and therapists usually ignore the patient's second language (L2) albeit its interference in first language (L1) processing has been shown. The excellent temporal resolution by which each individual linguistic component can be gaged during word-processing, promoted the event-related potential (ERP) technique for studying language processing in healthy bilinguals and monolingual aphasia patients. However, this technique has not yet been applied in the context of bilingual aphasia. In the current study, we report on L2 interference in L1 processing using the ERP technique in bilingual aphasia. We tested four bilingual- and one trilingual patients with aphasia, as well as several young and older (age-matched with patients) healthy subjects as controls. We recorded ERPs when subjects were engaged in a semantic association judgment task on 122 related and 122 unrelated Dutch word-pairs (prime and target words). In 61 related and 61 unrelated word-pairs, an inter-lingual homograph was used as prime. In these word-pairs, when the target was unrelated to the prime in Dutch (L1), it was associated to the English (L2) meaning of the homograph. Results showed a significant effect of homograph use as a prime on early and/or late ERPs in response to word-pairs related in Dutch or English. Each patient presented a unique pattern of L2 interference in L1 processing as reflected by his/her ERP image. These interferences depended on the patient's pre- and post-morbid L2 proficiency. When the proficiency was high, the L2 interference in L1 processing was higher. Furthermore, the mechanism of interference in patients that were pre-morbidly highly proficient in L2 additionally depended on the frequency of pre-morbid L2 exposure. In summary, we showed that the mechanism behind L2 interference in L1 processing in bilingual patients with aphasia depends on a complex interaction between pre- and post-morbid L2 proficiency, pre- and post-morbid L2 exposure, impairment and the presented stimulus (inter-lingual homographs). Our ERP study complements the usually adopted behavioral approach by providing new insights into language interactions on the level of individual linguistic components in bilingual patients with aphasia.
| S-EPMC5844919 | biostudies-literature
Project description:What role do domain-general executive functions play in human language comprehension? To address this question, we examine the relationship between behavioral measures of comprehension and neural activity in the domain-general "multiple demand" (MD) network, which has been linked to constructs like attention, working memory, inhibitory control, and selection, and implicated in diverse goal-directed behaviors. Specifically, functional magnetic resonance imaging data collected during naturalistic story listening are compared with theory-neutral measures of online comprehension difficulty and incremental processing load (reading times and eye-fixation durations). Critically, to ensure that variance in these measures is driven by features of the linguistic stimulus rather than reflecting participant- or trial-level variability, the neuroimaging and behavioral datasets were collected in nonoverlapping samples. We find no behavioral-neural link in functionally localized MD regions; instead, this link is found in the domain-specific, fronto-temporal "core language network," in both left-hemispheric areas and their right hemispheric homotopic areas. These results argue against strong involvement of domain-general executive circuits in language comprehension.
| S-EPMC8328211 | biostudies-literature
Project description:BackgroundSpeech intelligibility and speech comprehension for dysarthric speech has attracted much attention recently. Dysarthria is characterized by irregularities in the speed, strength, pitch, breath control, range, steadiness, and accuracy of muscle movements required for articulatory aspects of speech production.ObjectiveThis study examined the contributions made by other studies involved in dysarthric speech comprehension. We focused on the modes of meaning extraction used in generalizing speaker-listener underpinnings in light of semantic ontology extraction as a desired technique, applied method types, speech representations used, and databases sourced from.MethodsThis study involved a systematic literature review using 7 electronic databases: Cochrane Database of Systematic Reviews, Web of Science Core Collection, Scopus, PubMed, ACM, IEEE Xplore, and Google Scholar. The main eligibility criterion was the extraction of meaning from dysarthric speech using natural language processing or understanding approaches to improve on dysarthric speech comprehension. In total, out of 834 search results, 30 studies that matched the eligibility requirements were acquired following screening by 2 independent reviewers, with a lack of consensus being resolved through joint discussion or consultation with a third party. In order to evaluate the studies' methodological quality, the risk of bias assessment was based on the Cochrane risk-of-bias tool version 2 (RoB2) with 23 of the studies (77%) registering low risk of bias and 7 studies (33%) raising some concern over the risk of bias. The overall quality assessment of the study was done using TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis).ResultsFollowing a review of 30 primary studies, this study revealed that the reviewed studies focused on natural language understanding or clinical approaches, with an increase in proposed solutions from 2020 onwards. Most studies relied on speaker-dependent speech features, while others used speech patterns, semantic knowledge, or hybrid approaches. The prevalent use of vector representation aligned with natural language understanding models, while Mel-frequency cepstral coefficient representation and no representation approaches were applied in neural networks. Hybrid representation studies aimed to reconstruct dysarthric speech or improve comprehension. Comprehensive databases, like TORGO and UA-Speech, were commonly used in combination with other curated databases, while primary data was preferred for specific or unique research objectives.ConclusionsWe found significant gaps in dysarthric speech comprehension characterized by the lack of inclusion of important listener or speech-independent features in the speech representations, mode of extraction, and data sources used. Further research is therefore proposed regarding the formulation of models that accommodate listener and speech-independent features through semantic ontologies that will be useful in the inclusion of key features of listener and speech-independent features for meaning extraction of dysarthric speech.
| S-EPMC10655903 | biostudies-literature
Project description:Visual information conveyed by iconic hand gestures and visible speech can enhance speech comprehension under adverse listening conditions for both native and non-native listeners. However, how a listener allocates visual attention to these articulators during speech comprehension is unknown. We used eye-tracking to investigate whether and how native and highly proficient non-native listeners of Dutch allocated overt eye gaze to visible speech and gestures during clear and degraded speech comprehension. Participants watched video clips of an actress uttering a clear or degraded (6-band noise-vocoded) action verb while performing a gesture or not, and were asked to indicate the word they heard in a cued-recall task. Gestural enhancement was the largest (i.e., a relative reduction in reaction time cost) when speech was degraded for all listeners, but it was stronger for native listeners. Both native and non-native listeners mostly gazed at the face during comprehension, but non-native listeners gazed more often at gestures than native listeners. However, only native but not non-native listeners' gaze allocation to gestures predicted gestural benefit during degraded speech comprehension. We conclude that non-native listeners might gaze at gesture more as it might be more challenging for non-native listeners to resolve the degraded auditory cues and couple those cues to phonological information that is conveyed by visible speech. This diminished phonological knowledge might hinder the use of semantic information that is conveyed by gestures for non-native compared to native listeners. Our results demonstrate that the degree of language experience impacts overt visual attention to visual articulators, resulting in different visual benefits for native versus non-native listeners.
| S-EPMC6790953 | biostudies-literature