Dataset Information

Common Neural System for Sentence and Picture Comprehension Across Languages: A Chinese-Japanese Bilingual Study.

ABSTRACT: While common semantic representations for individual words across languages have been identified, a common meaning system at sentence-level has not been determined. In this study, fMRI was used to investigate whether an across-language sentence comprehension system exists. Chinese-Japanese bilingual participants (n = 32) were asked to determine whether two consecutive stimuli were related (coherent) or not (incoherent) to the same event. Stimuli were displayed with three different modalities (Chinese written sentences, Japanese written sentences, and pictures). The behavioral results showed no significant difference in accuracy and response times among the three modalities. Multi-voxel pattern analysis (MVPA) of fMRI data was used to classify the semantic relationship (coherent or incoherent) across the stimulus modalities. The classifier was first trained to determine coherency within Chinese sentences and then tested with Japanese sentences, and vice versa. A whole-brain searchlight analysis revealed significant above-chance classification accuracy across Chinese and Japanese sentences in the supramarginal gyrus (BA 40), extending into the angular gyrus (BA 39) as well as the opercular (BA 44) and triangular (BA 45) parts of the inferior frontal gyrus in the left hemisphere (cluster-level FWE corrected p < 0.05). Significant above-chance classification accuracy was also found across Japanese sentences and pictures in the supramarginal (BA 40) and angular gyrus (BA 39). These results indicate that a common meaning system for sentence processing across languages and modalities exists, and it involves the left inferior parietal gyrus.

SUBMITTER: Hu Z

PROVIDER: S-EPMC6823717 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Common Neural System for Sentence and Picture Comprehension Across Languages: A Chinese-Japanese Bilingual Study.

Hu Zhengfei Z Yang Huixiang H Yang Yuxiang Y Nishida Shuhei S Madden-Lombardi Carol C Ventre-Dominey Jocelyne J Dominey Peter Ford PF Ogawa Kenji K

Frontiers in human neuroscience 20191025

While common semantic representations for individual words across languages have been identified, a common meaning system at sentence-level has not been determined. In this study, fMRI was used to investigate whether an across-language sentence comprehension system exists. Chinese-Japanese bilingual participants (<i>n</i> = 32) were asked to determine whether two consecutive stimuli were related (coherent) or not (incoherent) to the same event. Stimuli were displayed with three different modalit ...[more]

PMID: 31708762

Similar Datasets

Project description:Functional neuroimaging and lesion-symptom mapping investigations implicate a left frontal-temporal-parietal network for sentence processing. The majority of studies have focused on sentence comprehension, with fewer in the domain of sentence production, which have not fully elucidated overlapping and/or unique brain structures associated with the two domains, particularly for sentences with noncanonical word order. Using voxel-based lesion symptom mapping (VLSM) we examined the relationship between lesions within the left hemisphere language network and both sentence comprehension and production of simple and complex syntactic structures in 76 participants with chronic stroke-induced aphasia. Results revealed shared regions across domains in the anterior and posterior superior temporal gyri (aSTG, pSTG), and the temporal pole (adjusted for verb production/comprehension). Additionally, comprehension was associated with lesions in the anterior and posterior middle temporal gyri (aMTG, pMTG), the MTG temporooccipital regions, SMG/AG, central and parietal operculum, and the insula. Subsequent VLSM analyses (production versus comprehension) revealed critical regions associated with each domain: anterior temporal lesions were associated with production; posterior temporo-parietal lesions were associated with comprehension, implicating important roles for regions within the ventral and dorsal stream processing routes, respectively. Processing of syntactically complex, noncanonical (adjusted for canonical), sentences was associated with damage to the pSTG across domains, with additional damage to the pMTG and IPL associated with impaired sentence comprehension, suggesting that the pSTG is crucial for computing noncanonical sentences across domains and that the pMTG, and IPL are necessary for re-analysis of thematic roles as required for resolution of long-distance dependencies. These findings converge with previous studies and extend our knowledge of the neural mechanisms of sentence comprehension to production, highlighting critical regions associated with both domains, and further address the mechanism engaged for syntactic computation, controlled for the contribution of verb processing.

Project description:The present pilot study investigated potential effects of early and late child bilingualism in highly proficient adult bilinguals. It has been shown that some early second language (eL2) speakers stagnate when it comes to complex linguistic phenomena and that they display subtle difficulties in adulthood. Therefore, we have chosen the complex structure of double object constructions. We investigate the long-term achievement in a combined-method approach using elicited production, explicit comprehension by sentence-picture matching and a measure of implicit linguistic knowledge, namely pupillometry. This eye tracking method is suitable for measuring implicit reactions of the pupils to unexpected or ungrammatical stimuli. For production, ditransitive structures were elicited by means of a game. For comprehension, a sentence-picture matching task was conducted. Two pictures were shown on a monitor that were equal with respect to the involved objects, but the thematic roles of direct and indirect objects were interchanged. Items were controlled for length, gender, animacy, semantic likelihood and word order. Reaction times and accuracy scores were analyzed. To this end, N = 18 bilingual adult speakers of German (+ another language, mean age: 26.5) with different ages of onset participated in this study and were compared to N = 26 monolingual German adult speakers (mean age 23.9). All participants had a proficiency of German above 89% correct in placement and cloze tests. Results show fully comparable productive and comprehensive competencies in monolinguals and bilinguals including the reaction times in the sentence-picture matching task and a word order effect on the reaction times in both groups. In the pupillometry task, we found monolinguals and bilinguals to be sensitive to differing conditions with respect to grammatical and ungrammatical utterances. However, we find between group differences in pupil dilations in that bilinguals react differently to strong grammatical violations than monolinguals. These results are discussed with respect to the term of native speaker competence and the variation within both groups.

Dataset Information

Common Neural System for Sentence and Picture Comprehension Across Languages: A Chinese-Japanese Bilingual Study.

Publications

Common Neural System for Sentence and Picture Comprehension Across Languages: A Chinese-Japanese Bilingual Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets