Tracking Colisteners' Knowledge States During Language Comprehension.
Ontology highlight
ABSTRACT:
SUBMITTER: Jouravlev O
PROVIDER: S-EPMC6344950 | biostudies-literature | 2019 Jan
REPOSITORIES: biostudies-literature
Publications
Tracking Colisteners' Knowledge States During Language Comprehension.
Jouravlev Olessia O Schwartz Rachael R Ayyash Dima D Mineroff Zachary Z Gibson Edward E Fedorenko Evelina E
Psychological science 20181116 1
When we receive information in the presence of other people, are we sensitive to what they do or do not understand? In two event-related-potential experiments, participants read implausible sentences (e.g., "The girl had a little beak") in contexts that rendered them plausible (e.g., "The girl dressed up as a canary for Halloween"). No semantic-processing difficulty (no N400 effect) ensued when they read the sentences while alone in the room. However, when a confederate was present who did not r ...[more]
Similar Datasets
Project description:Spatial terms such as "above", "in front of", and "on the left of" are all essential for describing the location of one object relative to another object in everyday communication. Apprehending such spatial relations involves relating linguistic to object representations by means of attention. This requires at least one attentional shift, and models such as the Attentional Vector Sum (AVS) predict the direction of that attention shift, from the sausage to the box for spatial utterances such as "The box is above the sausage". To the extent that this prediction generalizes to overt gaze shifts, a listener's visual attention should shift from the sausage to the box. However, listeners tend to rapidly look at referents in their order of mention and even anticipate them based on linguistic cues, a behavior that predicts a converse attentional shift from the box to the sausage. Four eye-tracking experiments assessed the role of overt attention in spatial language comprehension by examining to which extent visual attention is guided by words in the utterance and to which extent it also shifts "against the grain" of the unfolding sentence. The outcome suggests that comprehenders' visual attention is predominantly guided by their interpretation of the spatial description. Visual shifts against the grain occurred only when comprehenders had some extra time, and their absence did not affect comprehension accuracy. However, the timing of this reverse gaze shift on a trial correlated with that trial's verification time. Thus, while the timing of these gaze shifts is subtly related to the verification time, their presence is not necessary for successful verification of spatial relations.
| S-EPMC4301815 | biostudies-literature
Project description:Second language learners tend to focus more on learning the meaning of vocabulary than on how to use it in their speech and writing. Although comprehensive vocabulary knowledge is necessary for understanding sentences, productive vocabulary knowledge may also have a positive impact on sentence comprehension. Most studies examining the relationship between production and comprehension have compared these abilities between participants or evaluated unrelated criteria between tasks, which may be insufficient for examining the direct effects of productive knowledge on sentence comprehension. Our study investigates changes in sentence comprehension speed during listening, and we used a within-subjects comparison to examine the effect of productive vocabulary knowledge or the lack thereof. We applied generalized linear mixed models to investigate productive vocabulary knowledge effects by partialing out other influential factors, such as confidence, frequency of target words, stimulus duration, and individual differences. The results showed that the sentences with a producible phrase were processed faster than the sentences that included phrases with only comprehensive knowledge or no comprehension. The effect of productive vocabulary knowledge on the speed of sentence comprehension was directly examined with a within-subject comparison, and its contribution was clearly found. This study emphasizes the value of productive vocabulary knowledge acquisition in enhancing the speed of sentence comprehension.
| S-EPMC10140509 | biostudies-literature
Project description:Facial electromyography research shows that corrugator supercilii ("frowning muscle") activity tracks the emotional valence of linguistic stimuli. Grounded or embodied accounts of language processing take such activity to reflect the simulation or "re-enactment" of emotion, as part of the retrieval of word meaning (e.g., of "furious") and/or of building a situation model (e.g., for "Mark is furious"). However, the same muscle also expresses our primary emotional evaluation of things we encounter. Language-driven affective simulation can easily be at odds with the reader's affective evaluation of what language describes (e.g., when we like Mark being furious). In a previous experiment ('t Hart et al., 2018) we demonstrated that neither language-driven simulation nor affective evaluation alone seem sufficient to explain the corrugator patterns that emerge during online language comprehension in these complex cases. Those results showed support for a multiple-drivers account of corrugator activity, where both simulation and evaluation processes contribute to the activation patterns observed in the corrugator. The study at hand replicates and extends these findings. With more refined control over when precisely affective information became available in a narrative, we again find results that speak against an interpretation of corrugator activity in terms of simulation or evaluation alone, and as such support the multiple-drivers account. Additional evidence suggests that the simulation driver involved reflects simulation at the level of situation model construction, rather than at the level of retrieving concepts from long-term memory. In all, by giving insights into how language-driven simulation meshes with the reader's evaluative responses during an unfolding narrative, this study contributes to the understanding of affective language comprehension.
| S-EPMC6398452 | biostudies-literature
Project description:Linguistic phrases are tracked in sentences even though there is no one-to-one acoustic phrase marker in the physical signal. This phenomenon suggests an automatic tracking of abstract linguistic structure that is endogenously generated by the brain. However, all studies investigating linguistic tracking compare conditions where either relevant information at linguistic timescales is available, or where this information is absent altogether (e.g., sentences versus word lists during passive listening). It is therefore unclear whether tracking at phrasal timescales is related to the content of language, or rather, results as a consequence of attending to the timescales that happen to match behaviourally relevant information. To investigate this question, we presented participants with sentences and word lists while recording their brain activity with magnetoencephalography (MEG). Participants performed passive, syllable, word, and word-combination tasks corresponding to attending to four different rates: one they would naturally attend to, syllable-rates, word-rates, and phrasal-rates, respectively. We replicated overall findings of stronger phrasal-rate tracking measured with mutual information for sentences compared to word lists across the classical language network. However, in the inferior frontal gyrus (IFG) we found a task effect suggesting stronger phrasal-rate tracking during the word-combination task independent of the presence of linguistic structure, as well as stronger delta-band connectivity during this task. These results suggest that extracting linguistic information at phrasal rates occurs automatically with or without the presence of an additional task, but also that IFG might be important for temporal integration across various perceptual domains.
| S-EPMC9282854 | biostudies-literature
Project description:Many studies have shown that mental simulation may occur during language comprehension. Supporting evidence is derived from the matching effects in the sentence-picture verification (SPV) task often used to assess mental simulations of object properties, such as size, orientation, and shape. However, mixed results have been obtained regarding object colour, with researchers reporting matching or mismatching effects. This study investigated the impact of colour information clarity within sentences on the process of mental simulation during language comprehension. Employing the SPV task and using novel objects, we examined whether there is a mental simulation of colour after excluding typical/atypical colour bias and how varying levels of colour information clarity in sentences influence the emergence of matching effects at different stages of comprehension. To address these issues, we conducted two experiments. In Experiment 1, the participants read normal sentences and subsequently engaged in picture verification with a novel object after a 500 ms delay. In Experiment 2, the participants encountered sentences containing both clear and unclear colour information and, after either a 0 ms or 1500 ms interval, completed picture verification tasks with a novel object. Null effects were found in the 500 ms condition for normal sentences and the 0 ms condition for unclear colour information sentences. A mismatching effect appeared in the 0 ms condition after clear colour information sentences, and a matching effect appeared in the 1500 ms condition for all sentences. The results indicated that after excluding colour bias, the participants still formed mental simulations of colour during language comprehension. Our results also indicated that ongoing colour simulation with time pressure impacted the participant responses. The participants ignored unclear colour information under time pressure, but without time pressure, they constructed simulations that were as detailed as possible, regardless of whether the implicit colour information in the sentence was clear.
| S-EPMC11541384 | biostudies-literature
Project description:Bilinguals learn to resolve conflict between their two languages and that skill has been hypothesized to create long-term adaptive changes in cognitive functioning. Yet, little is known about how bilinguals recruit cognitive control to enable efficient use of one of their languages, especially in the less skilled and more effortful second language (L2). Here we examined how real-time cognitive control engagement influences L2 sentence comprehension (i.e., conflict adaptation). We tested a group of English monolinguals and a group of L2 English speakers using a recently-developed cross-task adaptation paradigm. Stroop sequences were pseudo-randomly interleaved with a visual-world paradigm in which participants were asked to carry out spoken instructions that were either syntactically ambiguous or unambiguous. Consistent with previous research, eye-movement results showed that Stroop-related conflict improved the ability to engage correct-goal interpretations, and disengage incorrect-goal interpretations, during ambiguous instructions. Such cognitive-to-language modulations were similar in both groups, but only in the engagement piece. In the disengagement portion, the modulation emerged earlier in bilinguals than in monolinguals, suggesting group differences in attentional disengagement following cognitive control recruitment. Additionally, incorrect-goal eye-movements were modulated by individual differences in working memory, although differently for each group, suggesting an involvement of both language-specific and domain-general resources.
| S-EPMC6562798 | biostudies-literature
Project description:The relationship between the evoked responses (ERPs/ERFs) and the event-related changes in EEG/MEG power that can be observed during sentence-level language comprehension is as yet unclear. This study addresses a possible relationship between MEG power changes and the N400m component of the event-related field. Whole-head MEG was recorded while subjects listened to spoken sentences with incongruent (IC) or congruent (C) sentence endings. A clear N400m was observed over the left hemisphere, and was larger for the IC sentences than for the C sentences. A time-frequency analysis of power revealed a decrease in alpha and beta power over the left hemisphere in roughly the same time range as the N400m for the IC relative to the C condition. A linear regression analysis revealed a positive linear relationship between N400m and beta power for the IC condition, not for the C condition. No such linear relation was found between N400m and alpha power for either condition. The sources of the beta decrease were estimated in the LIFG, a region known to be involved in semantic unification operations. One source of the N400m was estimated in the left superior temporal region, which has been related to lexical retrieval. We interpret our data within a framework in which beta oscillations are inversely related to the engagement of task-relevant brain networks. The source reconstructions of the beta power suppression and the N400m effect support the notion of a dynamic communication between the LIFG and the left superior temporal region during language comprehension.
| S-EPMC6870343 | biostudies-literature
Project description:Understanding spoken language requires transforming ambiguous acoustic streams into a hierarchy of representations, from phonemes to meaning. It has been suggested that the brain uses prediction to guide the interpretation of incoming input. However, the role of prediction in language processing remains disputed, with disagreement about both the ubiquity and representational nature of predictions. Here, we address both issues by analyzing brain recordings of participants listening to audiobooks, and using a deep neural network (GPT-2) to precisely quantify contextual predictions. First, we establish that brain responses to words are modulated by ubiquitous predictions. Next, we disentangle model-based predictions into distinct dimensions, revealing dissociable neural signatures of predictions about syntactic category (parts of speech), phonemes, and semantics. Finally, we show that high-level (word) predictions inform low-level (phoneme) predictions, supporting hierarchical predictive processing. Together, these results underscore the ubiquity of prediction in language processing, showing that the brain spontaneously predicts upcoming language at multiple levels of abstraction.
| S-EPMC9371745 | biostudies-literature
Project description:Using functional magnetic resonance imaging (fMRI), we identified cortical regions mediating interpretive processes that take place during language comprehension. We manipulated participants' interpretation of texts by asking them to focus on action-, space-, or time-related features while listening to identical short stories. We identify several cortical regions where activity varied significantly in response to this attention manipulation, even though the content being processed was exactly the same. Activity in the posterior and anterior sections of the left inferior frontal gyrus (IFG), which are thought to have different sensitivities to high-level language processing, was modulated by the listeners' attentional focus, but in ways that were quite different. The posterior left IFG (Pars Opercularis) showed different activity levels for the three conditions. However, a population coding analysis demonstrated similar distributions of activity across conditions. This suggests that while the gain of the response in the Pars Opercularis was modulated, its core organization was relatively invariant across the experimental conditions. In the anterior left IFG (Pars Triangularis), the analysis of population codes revealed different activity patterns between conditions: there was little similarity between activity during time-attention and action- and space-attention, however there were similar activity patterns while attending to space and action information. In addition, both the left superior temporal gyrus and sulcus showed greater activity in the space and action attention conditions when contrasted with time attention. We discuss these findings in light of work on the role of left IFG in processing semantic information in language, and in light of theories suggesting that temporal information in language is processed in the brain using similar mechanisms as spatial information. Our findings suggest that a substantial source of variance in neural activity during language comprehension emerges from the internally-driven, information-seeking preferences of listeners rather than the syntactic or semantic properties of a text.
| S-EPMC3049859 | biostudies-literature
Project description:Although we often seem to successfully comprehend language in the face of distraction, few studies have examined the role of sustained attention in critical components of sentence processing, such as integrating information over a sentence and revising predictions when unexpected information is encountered. The current study investigated the impact of attention on sentence processing using a novel dual-task paradigm. Participants read weakly and strongly constraining sentences with expected or unexpected endings while also tracking the motion of dots in the background, and their EEG was recorded. Under full attention, the amplitude of the N400 component of the ERP, a measure of semantic access, was reduced (facilitated) in a graded fashion by contextual strength and fit. This context-based facilitation was attenuated when attention was divided, suggesting that sustained attention is important for building up message-level representations. In contrast, the post-N400 frontal positivity that has been observed to prediction violations and associated with revision processes was unaffected by dividing attention. However, under divided attention, participants also elicited posteriorly-distributed effects to these violations. Thus, predictive processes seem to be engaged even when attention is divided, but additional resources may then be required to process unexpected information.
| S-EPMC8491584 | biostudies-literature