Dynamic EEG analysis during language comprehension reveals interactive cascades between perceptual processing and sentential expectations.
Ontology highlight
ABSTRACT:
SUBMITTER: Sarrett ME
PROVIDER: S-EPMC7682806 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Based on an embodied account of language comprehension, this study investigated the dynamic characteristics of children and adults' perceptual simulations during sentence comprehension, using a novel paradigm to assess the perceptual simulation of objects moving up and down a vertical axis. The participants comprised adults (N = 40) and 6-, 8-, and 10-year-old children (N = 116). After listening in experimental trials to sentences implying that objects moved upward or downward, the participants were shown pictures and had to decide as quickly as possible whether the objects depicted had been mentioned in the sentences. The target pictures moved either up or down and then stopped in the middle of the screen. All age groups' reaction times were found to be shorter when the objects moved in the directions that the sentences implied. Age exerted no developmental effect on reaction times. The findings suggest that dynamic perceptual simulations are fundamental to language comprehension in text recipients aged 6 and older.
| S-EPMC8354901 | biostudies-literature
Project description:The dynamic neural processes underlying spoken language comprehension require the real-time integration of general perceptual and specialized linguistic information. We recorded combined electro- and magnetoencephalographic measurements of participants listening to spoken words varying in perceptual and linguistic complexity. Combinatorial linguistic complexity processing was consistently localized to left perisylvian cortices, whereas competition-based perceptual complexity triggered distributed activity over both hemispheres. Functional connectivity showed that linguistically complex words engaged a distributed network of oscillations in the gamma band (20-60 Hz), which only partially overlapped with the network supporting perceptual analysis. Both processes enhanced cross-talk between left temporal regions and bilateral pars orbitalis (BA47). The left-lateralized synchrony between temporal regions and pars opercularis (BA44) was specific to the linguistically complex words, suggesting a specific role of left frontotemporal cross-cortical interactions in morphosyntactic computations. Synchronizations in oscillatory dynamics reveal the transient coupling of functional networks that support specific computational processes in language comprehension.
| S-EPMC4585526 | biostudies-literature
Project description:Natural language provides an intuitive and effective interaction interface between human beings and robots. Currently, multiple approaches are presented to address natural language visual grounding for human-robot interaction. However, most of the existing approaches handle the ambiguity of natural language queries and achieve target objects grounding via dialogue systems, which make the interactions cumbersome and time-consuming. In contrast, we address interactive natural language grounding without auxiliary information. Specifically, we first propose a referring expression comprehension network to ground natural referring expressions. The referring expression comprehension network excavates the visual semantics via a visual semantic-aware network, and exploits the rich linguistic contexts in expressions by a language attention network. Furthermore, we combine the referring expression comprehension network with scene graph parsing to achieve unrestricted and complicated natural language grounding. Finally, we validate the performance of the referring expression comprehension network on three public datasets, and we also evaluate the effectiveness of the interactive natural language grounding architecture by conducting extensive natural language query groundings in different household scenarios.
| S-EPMC7331387 | biostudies-literature
Project description:We construct a mapping from complex recursive linguistic data structures to spherical wave functions using Smolensky's filler/role bindings and tensor product representations. Syntactic language processing is then described by the transient evolution of these spherical patterns whose amplitudes are governed by nonlinear order parameter equations. Implications of the model in terms of brain wave dynamics are indicated.
| S-EPMC2427059 | biostudies-literature
Project description:In two ERP experiments, we asked whether comprehenders used the concessive connective, even so, to predict upcoming events. Participants read coherent and incoherent scenarios, with and without even so, e.g. "Elizabeth had a history exam on Monday. She took the test and aced/failed it. (Even so), she went home and celebrated wildly.", as they rated coherence (Experiment 1) or simply answered intermittent comprehension questions (Experiment 2). The semantic function of even so was used to reverse real-world knowledge predictions, leading to an attenuated N400 to coherent versus incoherent target words ("celebrated"). Moreover, its pragmatic communicative function enhanced predictive processing, leading to more N400 attenuation to coherent targets in scenarios with than without even so. This benefit however, did not come for free: the detection of failed event predictions triggered a later posterior positivity and/or an anterior negativity effect, and costs of maintaining alternative likelihood relations manifest as a sustained negativity effect on sentence-final words.
| S-EPMC4405243 | biostudies-literature
Project description:BackgroundStudies demonstrating the involvement of motor brain structures in language processing typically focus on time windows beyond the latencies of lexical-semantic access. Consequently, such studies remain inconclusive regarding whether motor brain structures are recruited directly in language processing or through post-linguistic conceptual imagery. In the present study, we introduce a grip-force sensor that allows online measurements of language-induced motor activity during sentence listening. We use this tool to investigate whether language-induced motor activity remains constant or is modulated in negative, as opposed to affirmative, linguistic contexts.Methodology/principal findingsParticipants listened to spoken action target words in either affirmative or negative sentences while holding a sensor in a precision grip. The participants were asked to count the sentences containing the name of a country to ensure attention. The grip force signal was recorded continuously. The action words elicited an automatic and significant enhancement of the grip force starting at approximately 300 ms after target word onset in affirmative sentences; however, no comparable grip force modulation was observed when these action words occurred in negative contexts.Conclusions/significanceOur findings demonstrate that this simple experimental paradigm can be used to study the online crosstalk between language and the motor systems in an ecological and economical manner. Our data further confirm that the motor brain structures that can be called upon during action word processing are not mandatorily involved; the crosstalk is asymmetrically governed by the linguistic context and not vice versa.
| S-EPMC3515598 | biostudies-literature
Project description:The gap between domain experts and natural language processing expertise is a barrier to extracting understanding from clinical text. We describe a prototype tool for interactive review and revision of natural language processing models of binary concepts extracted from clinical notes. We evaluated our prototype in a user study involving 9 physicians, who used our tool to build and revise models for 2 colonoscopy quality variables. We report changes in performance relative to the quantity of feedback. Using initial training sets as small as 10 documents, expert review led to final F1scores for the "appendiceal-orifice" variable between 0.78 and 0.91 (with improvements ranging from 13.26% to 29.90%). F1for "biopsy" ranged between 0.88 and 0.94 (-1.52% to 11.74% improvements). The average System Usability Scale score was 70.56. Subjective feedback also suggests possible design improvements.
| S-EPMC6381768 | biostudies-literature
Project description:Speech comprehension involves processing at different levels of analysis, such as acoustic, phonetic, and lexical. We investigated neural responses to manipulating the difficulty of processing at two of these levels. Twelve subjects underwent positron emission tomographic scanning while making decisions based upon the semantic relatedness between heard nouns. We manipulated perceptual difficulty by presenting either clear or acoustically degraded speech, and semantic difficulty by varying the degree of semantic relatedness between words. Increasing perceptual difficulty was associated with greater activation of the left superior temporal gyrus, an auditory-perceptual region involved in speech processing. Increasing semantic difficulty was associated with reduced activity in both superior temporal gyri and increased activity within the left angular gyrus, a heteromodal region involved in accessing word meaning. Comparing across all the conditions, we also observed increased activation within the left inferior prefrontal cortex as the complexity of language processing increased. These results demonstrate a flexible system for language processing, where activity within distinct parts of the network is modulated as processing demands change.
| S-EPMC6870623 | biostudies-literature
Project description:BackgroundSpeech intelligibility and speech comprehension for dysarthric speech has attracted much attention recently. Dysarthria is characterized by irregularities in the speed, strength, pitch, breath control, range, steadiness, and accuracy of muscle movements required for articulatory aspects of speech production.ObjectiveThis study examined the contributions made by other studies involved in dysarthric speech comprehension. We focused on the modes of meaning extraction used in generalizing speaker-listener underpinnings in light of semantic ontology extraction as a desired technique, applied method types, speech representations used, and databases sourced from.MethodsThis study involved a systematic literature review using 7 electronic databases: Cochrane Database of Systematic Reviews, Web of Science Core Collection, Scopus, PubMed, ACM, IEEE Xplore, and Google Scholar. The main eligibility criterion was the extraction of meaning from dysarthric speech using natural language processing or understanding approaches to improve on dysarthric speech comprehension. In total, out of 834 search results, 30 studies that matched the eligibility requirements were acquired following screening by 2 independent reviewers, with a lack of consensus being resolved through joint discussion or consultation with a third party. In order to evaluate the studies' methodological quality, the risk of bias assessment was based on the Cochrane risk-of-bias tool version 2 (RoB2) with 23 of the studies (77%) registering low risk of bias and 7 studies (33%) raising some concern over the risk of bias. The overall quality assessment of the study was done using TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis).ResultsFollowing a review of 30 primary studies, this study revealed that the reviewed studies focused on natural language understanding or clinical approaches, with an increase in proposed solutions from 2020 onwards. Most studies relied on speaker-dependent speech features, while others used speech patterns, semantic knowledge, or hybrid approaches. The prevalent use of vector representation aligned with natural language understanding models, while Mel-frequency cepstral coefficient representation and no representation approaches were applied in neural networks. Hybrid representation studies aimed to reconstruct dysarthric speech or improve comprehension. Comprehensive databases, like TORGO and UA-Speech, were commonly used in combination with other curated databases, while primary data was preferred for specific or unique research objectives.ConclusionsWe found significant gaps in dysarthric speech comprehension characterized by the lack of inclusion of important listener or speech-independent features in the speech representations, mode of extraction, and data sources used. Further research is therefore proposed regarding the formulation of models that accommodate listener and speech-independent features through semantic ontologies that will be useful in the inclusion of key features of listener and speech-independent features for meaning extraction of dysarthric speech.
| S-EPMC10655903 | biostudies-literature
Project description:The two-step process account of negation understanding posits an initial representation of the negated events, followed by a representation of the actual state of events. On the other hand, behavioral and neurophysiological studies provided evidence that linguistic negation suppresses or reduces the activation of the negated events, contributing to shift attention to the actual state of events. However, the specific mechanism of this suppression is poorly known. Recently, based on the brain organization principle of neural reuse (Anderson, 2010), it has been proposed that understanding linguistic negation partially relies upon the neurophysiological mechanisms of response inhibition. Specifically, it was reported that negated action-related sentences modulate EEG signatures of response inhibition (de Vega et al., 2016; Beltrán et al., 2018). In the current EEG study, we ponder whether the reusing of response inhibition processes by negation is constrained to action-related contents or consists of a more general-purpose mechanism. To this end, we employed the same dual-task paradigm as in our prior study-a Go/NoGo task embedded into a sentence comprehension task-but this time including both action and non-action sentences. The results confirmed that the increase of theta power elicited by NoGo trials was modulated by negative sentences, compared to their affirmative counterparts, and this polarity effect was statistically similar for both action- and non-action-related sentences. Thus, a general-purpose inhibitory control mechanism, rather than one specific for action language, is likely operating in the comprehension of sentential negation to produce the transition between alternative representations.
| S-EPMC6694754 | biostudies-literature