Language processing with dynamic fields.
Ontology highlight
ABSTRACT:
SUBMITTER: Beim Graben P
PROVIDER: S-EPMC2427059 | biostudies-literature | 2008 Jun
REPOSITORIES: biostudies-literature
Publications
Language processing with dynamic fields.
Beim Graben Peter P Pinotsis Dimitris D Saddy Douglas D Potthast Roland R
Cognitive neurodynamics 20080531 2
We construct a mapping from complex recursive linguistic data structures to spherical wave functions using Smolensky's filler/role bindings and tensor product representations. Syntactic language processing is then described by the transient evolution of these spherical patterns whose amplitudes are governed by nonlinear order parameter equations. Implications of the model in terms of brain wave dynamics are indicated. ...[more]
Similar Datasets
Project description:Understanding spoken language requires analysis of the rapidly unfolding speech signal at multiple levels: acoustic, phonological, and semantic. However, there is not yet a comprehensive picture of how these levels relate. We recorded electroencephalography (EEG) while listeners (N = 31) heard sentences in which we manipulated acoustic ambiguity (e.g., a bees/peas continuum) and sentential expectations (e.g., Honey is made by bees). EEG was analyzed with a mixed effects model over time to quantify how language processing cascades proceed on a millisecond-by-millisecond basis. Our results indicate: (1) perceptual processing and memory for fine-grained acoustics is preserved in brain activity for up to 900 msec; (2) contextual analysis begins early and is graded with respect to the acoustic signal; and (3) top-down predictions influence perceptual processing in some cases, however, these predictions are available simultaneously with the veridical signal. These mechanistic insights provide a basis for a better understanding of the cortical language network.
| S-EPMC7682806 | biostudies-literature
Project description:The relation between the timing of language input and development of neural organization for language processing in adulthood has been difficult to tease apart because language is ubiquitous in the environment of nearly all infants. However, within the congenitally deaf population are individuals who do not experience language until after early childhood. Here, we investigated the neural underpinnings of American Sign Language (ASL) in 2 adolescents who had no sustained language input until they were approximately 14 years old. Using anatomically constrained magnetoencephalography, we found that recently learned signed words mainly activated right superior parietal, anterior occipital, and dorsolateral prefrontal areas in these 2 individuals. This spatiotemporal activity pattern was significantly different from the left fronto-temporal pattern observed in young deaf adults who acquired ASL from birth, and from that of hearing young adults learning ASL as a second language for a similar length of time as the cases. These results provide direct evidence that the timing of language experience over human development affects the organization of neural language processing.
| S-EPMC4153811 | biostudies-literature
Project description:There are increasing applications of natural language processing techniques for information retrieval, indexing, topic modelling and text classification in engineering contexts. A standard component of such tasks is the removal of stopwords, which are uninformative components of the data. While researchers use readily available stopwords lists that are derived from non-technical resources, the technical jargon of engineering fields contains their own highly frequent and uninformative words and there exists no standard stopwords list for technical language processing applications. Here we address this gap by rigorously identifying generic, insignificant, uninformative stopwords in engineering texts beyond the stopwords in general texts, based on the synthesis of alternative statistical measures such as term frequency, inverse document frequency, and entropy, and curating a stopwords dataset ready for technical language processing applications.
| S-EPMC8341615 | biostudies-literature
Project description:Language comprehension is shaped by world knowledge. After hearing about "a farm animal," meanings of typical ("cow") versus atypical exemplars ("ox") are more accessible, as evidenced by N400 responses. Moreover, atypical exemplars elicit a larger post-N400 frontal positivity than typical and incongruous ("ivy") exemplars, indexing the integration of unexpected information. Do listeners adapt this category knowledge to specific talkers? We first replicated typicality effects in the auditory modality. Then, we extended the design to a two-talker context: talkers alternated cueing (Bob: "Susan, name a farm animal") and answering (Susan: "cow"). Critically, participants first heard interviews in which one talker revealed strong associations with atypical exemplars (Susan works on an ox farm). We observed increased frontal positivity to a typical exemplar ("cow") said by Susan compared to Bob, indicating participants appreciated that the typical exemplar was atypical for Susan. These results suggest that comprehenders can tailor their expectations to the talker.
| S-EPMC7943179 | biostudies-literature
Project description:One of the main characteristics of human languages is that they are subject to fundamental changes over time. However, because of the long transitional periods involved, the internal dynamics of such changes are typically inaccessible. Here, we present a new approach to examining language change via its connection to language comprehension. By means of an EEG experiment on Icelandic, a prominent current example of a language in transition, we show that the neurophysiological responses of native speakers already reflect projected changes that are not yet apparent in their overt behavior. Neurocognitive measures thus offer a means of predicting, rather than only retracing, language change.
| S-EPMC6978737 | biostudies-literature
Project description:One key question in neurolinguistics is the extent to which the neural processing system for language requires linguistic experience during early life to develop fully. We conducted a longitudinal anatomically constrained magnetoencephalography (aMEG) analysis of lexico-semantic processing in 2 deaf adolescents who had no sustained language input until 14 years of age, when they became fully immersed in American Sign Language. After 2 to 3 years of language, the adolescents' neural responses to signed words were highly atypical, localizing mainly to right dorsal frontoparietal regions and often responding more strongly to semantically primed words (Ferjan Ramirez N, Leonard MK, Torres C, Hatrak M, Halgren E, Mayberry RI. 2014. Neural language processing in adolescent first-language learners. Cereb Cortex. 24 (10): 2772-2783). Here, we show that after an additional 15 months of language experience, the adolescents' neural responses remained atypical in terms of polarity. While their responses to less familiar signed words still showed atypical localization patterns, the localization of responses to highly familiar signed words became more concentrated in the left perisylvian language network. Our findings suggest that the timing of language experience affects the organization of neural language processing; however, even in adolescence, language representation in the human brain continues to evolve with experience.
| S-EPMC4737603 | biostudies-literature
Project description:Lexical access in bilinguals has been considered either selective or non-selective and evidence exists in favor of both hypotheses. We conducted a linguistic experiment to assess whether a bilingual's language mode influences the processing of first language information. We recorded event related potentials during a semantic priming paradigm with a covert manipulation of the second language (L2) using two types of stimulus presentations (short and long). We observed a significant facilitation of word pairs related in L2 in the short version reflected by a decrease in N400 amplitude in response to target words related to the English meaning of an inter-lingual homograph (homograph-unrelated group). This was absent in the long version, as the N400 amplitude for this group was similar to the one for the control-unrelated group. We also interviewed the participants whether they were aware of the importance of L2 in the experiment. We conclude that subjects participating in the long and short versions were in different language modes: closer to monolingual mode for the long and closer to bilingual mode for the short version; and that awareness about covert manipulation of L2 can influence the language mode, which in its turn influences the processing of the first language.
| S-EPMC5125703 | biostudies-literature
Project description:Departing from traditional linguistic models, advances in deep learning have resulted in a new type of predictive (autoregressive) deep language models (DLMs). Using a self-supervised next-word prediction task, these models generate appropriate linguistic responses in a given context. In the current study, nine participants listened to a 30-min podcast while their brain responses were recorded using electrocorticography (ECoG). We provide empirical evidence that the human brain and autoregressive DLMs share three fundamental computational principles as they process the same natural narrative: (1) both are engaged in continuous next-word prediction before word onset; (2) both match their pre-onset predictions to the incoming word to calculate post-onset surprise; (3) both rely on contextual embeddings to represent words in natural contexts. Together, our findings suggest that autoregressive DLMs provide a new and biologically feasible computational framework for studying the neural basis of language.
| S-EPMC8904253 | biostudies-literature
Project description:Frontal and temporal language areas involved in syntactic processing are connected by several dorsal and ventral tracts, but the functional roles of the different tracts are not well understood. To identify which white matter tract(s) are important for syntactic processing, we examined the relationship between white matter damage and syntactic deficits in patients with primary progressive aphasia, using multimodal neuroimaging and neurolinguistic assessment. Diffusion tensor imaging showed that microstructural damage to left hemisphere dorsal tracts--the superior longitudinal fasciculus including its arcuate component--was strongly associated with deficits in comprehension and production of syntax. Damage to these dorsal tracts predicted syntactic deficits after gray matter atrophy was taken into account, and fMRI confirmed that these tracts connect regions modulated by syntactic processing. In contrast, damage to ventral tracts--the extreme capsule fiber system or the uncinate fasciculus--was not associated with syntactic deficits. Our findings show that syntactic processing depends primarily on dorsal language tracts.
| S-EPMC3201770 | biostudies-literature
Project description:Lifestyle modification, including diet, exercise, and tobacco cessation, is the first-line treatment of many disorders including hypertension, obesity, and diabetes. Lifestyle modification data are not easily retrieved or used in research due to their textual nature. This study addresses this knowledge gap using natural language processing to automatically identify lifestyle modification documentation from electronic health records. Electronic health record notes from hypertension patients were analyzed using an open-source natural language processing tool to retrieve assessment and advice regarding lifestyle modification. These data were classified as lifestyle modification assessment or advice and mapped to a coded standard ontology. Combined lifestyle modification (advice and assessment) recall was 99.27 percent, precision 94.44 percent, and correct classification 88.15 percent. Through extraction and transformation of narrative lifestyle modification data to coded data, this critical information can be used in research, metric development, and quality improvement efforts regarding care delivery for multiple medical conditions that benefit from lifestyle modification.
| S-EPMC6722039 | biostudies-literature