The development of dynamic perceptual simulations during sentence comprehension.
Ontology highlight
ABSTRACT:
SUBMITTER: Hauf JEK
PROVIDER: S-EPMC8354901 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Language comprehension requires recovering meaning from linguistic form, even when the mapping between the two is indirect. A canonical example is ellipsis, the omission of information that is subsequently understood without being overtly pronounced. Comprehension of ellipsis requires retrieval of an antecedent from memory, without prior prediction, a property which enables the study of retrieval in situ (Martin & McElree, 2008, 2009). Sluicing, or inflectional phrase ellipsis, in the presence of a conjunction, presents a test case where a competing antecedent position is syntactically licensed, in contrast with most cases of nonadjacent dependency, including verb phrase ellipsis. We present speed-accuracy tradeoff and eye-movement data inconsistent with the hypothesis that retrieval is accomplished via a syntactically guided search, a particular variant of search not examined in past research. The observed timecourse profiles are consistent with the hypothesis that antecedents are retrieved via a cue-dependent direct-access mechanism susceptible to general memory variables.
| S-EPMC3093705 | biostudies-literature
Project description:Language processing requires us to integrate incoming linguistic representations with representations of past input, often across intervening words and phrases. This computational situation has been argued to require retrieval of the appropriate representations from memory via a set of features or representations serving as retrieval cues. However, even within in a cue-based retrieval account of language comprehension, both the structure of retrieval cues and the particular computation that underlies direct-access retrieval are still underspecified. Evidence from two event-related brain potential (ERP) experiments that show cue-based interference from different types of linguistic representations during ellipsis comprehension are consistent with an architecture wherein different cue types are integrated, and where the interaction of cue with the recent contents of memory determines processing outcome, including expression of the interference effect in ERP componentry. I conclude that retrieval likely includes a computation where cues are integrated with the contents of memory via a linear weighting scheme, and I propose vector addition as a candidate formalization of this computation. I attempt to account for these effects and other related phenomena within a broader cue-based framework of language processing.
| S-EPMC6264514 | biostudies-literature
Project description:Understanding spoken language requires analysis of the rapidly unfolding speech signal at multiple levels: acoustic, phonological, and semantic. However, there is not yet a comprehensive picture of how these levels relate. We recorded electroencephalography (EEG) while listeners (N = 31) heard sentences in which we manipulated acoustic ambiguity (e.g., a bees/peas continuum) and sentential expectations (e.g., Honey is made by bees). EEG was analyzed with a mixed effects model over time to quantify how language processing cascades proceed on a millisecond-by-millisecond basis. Our results indicate: (1) perceptual processing and memory for fine-grained acoustics is preserved in brain activity for up to 900 msec; (2) contextual analysis begins early and is graded with respect to the acoustic signal; and (3) top-down predictions influence perceptual processing in some cases, however, these predictions are available simultaneously with the veridical signal. These mechanistic insights provide a basis for a better understanding of the cortical language network.
| S-EPMC7682806 | biostudies-literature
Project description:Much research in cognitive neuroscience supports prediction as a canonical computation of cognition across domains. Is such predictive coding implemented by feedback from higher-order domain-general circuits, or is it locally implemented in domain-specific circuits? What information sources are used to generate these predictions? This study addresses these two questions in the context of language processing. We present fMRI evidence from a naturalistic comprehension paradigm (1) that predictive coding in the brain's response to language is domain-specific, and (2) that these predictions are sensitive both to local word co-occurrence patterns and to hierarchical structure. Using a recently developed continuous-time deconvolutional regression technique that supports data-driven hemodynamic response function discovery from continuous BOLD signal fluctuations in response to naturalistic stimuli, we found effects of prediction measures in the language network but not in the domain-general multiple-demand network, which supports executive control processes and has been previously implicated in language comprehension. Moreover, within the language network, surface-level and structural prediction effects were separable. The predictability effects in the language network were substantial, with the model capturing over 37% of explainable variance on held-out data. These findings indicate that human sentence processing mechanisms generate predictions about upcoming words using cognitive processes that are sensitive to hierarchical structure and specialized for language processing, rather than via feedback from high-level executive control mechanisms.
| S-EPMC7140726 | biostudies-literature
Project description:Previous studies have shown that brain regions for mentalizing, including temporoparietal junction (TPJ) and medial prefrontal cortex (mPFC), are activated in understanding the nonliteral meaning of sentences. A different set of brain regions, including left inferior frontal gyrus (IFG), is activated for dealing with pragmatic incongruence. Here we demonstrate that individuals' cognitive empathic ability modulates the brain activity underlying the processing of pragmatic constraints during sentence comprehension. The lian … dou … construction in Chinese (similar to English even) normally describes an event of low expectedness; it also introduces a pragmatic scale against which the likelihood of an underspecified event can be inferred. By embedding neutral or highly likely events in the construction, we created underspecified and incongruent sentences and compared both with control sentences in which events of low expectedness were described. Imaging results showed that (i) left TPJ was activated for the underspecified sentences, and the activity in mPFC correlated with individuals' fantasizing ability and (ii) anterior cingulate cortex (ACC) was activated for the incongruent sentences, and the activity in bilateral IFG correlated with individuals' perspective taking ability. These findings suggest that brain activations in making pragmatic inference and in dealing with pragmatic failure are modulated by different components of cognitive empathy.
| S-EPMC4127016 | biostudies-literature
Project description:Current psycholinguistic research generally acknowledges that aspects of sentence comprehension benefit from neural preactivation of different types of information. However, despite strong support from a number of studies, routine specific word form preactivation has been challenged by Ito, Corley, Pickering, Martin, and Nieuwland (2016). They suggest that word form prediction is contingent upon having enough processing time and resources (afforded by slower input rates) to progress through unidirectional, productionlike stages of comprehension to arrive at word forms via semantic feature preactivation. This conclusion is based on findings from their ERP study, which used a related anomaly paradigm and reported form preactivation at a slow (700 ms) word presentation rate but not a faster one (500 ms). The present experimental design is a conceptual replication of Ito et al. (2016), testing young adults by measuring ERP amplitudes to unpredictable words related either semantically/associatively or orthographically to predictable sentence continuations, relative to unrelated continuations. Results showed that, at a visual presentation rate of two words per second, both types of related words show similarly reduced N400s, as well as varying degrees of increased posterior post-N400 positivity. These findings indicate that word form preactivation during sentence comprehension is detectable along a similar time course as semantic feature preactivation, and such processing does not necessarily require additional time beyond that afforded by near-normal reading rates.
| S-EPMC6402973 | biostudies-literature
Project description:This study investigated the interaction of prosody and thematic fit/plausibility information during the processing of sentences containing temporary early closure (correct) or late closure (incorrect) syntactic ambiguities using event-related potentials (ERPs). Early closure sentences with congruent and incongruent prosody were presented where the temporarily ambiguous NP was either a plausible or an implausible continuation for the subordinate verb (e.g. "While the band played the song/beer pleased all the customers."). N400 and P600 components were examined at critical points in each condition. The CPS was examined in sentences with congruent prosody. Prosodic and thematic fit cues interacted immediately (N400-P600) at the implausible NP (beer), when it was paired with incongruent prosody. Incongruent prosody paired with a plausible NP (song) resulted in garden-path effects (N400-P600) at the critical verb (pleased). These findings provide strong evidence that prosodic and thematic fit/plausibility cues interact to aid the parser in syntactic structure building.
| S-EPMC5997268 | biostudies-literature
Project description:The present study investigates how sequential coherence in sentence pairs (events in sequence vs. unrelated events) affects the perceived ability to form a mental image of the sentences for both auditory and visual presentations. In addition, we investigated how the ease of event imagery affected online comprehension (word reading times) in the case of sequentially coherent and incoherent sentence pairs. Two groups of comprehenders were identified based on their self-reported ability to form vivid mental images of described events. Imageability ratings were higher and faster for pairs of sentences that described events in coherent sequences rather than non-sequential events, especially for high imagers. Furthermore, reading times on individual words suggested different comprehension patterns with respect to sequence coherence for the two groups of imagers, with high imagers activating richer mental images earlier than low imagers. The present results offer a novel link between research on imagery and discourse coherence, with specific contributions to our understanding of comprehension patterns for high and low imagers.
| S-EPMC4575052 | biostudies-literature
Project description:Since Saussure, the relationship between the sound and the meaning of words has been regarded as largely arbitrary. Here, however, we show that a probabilistic relationship exists between the sound of a word and its lexical category. Corpus analyses of nouns and verbs indicate that the phonological properties of the individual words in these two lexical categories form relatively separate and coherent clusters, with some nouns sounding more typical of the noun category than others and likewise for verbs. Additional analyses reveal that the phonological properties of nouns and verbs affect lexical access, and we also demonstrate the influence of such properties during the on-line processing of both simple unambiguous and syntactically ambiguous sentences. Thus, although the sound of a word may not provide cues to its specific meaning, phonological typicality, the degree to which the sound properties of an individual word are typical of other words in its lexical category, affects both word- and sentence-level language processing. The findings are consistent with a perspective on language comprehension in which sensitivity to multiple syntactic constraints in adulthood emerges as a product of language-development processes that are driven by the integration of multiple cues to linguistic structure, including phonological typicality.
| S-EPMC1567719 | biostudies-other
Project description:Motion events in language describe the movement of an entity to another location along a path. In 2 eye-tracking experiments, we found that comprehension of motion events involves the online construction of a spatial mental model that integrates language with the visual world. In Experiment 1, participants listened to sentences describing the movement of an agent to a goal while viewing visual scenes depicting the agent, goal, and empty space in between. Crucially, verbs suggested either upward (e.g., jump) or downward (e.g., crawl) paths. We found that in the rare event of fixating the empty space between the agent and goal, visual attention was biased upward or downward in line with the verb. In Experiment 2, visual scenes depicted a central obstruction, which imposed further constraints on the paths and increased the likelihood of fixating the empty space between the agent and goal. The results from this experiment corroborated and refined the previous findings. Specifically, eye-movement effects started immediately after hearing the verb and were in line with data from an additional mouse-tracking task that encouraged a more explicit spatial reenactment of the motion event. In revealing how event comprehension operates in the visual world, these findings suggest a mental simulation process whereby spatial details of motion events are mapped onto the world through visual attention. The strength and detectability of such effects in overt eye-movements is constrained by the visual world and the fact that perceivers rarely fixate regions of empty space. (PsycINFO Database Record
| S-EPMC4849431 | biostudies-other