Dataset Information

Predictability modulates neurocognitive semantic processing of non-verbal narratives.

ABSTRACT: Predictability is known to modulate semantic processing in language, but it is unclear to what extent this applies for other modalities. Here we ask whether similar cognitive processes are at play in predicting upcoming events in a non-verbal visual narrative. Typically developing adults viewed comics sequences in which a target panel was highly predictable ("high cloze"), less predictable ("low cloze"), or incongruent with the preceding narrative context ("anomalous") during EEG recording. High and low predictable sequences were determined by a pretest where participants assessed "what happened next?", resulting in cloze probability scores for sequence outcomes comparable to those used to measure predictability in sentence processing. Through both factorial and correlational analyses, we show a significant modulation of neural responses by cloze such that N400 effects are diminished as a target panel in a comic sequence becomes more predictable. Predictability thus appears to play a similar role in non-verbal comprehension of sequential images as in language comprehension, providing further evidence for the domain generality of semantic processing in the brain.

SUBMITTER: Coderre EL

PROVIDER: S-EPMC7316725 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Predictability modulates neurocognitive semantic processing of non-verbal narratives.

Coderre Emily L EL O'Donnell Elizabeth E O'Rourke Emme E Cohn Neil N

Scientific reports 20200625 1

Predictability is known to modulate semantic processing in language, but it is unclear to what extent this applies for other modalities. Here we ask whether similar cognitive processes are at play in predicting upcoming events in a non-verbal visual narrative. Typically developing adults viewed comics sequences in which a target panel was highly predictable ("high cloze"), less predictable ("low cloze"), or incongruent with the preceding narrative context ("anomalous") during EEG recording. High ...[more]

PMID: 32587312

Similar Datasets

Project description:Features of ongoing experience are common across individuals and cultures. However, certain people express specific patterns of thought to a greater extent than others. Contemporary psychological theory assumes that individual differences in thought patterns occur because different types of experience depend on the expression of different neurocognitive processes. Consequently, individual variation in the underlying neurocognitive architecture is hypothesised to determine the ease with which certain thought patterns are generated or maintained. Our study (N = 178) tested this hypothesis using multivariate pattern analysis to infer shared variance among measures of cognitive function and neural organisation and examined whether these latent variables explained reports of the patterns of on-going thoughts people experienced in the lab. We found that relatively better performance on tasks relying primarily on semantic knowledge, rather than executive control, was linked to a neural functional organisation associated, via meta-analysis, with task labels related to semantic associations (sentence processing, reading and verbal semantics). Variability of this functional mode predicted significant individual variation in the types of thoughts that individuals experienced in the laboratory: neurocognitive patterns linked to better performance at tasks that required guidance from semantic representation, rather than those dependent on executive control, were associated with patterns of thought characterised by greater subjective detail and a focus on time periods other than the here and now. These relationships were consistent across different days and did not vary with level of task demands, indicating they are relatively stable features of an individual's cognitive profile. Together these data confirm that individual variation in aspects of ongoing experience can be inferred from hidden neurocognitive architecture and demonstrate that performance trade-offs between executive control and long-term semantic knowledge are linked to a person's tendency to imagine situations that transcend the here and now.

Project description:Previous studies have shown that at moderate levels of spectral degradation, semantic predictability facilitates language comprehension. It is argued that when speech is degraded, listeners have narrowed expectations about the sentence endings; i.e., semantic prediction may be limited to only most highly predictable sentence completions. The main objectives of this study were to (i) examine whether listeners form narrowed expectations or whether they form predictions across a wide range of probable sentence endings, (ii) assess whether the facilitatory effect of semantic predictability is modulated by perceptual adaptation to degraded speech, and (iii) use and establish a sensitive metric for the measurement of language comprehension. For this, we created 360 German Subject-Verb-Object sentences that varied in semantic predictability of a sentence-final target word in a graded manner (high, medium, and low) and levels of spectral degradation (1, 4, 6, and 8 channels noise-vocoding). These sentences were presented auditorily to two groups: One group (n =48) performed a listening task in an unpredictable channel context in which the degraded speech levels were randomized, while the other group (n =50) performed the task in a predictable channel context in which the degraded speech levels were blocked. The results showed that at 4 channels noise-vocoding, response accuracy was higher in high-predictability sentences than in the medium-predictability sentences, which in turn was higher than in the low-predictability sentences. This suggests that, in contrast to the narrowed expectations view, comprehension of moderately degraded speech, ranging from low- to high- including medium-predictability sentences, is facilitated in a graded manner; listeners probabilistically preactivate upcoming words from a wide range of semantic space, not limiting only to highly probable sentence endings. Additionally, in both channel contexts, we did not observe learning effects; i.e., response accuracy did not increase over the course of experiment, and response accuracy was higher in the predictable than in the unpredictable channel context. We speculate from these observations that when there is no trial-by-trial variation of the levels of speech degradation, listeners adapt to speech quality at a long timescale; however, when there is a trial-by-trial variation of the high-level semantic feature (e.g., sentence predictability), listeners do not adapt to low-level perceptual property (e.g., speech quality) at a short timescale.

Dataset Information

Predictability modulates neurocognitive semantic processing of non-verbal narratives.

Publications

Predictability modulates neurocognitive semantic processing of non-verbal narratives.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets