Lossy-Context Surprisal: An Information-Theoretic Model of Memory Effects in Sentence Processing.
Ontology highlight
ABSTRACT:
SUBMITTER: Futrell R
PROVIDER: S-EPMC7065005 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectiveChildren with ADHD demonstrate impaired performance on a wide range of neuropsychological tests. It is unclear, however, whether ADHD is associated with many neurocognitive deficits or whether a small number of impairment(s) broadly influence test performance. The current study tests competing model predictions regarding two candidate causal mechanisms in ADHD: information processing speed and working memory.MethodA well-characterized sample of 86 children (Mage = 10.52, SDage = 1.54; 34 girls; 64% Caucasian/Non-Hispanic) with ADHD (n = 45) and without ADHD (n = 41) completed eight fully crossed experimental tasks that systematically manipulated working memory (BF?? = 1.80 × 10?³) and information processing speed (drift rate; BF?? = 7.61 × 10?).ResultsBayesian mixed-model ANOVAs indicated that increasing working memory demands produced significant reductions in information processing speed (drift rate; BF?? = 5.82 × 10??). In contrast, experimentally reducing children's information processing speed did not significantly change their working memory performance (BF?? = 1.31). ADHD status interacted with the working memory manipulation, such that the ADHD and non-ADHD groups showed equivalently high accuracy under the encoding-only conditions (BF?? = 3.45) but differed significantly under high working memory conditions (encoding + recall; BF?? = 19.58). Importantly, however, ADHD status failed to interact with (a) the working memory manipulation to differentially affect information processing speed and (b) the information processing speed manipulation to differentially affect working memory performance (all BF?? > 4.25).ConclusionsThese findings indicate that top-down executive control exerts significant effects on children's ability to quickly process information, but that working memory deficits and slowed information processing speed appear to be relatively independent impairments in ADHD. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
| S-EPMC6987009 | biostudies-literature
Project description:Various structural features of networks have been applied to develop link prediction methods. However, because different features highlight different aspects of network structural properties, it is very difficult to benefit from all of the features that might be available. In this paper, we investigate the role of network topology in predicting missing links from the perspective of information theory. In this way, the contributions of different structural features to link prediction are measured in terms of their values of information. Then, an information-theoretic model is proposed that is applicable to multiple structural features. Furthermore, we design a novel link prediction index, called Neighbor Set Information (NSI), based on the information-theoretic model. According to our experimental results, the NSI index performs well in real-world networks, compared with other typical proximity indices.
| S-EPMC4558573 | biostudies-literature
Project description:Meta-regression can be used to examine the association between effect size estimates and the characteristics of the studies included in a meta-analysis using regression-type methods. By searching for those characteristics (i.e., moderators) that are related to the effect sizes, we seek to identify a model that represents the best approximation to the underlying data generating mechanism. Model selection via testing, either through a series of univariate models or a model including all moderators, is the most commonly used approach for this purpose. Here, we describe alternative model selection methods based on information criteria, multimodel inference, and relative variable importance. We demonstrate their application using an illustrative example and present results from a simulation study to compare the performance of the various model selection methods for identifying the true model across a wide variety of conditions. Whether information-theoretic approaches can also be used not only in combination with maximum likelihood (ML) but also restricted maximum likelihood (REML) estimation was also examined. The results indicate that the conventional methods for model selection may be outperformed by information-theoretic approaches. The latter are more often among the set of best methods across all of the conditions simulated and can have higher probabilities for identifying the true model under particular scenarios. Moreover, their performance based on REML estimation was either very similar to that from ML estimation or at times even better depending on how exactly the REML likelihood was computed. These results suggest that alternative model selection methods should be more widely applied in meta-regression.
| S-EPMC8359854 | biostudies-literature
Project description:We suggest an information-theoretic approach for measuring stylistic coordination in dialogues. The proposed measure has a simple predictive interpretation and can account for various confounding factors through proper conditioning. We revisit some of the previous studies that reported strong signatures of stylistic accommodation, and find that a significant part of the observed coordination can be attributed to a simple confounding effect--length coordination. Specifically, longer utterances tend to be followed by longer responses, which gives rise to spurious correlations in the other stylistic features. We propose a test to distinguish correlations in length due to contextual factors (topic of conversation, user verbosity, etc.) and turn-by-turn coordination. We also suggest a test to identify whether stylistic coordination persists even after accounting for length coordination and contextual factors.
| S-EPMC4483141 | biostudies-literature
Project description:Speakers' memory of sentence structure can persist and modulate the syntactic choices of subsequent utterances (i.e., structural priming). Much research on structural priming posited a multifactorial account by which an implicit learning process and a process related to explicit memory jointly contribute to the priming effect. Here, we tested two predictions from that account: (1) that lexical repetition facilitates the retrieval of sentence structures from memory; (2) that priming is partly driven by a short-term explicit memory mechanism with limited resources. In two pairs of structural priming and sentence structure memory experiments, we examined the effects of structural priming and its modulation by lexical repetition as a function of cognitive load in native Dutch speakers. Cognitive load was manipulated by interspersing the prime and target trials with easy or difficult mathematical problems. Lexical repetition boosted both structural priming (Experiments 1a-2a) and memory for sentence structure (Experiments 1b-2b) and did so with a comparable magnitude. In Experiment 1, there were no load effects, but in Experiment 2, with a stronger manipulation of load, both the priming and memory effects were reduced with a larger cognitive load. The findings support an explicit memory mechanism in structural priming that is cue-dependent and attention-demanding, consistent with a multifactorial account of structural priming.
| S-EPMC7643978 | biostudies-literature
Project description:Sentences are the primary means by which people communicate information. The information conveyed by a sentence depends on how that sentence relates to what is already known. We conducted an fMRI study to determine how the brain establishes and retains this information. We embedded sentences in contexts that rendered them more or less informative and assessed which functional networks were associated with comprehension of these sentences and with memory for their content. We identified two such networks: A frontotemporal network, previously associated with working memory and language processing, showed greater activity when sentences were informative. Independently, greater activity in this network predicted subsequent memory for sentence content. In a separate network, previously associated with resting-state processes and generation of internal thoughts, greater neural activity predicted subsequent memory for informative sentences but also predicted subsequent forgetting for less-informative sentences. These results indicate that in the brain, establishing the information conveyed by a sentence, that is, its contextually based meaning, involves two dissociable networks, both of which are related to processing of sentence meaning and its encoding to memory.
| S-EPMC3405557 | biostudies-literature
Project description:To facilitate analysis and understanding of biological systems, large-scale data are often integrated into models using a variety of mathematical and computational approaches. Such models describe the dynamics of the biological system and can be used to study the changes in the state of the system over time. For many model classes, such as discrete or continuous dynamical systems, there exist appropriate frameworks and tools for analyzing system dynamics. However, the heterogeneous information that encodes and bridges molecular and cellular dynamics, inherent to fine-grained molecular simulation models, presents significant challenges to the study of system dynamics. In this paper, we present an algorithmic information theory based approach for the analysis and interpretation of the dynamics of such executable models of biological systems. We apply a normalized compression distance (NCD) analysis to the state representations of a model that simulates the immune decision making and immune cell behavior. We show that this analysis successfully captures the essential information in the dynamics of the system, which results from a variety of events including proliferation, differentiation, or perturbations such as gene knock-outs. We demonstrate that this approach can be used for the analysis of executable models, regardless of the modeling framework, and for making experimentally quantifiable predictions.
| S-EPMC3602105 | biostudies-literature
Project description:Research with adults and older children indicates that verb biases are strong influences on listeners' interpretations when processing sentences, but they can be overruled. In this paper, we ask two questions: (i) are children with Autism Spectrum Disorder (ASD) who are high functioning sensitive to verb biases like their same age typically developing peers?, and (ii) do young children with ASD and young children with typical development (TD) override strong verb biases to consider alternative interpretations of ambiguous sentences? Participants were aged 5-9 years (mean age 6.65 years): children with ASD who were high functioning and children with TD. In task 1, biasing and neutral verbs were included (e.g., eat cake versus move cake). In task 2, the focus was on whether the prepositional phrase occurring with an instrument biasing verb (e.g., 'Chop the tree with the axe') was interpreted as an instrument even if the named item was an implausible instrument (e.g., candle in 'Cut the cake with the candle'). Overall, the results showed similarities between groups but the ASD group was generally slower. In task 1, both groups looked at the named object faster in the biasing than the non-biasing condition, and in the biasing condition the ASD group looked away from the target more quickly than the TD group. In task 2, both groups identified the target in the prepositional phrase. They were more likely to override the verb instrument bias and consider the alternative (modification) interpretation in the implausible condition (e.g., looking at the picture of a cake with a candle on it'). Our findings indicate that children of age 5 years and above can use context to override verb biases. Additionally, an important component of the sentence processing mechanism is largely intact for young children with ASD who are high functioning. Like children with TD, they draw on verb semantics and plausibility in integrating information. However, they are likely to be slower in processing the language they hear. Based on previous findings of associations between processing speed and cognitive functioning, the implication is that their understanding will be negatively affected, as will their academic outcomes.
| S-EPMC4759258 | biostudies-literature
Project description:Witnesses are likely to describe a crime many times before testifying or encountering misinformation about that crime. Research examining the effect of retrieval on later suggestibility has yielded mixed results. LaPaglia and Chan manipulated whether misinformation was presented in a narrative or misleading questions, and they found that retrieval increased suggestibility when misinformation was presented in a narrative, but reduced suggestibility when the same misinformation was presented in questions. In the current study, we aimed to address why these differences occurred. Specifically, we examined whether contextual detail and narrative coherence during misinformation exposure influenced the relation between retrieval and suggestibility. Participants watched a robbery video and some were questioned about the event afterwards. They were then exposed to misinformation presented in a narrative (Experiment 1) or questions (Experiment 2) before taking a final memory test. Testing enhanced suggestibility when the misinformation phase reinstated contextual information of the event, but not when the misinformation phase included few contextual details-regardless of whether the misinformation was in a narrative or questions. In Experiment 3, disrupting narrative coherence by randomizing the order of contextual information eliminated retrieval-enhanced suggestibility. Therefore, context processing during the post-event information phase influences whether retrieval enhances or reduces eyewitness suggestibility.
| S-EPMC6383884 | biostudies-literature
Project description:Object relative clauses are harder to process than subject relative clauses. Under Grillo's (2009) Generalized Minimality framework, complexity effects of object relatives are construed as intervention effects, which result from an interaction between locality constraints on movement (Relativized Minimality) and the sentence processing system. Specifically, intervention of the subject DP in the movement dependency is expected to generate a minimality violation whenever processing limitations render the moved object underspecified, resulting in compromised comprehension. In the present study, assuming Generalized Minimality, we compared the processing of object relatives with the processing of subject control in ditransitives, which, like object relatives, instantiates a syntactic dependency across an intervening DP. This comparison is justified by the current debate on whether Control should be analyzed as movement: if control involves movement of the controller DP, as proposed by Hornstein (1999), a parallel between the processing of object relatives and subject control in ditransitives may be anticipated on the basis of intervention. In addition, we explored whether general cognitive factors contribute to complexity effects ascribed to movement across a DP. Sixty-nine adult speakers of European Portuguese read sentences and answered comprehension probes in a self-paced reading task with moving-window display, comprising four experimental conditions: Subject Relatives; Object Relatives; Subject Control; Object Control. Furthermore, participants performed four supplementary tasks, serving as measures of resistance to interference, lexical knowledge, working memory capacity and lexical access ability. The results from the reading task showed that whereas object relatives were harder to process than subject relatives, subject control was not harder to process than object control, arguing against recent movement accounts of control. Furthermore, we found that whereas object relative complexity effects assessed by response times to comprehension probes interacted with Reading Span, object relative complexity effects assessed by comprehension accuracy and reading times did not interact with any of the supplementary tasks. We discuss these results in light of Generalized Minimality and the hypothesis of modularity in syntactic processing (Caplan and Waters, 1999).
| S-EPMC7884622 | biostudies-literature