Stimulus-independent neural coding of event semantics: Evidence from cross-sentence fMRI decoding.
Ontology highlight
ABSTRACT:
SUBMITTER: Asyraff A
PROVIDER: S-EPMC8270886 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:A central focus of cognitive neuroscience is identification of the neural codes that represent stimulus dimensions. One common theme is the study of whether dimensions, such as color and shape, are encoded independently by separate pools of neurons or are represented by neurons conjointly tuned for both properties. We describe an application of functional magnetic resonance imaging (fMRI) adaptation to distinguish between independent and conjoint neural representations of dimensions by examining the neural signal evoked by changes in one versus two stimulus dimensions and considering the metric of two-dimension additivity. We describe how a continuous carry-over paradigm may be used to efficiently estimate this metric. The assumptions of the method are examined as are optimizations. Finally, we demonstrate that the method produces the expected result for fMRI data collected from ventral occipitotemporal cortex while subjects viewed sets of shapes predicted to be represented by conjoint or independent neural tuning.
| S-EPMC2694123 | biostudies-literature
Project description:Much research in cognitive neuroscience supports prediction as a canonical computation of cognition across domains. Is such predictive coding implemented by feedback from higher-order domain-general circuits, or is it locally implemented in domain-specific circuits? What information sources are used to generate these predictions? This study addresses these two questions in the context of language processing. We present fMRI evidence from a naturalistic comprehension paradigm (1) that predictive coding in the brain's response to language is domain-specific, and (2) that these predictions are sensitive both to local word co-occurrence patterns and to hierarchical structure. Using a recently developed continuous-time deconvolutional regression technique that supports data-driven hemodynamic response function discovery from continuous BOLD signal fluctuations in response to naturalistic stimuli, we found effects of prediction measures in the language network but not in the domain-general multiple-demand network, which supports executive control processes and has been previously implicated in language comprehension. Moreover, within the language network, surface-level and structural prediction effects were separable. The predictability effects in the language network were substantial, with the model capturing over 37% of explainable variance on held-out data. These findings indicate that human sentence processing mechanisms generate predictions about upcoming words using cognitive processes that are sensitive to hierarchical structure and specialized for language processing, rather than via feedback from high-level executive control mechanisms.
| S-EPMC7140726 | biostudies-literature
Project description:Decoding the inner representation of a word meaning from human cortical activity is a substantial challenge in the development of speech brain-machine interfaces (BMIs). The semantic aspect of speech is a novel target of speech decoding that may enable versatile communication platforms for individuals with impaired speech ability; however, there is a paucity of electrocorticography studies in this field. We decoded the semantic representation of a word from single-trial cortical activity during an imageability-based property identification task that required participants to discriminate between the abstract and concrete words. Using high gamma activity in the language-dominant hemisphere, a support vector machine classifier could discriminate the 2-word categories with significantly high accuracy (73.1 ± 7.5%). Activities in specific time components from two brain regions were identified as significant predictors of abstract and concrete dichotomy. Classification using these feature components revealed that comparable prediction accuracy could be obtained based on a spatiotemporally targeted decoding approach. Our study demonstrated that mental representations of abstract and concrete word processing could be decoded from cortical high gamma activities, and the coverage of implanted electrodes and time window of analysis could be successfully minimized. Our findings lay the foundation for the future development of semantic-based speech BMIs.
| S-EPMC9753048 | biostudies-literature
Project description:The present study investigated the association between traits of the Five Factor Model of Personality (Neuroticism, Extraversion, Openness for Experiences, Agreeableness, and Conscientiousness) and neural correlates of error monitoring obtained from a combined Eriksen-Flanker-Go/NoGo task during event-related functional magnetic resonance imaging in 27 healthy subjects. Individual expressions of personality traits were measured using the NEO-PI-R questionnaire. Conscientiousness correlated positively with error signaling in the left inferior frontal gyrus and adjacent anterior insula (IFG/aI). A second strong positive correlation was observed in the anterior cingulate gyrus (ACC). Neuroticism was negatively correlated with error signaling in the inferior frontal cortex possibly reflecting the negative inter-correlation between both scales observed on the behavioral level. Under present statistical thresholds no significant results were obtained for remaining scales. Aligning the personality trait of Conscientiousness with task accomplishment striving behavior the correlation in the left IFG/aI possibly reflects an inter-individually different involvement whenever task-set related memory representations are violated by the occurrence of errors. The strong correlations in the ACC may indicate that more conscientious subjects were stronger affected by these violations of a given task-set expressed by individually different, negatively valenced signals conveyed by the ACC upon occurrence of an error. Present results illustrate that for predicting individual responses to errors underlying personality traits should be taken into account and also lend external validity to the personality trait approach suggesting that personality constructs do reflect more than mere descriptive taxonomies.
| S-EPMC3425580 | biostudies-literature
Project description:When a sequence of written words is presented briefly and participants are asked to report the identity of one of the words, identification accuracy is higher when the words form a correct sentence. Here we examined the extent to which this sentence superiority effect can be modulated by semantic content. The central hypothesis guiding this study is that the sentence superiority effect is primarily a syntactic effect. We therefore predicted little or no modulation of the effect by semantics. The influence of semantic content was measured by comparing the sentence superiority effect obtained with semantically regular sentences (e.g., son amie danse bien [her friend dances well]) and semantically anomalous but syntactically correct sentences (e.g., votre sac boit gros [your bag drinks big]), with effects being measured against ungrammatical scrambled versions of the same words in both cases. We found sentence superiority effects with both types of sentences, and a significant interaction, such that the effects were greater with semantically regular sentences compared with semantically anomalous sentences. We conclude that sentence-level semantic information can constrain word identities under parallel word processing, albeit with less impact than that exerted by syntax.
| S-EPMC8505490 | biostudies-literature
Project description:Event simulation (ES) is the situational inference process in which perceived event features such as objects, agents, and actions are associated in the brain to represent the whole situation. ES provides a common basis for various cognitive processes, such as perceptual prediction, situational understanding/prediction, and social cognition (such as mentalizing/trait inference). Here, functional magnetic resonance imaging was used to elucidate the neural substrates underlying important subdivisions within ES. First, the study investigated whether ES depends on different neural substrates when it is conducted explicitly and implicitly. Second, the existence of neural substrates specific to the future-prediction component of ES was assessed. Subjects were shown contextually related object pictures implying a situation and performed several picture-word-matching tasks. By varying task goals, subjects were made to infer the implied situation implicitly/explicitly or predict the future consequence of that situation. The results indicate that, whereas implicit ES activated the lateral prefrontal cortex and medial/lateral parietal cortex, explicit ES activated the medial prefrontal cortex, posterior cingulate cortex, and medial/lateral temporal cortex. Additionally, the left temporoparietal junction plays an important role in the future-prediction component of ES. These findings enrich our understanding of the neural substrates of the implicit/explicit/predictive aspects of ES-related cognitive processes.
| S-EPMC4008581 | biostudies-literature
Project description:We demonstrate that multivoxel pattern analysis can be used to decode place-related information in fMRI. Subjects performed a working memory version of the Morris water maze task in a virtual environment with a single wall cue. The voxel data that corresponds to when subjects were located at the goal was extracted for seven regions implicated in spatial navigation, and then used to train a pattern classifier based on partial least squares. Using a leave-one-out (LOO) test procedure, goal locations at E, W, N positions (relative to the cue as S) were predicted significantly better than a naïve classifier for voxels in medial prefrontal cortex, hippocampus, and inferior parietal cortex. Prediction with voxels from other regions involved in navigation was also better than a naïve classifier, which raises the possibility that goal-location information is widely disseminated among the navigation network. It turns out that predictive capability of all regions combined significantly decreases, relative to no change, only when voxel data from the hippocampus is left out. This implies that the hippocampus contains some unique information that identifies goal locations, whereas other regions contain information that also identifies goal locations but is more redundant. Classification of goal locations is an important step toward decoding a variety of place-related information in spatial navigation with fMRI.
| S-EPMC2826536 | biostudies-literature
Project description:Previously we reported that correlations between the activities of peripheral afferents mediate a phase invariant representation of natural communication stimuli that is refined across successive processing stages thereby leading to perception and behavior in the weakly electric fish Apteronotus leptorhynchus (Metzen et al., 2016). Here, we explore how phase invariant coding and perception of natural communication stimuli are affected by changes in the sinusoidal background over which they occur. We found that increasing background frequency led to phase locking, which decreased both detectability and phase invariant coding. Correlated afferent activity was a much better predictor of behavior as assessed from both invariance and detectability than single neuron activity. Thus, our results provide not only further evidence that correlated activity likely determines perception of natural communication signals, but also a novel explanation as to why these preferentially occur on top of low frequency as well as low-intensity sinusoidal backgrounds.
| S-EPMC5389862 | biostudies-literature
Project description:This study proposes a method for classifying event-related fMRI responses in a specialized setting of many known but few unknown stimuli presented in a rapid event-related design. Compared to block design fMRI signals, classification of the response to a single or a few stimulus trial(s) is not a trivial problem due to contamination by preceding events as well as the low signal-to-noise ratio. To overcome such problems, we proposed a single trial-based classification method of rapid event-related fMRI signals utilizing sparse multivariate Bayesian decoding of spatio-temporal fMRI responses. We applied the proposed method to classification of memory retrieval processes for two different classes of episodic memories: a voluntarily conducted experience and a passive experience induced by watching a video of others' actions. A cross-validation showed higher classification performance of the proposed method compared to that of a support vector machine or of a classifier based on the general linear model. Evaluation of classification performances for one, two, and three stimuli from the same class and a correlation analysis between classification accuracy and target stimulus positions among trials suggest that presenting two target stimuli at longer inter-stimulus intervals is optimal in the design of classification experiments to identify the target stimuli. The proposed method for decoding subject-specific memory retrieval of voluntary behavior using fMRI would be useful in forensic applications in a natural environment, where many known trials can be extracted from a simulation of everyday tasks and few target stimuli from a crime scene.
| S-EPMC5544208 | biostudies-other
Project description:The response of a neuron to a time-dependent stimulus, as measured in a Peri-Stimulus-Time-Histogram (PSTH), exhibits an intricate temporal structure that reflects potential temporal coding principles. Here we analyze the encoding and decoding of PSTHs for spiking neurons with arbitrary refractoriness and adaptation. As a modeling framework, we use the spike response model, also known as the generalized linear neuron model. Because of refractoriness, the effect of the most recent spike on the spiking probability a few milliseconds later is very strong. The influence of the last spike needs therefore to be described with high precision, while the rest of the neuronal spiking history merely introduces an average self-inhibition or adaptation that depends on the expected number of past spikes but not on the exact spike timings. Based on these insights, we derive a 'quasi-renewal equation' which is shown to yield an excellent description of the firing rate of adapting neurons. We explore the domain of validity of the quasi-renewal equation and compare it with other rate equations for populations of spiking neurons. The problem of decoding the stimulus from the population response (or PSTH) is addressed analogously. We find that for small levels of activity and weak adaptation, a simple accumulator of the past activity is sufficient to decode the original input, but when refractory effects become large decoding becomes a non-linear function of the past activity. The results presented here can be applied to the mean-field analysis of coupled neuron networks, but also to arbitrary point processes with negative self-interaction.
| S-EPMC3464223 | biostudies-literature