Browse
Submit Data
Databases
API
Help

Dataset Information

23 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Learning of distant state predictions by the orbitofrontal cortex in humans.

ABSTRACT: Representations of our future environment are essential for planning and decision making. Previous research in humans has demonstrated that the hippocampus is a critical region for forming and retrieving associations, while the medial orbitofrontal cortex (OFC) is an important region for representing information about recent states. However, it is not clear how the brain acquires predictive representations during goal-directed learning. Here, we show using fMRI that while participants learned to find rewards in multiple different Y-maze environments, hippocampal activity was highest during initial exposure and then decayed across the remaining repetitions of each maze, consistent with a role in rapid encoding. Importantly, multivariate patterns in the OFC-VPFC came to represent predictive information about upcoming states approximately 30?s in the future. Our findings provide a mechanism by which the brain can build models of the world that span long-timescales to make predictions.

SUBMITTER: Elliott Wimmer G

PROVIDER: S-EPMC6560030 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Learning of distant state predictions by the orbitofrontal cortex in humans.

Elliott Wimmer G G Büchel Christian C

Nature communications 20190611 1

Representations of our future environment are essential for planning and decision making. Previous research in humans has demonstrated that the hippocampus is a critical region for forming and retrieving associations, while the medial orbitofrontal cortex (OFC) is an important region for representing information about recent states. However, it is not clear how the brain acquires predictive representations during goal-directed learning. Here, we show using fMRI that while participants learned to ...[more]

PMID: 31186425

Similar Datasets

Visual predictions in the orbitofrontal cortex rely on associative content.

Project description:Predicting upcoming events from incomplete information is an essential brain function. The orbitofrontal cortex (OFC) plays a critical role in this process by facilitating recognition of sensory inputs via predictive feedback to sensory cortices. In the visual domain, the OFC is engaged by low spatial frequency (LSF) and magnocellular-biased inputs, but beyond this, we know little about the information content required to activate it. Is the OFC automatically engaged to analyze any LSF information for meaning? Or is it engaged only when LSF information matches preexisting memory associations? We tested these hypotheses and show that only LSF information that could be linked to memory associations engages the OFC. Specifically, LSF stimuli activated the OFC in 2 distinct medial and lateral regions only if they resembled known visual objects. More identifiable objects increased activity in the medial OFC, known for its function in affective responses. Furthermore, these objects also increased the connectivity of the lateral OFC with the ventral visual cortex, a crucial region for object identification. At the interface between sensory, memory, and affective processing, the OFC thus appears to be attuned to the associative content of visual information and to play a central role in visuo-affective prediction.

| S-EPMC4193460 | biostudies-literature

Meta-reinforcement learning via orbitofrontal cortex.

Project description:The meta-reinforcement learning (meta-RL) framework, which involves RL over multiple timescales, has been successful in training deep RL models that generalize to new environments. It has been hypothesized that the prefrontal cortex may mediate meta-RL in the brain, but the evidence is scarce. Here we show that the orbitofrontal cortex (OFC) mediates meta-RL. We trained mice and deep RL models on a probabilistic reversal learning task across sessions during which they improved their trial-by-trial RL policy through meta-learning. Ca2+/calmodulin-dependent protein kinase II-dependent synaptic plasticity in OFC was necessary for this meta-learning but not for the within-session trial-by-trial RL in experts. After meta-learning, OFC activity robustly encoded value signals, and OFC inactivation impaired the RL behaviors. Longitudinal tracking of OFC activity revealed that meta-learning gradually shapes population value coding to guide the ongoing behavioral policy. Our results indicate that two distinct RL algorithms with distinct neural mechanisms and timescales coexist in OFC to support adaptive decision-making.

| S-EPMC10689244 | biostudies-literature

Lucky Rhythms in Orbitofrontal Cortex Bias Gambling Decisions in Humans.

Project description:It is well established that emotions influence our decisions, yet the neural basis of this biasing effect is not well understood. Here we directly recorded local field potentials from the OrbitoFrontal Cortex (OFC) in five human subjects performing a financial decision-making task. We observed a striking increase in gamma-band (36-50 Hz) oscillatory activity that reflected subjects' decisions to make riskier choices. Additionally, these gamma rhythms were linked back to mismatched expectations or "luck" occurring in past trials. Specifically, when a subject expected to win but lost, the trial was defined as "unlucky" and when the subject expected to lose but won, the trial was defined as "lucky". Finally, a fading memory model of luck correlated to an objective measure of emotion, heart rate variability. Our findings suggest OFC may play a pivotal role in processing a subject's internal (emotional) state during financial decision-making, a particularly interesting result in light of the more recent "cognitive map" theory of OFC function.

| S-EPMC5103224 | biostudies-literature

The orbitofrontal cortex is necessary for learning to ignore.

Project description:Animals learn not only what is potentially useful but also what is meaningless and should be disregarded. How this is accomplished is a key but seldom explored question in psychology and neuroscience. Learning to ignore irrelevant cues is evident in latent inhibition-the ubiquitous phenomenon where presenting a cue several times without consequences leads to retardation of subsequent conditioning to that cue.1,2 Does learning to ignore these cues, because they predict nothing, involve the same neural circuits that are critical to learning to make predictions about other "real world" impending events? If so, the orbitofrontal cortex (OFC), as a key node in such networks, should be important.3 Specifically, the OFC has been hypothesized to participate in the recognition of hidden task states, which are not directly signaled by explicit outcomes.4 Evaluating its involvement in pre-exposure learning during latent inhibition would be an acid test for this hypothesis. Here, we report that selective chemogenetic inactivation of rat orbitofrontal cortex principal neurons during stimulus pre-exposure markedly reduces latent inhibition in subsequent conditioning. Inactivation only during pre-exposure ensured that the observed effects were due to an impact on the acquisition of information prior to its use in any sort of behavior, i.e., during latent learning. Further behavioral tests confirmed this, showing that the impact of OFC inactivation during pre-exposure was limited to the latent inhibition effect. These results demonstrate that the OFC is important for latent learning and the formation of associations even in the absence of explicit outcomes.

| S-EPMC8222097 | biostudies-literature

Human Orbitofrontal Cortex Represents a Cognitive Map of State Space.

Project description:Although the orbitofrontal cortex (OFC) has been studied intensely for decades, its precise functions have remained elusive. We recently hypothesized that the OFC contains a "cognitive map" of task space in which the current state of the task is represented, and this representation is especially critical for behavior when states are unobservable from sensory input. To test this idea, we apply pattern-classification techniques to neuroimaging data from humans performing a decision-making task with 16 states. We show that unobservable task states can be decoded from activity in OFC, and decoding accuracy is related to task performance and the occurrence of individual behavioral errors. Moreover, similarity between the neural representations of consecutive states correlates with behavioral accuracy in corresponding state transitions. These results support the idea that OFC represents a cognitive map of task space and establish the feasibility of decoding state representations in humans using non-invasive neuroimaging.

| S-EPMC5044873 | biostudies-literature

Orbitofrontal control of visual cortex gain promotes visual associative learning.

Project description:The orbitofrontal cortex (OFC) encodes expected outcomes and plays a critical role in flexible, outcome-guided behavior. The OFC projects to primary visual cortex (V1), yet the function of this top-down projection is unclear. We find that optogenetic activation of OFC projection to V1 reduces the amplitude of V1 visual responses via the recruitment of local somatostatin-expressing (SST) interneurons. Using mice performing a Go/No-Go visual task, we show that the OFC projection to V1 mediates the outcome-expectancy modulation of V1 responses to the reward-irrelevant No-Go stimulus. Furthermore, V1-projecting OFC neurons reduce firing during expectation of reward. In addition, chronic optogenetic inactivation of OFC projection to V1 impairs, whereas chronic activation of SST interneurons in V1 improves the learning of Go/No-Go visual task, without affecting the immediate performance. Thus, OFC top-down projection to V1 is crucial to drive visual associative learning by modulating the response gain of V1 neurons to non-relevant stimulus.

| S-EPMC7270099 | biostudies-literature

Dissociable roles of medial orbitofrontal cortex in human operant extinction learning.

Project description:Operant extinction, which features modification of instrumental responses to stimuli following a change in associated reinforcement, is an important form of learning for organisms in dynamic environments. Animal studies have highlighted orbital and medial prefrontal cortex and amygdala as mediators of operant extinction. Yet little is known about the neural mediators of operant extinction learning in humans. Using a novel fMRI paradigm, we report dissociable functional responses in distinct regions of medial orbitofrontal cortex (mOFC) during successful appetitive and aversive based operant extinction. During successful operant extinction, increased activity was observed in frontopolar OFC, while decreased activity was observed in caudal mOFC and rostral anterior cingulate cortex (rACC) relative to both (i) successful control trials where the reinforcement associated with the stimulus does not change; and (ii) successful acquisition trials during initial learning of the stimulus-reinforcement associations. Functional connectivity analysis demonstrated inverse connectivity between frontopolar OFC and both rACC and the amygdala. These data support animal models suggesting the importance of mOFC-amygdala interaction during operant extinction and expand our knowledge of the neural systems in humans. These findings suggest that in humans, frontopolar OFC modulates activity in caudal mOFC, rACC and amygdala during successful operant extinction learning.

| S-EPMC3941699 | biostudies-literature

Orbitofrontal cortex supports behavior and learning using inferred but not cached values.

Project description:Computational and learning theory models propose that behavioral control reflects value that is both cached (computed and stored during previous experience) and inferred (estimated on the fly on the basis of knowledge of the causal structure of the environment). The latter is thought to depend on the orbitofrontal cortex. Yet some accounts propose that the orbitofrontal cortex contributes to behavior by signaling "economic" value, regardless of the associative basis of the information. We found that the orbitofrontal cortex is critical for both value-based behavior and learning when value must be inferred but not when a cached value is sufficient. The orbitofrontal cortex is thus fundamental for accessing model-based representations of the environment to compute value rather than for signaling value per se.

| S-EPMC3592380 | biostudies-literature

Different time courses for learning-related changes in amygdala and orbitofrontal cortex.

Project description:The orbitofrontal cortex (OFC) and amygdala are thought to participate in reversal learning, a process in which cue-outcome associations are switched. However, current theories disagree on whether OFC directs reversal learning in the amygdala. Here, we show that during reversal of cues' associations with rewarding and aversive outcomes, neurons that respond preferentially to stimuli predicting aversive events update more quickly in amygdala than OFC; meanwhile, OFC neurons that respond preferentially to reward-predicting stimuli update more quickly than those in the amygdala. After learning, however, OFC consistently differentiates between impending reinforcements with a shorter latency than the amygdala. Finally, analysis of local field potentials (LFPs) reveals a disproportionate influence of OFC on amygdala that emerges after learning. We propose that reversal learning is supported by complex interactions between neural circuits spanning the amygdala and OFC, rather than directed by any single structure.

| S-EPMC3236094 | biostudies-literature

Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex.

Project description:Cerebral cortical gamma-aminobutyric acidergic interneuron dysfunction is hypothesized to lead to cognitive deficits comorbid with human neuropsychiatric disorders, including schizophrenia, autism, and epilepsy. We have previously shown that mice that harbor mutations in the Plaur gene, which is associated with schizophrenia, have deficits in frontal cortical parvalbumin-expressing interneurons. Plaur mice have impaired reversal learning, similar to deficits observed in patients with schizophrenia.We examined the role of parvalbumin interneurons in orbitofrontal cortex during reversal learning by recording single unit activity from 180 control and 224 Plaur mouse neurons during a serial reversal task. Neural activity was analyzed during correct and incorrect decision choices and reward receipt.Neurons in control mice exhibited strong phasic responses both during discrimination and reversal learning to decisions and rewards, and the strength of the response was correlated with behavioral performance. Although baseline firing was significantly enhanced in Plaur mice, neural selectivity for correct or erroneous decisions was diminished and not correlated with behavior, and reward encoding was downscaled. In addition, Plaur mice showed a significant reduction in the number of neurons that encoded expected outcomes across task phases during the decision period.These data indicate that parvalbumin interneurons are necessary for the representation of outcomes in orbitofrontal cortex. Deficits in inhibition blunt selective neural firing during key decisions, contributing to behavioral inflexibility. These data provide a potential explanation for disorders of cognitive control that accompany the loss of these gamma-aminobutyric acidergic interneurons in human neuropsychiatric disorders, such as autism, epilepsy, and schizophrenia.

| S-EPMC4312743 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data