Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Orbitofrontal cortex supports behavior and learning using inferred but not cached values.

ABSTRACT: Computational and learning theory models propose that behavioral control reflects value that is both cached (computed and stored during previous experience) and inferred (estimated on the fly on the basis of knowledge of the causal structure of the environment). The latter is thought to depend on the orbitofrontal cortex. Yet some accounts propose that the orbitofrontal cortex contributes to behavior by signaling "economic" value, regardless of the associative basis of the information. We found that the orbitofrontal cortex is critical for both value-based behavior and learning when value must be inferred but not when a cached value is sufficient. The orbitofrontal cortex is thus fundamental for accessing model-based representations of the environment to compute value rather than for signaling value per se.

SUBMITTER: Jones JL

PROVIDER: S-EPMC3592380 | biostudies-literature | 2012 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Orbitofrontal cortex supports behavior and learning using inferred but not cached values.

Jones Joshua L JL Esber Guillem R GR McDannald Michael A MA Gruber Aaron J AJ Hernandez Alex A Mirenzi Aaron A Schoenbaum Geoffrey G

Science (New York, N.Y.) 20121101 6109

Computational and learning theory models propose that behavioral control reflects value that is both cached (computed and stored during previous experience) and inferred (estimated on the fly on the basis of knowledge of the causal structure of the environment). The latter is thought to depend on the orbitofrontal cortex. Yet some accounts propose that the orbitofrontal cortex contributes to behavior by signaling "economic" value, regardless of the associative basis of the information. We found ...[more]

PMID: 23162000

Similar Datasets

Neural estimates of imagined outcomes in the orbitofrontal cortex drive behavior and learning.

Project description:Imagination, defined as the ability to interpret reality in ways that diverge from past experience, is fundamental to adaptive behavior. This can be seen at a simple level in our capacity to predict novel outcomes in new situations. The ability to anticipate outcomes never before received can also influence learning if those imagined outcomes are not received. The orbitofrontal cortex is a key candidate for where the process of imagining likely outcomes occurs; however, its precise role in generating these estimates and applying them to learning remain open questions. Here we address these questions by showing that single-unit activity in the orbitofrontal cortex reflects novel outcome estimates. The strength of these neural correlates predicted both behavior and learning, learning that was abolished by temporally specific inhibition of orbitofrontal neurons. These results are consistent with the proposal that the orbitofrontal cortex is critical for integrating information to imagine future outcomes.

| S-EPMC3806218 | biostudies-literature

Values encoded in orbitofrontal cortex are causally related to economic choices.

Project description:In the eighteenth century, Daniel Bernoulli, Adam Smith and Jeremy Bentham proposed that economic choices rely on the computation and comparison of subjective values1. This hypothesis continues to inform modern economic theory2 and research in behavioural economics3, but behavioural measures are ultimately not sufficient to verify the proposal4. Consistent with the hypothesis, when agents make choices, neurons in the orbitofrontal cortex (OFC) encode the subjective value of offered and chosen goods5. Value-encoding cells integrate multiple dimensions6-9, variability in the activity of each cell group correlates with variability in choices10,11 and the population dynamics suggests the formation of a decision12. However, it is unclear whether these neural processes are causally related to choices. More generally, the evidence linking economic choices to value signals in the brain13-15 remains correlational16. Here we show that neuronal activity in the OFC is causal to economic choices. We conducted two experiments using electrical stimulation in rhesus monkeys (Macaca mulatta). Low-current stimulation increased the subjective value of individual offers and thus predictably biased choices. Conversely, high-current stimulation disrupted both the computation and the comparison of subjective values, and thus increased choice variability. These results demonstrate a causal chain linking subjective values encoded in OFC to valuation and choice.

| S-EPMC7746614 | biostudies-literature

Behavior- and Modality-General Representation of Confidence in Orbitofrontal Cortex.

Project description:Every decision we make is accompanied by a sense of confidence about its likely outcome. This sense informs subsequent behavior, such as investing more-whether time, effort, or money-when reward is more certain. A neural representation of confidence should originate from a statistical computation and predict confidence-guided behavior. An additional requirement for confidence representations to support metacognition is abstraction: they should emerge irrespective of the source of information and inform multiple confidence-guided behaviors. It is unknown whether neural confidence signals meet these criteria. Here, we show that single orbitofrontal cortex neurons in rats encode statistical decision confidence irrespective of the sensory modality, olfactory or auditory, used to make a choice. The activity of these neurons also predicts two confidence-guided behaviors: trial-by-trial time investment and cross-trial choice strategy updating. Orbitofrontal cortex thus represents decision confidence consistent with a metacognitive process that is useful for mediating confidence-guided economic decisions.

| S-EPMC8083070 | biostudies-literature

Orbitofrontal cortex connectivity as a mechanism of adolescent behavior change.

Project description:An increasing number of studies have implicated the role of network functional connectivity in addiction. Yet, none have examined functional connectivity as a potential mechanism of adolescent behavior change. We examined the underlying neural mechanism of a promising treatment for adolescents, motivational interviewing (MI). We began by employing psychophysiological interaction (PPI) to evaluate network response in a sample of adolescent cannabis users (N=30). Next, we examined correlations between network connectivity and clinical metrics of treatment outcome. PPI analyses seeded on the orbitofrontal cortex (OFC) showed significant increases in functional connectivity across the inferior frontal gyrus (IFG), precentral gyrus, anterior and posterior cingulate gyrus, supplementary motor area (SMA), superior frontal gyrus, pallidus, caudate, and parahippocampal gyrus. Further, greater functional connectivity between the OFC and anterior cingulate/medial frontal gyrus was associated with less behavior change (e.g., greater post-treatment cannabis problems). These data support the role of the OFC network as a mechanism of adolescent treatment response.

| S-EPMC5420345 | biostudies-literature

Orbitofrontal control of visual cortex gain promotes visual associative learning.

Project description:The orbitofrontal cortex (OFC) encodes expected outcomes and plays a critical role in flexible, outcome-guided behavior. The OFC projects to primary visual cortex (V1), yet the function of this top-down projection is unclear. We find that optogenetic activation of OFC projection to V1 reduces the amplitude of V1 visual responses via the recruitment of local somatostatin-expressing (SST) interneurons. Using mice performing a Go/No-Go visual task, we show that the OFC projection to V1 mediates the outcome-expectancy modulation of V1 responses to the reward-irrelevant No-Go stimulus. Furthermore, V1-projecting OFC neurons reduce firing during expectation of reward. In addition, chronic optogenetic inactivation of OFC projection to V1 impairs, whereas chronic activation of SST interneurons in V1 improves the learning of Go/No-Go visual task, without affecting the immediate performance. Thus, OFC top-down projection to V1 is crucial to drive visual associative learning by modulating the response gain of V1 neurons to non-relevant stimulus.

| S-EPMC7270099 | biostudies-literature

Dissociable roles of medial orbitofrontal cortex in human operant extinction learning.

Project description:Operant extinction, which features modification of instrumental responses to stimuli following a change in associated reinforcement, is an important form of learning for organisms in dynamic environments. Animal studies have highlighted orbital and medial prefrontal cortex and amygdala as mediators of operant extinction. Yet little is known about the neural mediators of operant extinction learning in humans. Using a novel fMRI paradigm, we report dissociable functional responses in distinct regions of medial orbitofrontal cortex (mOFC) during successful appetitive and aversive based operant extinction. During successful operant extinction, increased activity was observed in frontopolar OFC, while decreased activity was observed in caudal mOFC and rostral anterior cingulate cortex (rACC) relative to both (i) successful control trials where the reinforcement associated with the stimulus does not change; and (ii) successful acquisition trials during initial learning of the stimulus-reinforcement associations. Functional connectivity analysis demonstrated inverse connectivity between frontopolar OFC and both rACC and the amygdala. These data support animal models suggesting the importance of mOFC-amygdala interaction during operant extinction and expand our knowledge of the neural systems in humans. These findings suggest that in humans, frontopolar OFC modulates activity in caudal mOFC, rACC and amygdala during successful operant extinction learning.

| S-EPMC3941699 | biostudies-literature

Learning of distant state predictions by the orbitofrontal cortex in humans.

Project description:Representations of our future environment are essential for planning and decision making. Previous research in humans has demonstrated that the hippocampus is a critical region for forming and retrieving associations, while the medial orbitofrontal cortex (OFC) is an important region for representing information about recent states. However, it is not clear how the brain acquires predictive representations during goal-directed learning. Here, we show using fMRI that while participants learned to find rewards in multiple different Y-maze environments, hippocampal activity was highest during initial exposure and then decayed across the remaining repetitions of each maze, consistent with a role in rapid encoding. Importantly, multivariate patterns in the OFC-VPFC came to represent predictive information about upcoming states approximately 30?s in the future. Our findings provide a mechanism by which the brain can build models of the world that span long-timescales to make predictions.

| S-EPMC6560030 | biostudies-literature

Different time courses for learning-related changes in amygdala and orbitofrontal cortex.

Project description:The orbitofrontal cortex (OFC) and amygdala are thought to participate in reversal learning, a process in which cue-outcome associations are switched. However, current theories disagree on whether OFC directs reversal learning in the amygdala. Here, we show that during reversal of cues' associations with rewarding and aversive outcomes, neurons that respond preferentially to stimuli predicting aversive events update more quickly in amygdala than OFC; meanwhile, OFC neurons that respond preferentially to reward-predicting stimuli update more quickly than those in the amygdala. After learning, however, OFC consistently differentiates between impending reinforcements with a shorter latency than the amygdala. Finally, analysis of local field potentials (LFPs) reveals a disproportionate influence of OFC on amygdala that emerges after learning. We propose that reversal learning is supported by complex interactions between neural circuits spanning the amygdala and OFC, rather than directed by any single structure.

| S-EPMC3236094 | biostudies-literature

Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex.

Project description:Cerebral cortical gamma-aminobutyric acidergic interneuron dysfunction is hypothesized to lead to cognitive deficits comorbid with human neuropsychiatric disorders, including schizophrenia, autism, and epilepsy. We have previously shown that mice that harbor mutations in the Plaur gene, which is associated with schizophrenia, have deficits in frontal cortical parvalbumin-expressing interneurons. Plaur mice have impaired reversal learning, similar to deficits observed in patients with schizophrenia.We examined the role of parvalbumin interneurons in orbitofrontal cortex during reversal learning by recording single unit activity from 180 control and 224 Plaur mouse neurons during a serial reversal task. Neural activity was analyzed during correct and incorrect decision choices and reward receipt.Neurons in control mice exhibited strong phasic responses both during discrimination and reversal learning to decisions and rewards, and the strength of the response was correlated with behavioral performance. Although baseline firing was significantly enhanced in Plaur mice, neural selectivity for correct or erroneous decisions was diminished and not correlated with behavior, and reward encoding was downscaled. In addition, Plaur mice showed a significant reduction in the number of neurons that encoded expected outcomes across task phases during the decision period.These data indicate that parvalbumin interneurons are necessary for the representation of outcomes in orbitofrontal cortex. Deficits in inhibition blunt selective neural firing during key decisions, contributing to behavioral inflexibility. These data provide a potential explanation for disorders of cognitive control that accompany the loss of these gamma-aminobutyric acidergic interneurons in human neuropsychiatric disorders, such as autism, epilepsy, and schizophrenia.

| S-EPMC4312743 | biostudies-literature

Closed-Loop Theta Stimulation in the Orbitofrontal Cortex Prevents Reward-Based Learning.

Project description:Neuronal oscillations in the frontal cortex have been hypothesized to play a role in the organization of high-level cognition. Within the orbitofrontal cortex (OFC), there is a prominent oscillation in the theta frequency (4-8 Hz) during reward-guided behavior, but it is unclear whether this oscillation has causal significance. One methodological challenge is that it is difficult to manipulate theta without affecting other neural signals, such as single-neuron firing rates. A potential solution is to use closed-loop control to record theta in real time and use this signal to control the application of electrical microstimulation to the OFC. Using this method, we show that theta oscillations in the OFC are critically important for reward-guided learning and that they are driven by theta oscillations in the hippocampus (HPC). The ability to disrupt OFC computations via spatially localized and temporally precise stimulation could lead to novel treatment strategies for neuropsychiatric disorders involving OFC dysfunction.

| S-EPMC7480400 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data