Browse
Submit Data
Databases
API
Help

Dataset Information

40 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Orbitofrontal cortex as a cognitive map of task space.

ABSTRACT: Orbitofrontal cortex (OFC) has long been known to play an important role in decision making. However, the exact nature of that role has remained elusive. Here, we propose a unifying theory of OFC function. We hypothesize that OFC provides an abstraction of currently available information in the form of a labeling of the current task state, which is used for reinforcement learning (RL) elsewhere in the brain. This function is especially critical when task states include unobservable information, for instance, from working memory. We use this framework to explain classic findings in reversal learning, delayed alternation, extinction, and devaluation as well as more recent findings showing the effect of OFC lesions on the firing of dopaminergic neurons in ventral tegmental area (VTA) in rodents performing an RL task. In addition, we generate a number of testable experimental predictions that can distinguish our theory from other accounts of OFC function.

SUBMITTER: Wilson RC

PROVIDER: S-EPMC4001869 | biostudies-literature | 2014 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Orbitofrontal cortex as a cognitive map of task space.

Wilson Robert C RC Takahashi Yuji K YK Schoenbaum G G Niv Yael Y

Neuron 20140101 2

Orbitofrontal cortex (OFC) has long been known to play an important role in decision making. However, the exact nature of that role has remained elusive. Here, we propose a unifying theory of OFC function. We hypothesize that OFC provides an abstraction of currently available information in the form of a labeling of the current task state, which is used for reinforcement learning (RL) elsewhere in the brain. This function is especially critical when task states include unobservable information, ...[more]

PMID: 24462094

Similar Datasets

Human Orbitofrontal Cortex Represents a Cognitive Map of State Space.

Project description:Although the orbitofrontal cortex (OFC) has been studied intensely for decades, its precise functions have remained elusive. We recently hypothesized that the OFC contains a "cognitive map" of task space in which the current state of the task is represented, and this representation is especially critical for behavior when states are unobservable from sensory input. To test this idea, we apply pattern-classification techniques to neuroimaging data from humans performing a decision-making task with 16 states. We show that unobservable task states can be decoded from activity in OFC, and decoding accuracy is related to task performance and the occurrence of individual behavioral errors. Moreover, similarity between the neural representations of consecutive states correlates with behavioral accuracy in corresponding state transitions. These results support the idea that OFC represents a cognitive map of task space and establish the feasibility of decoding state representations in humans using non-invasive neuroimaging.

| S-EPMC5044873 | biostudies-literature

A neural network model for the orbitofrontal cortex and task space acquisition during reinforcement learning.

Project description:Reinforcement learning has been widely used in explaining animal behavior. In reinforcement learning, the agent learns the value of the states in the task, collectively constituting the task state space, and uses the knowledge to choose actions and acquire desired outcomes. It has been proposed that the orbitofrontal cortex (OFC) encodes the task state space during reinforcement learning. However, it is not well understood how the OFC acquires and stores task state information. Here, we propose a neural network model based on reservoir computing. Reservoir networks exhibit heterogeneous and dynamic activity patterns that are suitable to encode task states. The information can be extracted by a linear readout trained with reinforcement learning. We demonstrate how the network acquires and stores task structures. The network exhibits reinforcement learning behavior and its aspects resemble experimental findings of the OFC. Our study provides a theoretical explanation of how the OFC may contribute to reinforcement learning and a new approach to understanding the neural mechanism underlying reinforcement learning.

| S-EPMC5771635 | biostudies-literature

Complementary Task Structure Representations in Hippocampus and Orbitofrontal Cortex during an Odor Sequence Task.

Project description:Both hippocampus (HPC) and orbitofrontal cortex (OFC) have been shown to be critical for behavioral tasks that require use of an internal model or cognitive map, composed of the states and the relationships between them, which define the current environment or task at hand. One general idea is that the HPC provides the cognitive map, which is then transformed by OFC to emphasize information of relevance to current goals. Our previous analysis of ensemble activity in OFC in rats performing an odor sequence task revealed a rich representation of behaviorally relevant task structure, consistent with this proposal. Here, we compared those data to recordings from single units in area CA1 of the HPC of rats performing the same task. Contrary to expectations that HPC ensembles would represent detailed, even incidental, information defining the full task space, we found that HPC ensembles-like those in OFC-failed to distinguish states when it was not behaviorally necessary. However, hippocampal ensembles were better than those in OFC at distinguishing task states in which prospective memory was necessary for future performance. These results suggest that, in familiar environments, the HPC and OFC may play complementary roles, with the OFC maintaining the subjects' current position on the cognitive map or state space, supported by HPC when memory demands are high.

| S-EPMC6810873 | biostudies-literature

The orbitofrontal cortex represents advantageous choice in the Iowa gambling task.

Project description:A good-based model, the central neurobiological model of economic decision-making, proposes that the orbitofrontal cortex (OFC) represents binary choice outcome, that is, the chosen good. A good is defined by a group of determinants characterizing the conditions in which the commodity is offered, including commodity type, cost, risk, time delay, and ambiguity. Previous studies have found that the OFC represents the binary choice outcome in decision-making tasks involving commodity type, cost, risk, and delay. Real-life decisions are often complex and involve uncertainty, rewards, and penalties; however, whether the OFC represents binary choice outcomes in a complex decision-making situation, for example, Iowa gambling task (IGT), remains unclear. Here, we propose that the OFC represents binary choice outcome, that is, advantageous choice versus disadvantageous choice, in the IGT. We propose two hypotheses: first, the activity pattern in the human OFC represents an advantageous choice; and second, choice induces an OFC-related functional network. Using functional magnetic resonance imaging and advanced machine-learning tools, we found that the OFC represented an advantageous choice in the IGT. The OFC representation of advantageous choice was related to decision-making performance. Choice modulated the functional connectivity between the OFC and the superior medial gyrus. In conclusion, the OFC represents an advantageous choice during the IGT. In the framework of a good-based model, the results extend the role of the OFC to complex decision-making situation when making a binary choice.

| S-EPMC9294296 | biostudies-literature

A map of object space in primate inferotemporal cortex.

Project description:The inferotemporal (IT) cortex is responsible for object recognition, but it is unclear how the representation of visual objects is organized in this part of the brain. Areas that are selective for categories such as faces, bodies, and scenes have been found1-5, but large parts of IT cortex lack any known specialization, raising the question of what general principle governs IT organization. Here we used functional MRI, microstimulation, electrophysiology, and deep networks to investigate the organization of macaque IT cortex. We built a low-dimensional object space to describe general objects using a feedforward deep neural network trained on object classification6. Responses of IT cells to a large set of objects revealed that single IT cells project incoming objects onto specific axes of this space. Anatomically, cells were clustered into four networks according to the first two components of their preferred axes, forming a map of object space. This map was repeated across three hierarchical stages of increasing view invariance, and cells that comprised these maps collectively harboured sufficient coding capacity to approximately reconstruct objects. These results provide a unified picture of IT organization in which category-selective regions are part of a coarse map of object space whose dimensions can be extracted from a deep network.

| S-EPMC8088388 | biostudies-literature

The hippocampus and orbitofrontal cortex jointly represent task structure during memory-guided decision making.

Project description:The hippocampus, well known for its role in episodic memory, might also be an important brain region for extracting structure from our experiences in order to guide future decisions. Recent evidence in rodents suggests that the hippocampus supports decision making by representing task structure in cooperation with the orbitofrontal cortex (OFC). Here, we examine how the human hippocampus and OFC represent task structure during an associative learning task that required learning of both context-determined and context-invariant probabilistic associations. We find that after learning, hippocampal and lateral OFC representations differentiated between context-determined and context-invariant task structures. The degree of this differentiation within the hippocampus and lateral OFC is highly correlated. These results advance our understanding of the hippocampus and suggest that the hippocampus and OFC support goal-directed behavior by representing information that guides the selection of appropriate decision strategies.

| S-EPMC8686644 | biostudies-literature

A map of visual space in the primate entorhinal cortex.

Project description:Place-modulated activity among neurons in the hippocampal formation presents a means to organize contextual information in the service of memory formation and recall. One particular spatial representation, that of grid cells, has been observed in the entorhinal cortex (EC) of rats and bats, but has yet to be described in single units in primates. Here we examined spatial representations in the EC of head-fixed monkeys performing a free-viewing visual memory task. Individual neurons were identified in the primate EC that emitted action potentials when the monkey fixated multiple discrete locations in the visual field in each of many sequentially presented complex images. These firing fields possessed spatial periodicity similar to a triangular tiling with a corresponding well-defined hexagonal structure in the spatial autocorrelation. Further, these neurons showed theta-band oscillatory activity and changing spatial scale as a function of distance from the rhinal sulcus, which is consistent with previous findings in rodents. These spatial representations may provide a framework to anchor the encoding of stimulus content in a complex visual scene. Together, our results provide a direct demonstration of grid cells in the primate and suggest that EC neurons encode space during visual exploration, even without locomotion.

| S-EPMC3565234 | biostudies-literature

Impulsive choice in hippocampal but not orbitofrontal cortex-lesioned rats on a nonspatial decision-making maze task.

Project description:Orbitofrontal cortical (OFC) and hippocampal (HPC) lesions in primates and rodents have been associated with impulsive behaviour. We showed previously that OFC- or HPC-lesioned rats chose the immediate low-reward (LR) option in preference to the delayed high-reward (HR) option, where LR and HR were associated with different spatial responses in a uniform grey T-maze. We now report that on a novel nonspatial T-maze task in which the HR and LR options are associated with patterned goal arms (black-and-white stripes vs. gray), OFC-lesioned rats did not show impulsive behaviour, choosing the delayed HR option, and were indistinguishable from controls. In contrast, HPC-lesioned rats exhibited impulsive choice in the nonspatial decision-making task, although they chose the HR option on the majority of trials when there was a 10-s delay associated with both goal arms. The previously reported impairment in OFC-lesioned rats on the spatial version of the intertemporal choice task is unlikely to reflect a general problem with spatial learning, because OFC lesions were without effect on acquisition of the standard reference memory water-maze task and spatial working memory performance (nonmatching-to-place) on the T-maze. The differential effect of OFC lesions on the two versions of the intertemporal choice task may be explained instead in terms of the putative role of OFC in using associative information to represent expected outcomes and generate predictions. The impulsivity in HPC-lesioned rats may reflect impaired temporal information processing, and emphasizes a role for the hippocampus beyond the spatial domain.

| S-EPMC2777256 | biostudies-literature

A novel role for brain interleukin-6: facilitation of cognitive flexibility in rat orbitofrontal cortex.

Project description:Cytokines, small proteins released by the immune system to combat infection, are typically studied under inflammatory conditions. However, these molecules are also expressed in the brain in basal, nonpathological states, where they can regulate neuronal processes, such as learning and memory. However, little is known about how cytokine signaling in the brain may influence higher-order cognitive functions. Cognitive flexibility is one such executive process, mediated by the prefrontal cortex, which requires an adaptive modification of learned behaviors in response to environmental change. We explored the role of basal IL-6 signaling in the orbitofrontal cortex (OFC) in reversal learning, a form of cognitive flexibility that can be measured in the rat using the attentional set-shifting test. We found that inhibiting IL-6 or its downstream JAK/STAT signaling pathway in the OFC impaired reversal learning, suggesting that basal IL-6 and JAK/STAT signaling facilitate cognitive flexibility. Further, we demonstrated that elevating IL-6 in the OFC by adeno-associated virus-mediated gene delivery reversed a cognitive deficit induced by chronic stress, thus identifying IL-6 and the downstream JAK/STAT signaling pathway as potentially novel therapeutic targets for the treatment of stress-related psychiatric diseases associated with cognitive dysfunction.

| S-EPMC3891970 | biostudies-literature

The orbitofrontal cortex and response selection.

Project description:Orbitofrontal cortex (OFC) function is often characterized in terms of stimulus-reward mapping; however, more recent evidence suggests that the OFC may play a role in selecting and representing extended actions. First, previously encoded reward associations in the OFC could be used to inform responding in novel but similar situations. Second, when evaluated in tasks requiring the animal to perform extended actions, response selective activity can be recorded in the OFC. Finally, the interaction between the OFC and hippocampus illustrates OFC's role in response selection. The OFC may facilitate reward-guided memory retrieval by selecting the memories most relevant to achieve a goal. This model for OFC function places it within the hierarchy of increasingly complex action representations that support decision making.

| S-EPMC5545878 | biostudies-other

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data