Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Orbitofrontal neurons signal sensory associations underlying model-based inference in a sensory preconditioning task.

ABSTRACT: Using knowledge of the structure of the world to infer value is at the heart of model-based reasoning and relies on a circuit that includes the orbitofrontal cortex (OFC). Some accounts link this to the representation of biological significance or value by neurons in OFC, while other models focus on the representation of associative structure or cognitive maps. Here we tested between these accounts by recording OFC neurons in rats during an OFC-dependent sensory preconditioning task. We found that while OFC neurons were strongly driven by biological significance or reward predictions at the end of training, they also showed clear evidence of acquiring the incidental stimulus-stimulus pairings in the preconditioning phase, prior to reward training. These results support a role for OFC in representing associative structure, independent of value.

SUBMITTER: Sadacca BF

PROVIDER: S-EPMC5847331 | biostudies-literature | 2018 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Orbitofrontal neurons signal sensory associations underlying model-based inference in a sensory preconditioning task.

Sadacca Brian F BF Wied Heather M HM Lopatina Nina N Saini Gurpreet K GK Nemirovsky Daniel D Schoenbaum Geoffrey G

eLife 20180307

Using knowledge of the structure of the world to infer value is at the heart of model-based reasoning and relies on a circuit that includes the orbitofrontal cortex (OFC). Some accounts link this to the representation of biological significance or value by neurons in OFC, while other models focus on the representation of associative structure or cognitive maps. Here we tested between these accounts by recording OFC neurons in rats during an OFC-dependent sensory preconditioning task. We found th ...[more]

PMID: 29513220

Similar Datasets

Anterior cingulate neurons signal neutral cue pairings during sensory preconditioning.

Project description:Of all frontocortical subregions, the anterior cingulate cortex (ACC) has perhaps the most overlapping theories of function.1-3 Recording studies in rats, humans, and other primates have reported diverse neural responses that support many theories,4-12 yet nearly all these studies have in common tasks in which one event reliably predicts another. This leaves open the possibility that ACC represents associative pairing of events, independent of their overt biological significance. Sensory preconditioning13 provides an opportunity to test this. In the first phase, preconditioning, value-neutral sensory stimuli are paired (A→B). To test whether this was learned, subjects are given standard conditioning during which one of the previously neutral sensory cues is paired with a biologically meaningful outcome (B→outcome). During the final probe test, the neutral cue which was never paired with a biologically meaningful outcome is presented alone (A→) and will elicit a conditional response, suggesting that subjects had learned the associative structure during preconditioning and use that knowledge to infer presentation of the biologically relevant outcome (A→B→outcome). Inference-based responding demonstrates a fundamental property of model-based reasoning14,15 and requires learning of the associations between neutral stimuli before rewards are introduced.16-19 ACC neurons developed firing patterns that reflected the learning of sensory associations during preconditioning, even though no rewards were present. The strength of these correlates predicted rats' ability to later mobilize and use that associative information during the probe test. These results demonstrate that clear biological significance is not necessary to produce correlates of learning in ACC.

| S-EPMC8976914 | biostudies-literature

Interactions between human orbitofrontal cortex and hippocampus support model-based inference.

Project description:Internal representations of relationships between events in the external world can be utilized to infer outcomes when direct experience is lacking. This process is thought to involve the orbitofrontal cortex (OFC) and hippocampus (HPC), but there is little evidence regarding the relative role of these areas and their interactions in inference. Here, we used a sensory preconditioning task and pattern-based neuroimaging to study this question. We found that associations among value-neutral cues were acquired in both regions during preconditioning but that value-related information was only represented in the OFC at the time of the probe test. Importantly, inference was accompanied by representations of associated cues and inferred outcomes in the OFC, as well as by increased HPC-OFC connectivity. These findings suggest that the OFC and HPC represent only partially overlapping information and that interactions between the two regions support model-based inference.

| S-EPMC6974031 | biostudies-literature

The signal processing architecture underlying subjective reports of sensory awareness.

Project description:What is the relationship between perceptual information processing and subjective perceptual experience? Empirical dissociations between stimulus identification performance and subjective reports of stimulus visibility are crucial for shedding light on this question. We replicated a finding that metacontrast masking can produce such a dissociation (Lau and Passingham, 2006), and report a novel finding that this paradigm can also dissociate stimulus identification performance from the efficacy with which visibility ratings predict task performance. We explored various hypotheses about the relationship between perceptual task performance and visibility rating by implementing them in computational models and using formal model comparison techniques to assess which ones best captured the unusual patterns in the data. The models fell into three broad categories: Single Channel models, which hold that task performance and visibility ratings are based on the same underlying source of information; Dual Channel models, which hold that there are two independent processing streams that differentially contribute to task performance and visibility rating; and Hierarchical models, which hold that a late processing stage generates visibility ratings by evaluating the quality of early perceptual processing. Taking into account the quality of data fitting and model complexity, we found that Hierarchical models perform best at capturing the observed behavioral dissociations. Because current theories of visual awareness map well onto these different model structures, a formal comparison between them is a powerful approach for arbitrating between the different theories.

| S-EPMC4972343 | biostudies-literature

A neural network model for the orbitofrontal cortex and task space acquisition during reinforcement learning.

Project description:Reinforcement learning has been widely used in explaining animal behavior. In reinforcement learning, the agent learns the value of the states in the task, collectively constituting the task state space, and uses the knowledge to choose actions and acquire desired outcomes. It has been proposed that the orbitofrontal cortex (OFC) encodes the task state space during reinforcement learning. However, it is not well understood how the OFC acquires and stores task state information. Here, we propose a neural network model based on reservoir computing. Reservoir networks exhibit heterogeneous and dynamic activity patterns that are suitable to encode task states. The information can be extracted by a linear readout trained with reinforcement learning. We demonstrate how the network acquires and stores task structures. The network exhibits reinforcement learning behavior and its aspects resemble experimental findings of the OFC. Our study provides a theoretical explanation of how the OFC may contribute to reinforcement learning and a new approach to understanding the neural mechanism underlying reinforcement learning.

| S-EPMC5771635 | biostudies-literature

Adaptation of reward sensitivity in orbitofrontal neurons.

Project description:Animals depend on a large variety of rewards but their brains have a limited dynamic coding range. When rewards are uncertain, neuronal coding needs to cover a wide range of possible rewards. However, when reward is likely to occur within a specific range, focusing the sensitivity on the predicted range would optimize the discrimination of small reward differences. One way to overcome the trade-off between wide coverage and optimal discrimination is to adapt reward sensitivity dynamically to the available rewards. We investigated how changes in reward distribution influenced the coding of reward in the orbitofrontal cortex. Animals performed an oculomotor task in which a fixation cue predicted the SD of the probability distribution of juice volumes, while the expected mean volume was kept constant. A subsequent cue specified the exact juice volume obtained for a correct saccade response. Population responses of orbitofrontal neurons that reflected the predicted juice volume showed adaptation to the reward distribution. Statistical tests on individual responses revealed that a quarter of value-coding neurons shifted the reward sensitivity slope significantly between two reward distributions, whereas the remaining neurons showed insignificant change or lack of adaptation. Adaptations became more prominent when reward distributions changed less frequently, indicating time constraints for assessing reward distributions and adjusting neuronal sensitivity. The observed neuronal adaptation would optimize discrimination and contribute to the efficient coding of a large variety of potential rewards by neurons with limited dynamic range.

| S-EPMC2880492 | biostudies-other

Hyperexcitability of Sensory Neurons in Fragile X Mouse Model.

Project description:Sensory hypersensitivity and somatosensory deficits represent the core symptoms of Fragile X syndrome (FXS). These alterations are believed to arise from changes in cortical sensory processing, while potential deficits in the function of peripheral sensory neurons residing in dorsal root ganglia remain unexplored. We found that peripheral sensory neurons exhibit pronounced hyperexcitability in Fmr1 KO mice, manifested by markedly increased action potential (AP) firing rate and decreased threshold. Unlike excitability changes found in many central neurons, no significant changes were observed in AP rising and falling time, peak potential, amplitude, or duration. Sensory neuron hyperexcitability was caused primarily by increased input resistance, without changes in cell capacitance or resting membrane potential. Analyses of the underlying mechanisms revealed reduced activity of HCN channels and reduced expression of HCN1 and HCN4 in Fmr1 KO compared to WT. A selective HCN channel blocker abolished differences in all measures of sensory neuron excitability between WT and Fmr1 KO neurons. These results reveal a hyperexcitable state of peripheral sensory neurons in Fmr1 KO mice caused by dysfunction of HCN channels. In addition to the intrinsic neuronal dysfunction, the accompanying paper examines deficits in sensory neuron association/communication with their enveloping satellite glial cells, suggesting contributions from both neuronal intrinsic and extrinsic mechanisms to sensory dysfunction in the FXS mouse model.

| S-EPMC8727524 | biostudies-literature

Orbitofrontal cortex as a cognitive map of task space.

Project description:Orbitofrontal cortex (OFC) has long been known to play an important role in decision making. However, the exact nature of that role has remained elusive. Here, we propose a unifying theory of OFC function. We hypothesize that OFC provides an abstraction of currently available information in the form of a labeling of the current task state, which is used for reinforcement learning (RL) elsewhere in the brain. This function is especially critical when task states include unobservable information, for instance, from working memory. We use this framework to explain classic findings in reversal learning, delayed alternation, extinction, and devaluation as well as more recent findings showing the effect of OFC lesions on the firing of dopaminergic neurons in ventral tegmental area (VTA) in rodents performing an RL task. In addition, we generate a number of testable experimental predictions that can distinguish our theory from other accounts of OFC function.

| S-EPMC4001869 | biostudies-literature

Risk-responsive orbitofrontal neurons track acquired salience.

Project description:Decision making is impacted by uncertainty and risk (i.e., variance). Activity in the orbitofrontal cortex, an area implicated in decision making, covaries with these quantities. However, this activity could reflect the heightened salience of situations in which multiple outcomes-reward and reward omission-are expected. To resolve these accounts, rats were trained to respond to cues predicting 100%, 67%, 33%, or 0% reward. Consistent with prior reports, some orbitofrontal neurons fired differently in anticipation of uncertain (33% and 67%) versus certain (100% and 0%) reward. However, over 90% of these neurons also fired differently prior to 100% versus 0% reward (or baseline) or prior to 33% versus 67% reward. These responses are inconsistent with risk but fit well with the representation of acquired salience linked to the sum of cue-outcome and cue-no-outcome associative strengths. These results expand our understanding of how the orbitofrontal cortex might regulate learning and behavior.

| S-EPMC3559000 | biostudies-literature

Neurons in posterior cingulate cortex signal exploratory decisions in a dynamic multioption choice task.

Project description:In dynamic environments, adaptive behavior requires striking a balance between harvesting currently available rewards (exploitation) and gathering information about alternative options (exploration). Such strategic decisions should incorporate not only recent reward history, but also opportunity costs and environmental statistics. Previous neuroimaging and neurophysiological studies have implicated orbitofrontal cortex, anterior cingulate cortex, and ventral striatum in distinguishing between bouts of exploration and exploitation. Nonetheless, the neuronal mechanisms that underlie strategy selection remain poorly understood. We hypothesized that posterior cingulate cortex (CGp), an area linking reward processing, attention, memory, and motor control systems, mediates the integration of variables such as reward, uncertainty, and target location that underlie this dynamic balance. Here we show that CGp neurons distinguish between exploratory and exploitative decisions made by monkeys in a dynamic foraging task. Moreover, firing rates of these neurons predict in graded fashion the strategy most likely to be selected on upcoming trials. This encoding is distinct from switching between targets and is independent of the absolute magnitudes of rewards. These observations implicate CGp in the integration of individual outcomes across decision making and the modification of strategy in dynamic environments.

| S-EPMC3515083 | biostudies-literature

Methylphenidate Enhances Early-Stage Sensory Processing and Rodent Performance of a Visual Signal Detection Task.

Project description:Methylphenidate (MPH) is used clinically to treat attention-deficit/hyperactivity disorder (ADHD) and off-label as a performance-enhancing agent in healthy individuals. MPH enhances catecholamine transmission via blockade of norepinephrine (NE) and dopamine (DA) reuptake transporters. However, it is not clear how this action affects neural circuits performing cognitive and sensorimotor functions driving performance enhancement. The dorsal lateral geniculate nucleus (dLGN) is the primary thalamic relay for visual information from the retina to the cortex and is densely innervated by NE-containing fibers from the locus coeruleus (LC), a pathway known to modulate state-dependent sensory processing. Here, MPH was evaluated for its potential to alter stimulus-driven sensory responses and behavioral outcomes during performance of a visual signal detection task. MPH enhanced activity within individual neurons, ensembles of neurons, and visually-evoked potentials (VEPs) in response to task light cues, while increasing coherence within theta and beta oscillatory frequency bands. MPH also improved reaction times to make correct responses, indicating more efficient behavioral performance. Improvements in reaction speed were highly correlated with faster VEP latencies. Finally, immunostaining revealed that catecholamine innervation of the dLGN is solely noradrenergic. This work suggests that MPH, acting via noradrenergic mechanisms, can substantially affect early-stage sensory signal processing and subsequent behavioral outcomes.

| S-EPMC5437885 | biostudies-other

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data