Rapid Rule-Based Reward Reversal and the Lateral Orbitofrontal Cortex.
Ontology highlight
ABSTRACT:
SUBMITTER: Rolls ET
PROVIDER: S-EPMC8152898 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Adapting behavior to a dynamic environment requires both steadiness when the environment is stable and behavioral flexibility in response to changes. Much evidence suggests that cognitive flexibility, which can be operationalized in reversal learning tasks, is mediated by cortico-striatal circuitries, with the orbitofrontal cortex (OFC) playing a prominent role. The OFC is a functionally heterogeneous region, and we have previously reported differential roles of lateral (lOFC) and medial (mOFC) regions in a touchscreen serial visual reversal learning task for rats using pharmacological inactivation. Here, we investigated the effects of pharmacological overactivation of these regions using a glutamate transporter 1 (GLT-1) inhibitor, dihydrokainate (DHK), which increases extracellular glutamate by blocking its reuptake. We also tested the impact of antagonism of the serotonin 2A receptor (5-HT2AR), which modulates glutamate action, in the mOFC and lOFC on the same task. Overactivation induced by DHK produced dissociable effects in the mOFC and lOFC, with more prominent effects in the mOFC, specifically improving performance in the early, perseveration phase. Intra-lOFC DHK increased the number of omitted responses without affecting errors. In contrast, blocking the 5-HT2AR in the lOFC impaired reversal learning overall, while mOFC 5-HT2AR blockade had no effect. These results further support dissociable roles of the rodent mOFC and lOFC in deterministic visual reversal learning and indicate that modulating glutamate transmission through blocking the GLT-1 and the 5-HT2AR have different roles in these two structures.
| S-EPMC7872199 | biostudies-literature
Project description:Neuronal oscillations in the frontal cortex have been hypothesized to play a role in the organization of high-level cognition. Within the orbitofrontal cortex (OFC), there is a prominent oscillation in the theta frequency (4-8 Hz) during reward-guided behavior, but it is unclear whether this oscillation has causal significance. One methodological challenge is that it is difficult to manipulate theta without affecting other neural signals, such as single-neuron firing rates. A potential solution is to use closed-loop control to record theta in real time and use this signal to control the application of electrical microstimulation to the OFC. Using this method, we show that theta oscillations in the OFC are critically important for reward-guided learning and that they are driven by theta oscillations in the hippocampus (HPC). The ability to disrupt OFC computations via spatially localized and temporally precise stimulation could lead to novel treatment strategies for neuropsychiatric disorders involving OFC dysfunction.
| S-EPMC7480400 | biostudies-literature
Project description:Pleasurable stimuli, including reward, inhibit pain, but the level of the neuraxis at which they do so and the cerebral processes involved are unknown. Here, we characterized a brain circuitry mediating pain inhibition by reward. Twenty-four healthy participants underwent functional magnetic resonance imaging while playing a wheel of fortune game with simultaneous thermal pain stimuli and monetary wins or losses. As expected, winning decreased pain perception compared to losing. Inter-individual differences in pain modulation by monetary wins relative to losses correlated with activation in the medial orbitofrontal cortex (mOFC). When pain and reward occured simultaneously, mOFCs functional connectivity changed: the signal time course in the mOFC condition-dependent correlated negatively with the signal time courses in the rostral anterior insula, anterior-dorsal cingulate cortex and primary somatosensory cortex, which might signify moment-to-moment down-regulation of these regions by the mOFC. Monetary wins and losses did not change the magnitude of pain-related activation, including in regions that code perceived pain intensity when nociceptive input varies and/or receive direct nociceptive input. Pain inhibition by reward appears to involve brain regions not typically involved in nociceptive intensity coding but likely mediate changes in the significance and/or value of pain.
| S-EPMC5390724 | biostudies-literature
Project description:The orbitofrontal cortex (OFC) is involved in cognitive functions, and is also closely related to autonomic functions. The OFC is densely connected with the hypothalamus, a heterogeneous structure controlling autonomic functions that can be divided into two major parts: the lateral and the medial. Resting-state functional connectivity has allowed us to parcellate the cerebral cortex into putative functional areas based on the changes in the spatial pattern of connectivity in the cerebral cortex when a seed point is moved from one voxel to another. In the present high spatial-resolution fMRI study, we investigate the connectivity-based organization of the OFC with reference to the hypothalamus. The OFC was parcellated using resting-state functional connectivity in an individual subject approach, and then the functional connectivity was examined between the parcellated areas in the OFC and the lateral/medial hypothalamus. We found a functional double dissociation in the OFC: the lateral OFC (the lateral orbital gyrus) was more likely connected with the lateral hypothalamus, whereas the medial OFC (the medial orbital and rectal gyri) was more likely connected with the medial hypothalamus. These results demonstrate the fundamental heterogeneity of the OFC, and suggest a potential neural basis of the OFC-hypothalamic functional interaction.
| S-EPMC4880561 | biostudies-literature
Project description:An optimal choice among alternative behavioral options requires precise anticipatory representations of their possible outcomes. A fundamental question is how such anticipated outcomes are represented in the brain. Reward coding at the level of single cells in the orbitofrontal cortex (OFC) follows a more heterogeneous coding scheme than suggested by studies using functional MRI (fMRI) in humans. Using a combination of multivariate pattern classification and fMRI we show that the reward value of sensory cues can be decoded from distributed fMRI patterns in the OFC. This distributed representation is compatible with previous reports from animal electrophysiology that show that reward is encoded by different neural populations with opposing coding schemes. Importantly, the fMRI patterns representing specific values during anticipation are similar to those that emerge during the receipt of reward. Furthermore, we show that the degree of this coding similarity is related to subjects' ability to use value information to guide behavior. These findings narrow the gap between reward coding in humans and animals and corroborate the notion that value representations in OFC are independent of whether reward is anticipated or actually received.
| S-EPMC2851854 | biostudies-other
Project description:To successfully evaluate potential courses of action and choose the most favorable, we must consider the outcomes that may result. Many choices involve risk, our assessment of which may lead us to success or failure in matters financial, legal or health-related. The orbitofrontal cortex (OFC) has been implicated as critical for evaluating choices based on risk. To measure how outcomes of risky decisions are represented in the OFC, we recorded the electrophysiological activity of single neurons while rats made behavioral responses to obtain rewards under conditions of either certainty or risk. Rats exhibited different risk-preferences when given the opportunity to choose. In risk-preferring rats, OFC responses were enhanced following the delivery of large rewards obtained under risk compared with smaller, certain rewards and reward omission. However, in risk-neutral rats, neurons showed similarly enhanced responses to both large rewards obtained under risk and smaller, certain rewards compared with reward omission. Thus, the responses of OFC neurons reflected the subjective evaluation of outcomes in individuals with different risk-preferences. Such enhanced neural responding to risky rewards may serve to bias individuals towards risk-preference in decision-making.
| S-EPMC3745026 | biostudies-literature
Project description:Anterior insular and orbitofrontal cortex (AIC and OFC, respectively) are known to play important roles in decision making under risk. However, risk-related AIC neural activity has not been investigated and it is controversial whether the rodent OFC conveys genuine risk signals. To address these issues, we examined AIC and OFC neuronal activity in rats responding to five distinct auditory cues predicting water reward with different probabilities. Both structures conveyed significant neural signals for reward, value and risk, with value and risk signals conjunctively coded. However, value signals were stronger and appeared earlier in the OFC, and many risk-coding OFC neurons responded only to the cue predicting certain (100%) reward. Also, AIC neurons tended to increase their activity for a prolonged time following a negative outcome and according to previously expected value. These results show that both the AIC and OFC convey neural signals related to reward uncertainty, but in different ways. The OFC might play an important role in encoding certain reward-biased, risk-modulated subjective value, whereas the AIC might convey prolonged negative outcome and disappointment signals.
| S-EPMC4823699 | biostudies-other
Project description:It is well established that aesthetic appreciation is related with activity in several different brain regions. The identification of the neural correlates of beauty or liking ratings has been the focus of most prior studies. Not much attention has been directed towards the fact that humans are surrounded by objects that lead them to experience aesthetic indifference or leave them with a negative aesthetic impression. Here we explore the neural substrate of such experiences. Given the neuroimaging techniques that have been used, little is known about the temporal features of such brain activity. By means of magnetoencephalography we registered the moment at which brain activity differed while participants viewed images they considered to be beautiful or not. Results show that the first differential activity appears between 300 and 400 ms after stimulus onset. During this period activity in right lateral orbitofrontal cortex (lOFC) was greater while participants rated visual stimuli as not beautiful than when they rated them as beautiful. We argue that this activity is associated with an initial negative aesthetic impression formation, driven by the relative hedonic value of stimuli regarded as not beautiful. Additionally, our results contribute to the understanding of the nature of the functional roles of the lOFC.
| S-EPMC3367021 | biostudies-literature
Project description:Cerebral cortical gamma-aminobutyric acidergic interneuron dysfunction is hypothesized to lead to cognitive deficits comorbid with human neuropsychiatric disorders, including schizophrenia, autism, and epilepsy. We have previously shown that mice that harbor mutations in the Plaur gene, which is associated with schizophrenia, have deficits in frontal cortical parvalbumin-expressing interneurons. Plaur mice have impaired reversal learning, similar to deficits observed in patients with schizophrenia.We examined the role of parvalbumin interneurons in orbitofrontal cortex during reversal learning by recording single unit activity from 180 control and 224 Plaur mouse neurons during a serial reversal task. Neural activity was analyzed during correct and incorrect decision choices and reward receipt.Neurons in control mice exhibited strong phasic responses both during discrimination and reversal learning to decisions and rewards, and the strength of the response was correlated with behavioral performance. Although baseline firing was significantly enhanced in Plaur mice, neural selectivity for correct or erroneous decisions was diminished and not correlated with behavior, and reward encoding was downscaled. In addition, Plaur mice showed a significant reduction in the number of neurons that encoded expected outcomes across task phases during the decision period.These data indicate that parvalbumin interneurons are necessary for the representation of outcomes in orbitofrontal cortex. Deficits in inhibition blunt selective neural firing during key decisions, contributing to behavioral inflexibility. These data provide a potential explanation for disorders of cognitive control that accompany the loss of these gamma-aminobutyric acidergic interneurons in human neuropsychiatric disorders, such as autism, epilepsy, and schizophrenia.
| S-EPMC4312743 | biostudies-literature
Project description:To study how the interaction between orbitofrontal (OFC) and rhinal (Rh) cortices influences the judgment of reward size, we reversibly disconnected these regions using hM4Di-DREADD (designer receptor exclusively activated by designer drug). Repeated inactivation reduced sensitivity to differences in reward size in two monkeys. These results suggest that retrieval of relative stimulus values from memory depends on the interaction between Rh and OFC.
| S-EPMC4866611 | biostudies-literature