Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty.

ABSTRACT: Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the environment. The brain structures important in hidden state inference remain unknown. A previous study showed that midbrain dopamine neurons exhibit distinct response patterns depending on whether reward is delivered in 100% (task 1) or 90% of trials (task 2) in a classical conditioning task. Here we found that inactivation of the medial prefrontal cortex (mPFC) affected dopaminergic signaling in task 2, in which the hidden state must be inferred ("will reward come or not?"), but not in task 1, where the state was known with certainty. Computational modeling suggests that the effects of inactivation are best explained by a circuit in which the mPFC conveys inference over hidden states to the dopamine system. VIDEO ABSTRACT.

SUBMITTER: Starkweather CK

PROVIDER: S-EPMC5934341 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty.

Starkweather Clara Kwon CK Gershman Samuel J SJ Uchida Naoshige N

Neuron 20180412 3

Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the environment. The brain structures important in hidden state inference remain unknown. A previous study showed that midbrain dopamine neurons exhibit distinct response patterns depending on whether reward is delivered in 100% (task 1) or 90% of trials (task 2) in a classical conditioning task. Here we foun ...[more]

PMID: 29656872

Similar Datasets

Expecting social punishment facilitates control over a decision under uncertainty by recruiting medial prefrontal cortex.

Project description:In many decision-making situations, sub-optimal choices are increased by uncertainty. However, when wrong choices could lead to social punishment, such as blame, people might try to improve their performance by minimizing sub-optimal choices, which could be achieved by increasing the subjective cost of errors, thereby globally reducing decision noise or reducing an uncertainty-induced component of decision noise. In this functional magnetic resonance imaging (fMRI) study, 46 participants performed a choice task in which the probability of a correct choice with a given cue and the conditional probability of blame feedback (by making an incorrect choice) changed continuously. By comparing computational models of behaviour, we found that participants optimized their performance by preferentially reducing a component of decision noise associated with uncertainty. Simultaneously, expecting blame significantly deteriorated participants' mood. Model-based fMRI analyses and dynamic causal modelling indicate that the optimization mechanism based on the expectation of being blamed would be controlled by a neural circuit centred on the right medial prefrontal cortex. These results show novel behavioural and neural mechanisms regarding how humans optimize uncertain decisions under the expectation of being blamed.

| S-EPMC7745153 | biostudies-literature

Pain modulates neural responses to reward in the medial prefrontal cortex.

Project description:Pain has been found to promote reward-seeking behaviors, which might be a consequence of modulated brain activities in the reward neural circuitry in a painful state. The present study investigated how pain affected reward processing and reward-related neural activities using fMRI technique. A total of 50 healthy participants were recruited and used for data analyses, with half being treated with topical capsaicin cream and the other half with hand cream (treatment: pain or control). The participants were asked to perform a card-guessing game when their brain activities responding to feedbacks (outcome: win or loss) were recorded. Behavioral results showed that participants in pain group overestimated their correct choices in the card-guess game. Whole-brain fMRI analysis revealed that the main effect of outcome (win vs. loss) activated a typical network of the reward neural circuitry, including the medial prefrontal cortex (mPFC) and the bilateral nucleus accumbens (NAcc). Importantly, the region of interest analysis revealed a significant interaction of treatment and outcome in the mPFC, with increased mPFC neural activity responding to win outcome in pain condition. Moreover, the functional connectivity between the mPFC and the NAcc was decreased in pain condition. We conclude that the pain-induced modulation of the mPFC activity could result in alterations of both the emotional response to and the cognitive evaluation of reward.

| S-EPMC7267926 | biostudies-literature

Dopamine reward prediction errors reflect hidden-state inference across time.

Project description:Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a 'belief state'). Here we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling showed a notable difference between two tasks that differed only with respect to whether reward was delivered in a deterministic manner. Our results favor an associative learning rule that combines cached values with hidden-state inference.

| S-EPMC5374025 | biostudies-literature

Hunger or thirst state uncertainty is resolved by outcome evaluation in medial prefrontal cortex to guide decision-making.

Project description:Physiological need states direct decision-making toward re-establishing homeostasis. Using a two-alternative forced choice task for mice that models elements of human decisions, we found that varying hunger and thirst states caused need-inappropriate choices, such as food seeking when thirsty. These results show limits on interoceptive knowledge of hunger and thirst states to guide decision-making. Instead, need states were identified after food and water consumption by outcome evaluation, which depended on the medial prefrontal cortex.

| S-EPMC8254795 | biostudies-literature

Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence.

Project description:Patients suffering from addiction persist in consuming substances of abuse, despite negative consequences or absence of positive consequences. One potential explanation is that these patients are impaired at flexibly adapting their behavior to changes in reward contingencies. A key aspect of adaptive decision-making involves updating the value of behavioral options. This is thought to be mediated via a teaching signal expressed as a reward prediction error (PE) in the striatum. However, to exert control over adaptive behavior, value signals need to be broadcast to higher executive regions, such as prefrontal cortex. Here we used functional MRI and a reinforcement learning task to investigate the neural mechanisms underlying maladaptive behavior in human male alcohol-dependent patients. We show that in alcohol-dependent patients the expression of striatal PEs is intact. However, abnormal functional connectivity between striatum and dorsolateral prefrontal cortex (dlPFC) predicted impairments in learning and the magnitude of alcohol craving. These results are in line with reports of dlPFC structural abnormalities in substance dependence and highlight the importance of frontostriatal connectivity in addiction, and its pivotal role in adaptive updating of action values and behavioral regulation. Furthermore, they extend the scope of neurobiological deficits underlying addiction beyond the focus on the striatum.

| S-EPMC3047386 | biostudies-literature

Making sense: Dopamine activates conscious self-monitoring through medial prefrontal cortex.

Project description:When experiences become meaningful to the self, they are linked to synchronous activity in a paralimbic network of self-awareness and dopaminergic activity. This network includes medial prefrontal and medial parietal/posterior cingulate cortices, where transcranial magnetic stimulation may transiently impair self-awareness. Conversely, we hypothesize that dopaminergic stimulation may improve self-awareness and metacognition (i.e., the ability of the brain to consciously monitor its own cognitive processes). Here, we demonstrate improved noetic (conscious) metacognition by oral administration of 100 mg dopamine in minimal self-awareness. In a separate experiment with extended self-awareness dopamine improved the retrieval accuracy of memories of self-judgment (autonoetic, i.e., explicitly self-conscious) metacognition. Concomitantly, magnetoencephalography (MEG) showed increased amplitudes of oscillations (power) preferentially in the medial prefrontal cortex. Given that electromagnetic activity in this region is instrumental in self-awareness, this explains the specific effect of dopamine on explicit self-awareness and autonoetic metacognition.

| S-EPMC4737196 | biostudies-literature

Medial prefrontal cortex dopamine controls the persistent storage of aversive memories.

Project description:Medial prefrontal cortex (mPFC) is essential for initial memory processing and expression but its involvement in persistent memory storage has seldom been studied. Using the hippocampus dependent inhibitory avoidance learning task and the hippocampus-independent conditioned taste aversion paradigm together with specific dopamine receptor agonists and antagonists we found that persistence but not formation of long-term aversive memories requires dopamine D1/D5 receptors activation in mPFC immediately after training and, depending on the task, between 6 and 12 h later. Our results indicate that besides its well-known participation in retrieval and early consolidation, mPFC also modulates the endurance of long-lasting aversive memories regardless of whether formation of the aversive mnemonic trace requires the participation of the hippocampus.

| S-EPMC4246460 | biostudies-literature

Functional dissociations of risk and reward processing in the medial prefrontal cortex.

Project description:Making a risky decision is a complex process that involves evaluation of both the value of the options and the associated risk level. Yet the neural processes underlying these processes have not so far been clearly identified. Using functional magnetic resonance imaging and a task that simulates risky decisions, we found that the dorsal region of the medial prefrontal cortex (MPFC) was activated whenever a risky decision was made, but the degree of this activity across subjects was negatively correlated with their risk preference. In contrast, the ventral MPFC was parametrically modulated by the received gain/loss, and the activation in this region was positively correlated with an individual's risk preference. These results extend existing neurological evidence by showing that the dorsal and ventral MPFC convey different decision signals (i.e., aversion to uncertainty vs. approach to rewarding outcomes), where the relative strengths of these signals determine behavioral decisions involving risk and uncertainty.

| S-EPMC2665154 | biostudies-literature

Asymmetric coding of reward prediction errors in human insula and dorsomedial prefrontal cortex.

Project description:The signed value and unsigned salience of reward prediction errors (RPEs) are critical to understanding reinforcement learning (RL) and cognitive control. Dorsomedial prefrontal cortex (dMPFC) and insula (INS) are key regions for integrating reward and surprise information, but conflicting evidence for both signed and unsigned activity has led to multiple proposals for the nature of RPE representations in these brain areas. Recently developed RL models allow neurons to respond differently to positive and negative RPEs. Here, we use intracranially recorded high frequency activity (HFA) to test whether this flexible asymmetric coding strategy captures RPE coding diversity in human INS and dMPFC. At the region level, we found a bias towards positive RPEs in both areas which paralleled behavioral adaptation. At the local level, we found spatially interleaved neural populations responding to unsigned RPE salience and valence-specific positive and negative RPEs. Furthermore, directional connectivity estimates revealed a leading role of INS in communicating positive and unsigned RPEs to dMPFC. These findings support asymmetric coding across distinct but intermingled neural populations as a core principle of RPE processing and inform theories of the role of dMPFC and INS in RL and cognitive control.

| S-EPMC10739882 | biostudies-literature

Dopamine modulates inwardly rectifying potassium currents in medial prefrontal cortex pyramidal neurons.

Project description:Dopamine (DA) modulation of excitability in medial prefrontal cortex (mPFC) pyramidal neurons has attracted considerable attention because of the involvement of mPFC DA in several neuronal disorders. Here, we focused on DA modulation of inwardly rectifying K(+) current (IRKC) in pyramidal neurons acutely dissociated from rat mPFC. A Cs(+)-sensitive whole-cell IRKC was elicited by hyperpolarizing voltage steps from a holding potential of -50 mV. DA (20 microm) reduced IRKC amplitude, as did selective stimulation of DA D(1) or D(2) class receptors (D(1)Rs and D(2)Rs). D(1)Rs activate, whereas D(2)Rs inhibit, the adenylyl cyclase-cAMP-protein kinase A (PKA) signaling pathway. Suppression of IRKC by D(2)R stimulation was attributable to decreased PKA activity because similar inhibition was observed with PKA inhibitors, whereas enhancing PKA activity increased IRKC. This suggests that the DA D(1)R suppression of IRKC occurred through a PKA phosphorylation-independent process. Using outside-out patches of mPFC pyramidal neurons, which preclude involvement of cytosolic signaling molecules, we observed a Cs(+)-sensitive macroscopic IRKC that was suppressed by the membrane-permeable cyclic nucleotide Sp-cAMP but was unaffected by non-nucleotide modulators of PKA, suggesting direct interactions of the cyclic nucleotides with IRK channels. Our results indicate that DA suppresses IRKC through two mechanisms: D(1)R activation of cAMP and direct interactions of the nucleotide with IRK channels and D(2)R-mediated dephosphorylation of IRK channels. The DA modulation of IRKC indicates that ambient DA would tend to increase responsiveness to excitatory inputs when PFC neurons are near the resting membrane potential and may provide a mechanism by which DA impacts higher cognitive function.

| S-EPMC6729848 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data