Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine.
Ontology highlight
ABSTRACT:
SUBMITTER: Gan JO
PROVIDER: S-EPMC2800310 | biostudies-literature | 2010 Jan
REPOSITORIES: biostudies-literature
Publications
Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine.
Gan Jerylin O JO Walton Mark E ME Phillips Paul E M PE
Nature neuroscience 20091110 1
Reward-predicting cues evoke activity in midbrain dopamine neurons that encodes fundamental attributes of economic value, including reward magnitude, delay and uncertainty. We found that dopamine release in rat nucleus accumbens encodes anticipated benefits, but not effort-based response costs unless they are atypically low. This neural separation of costs and benefits indicates that mesolimbic dopamine scales with the value of pending rewards, but does not encode the net utility of the action t ...[more]
Similar Datasets
Project description:It is widely held that dopamine signaling encodes predictions of future rewards and such predictions are regularly used to drive behavior, but the relationship between these two is poorly defined. We found in rats that nucleus accumbens dopamine following a reward-predicting cue was attenuated unless movement was correctly initiated. Our results indicate that dopamine release in this region is contingent on correct action initiation and not just reward prediction.
| S-EPMC4697363 | biostudies-literature
Project description:Several emerging theories of addiction have described how abused substances exploit vulnerabilities in decision-making processes. These vulnerabilities have been proposed to result from pharmacologically corrupted neural mechanisms of normal brain valuation systems. High alcohol intake in rats during adolescence has been shown to increase risk preference, leading to suboptimal performance on a decision-making task when tested in adulthood. Understanding how alcohol use corrupts decision making in this way has significant clinical implications. However, the underlying mechanism by which alcohol use increases risk preference remains unclear. To address this central issue, we assessed dopamine neurotransmission with fast-scan cyclic voltammetry during reward valuation and risk-based decision making in rats with and without a history of adolescent alcohol intake. We specifically targeted the mesolimbic dopamine system, the site of action for virtually all abused substances. This system, which continuously develops during the adolescent period, is central to both reward processing and risk-based decision making. We report that a history of adolescent alcohol use alters dopamine signaling to risk but not to reward. Thus, a corruption of cost encoding suggests that adolescent alcohol use leads to long-term changes in decision making by altering the valuation of risk.
| S-EPMC3069180 | biostudies-other
Project description:Context can influence reactions to environmental cues and this elemental process has implications for substance use disorder. Using an animal model, we show that an alcohol-associated context elevates entry into a fluid port triggered by a conditioned stimulus (CS) that predicted alcohol (CS-triggered alcohol-seeking). This effect persists across multiple sessions and, after it diminishes in extinction, the alcohol context retains the capacity to augment reinstatement. Systemically administered eticlopride and chemogenetic inhibition of ventral tegmental area (VTA) dopamine neurons reduce CS-triggered alcohol-seeking. Chemogenetically silencing VTA dopamine terminals in the nucleus accumbens (NAc) core reduces CS-triggered alcohol-seeking, irrespective of context, whereas silencing VTA dopamine terminals in the NAc shell selectively reduces the elevation of CS-triggered alcohol-seeking in an alcohol context. This dissociation reveals new roles for divergent mesolimbic dopamine circuits in the control of responding to a discrete cue for alcohol and in the amplification of this behaviour in an alcohol context.
| S-EPMC7534644 | biostudies-literature
Project description:Adaptive behavior in a dynamic environment often requires rapid revaluation of stimuli that deviates from well-learned associations. The divergence between stable value-encoding and appropriate behavioral output remains a critical test to theories of dopamine's function in learning, motivation, and motor control. Yet how dopamine neurons are involved in the revaluation of cues when the world changes to alter our behavior remains unclear. Here we make use of pharmacology, in vivo electrophysiology, fiber photometry, and optogenetics to resolve the contributions of the mesolimbic dopamine system to the dynamic reorganization of reward-seeking. Male and female rats were trained to discriminate when a conditioned stimulus would be followed by sucrose reward by exploiting the prior, non-overlapping presentation of a separate discrete cue - an occasion setter. Only when the occasion setter's presentation preceded the conditioned stimulus did the conditioned stimulus predict sucrose delivery. As a result, in this task we were able to dissociate the average value of the conditioned stimulus from its immediate expected value on a trial-to-trial basis. Both the activity of ventral tegmental area dopamine neurons and dopamine signaling in the nucleus accumbens were essential for rats to successfully update behavioral responding in response to the occasion setter. Moreover, dopamine release in the nucleus accumbens following the conditioned stimulus only occurred when the occasion setter indicated it would predict reward. Downstream of dopamine release, we found that single neurons in the nucleus accumbens dynamically tracked the value of the conditioned stimulus. Together these results reveal a novel mechanism within the mesolimbic dopamine system for the rapid revaluation of motivation.
| S-EPMC10635154 | biostudies-literature
Project description:Ventral tegmental area (VTA) dopamine (DA) neurons play a central role in mediating motivated behaviors, but the circuitry through which they signal positive and negative motivational stimuli is incompletely understood. Using in vivo fiber photometry, we simultaneously recorded activity in DA terminals in different nucleus accumbens (NAc) subnuclei during an aversive and reward conditioning task. We find that DA terminals in the ventral NAc medial shell (vNAcMed) are excited by unexpected aversive outcomes and to cues that predict them, whereas DA terminals in other NAc subregions are persistently depressed. Excitation to reward-predictive cues dominated in the NAc lateral shell and was largely absent in the vNAcMed. Moreover, we demonstrate that glutamatergic (VGLUT2-expressing) neurons in the lateral hypothalamus represent a key afferent input for providing information about aversive outcomes to vNAcMed-projecting DA neurons. Collectively, we reveal the distinct functional contributions of separate mesolimbic DA subsystems and their afferent pathways underlying motivated behaviors. VIDEO ABSTRACT.
| S-EPMC6317997 | biostudies-literature
Project description:Midbrain dopamine neurons signal reward value, their prediction error, and the salience of events. If they play a critical role in achieving specific distant goals, long-term future rewards should also be encoded as suggested in reinforcement learning theories. Here, we address this experimentally untested issue. We recorded 185 dopamine neurons in three monkeys that performed a multistep choice task in which they explored a reward target among alternatives and then exploited that knowledge to receive one or two additional rewards by choosing the same target in a set of subsequent trials. An analysis of anticipatory licking for reward water indicated that the monkeys did not anticipate an immediately expected reward in individual trials; rather, they anticipated the sum of immediate and multiple future rewards. In accordance with this behavioral observation, the dopamine responses to the start cues and reinforcer beeps reflected the expected values of the multiple future rewards and their errors, respectively. More specifically, when monkeys learned the multistep choice task over the course of several weeks, the responses of dopamine neurons encoded the sum of the immediate and expected multiple future rewards. The dopamine responses were quantitatively predicted by theoretical descriptions of the value function with time discounting in reinforcement learning. These findings demonstrate that dopamine neurons learn to encode the long-term value of multiple future rewards with distant rewards discounted.
| S-EPMC3174584 | biostudies-literature
Project description:Reward-prediction errors track the extent to which rewards deviate from expectations, and aid in learning. How do such errors in prediction interact with memory for the rewarding episode? Existing findings point to both cooperative and competitive interactions between learning and memory mechanisms. Here, we investigated whether learning about rewards in a high-risk context, with frequent, large prediction errors, would give rise to higher fidelity memory traces for rewarding events than learning in a low-risk context. Experiment 1 showed that recognition was better for items associated with larger absolute prediction errors during reward learning. Larger prediction errors also led to higher rates of learning about rewards. Interestingly we did not find a relationship between learning rate for reward and recognition-memory accuracy for items, suggesting that these two effects of prediction errors were caused by separate underlying mechanisms. In Experiment 2, we replicated these results with a longer task that posed stronger memory demands and allowed for more learning. We also showed improved source and sequence memory for items within the high-risk context. In Experiment 3, we controlled for the difficulty of reward learning in the risk environments, again replicating the previous results. Moreover, this control revealed that the high-risk context enhanced item-recognition memory beyond the effect of prediction errors. In summary, our results show that prediction errors boost both episodic item memory and incremental reward learning, but the two effects are likely mediated by distinct underlying systems. (PsycINFO Database Record
| S-EPMC6117220 | biostudies-literature
Project description:Midbrain dopamine neurons are known to encode reward prediction errors (RPE) used to update value predictions. Here, we examine whether RPE signals coded by midbrain dopamine neurons are modulated by the cost paid to obtain rewards, by recording from dopamine neurons in awake behaving monkeys during performance of an effortful saccade task. Dopamine neuron responses to cues predicting reward and to the delivery of rewards were increased after the performance of a costly action compared to a less costly action, suggesting that RPEs are enhanced following the performance of a costly action. At the behavioral level, stimulus-reward associations are learned faster after performing a costly action compared to a less costly action. Thus, information about action cost is processed in the dopamine reward system in a manner that amplifies the following dopamine RPE signal, which in turn promotes more rapid learning under situations of high cost.
| S-EPMC6695452 | biostudies-literature
Project description:There has been significant progress in identifying genes that confer risk for autism spectrum disorders (ASDs). However, the heterogeneity of symptom presentation in ASDs impedes the detection of ASD risk genes. One approach to understanding genetic influences on ASD symptom expression is to evaluate relations between variants of ASD candidate genes and neural endophenotypes in unaffected samples. Allelic variations in the oxytocin receptor (OXTR) gene confer small but significant risk for ASDs for which the underlying mechanisms may involve associations between variability in oxytocin signaling pathways and neural response to rewards. The purpose of this preliminary study was to investigate the influence of allelic variability in the OXTR gene on neural responses to monetary rewards in healthy adults using functional magnetic resonance imaging (fMRI).The moderating effects of three single nucleotide polymorphisms (SNPs) (rs1042778, rs2268493 and rs237887) of the OXTR gene on mesolimbic responses to rewards were evaluated using a monetary incentive delay fMRI task.T homozygotes of the rs2268493 SNP demonstrated relatively decreased activation in mesolimbic reward circuitry (including the nucleus accumbens, amygdala, insula, thalamus and prefrontal cortical regions) during the anticipation of rewards but not during the outcome phase of the task. Allelic variation of the rs1042778 and rs237887 SNPs did not moderate mesolimbic activation during either reward anticipation or outcomes.This preliminary study suggests that the OXTR SNP rs2268493, which has been previously identified as an ASD risk gene, moderates mesolimbic responses during reward anticipation. Given previous findings of decreased mesolimbic activation during reward anticipation in ASD, the present results suggest that OXTR may confer ASD risk via influences on the neural systems that support reward anticipation.
| S-EPMC3922109 | biostudies-literature
Project description:Dopamine cell firing can encode errors in reward prediction, providing a learning signal to guide future behavior. Yet dopamine is also a key modulator of motivation, invigorating current behavior. Existing theories propose that fast (phasic) dopamine fluctuations support learning, whereas much slower (tonic) dopamine changes are involved in motivation. We examined dopamine release in the nucleus accumbens across multiple time scales, using complementary microdialysis and voltammetric methods during adaptive decision-making. We found that minute-by-minute dopamine levels covaried with reward rate and motivational vigor. Second-by-second dopamine release encoded an estimate of temporally discounted future reward (a value function). Changing dopamine immediately altered willingness to work and reinforced preceding action choices by encoding temporal-difference reward prediction errors. Our results indicate that dopamine conveys a single, rapidly evolving decision variable, the available reward for investment of effort, which is employed for both learning and motivational functions.
| S-EPMC4696912 | biostudies-literature