Action initiation shapes mesolimbic dopamine encoding of future rewards.
Ontology highlight
ABSTRACT:
SUBMITTER: Syed EC
PROVIDER: S-EPMC4697363 | biostudies-literature | 2016 Jan
REPOSITORIES: biostudies-literature
Publications
Action initiation shapes mesolimbic dopamine encoding of future rewards.
Syed Emilie C J EC Grima Laura L LL Magill Peter J PJ Bogacz Rafal R Brown Peter P Walton Mark E ME
Nature neuroscience 20151207 1
It is widely held that dopamine signaling encodes predictions of future rewards and such predictions are regularly used to drive behavior, but the relationship between these two is poorly defined. We found in rats that nucleus accumbens dopamine following a reward-predicting cue was attenuated unless movement was correctly initiated. Our results indicate that dopamine release in this region is contingent on correct action initiation and not just reward prediction. ...[more]
Similar Datasets
Project description:Reward-predicting cues evoke activity in midbrain dopamine neurons that encodes fundamental attributes of economic value, including reward magnitude, delay and uncertainty. We found that dopamine release in rat nucleus accumbens encodes anticipated benefits, but not effort-based response costs unless they are atypically low. This neural separation of costs and benefits indicates that mesolimbic dopamine scales with the value of pending rewards, but does not encode the net utility of the action to obtain them.
| S-EPMC2800310 | biostudies-literature
Project description:Several emerging theories of addiction have described how abused substances exploit vulnerabilities in decision-making processes. These vulnerabilities have been proposed to result from pharmacologically corrupted neural mechanisms of normal brain valuation systems. High alcohol intake in rats during adolescence has been shown to increase risk preference, leading to suboptimal performance on a decision-making task when tested in adulthood. Understanding how alcohol use corrupts decision making in this way has significant clinical implications. However, the underlying mechanism by which alcohol use increases risk preference remains unclear. To address this central issue, we assessed dopamine neurotransmission with fast-scan cyclic voltammetry during reward valuation and risk-based decision making in rats with and without a history of adolescent alcohol intake. We specifically targeted the mesolimbic dopamine system, the site of action for virtually all abused substances. This system, which continuously develops during the adolescent period, is central to both reward processing and risk-based decision making. We report that a history of adolescent alcohol use alters dopamine signaling to risk but not to reward. Thus, a corruption of cost encoding suggests that adolescent alcohol use leads to long-term changes in decision making by altering the valuation of risk.
| S-EPMC3069180 | biostudies-other
Project description:Adaptive behavior in a dynamic environment often requires rapid revaluation of stimuli that deviates from well-learned associations. The divergence between stable value-encoding and appropriate behavioral output remains a critical test to theories of dopamine's function in learning, motivation, and motor control. Yet how dopamine neurons are involved in the revaluation of cues when the world changes to alter our behavior remains unclear. Here we make use of pharmacology, in vivo electrophysiology, fiber photometry, and optogenetics to resolve the contributions of the mesolimbic dopamine system to the dynamic reorganization of reward-seeking. Male and female rats were trained to discriminate when a conditioned stimulus would be followed by sucrose reward by exploiting the prior, non-overlapping presentation of a separate discrete cue - an occasion setter. Only when the occasion setter's presentation preceded the conditioned stimulus did the conditioned stimulus predict sucrose delivery. As a result, in this task we were able to dissociate the average value of the conditioned stimulus from its immediate expected value on a trial-to-trial basis. Both the activity of ventral tegmental area dopamine neurons and dopamine signaling in the nucleus accumbens were essential for rats to successfully update behavioral responding in response to the occasion setter. Moreover, dopamine release in the nucleus accumbens following the conditioned stimulus only occurred when the occasion setter indicated it would predict reward. Downstream of dopamine release, we found that single neurons in the nucleus accumbens dynamically tracked the value of the conditioned stimulus. Together these results reveal a novel mechanism within the mesolimbic dopamine system for the rapid revaluation of motivation.
| S-EPMC10635154 | biostudies-literature
Project description:Prolonged mesolimbic dopamine concentration changes have been detected during spatial navigation, but little is known about the conditions that engender this signaling profile or how it develops with learning. To address this, we monitored dopamine concentration changes in the nucleus accumbens core of rats throughout acquisition and performance of an instrumental action sequence task. Prolonged dopamine concentration changes were detected that ramped up as rats executed each action sequence and declined after earned reward collection. With learning, dopamine concentration began to rise increasingly earlier in the execution of the sequence and ultimately backpropagated away from stereotyped sequence actions, becoming only transiently elevated by the most distal and unexpected reward predictor. Action sequence-related dopamine signaling was reactivated in well-trained rats if they became disengaged in the task and in response to an unexpected change in the value, but not identity of the earned reward. Throughout training and test, dopamine signaling correlated with sequence performance. These results suggest that action sequences can engender a prolonged mode of dopamine signaling in the nucleus accumbens core and that such signaling relates to elements of the motivation underlying sequence execution and is dynamic with learning, overtraining and violations in reward expectation.
| S-EPMC4751524 | biostudies-literature
Project description:Ventral tegmental area (VTA) dopamine (DA) neurons play a central role in mediating motivated behaviors, but the circuitry through which they signal positive and negative motivational stimuli is incompletely understood. Using in vivo fiber photometry, we simultaneously recorded activity in DA terminals in different nucleus accumbens (NAc) subnuclei during an aversive and reward conditioning task. We find that DA terminals in the ventral NAc medial shell (vNAcMed) are excited by unexpected aversive outcomes and to cues that predict them, whereas DA terminals in other NAc subregions are persistently depressed. Excitation to reward-predictive cues dominated in the NAc lateral shell and was largely absent in the vNAcMed. Moreover, we demonstrate that glutamatergic (VGLUT2-expressing) neurons in the lateral hypothalamus represent a key afferent input for providing information about aversive outcomes to vNAcMed-projecting DA neurons. Collectively, we reveal the distinct functional contributions of separate mesolimbic DA subsystems and their afferent pathways underlying motivated behaviors. VIDEO ABSTRACT.
| S-EPMC6317997 | biostudies-literature
Project description:Midbrain dopamine neurons signal reward value, their prediction error, and the salience of events. If they play a critical role in achieving specific distant goals, long-term future rewards should also be encoded as suggested in reinforcement learning theories. Here, we address this experimentally untested issue. We recorded 185 dopamine neurons in three monkeys that performed a multistep choice task in which they explored a reward target among alternatives and then exploited that knowledge to receive one or two additional rewards by choosing the same target in a set of subsequent trials. An analysis of anticipatory licking for reward water indicated that the monkeys did not anticipate an immediately expected reward in individual trials; rather, they anticipated the sum of immediate and multiple future rewards. In accordance with this behavioral observation, the dopamine responses to the start cues and reinforcer beeps reflected the expected values of the multiple future rewards and their errors, respectively. More specifically, when monkeys learned the multistep choice task over the course of several weeks, the responses of dopamine neurons encoded the sum of the immediate and expected multiple future rewards. The dopamine responses were quantitatively predicted by theoretical descriptions of the value function with time discounting in reinforcement learning. These findings demonstrate that dopamine neurons learn to encode the long-term value of multiple future rewards with distant rewards discounted.
| S-EPMC3174584 | biostudies-literature
Project description:Sequential reward-seeking actions are readily learned despite the temporal gap between the earliest (distal) action in the sequence and the reward delivery. Fast dopamine signaling is hypothesized to mediate this form of learning by reporting errors in reward prediction. However, such a role for dopamine release in voluntarily initiated action sequences remains to be demonstrated.Using fast-scan cyclic voltammetry, we monitored phasic mesolimbic dopamine release, in real time, as rats performed a self-initiated sequence of lever presses to earn sucrose rewards. Before testing, rats received either 0 (n = 11), 5 (n = 11), or 10 (n = 8) days of action sequence training.For rats acquiring the action sequence task at test, dopamine release was strongly elicited by response-contingent (but unexpected) rewards. With learning, a significant elevation in dopamine release preceded performance of the proximal action and subsequently came to precede the distal action. This predistal dopamine release response was also observed in rats previously trained on the action sequence task, and the amplitude of this signal predicted the latency with which rats completed the action sequence. Importantly, the dopamine response to contingent reward delivery was not observed in rats given extensive pretraining. Pharmacological analysis confirmed that task performance was dopamine-dependent.These data suggest that phasic mesolimbic dopamine release mediates the influence that rewards exert over the performance of self-paced, sequentially-organized behavior and sheds light on how dopamine signaling abnormalities may contribute to disorders of behavioral control.
| S-EPMC3471807 | biostudies-literature
Project description:We previously reported that the activity of mesolimbic dopamine neurons of the ventral tegmental area (VTA) is a key determinant of behavioral susceptibility vs resilience to chronic social defeat stress. However, this was based solely on ex vivo measurements, and the in vivo firing properties of VTA dopamine neurons in susceptible and resilient mice, as well as the effects of antidepressant treatments, remain completely unknown. Here, we show that chronic (10 d) social defeat stress significantly increased the in vivo spontaneous firing rates and bursting events in susceptible mice but not in the resilient subgroup. Both the firing rates and bursting events were significantly negatively correlated with social avoidance behavior, a key behavioral abnormality induced by chronic social defeat stress. Moreover, the increased firing rates, bursting events, and avoidance behavior in susceptible mice were completely reversed by chronic (2 week), but not acute (single dose), treatments with the antidepressant medication fluoxetine (20 mg/kg). Chronic social defeat stress increased hyperpolarization-activated cation current (I(h)) in VTA dopamine neurons, an effect that was also normalized by chronic treatment with fluoxetine. As well, local infusion of I(h) inhibitors ZD7288 (0.1 ?g) or DK-AH 269 (0.6 ?g) into the VTA exerted antidepressant-like behavioral effects. Together, these data suggest that the firing patterns of mesolimbic dopamine neurons in vivo mediate an individual's responses to chronic stress and antidepressant action.
| S-EPMC3061337 | biostudies-literature
Project description:Leptin acts on leptin receptor (LepRb)-expressing neurons throughout the brain, but the roles for many populations of LepRb neurons in modulating energy balance and behavior remain unclear. We found that the majority of LepRb neurons in the lateral hypothalamic area (LHA) contain neurotensin (Nts). To investigate the physiologic role for leptin action via these LepRb(Nts) neurons, we generated mice null for LepRb specifically in Nts neurons (Nts-LepRbKO mice). Nts-LepRbKO mice demonstrate early-onset obesity, modestly increased feeding, and decreased locomotor activity. Furthermore, consistent with the connection of LepRb(Nts) neurons with local orexin (OX) neurons and the ventral tegmental area (VTA), Nts-LepRbKO mice exhibit altered regulation of OX neurons and the mesolimbic DA system. Thus, LHA LepRb(Nts) neurons mediate physiologic leptin action on OX neurons and the mesolimbic DA system, and contribute importantly to the control of energy balance.
| S-EPMC3183584 | biostudies-other
Project description:There has been significant progress in identifying genes that confer risk for autism spectrum disorders (ASDs). However, the heterogeneity of symptom presentation in ASDs impedes the detection of ASD risk genes. One approach to understanding genetic influences on ASD symptom expression is to evaluate relations between variants of ASD candidate genes and neural endophenotypes in unaffected samples. Allelic variations in the oxytocin receptor (OXTR) gene confer small but significant risk for ASDs for which the underlying mechanisms may involve associations between variability in oxytocin signaling pathways and neural response to rewards. The purpose of this preliminary study was to investigate the influence of allelic variability in the OXTR gene on neural responses to monetary rewards in healthy adults using functional magnetic resonance imaging (fMRI).The moderating effects of three single nucleotide polymorphisms (SNPs) (rs1042778, rs2268493 and rs237887) of the OXTR gene on mesolimbic responses to rewards were evaluated using a monetary incentive delay fMRI task.T homozygotes of the rs2268493 SNP demonstrated relatively decreased activation in mesolimbic reward circuitry (including the nucleus accumbens, amygdala, insula, thalamus and prefrontal cortical regions) during the anticipation of rewards but not during the outcome phase of the task. Allelic variation of the rs1042778 and rs237887 SNPs did not moderate mesolimbic activation during either reward anticipation or outcomes.This preliminary study suggests that the OXTR SNP rs2268493, which has been previously identified as an ASD risk gene, moderates mesolimbic responses during reward anticipation. Given previous findings of decreased mesolimbic activation during reward anticipation in ASD, the present results suggest that OXTR may confer ASD risk via influences on the neural systems that support reward anticipation.
| S-EPMC3922109 | biostudies-literature