Browse
Submit Data
Databases
API
Help

Dataset Information

33 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons.

ABSTRACT: Midbrain dopamine neurons are known to encode reward prediction errors (RPE) used to update value predictions. Here, we examine whether RPE signals coded by midbrain dopamine neurons are modulated by the cost paid to obtain rewards, by recording from dopamine neurons in awake behaving monkeys during performance of an effortful saccade task. Dopamine neuron responses to cues predicting reward and to the delivery of rewards were increased after the performance of a costly action compared to a less costly action, suggesting that RPEs are enhanced following the performance of a costly action. At the behavioral level, stimulus-reward associations are learned faster after performing a costly action compared to a less costly action. Thus, information about action cost is processed in the dopamine reward system in a manner that amplifies the following dopamine RPE signal, which in turn promotes more rapid learning under situations of high cost.

SUBMITTER: Tanaka S

PROVIDER: S-EPMC6695452 | biostudies-literature | 2019 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

The cost of obtaining rewards enhances the reward prediction error signal of midbrain dopamine neurons.

Tanaka Shingo S O'Doherty John P JP Sakagami Masamichi M

Nature communications 20190815 1

Midbrain dopamine neurons are known to encode reward prediction errors (RPE) used to update value predictions. Here, we examine whether RPE signals coded by midbrain dopamine neurons are modulated by the cost paid to obtain rewards, by recording from dopamine neurons in awake behaving monkeys during performance of an effortful saccade task. Dopamine neuron responses to cues predicting reward and to the delivery of rewards were increased after the performance of a costly action compared to a less ...[more]

PMID: 31417077

Similar Datasets

Midbrain dopamine neurons signal preference for advance information about upcoming rewards.

Project description:The desire to know what the future holds is a powerful motivator in everyday life, but it is unknown how this desire is created by neurons in the brain. Here we show that when macaque monkeys are offered a water reward of variable magnitude, they seek advance information about its size. Furthermore, the same midbrain dopamine neurons that signal the expected amount of water also signal the expectation of information, in a manner that is correlated with the strength of the animal's preference. Our data show that single dopamine neurons process both primitive and cognitive rewards, and suggest that current theories of reward-seeking must be revised to include information-seeking.

| S-EPMC2723053 | biostudies-literature

Reward-predictive cues enhance excitatory synaptic strength onto midbrain dopamine neurons.

Project description:Using sensory information for the prediction of future events is essential for survival. Midbrain dopamine neurons are activated by environmental cues that predict rewards, but the cellular mechanisms that underlie this phenomenon remain elusive. We used in vivo voltammetry and in vitro patch-clamp electrophysiology to show that both dopamine release to reward predictive cues and enhanced synaptic strength onto dopamine neurons develop over the course of cue-reward learning. Increased synaptic strength was not observed after stable behavioral responding. Thus, enhanced synaptic strength onto dopamine neurons may act to facilitate the transformation of neutral environmental stimuli to salient reward-predictive cues.

| S-EPMC2613864 | biostudies-literature

Dopamine neurons share common response function for reward prediction error.

Project description:Dopamine neurons are thought to signal reward prediction error, or the difference between actual and predicted reward. How dopamine neurons jointly encode this information, however, remains unclear. One possibility is that different neurons specialize in different aspects of prediction error; another is that each neuron calculates prediction error in the same way. We recorded from optogenetically identified dopamine neurons in the lateral ventral tegmental area (VTA) while mice performed classical conditioning tasks. Our tasks allowed us to determine the full prediction error functions of dopamine neurons and compare them to each other. We found marked homogeneity among individual dopamine neurons: their responses to both unexpected and expected rewards followed the same function, just scaled up or down. As a result, we were able to describe both individual and population responses using just two parameters. Such uniformity ensures robust information coding, allowing each dopamine neuron to contribute fully to the prediction error signal.

| S-EPMC4767554 | biostudies-literature

The timing of action determines reward prediction signals in identified midbrain dopamine neurons.

Project description:Animals adapt their behavior in response to informative sensory cues using multiple brain circuits. The activity of midbrain dopaminergic neurons is thought to convey a critical teaching signal: reward-prediction error. Although reward-prediction error signals are thought to be essential to learning, little is known about the dynamic changes in the activity of midbrain dopaminergic neurons as animals learn about novel sensory cues and appetitive rewards. Here we describe a large dataset of cell-attached recordings of identified dopaminergic neurons as naive mice learned a novel cue-reward association. During learning midbrain dopaminergic neuron activity results from the summation of sensory cue-related and movement initiation-related response components. These components are both a function of reward expectation yet they are dissociable. Learning produces an increasingly precise coordination of action initiation following sensory cues that results in apparent reward-prediction error correlates. Our data thus provide new insights into the circuit mechanisms that underlie a critical computation in a highly conserved learning circuit.

| S-EPMC6226028 | biostudies-literature

Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision.

Project description:Central to the organization of behavior is the ability to predict the values of outcomes to guide choices. The accuracy of such predictions is honed by a teaching signal that indicates how incorrect a prediction was ("reward prediction error," RPE). In several reinforcement learning contexts, such as Pavlovian conditioning and decisions guided by reward history, this RPE signal is provided by midbrain dopamine neurons. In many situations, however, the stimuli predictive of outcomes are perceptually ambiguous. Perceptual uncertainty is known to influence choices, but it has been unclear whether or how dopamine neurons factor it into their teaching signal. To cope with uncertainty, we extended a reinforcement learning model with a belief state about the perceptually ambiguous stimulus; this model generates an estimate of the probability of choice correctness, termed decision confidence. We show that dopamine responses in monkeys performing a perceptually ambiguous decision task comply with the model's predictions. Consequently, dopamine responses did not simply reflect a stimulus' average expected reward value but were predictive of the trial-to-trial fluctuations in perceptual accuracy. These confidence-dependent dopamine responses emerged prior to monkeys' choice initiation, raising the possibility that dopamine impacts impending decisions, in addition to encoding a post-decision teaching signal. Finally, by manipulating reward size, we found that dopamine neurons reflect both the upcoming reward size and the confidence in achieving it. Together, our results show that dopamine responses convey teaching signals that are also appropriate for perceptual decisions.

| S-EPMC5819757 | biostudies-literature

Signal dynamics of midbrain dopamine neurons during economic decision-making in monkeys.

Project description:When we make economic choices, the brain first evaluates available options and then decides whether to choose them. Midbrain dopamine neurons are known to reinforce economic choices through their signal evoked by outcomes after decisions are made. However, although critical internal processing is executed while decisions are being made, little is known about the role of dopamine neurons during this period. We found that dopamine neurons exhibited dynamically changing signals related to the internal processing while rhesus monkeys were making decisions. These neurons encoded the value of an option immediately after it was offered and then gradually changed their activity to represent the animal's upcoming choice. Similar dynamics were observed in the orbitofrontal cortex, a center for economic decision-making, but the value-to-choice signal transition was completed earlier in dopamine neurons. Our findings suggest that dopamine neurons are a key component of the neural network that makes choices from values during ongoing decision-making processes.

| S-EPMC7458464 | biostudies-literature

Melanocortin 3 Receptor Signaling in Midbrain Dopamine Neurons Increases the Motivation for Food Reward.

Project description:The central melanocortin (MC) system mediates its effects on food intake via MC3 (MC3R) and MC4 receptors (MC4R). Although the role of MC4R in meal size determination, satiation, food preference, and motivation is well established, the involvement of MC3R in the modulation of food intake has been less explored. Here, we investigated the role of MC3R on the incentive motivation for food, which is a crucial component of feeding behavior. Dopaminergic neurons within the ventral tegmental area (VTA) have a crucial role in the motivation for food. We here report that MC3Rs are expressed on VTA dopaminergic neurons and that pro-opiomelanocortinergic (POMC) neurons in the arcuate nucleus of the hypothalamus (Arc) innervate these VTA dopaminergic neurons. Our findings show that intracerebroventricular or intra-VTA infusion of the selective MC3R agonist γMSH increases responding for sucrose under a progressive ratio schedule of reinforcement, but not free sucrose consumption in rats. Furthermore, ex vivo electrophysiological recordings show increased VTA dopaminergic neuronal activity upon γMSH application. Consistent with a dopamine-mediated effect of γMSH, the increased motivation for sucrose after intra-VTA infusion of γMSH was blocked by pretreatment with the dopamine receptor antagonist α-flupenthixol. Taken together, we demonstrate an Arc POMC projection onto VTA dopaminergic neurons that modulates motivation for palatable food via activation of MC3R signaling.

| S-EPMC4946052 | biostudies-literature

Manipulating midbrain dopamine neurons and reward-related behaviors with light-controllable nicotinic acetylcholine receptors.

Project description:Dopamine (DA) neurons of the ventral tegmental area (VTA) integrate cholinergic inputs to regulate key functions such as motivation and goal-directed behaviors. Yet the temporal dynamic range and mechanism of action of acetylcholine (ACh) on the modulation of VTA circuits and reward-related behaviors are not known. Here, we used a chemical-genetic approach for rapid and precise optical manipulation of nicotinic neurotransmission in VTA neurons in living mice. We provide direct evidence that the ACh tone fine-tunes the firing properties of VTA DA neurons through β2-containing (β2*) nicotinic ACh receptors (nAChRs). Furthermore, locally photo-antagonizing these receptors in the VTA was sufficient to reversibly switch nicotine reinforcement on and off. By enabling control of nicotinic transmission in targeted brain circuits, this technology will help unravel the various physiological functions of nAChRs and may assist in the design of novel therapies relevant to neuropsychiatric disorders.

| S-EPMC6122951 | biostudies-literature

Reward prediction error does not explain movement selectivity in DMS-projecting dopamine neurons.

Project description:Although midbrain dopamine (DA) neurons have been thought to primarily encode reward prediction error (RPE), recent studies have also found movement-related DAergic signals. For example, we recently reported that DA neurons in mice projecting to dorsomedial striatum are modulated by choices contralateral to the recording side. Here, we introduce, and ultimately reject, a candidate resolution for the puzzling RPE vs movement dichotomy, by showing how seemingly movement-related activity might be explained by an action-specific RPE. By considering both choice and RPE on a trial-by-trial basis, we find that DA signals are modulated by contralateral choice in a manner that is distinct from RPE, implying that choice encoding is better explained by movement direction. This fundamental separation between RPE and movement encoding may help shed light on the diversity of functions and dysfunctions of the DA system.

| S-EPMC6464606 | biostudies-literature

Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target.

Project description:Dopaminergic (DA) neurons in the midbrain provide rich topographic innervation of the striatum and are central to learning and to generating actions. Despite the importance of this DA innervation, it remains unclear whether and how DA neurons are specialized on the basis of the location of their striatal target. Thus, we sought to compare the function of subpopulations of DA neurons that target distinct striatal subregions in the context of an instrumental reversal learning task. We identified key differences in the encoding of reward and choice in dopamine terminals in dorsal versus ventral striatum: DA terminals in ventral striatum responded more strongly to reward consumption and reward-predicting cues, whereas DA terminals in dorsomedial striatum responded more strongly to contralateral choices. In both cases the terminals encoded a reward prediction error. Our results suggest that the DA modulation of the striatum is spatially organized to support the specialized function of the targeted subregion.

| S-EPMC4882228 | biostudies-other

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data