Browse
Submit Data
Databases
API
Help

Dataset Information

26 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Mesolimbic Dopamine Encodes Prediction Errors in a State-Dependent Manner.

ABSTRACT: Mesolimbic dopamine encodes the benefits of a course of action. However, the value of an appetitive reward depends strongly on an animal's current state. To investigate the relationship between dopamine, value, and physiological state, we monitored sub-second dopamine release in the nucleus accumbens core while rats made choices between food and sucrose solution following selective satiation on one of these reinforcers. Dopamine signals reflected preference for the reinforcers in the new state, decreasing to the devalued reward and, after satiation on food, increasing for the valued sucrose solution. These changes were rapid and selective, with dopamine release returning to pre-satiation patterns when the animals were re-tested in a standard food-restricted state. Such rapid and selective adaptation of dopamine-associated value signals could provide an important signal to promote efficient foraging for a varied diet.

SUBMITTER: Papageorgiou GK

PROVIDER: S-EPMC4835543 | biostudies-literature | 2016 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Mesolimbic Dopamine Encodes Prediction Errors in a State-Dependent Manner.

Papageorgiou Georgios K GK Baudonnat Mathieu M Cucca Flavia F Walton Mark E ME

Cell reports 20160331 2

Mesolimbic dopamine encodes the benefits of a course of action. However, the value of an appetitive reward depends strongly on an animal's current state. To investigate the relationship between dopamine, value, and physiological state, we monitored sub-second dopamine release in the nucleus accumbens core while rats made choices between food and sucrose solution following selective satiation on one of these reinforcers. Dopamine signals reflected preference for the reinforcers in the new state, ...[more]

PMID: 27050518

Similar Datasets

Dopamine reward prediction errors reflect hidden-state inference across time.

Project description:Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a 'belief state'). Here we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling showed a notable difference between two tasks that differed only with respect to whether reward was delivered in a deterministic manner. Our results favor an associative learning rule that combines cached values with hidden-state inference.

| S-EPMC5374025 | biostudies-literature

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans.

Project description:Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.

| S-EPMC2636869 | biostudies-literature

The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty.

Project description:Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the environment. The brain structures important in hidden state inference remain unknown. A previous study showed that midbrain dopamine neurons exhibit distinct response patterns depending on whether reward is delivered in 100% (task 1) or 90% of trials (task 2) in a classical conditioning task. Here we found that inactivation of the medial prefrontal cortex (mPFC) affected dopaminergic signaling in task 2, in which the hidden state must be inferred ("will reward come or not?"), but not in task 1, where the state was known with certainty. Computational modeling suggests that the effects of inactivation are best explained by a circuit in which the mPFC conveys inference over hidden states to the dopamine system. VIDEO ABSTRACT.

| S-EPMC5934341 | biostudies-literature

Dopamine Encodes Retrospective Temporal Information in a Context-Independent Manner.

Project description:The dopamine system responds to reward-predictive cues to reflect a prospective estimation of reward value, although its role in encoding retrospective reward-related information is unclear. We report that cue-evoked dopamine release in the nucleus accumbens core encodes the time elapsed since the previous reward or rather the wait time. Specifically, a cue that always follows the preceding reward with a short wait time elicits a greater dopamine response relative to a distinct cue that always follows the preceding reward with a long wait time. Differences in the dopamine response between short wait and long wait cues were evident even when these cues were never experienced together within the same context. Conditioned responding updated accordingly with a change in cue-evoked dopamine release but was unrelated to a difference in the dopamine response between cues. Collectively, these findings illustrate that the cue-evoked dopamine response conveys a subjective estimation of the relative reward rate.

| S-EPMC5573123 | biostudies-literature

Phasic mesolimbic dopamine signaling encodes the facilitation of incentive motivation produced by repeated cocaine exposure.

Project description:Drug addiction is marked by pathological drug seeking and intense drug craving, particularly in response to drug-related stimuli. Repeated psychostimulant administration is known to induce long-term alterations in mesolimbic dopamine (DA) signaling that are hypothesized to mediate this heightened sensitivity to environmental stimuli. However, there is little direct evidence that drug-induced alteration in mesolimbic DA function underlies this hypersensitivity to motivational cues. In the current study, we tested this hypothesis using fast-scan cyclic voltammetry to monitor phasic DA signaling in the nucleus accumbens core of cocaine-pretreated (6 once-daily injections of 15?mg/kg, i.p.) and drug-naive rats during a test of cue-evoked incentive motivation for food-the Pavlovian-to-instrumental transfer task. We found that prior cocaine exposure augmented both reward seeking and DA release triggered by the presentation of a reward-paired cue. Furthermore, cue-evoked DA signaling positively correlated with cue-evoked food seeking and was found to be a statistical mediator of this behavioral effect of cocaine. Taken together, these findings provide support for the hypothesis that repeated cocaine exposure enhances cue-evoked incentive motivation through augmented phasic mesolimbic DA signaling. This work sheds new light on a fundamental neurobiological mechanism underlying motivated behavior and its role in the expression of compulsive reward seeking.

| S-EPMC4138756 | biostudies-literature

Dopamine restores reward prediction errors in old age.

Project description:Senescence affects the ability to utilize information about the likelihood of rewards for optimal decision-making. Using functional magnetic resonance imaging in humans, we found that healthy older adults had an abnormal signature of expected value, resulting in an incomplete reward prediction error (RPE) signal in the nucleus accumbens, a brain region that receives rich input projections from substantia nigra/ventral tegmental area (SN/VTA) dopaminergic neurons. Structural connectivity between SN/VTA and striatum, measured by diffusion tensor imaging, was tightly coupled to inter-individual differences in the expression of this expected reward value signal. The dopamine precursor levodopa (L-DOPA) increased the task-based learning rate and task performance in some older adults to the level of young adults. This drug effect was linked to restoration of a canonical neural RPE. Our results identify a neurochemical signature underlying abnormal reward processing in older adults and indicate that this can be modulated by L-DOPA.

| S-EPMC3672991 | biostudies-literature

Arithmetic and local circuitry underlying dopamine prediction errors.

Project description:Dopamine neurons are thought to facilitate learning by comparing actual and expected reward. Despite two decades of investigation, little is known about how this comparison is made. To determine how dopamine neurons calculate prediction error, we combined optogenetic manipulations with extracellular recordings in the ventral tegmental area while mice engaged in classical conditioning. Here we demonstrate, by manipulating the temporal expectation of reward, that dopamine neurons perform subtraction, a computation that is ideal for reinforcement learning but rarely observed in the brain. Furthermore, selectively exciting and inhibiting neighbouring GABA (γ-aminobutyric acid) neurons in the ventral tegmental area reveals that these neurons are a source of subtraction: they inhibit dopamine neurons when reward is expected, causally contributing to prediction-error calculations. Finally, bilaterally stimulating ventral tegmental area GABA neurons dramatically reduces anticipatory licking to conditioned odours, consistent with an important role for these neurons in reinforcement learning. Together, our results uncover the arithmetic and local circuitry underlying dopamine prediction errors.

| S-EPMC4567485 | biostudies-literature

Nigrostriatal dopamine signals sequence-specific action-outcome prediction errors.

Project description:Dopamine has been suggested to encode cue-reward prediction errors during Pavlovian conditioning, signaling discrepancies between actual versus expected reward predicted by the cues.1-5 While this theory has been widely applied to reinforcement learning concerning instrumental actions, whether dopamine represents action-outcome prediction errors and how it controls sequential behavior remain largely unknown. The vast majority of previous studies examining dopamine responses primarily have used discrete reward-predictive stimuli,1-15 whether Pavlovian conditioned stimuli for which no action is required to earn reward or explicit discriminative stimuli that essentially instruct an animal how and when to respond for reward. Here, by training mice to perform optogenetic intracranial self-stimulation, we examined how self-initiated goal-directed behavior influences nigrostriatal dopamine transmission during single and sequential instrumental actions, in behavioral contexts with minimal overt changes in the animal's external environment. We found that dopamine release evoked by direct optogenetic stimulation was dramatically reduced when delivered as the consequence of the animal's own action, relative to non-contingent passive stimulation. This dopamine suppression generalized to food rewards was specific to the reinforced action, was temporally restricted to counteract the expected outcome, and exhibited sequence-selectivity consistent with hierarchical control of sequential behavior. These findings demonstrate that nigrostriatal dopamine signals sequence-specific prediction errors in action-outcome associations, with fundamental implications for reinforcement learning and instrumental behavior in health and disease.

| S-EPMC8665080 | biostudies-literature

Physiological state gates acquisition and expression of mesolimbic reward prediction signals.

Project description:Phasic dopamine signaling participates in associative learning by reinforcing associations between outcomes (unconditioned stimulus; US) and their predictors (conditioned stimulus; CS). However, prior work has always engendered these associations with innately rewarding stimuli. Thus, whether dopamine neurons can acquire prediction signals in the absence of appetitive experience and update them when the value of the outcome changes remains unknown. Here, we used sodium depletion to reversibly manipulate the appetitive value of a hypertonic sodium solution while measuring phasic dopamine signaling in rat nucleus accumbens. Dopamine responses to the NaCl US following sodium depletion updated independent of prior experience. In contrast, prediction signals were only acquired through extensive experience with a US that had positive affective value. Once learned, dopamine prediction signals were flexibly expressed in a state-dependent manner. Our results reveal striking differences with respect to how physiological state shapes dopamine signals evoked by outcomes and their predictors.

| S-EPMC4763767 | biostudies-other

Habenula Lesions Reveal that Multiple Mechanisms Underlie Dopamine Prediction Errors.

Project description:Dopamine (DA) neurons are thought to facilitate learning by signaling reward prediction errors (RPEs), the discrepancy between actual and expected reward. However, how RPEs are calculated remains unknown. It has been hypothesized that DA neurons receive RPE signals from the lateral habenula. Here, we tested how lesions of the habenular complex affect the response of optogenetically identified DA neurons in mice. We found that lesions impaired specific aspects of RPE signaling in DA neurons. The inhibitory responses caused by reward omission were greatly diminished while inhibitory responses to aversive stimuli, such as air puff-predictive cues or air puff, remained unimpaired. Furthermore, we found that after habenula lesions, DA neurons' ability to signal graded levels of positive RPEs became unreliable, yet significant excitatory responses still remained. These results demonstrate that the habenula plays a critical role in DA RPE signaling but suggest that it is not the exclusive source of RPE signals.

| S-EPMC4583356 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data