Browse
Submit Data
Databases
API
Help

Dataset Information

27 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Dopamine firing plays a dual role in coding reward prediction errors and signaling motivation in a working memory task.

ABSTRACT: Little is known about how dopamine (DA) neuron firing rates behave in cognitively demanding decision-making tasks. Here, we investigated midbrain DA activity in monkeys performing a discrimination task in which the animal had to use working memory (WM) to report which of two sequentially applied vibrotactile stimuli had the higher frequency. We found that perception was altered by an internal bias, likely generated by deterioration of the representation of the first frequency during the WM period. This bias greatly controlled the DA phasic response during the two stimulation periods, confirming that DA reward prediction errors reflected stimulus perception. In contrast, tonic dopamine activity during WM was not affected by the bias and did not encode the stored frequency. More interestingly, both delay-period activity and phasic responses before the second stimulus negatively correlated with reaction times of the animals after the trial start cue and thus represented motivated behavior on a trial-by-trial basis. During WM, this motivation signal underwent a ramp-like increase. At the same time, motivation positively correlated with accuracy, especially in difficult trials, probably by decreasing the effect of the bias. Overall, our results indicate that DA activity, in addition to encoding reward prediction errors, could at the same time be involved in motivation and WM. In particular, the ramping activity during the delay period suggests a possible DA role in stabilizing sustained cortical activity, hypothetically by increasing the gain communicated to prefrontal neurons in a motivation-dependent way.

SUBMITTER: Sarno S

PROVIDER: S-EPMC8764687 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Reward Motivation Enhances Task Coding in Frontoparietal Cortex.

Project description:Reward motivation often enhances task performance, but the neural mechanisms underlying such cognitive enhancement remain unclear. Here, we used a multivariate pattern analysis (MVPA) approach to test the hypothesis that motivation-related enhancement of cognitive control results from improved encoding and representation of task set information. Participants underwent two fMRI sessions of cued task switching, the first under baseline conditions, and the second with randomly intermixed reward incentive and no-incentive trials. Information about the upcoming task could be successfully decoded from cue-related activation patterns in a set of frontoparietal regions typically associated with task control. More critically, MVPA classifiers trained on the baseline session had significantly higher decoding accuracy on incentive than non-incentive trials, with decoding improvement mediating reward-related enhancement of behavioral performance. These results strongly support the hypothesis that reward motivation enhances cognitive control, by improving the discriminability of task-relevant information coded and maintained in frontoparietal brain regions.

| S-EPMC4785950 | biostudies-literature

Dopamine restores reward prediction errors in old age.

Project description:Senescence affects the ability to utilize information about the likelihood of rewards for optimal decision-making. Using functional magnetic resonance imaging in humans, we found that healthy older adults had an abnormal signature of expected value, resulting in an incomplete reward prediction error (RPE) signal in the nucleus accumbens, a brain region that receives rich input projections from substantia nigra/ventral tegmental area (SN/VTA) dopaminergic neurons. Structural connectivity between SN/VTA and striatum, measured by diffusion tensor imaging, was tightly coupled to inter-individual differences in the expression of this expected reward value signal. The dopamine precursor levodopa (L-DOPA) increased the task-based learning rate and task performance in some older adults to the level of young adults. This drug effect was linked to restoration of a canonical neural RPE. Our results identify a neurochemical signature underlying abnormal reward processing in older adults and indicate that this can be modulated by L-DOPA.

| S-EPMC3672991 | biostudies-literature

Dopamine promotes instrumental motivation, but reduces reward-related vigour.

Project description:We can be motivated when reward depends on performance, or merely by the prospect of a guaranteed reward. Performance-dependent (contingent) reward is instrumental, relying on an internal action-outcome model, whereas motivation by guaranteed reward may minimise opportunity cost in reward-rich environments. Competing theories propose that each type of motivation should be dependent on dopaminergic activity. We contrasted these two types of motivation with a rewarded saccade task, in patients with Parkinson's disease (PD). When PD patients were ON dopamine, they had greater response vigour (peak saccadic velocity residuals) for contingent rewards, whereas when PD patients were OFF medication, they had greater vigour for guaranteed rewards. These results support the view that reward expectation and contingency drive distinct motivational processes, and can be dissociated by manipulating dopaminergic activity. We posit that dopamine promotes goal-directed motivation, but dampens reward-driven vigour, contradictory to the prediction that increased tonic dopamine amplifies reward expectation.

| S-EPMC7599069 | biostudies-literature

Reward motivation increases univariate activity but has limited effect on coding of task-relevant information across the frontoparietal cortex.

Project description:Selection and integration of information based on current goals is fundamental for goal-directed behavior. Reward motivation has been shown to improve behavioral performance, yet the neural mechanisms that link motivation and control processes, and in particular its effect on context-dependent information processing, remain unclear. We used functional magnetic resonance imaging (fMRI) in 24 human volunteers (13 females) to test whether reward motivation enhances the coding of task-relevant information across the frontoparietal cortex, as would be predicted based on previous experimental evidence and theoretical accounts. In a cued target detection task, participants detected whether an object from a cued visual category was present in a subsequent display. The combination of the cue and the object visual category determined the behavioral status of the objects. To manipulate reward motivation, half of all trials offered the possibility of a monetary reward. We observed an increase with reward in overall univariate activity across the frontoparietal control network when the cue and subsequent object were presented. Multivariate pattern analysis (MVPA) showed that behavioral status information for the objects was conveyed across the network. However, in contrast to our prediction, reward did not increase the discrimination between behavioral status conditions in the stimulus epoch of a trial when object information was processed depending on a current context. In the high-level general-object visual region, the lateral occipital complex, the representation of behavioral status was driven by visual differences and was not modulated by reward. Our study provides useful evidence for the limited effects of reward motivation on task-related neural representations and highlights the necessity to unravel the diverse forms and extent of these effects.

| S-EPMC8434417 | biostudies-literature

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans.

Project description:Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.

| S-EPMC2636869 | biostudies-literature

Dopamine reward prediction errors reflect hidden-state inference across time.

Project description:Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a 'belief state'). Here we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling showed a notable difference between two tasks that differed only with respect to whether reward was delivered in a deterministic manner. Our results favor an associative learning rule that combines cached values with hidden-state inference.

| S-EPMC5374025 | biostudies-literature

Task difficulty rather than reward method modulates the reward boosts in visual working memory.

Project description:Both monetary and notional rewards are important to motivate individuals to prioritize specific items in visual working memory (VWM). However, whether the reward method and task difficulty are the key factors that modulate the reward boosts in VWM is unclear. In this study, we designed two experiments to explore this question. Experiment 1 examined whether the reward method modulates reward boosts in VWM by manipulating the item type (high reward, low reward, equal reward) and reward method (monetary and notional). Experiment 2 examined whether task difficulty modulates reward boosts in VWM by manipulating the number of high-reward items (1, 2, 3), reward method, and item type. The results indicated reward boosts for high-reward items compared to low- and equal-reward items. Moreover, the VWM performance was higher in the monetary reward condition than in the notional reward condition; however, there was no interaction between the reward method and item type. Additionally, a significant interaction was found between the reward number and item type: Reward boosts on VWM performance occurred only when one or two higher reward items were present. In conclusion, reward boosts in VWM tasks are modulated by task difficulty but not the reward method.

| S-EPMC9547356 | biostudies-literature

A novel operant task to assess social reward and motivation in rodents.

Project description:BACKGROUND:Social reward plays a critical role in the development of beneficial social relationships, and disorders of the mechanisms controlling social reward are involved in the etiology of many psychiatric diseases. NEW METHOD:We present a novel operant social preference task to quantify social reward in rodents using an apparatus with three chambers separated by one-way vertical-swing doors. The experimental animal is placed in the larger chamber while the two smaller chambers either remain empty or contain a stimulus animal or other potential reward stimulus. Adding weights to the door can alter effort required for rewards. RESULTS:Hamsters (Mesocricetus auratus) entered the chamber containing a stimulus hamster significantly more frequently than an empty chamber. When the reinforcing effects of social interactions were compared to food reward under progressive cost requirements, the reinforcing effects of social interaction and sunflower seeds were similar. Progressively increasing the door weight decreased number of entries, but increased time spent attempting to open the doors. COMPARISON WITH EXISTING METHODS:The quantification of the rewarding properties of social interactions has almost exclusively used the conditioned place preference (CPP) paradigm. Although robust and reliable, CPP includes a memory component, because it relies on the association of place with the social interaction while the operant task presented here does not. CONCLUSIONS:This task allows for detailed and direct assessment of social and non-social rewards that may serve as effective behavioral reinforcers in this operant conditioning model, and it can be used to investigate the neural mechanisms regulating motivation.

| S-EPMC7093839 | biostudies-literature

Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors.

Project description:Correlative studies have strongly linked phasic changes in dopamine activity with reward prediction error signaling. But causal evidence that these brief changes in firing actually serve as error signals to drive associative learning is more tenuous. Although there is direct evidence that brief increases can substitute for positive prediction errors, there is no comparable evidence that similarly brief pauses can substitute for negative prediction errors. In the absence of such evidence, the effect of increases in firing could reflect novelty or salience, variables also correlated with dopamine activity. Here we provide evidence in support of the proposed linkage, showing in a modified Pavlovian over-expectation task that brief pauses in the firing of dopamine neurons in rat ventral tegmental area at the time of reward are sufficient to mimic the effects of endogenous negative prediction errors. These results support the proposal that brief changes in the firing of dopamine neurons serve as full-fledged bidirectional prediction error signals.

| S-EPMC4696902 | biostudies-literature

The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty.

Project description:Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the environment. The brain structures important in hidden state inference remain unknown. A previous study showed that midbrain dopamine neurons exhibit distinct response patterns depending on whether reward is delivered in 100% (task 1) or 90% of trials (task 2) in a classical conditioning task. Here we found that inactivation of the medial prefrontal cortex (mPFC) affected dopaminergic signaling in task 2, in which the hidden state must be inferred ("will reward come or not?"), but not in task 1, where the state was known with certainty. Computational modeling suggests that the effects of inactivation are best explained by a circuit in which the mPFC conveys inference over hidden states to the dopamine system. VIDEO ABSTRACT.

| S-EPMC5934341 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data