Browse
Submit Data
Databases
API
Help

Dataset Information

30 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Dissociable reward and timing signals in human midbrain and ventral striatum.

ABSTRACT: Reward prediction error (RPE) signals are central to current models of reward-learning. Temporal difference (TD) learning models posit that these signals should be modulated by predictions, not only of magnitude but also timing of reward. Here we show that BOLD activity in the VTA conforms to such TD predictions: responses to unexpected rewards are modulated by a temporal hazard function and activity between a predictive stimulus and reward is depressed in proportion to predicted reward. By contrast, BOLD activity in ventral striatum (VS) does not reflect a TD RPE, but instead encodes a signal on the variable relevant for behavior, here timing but not magnitude of reward. The results have important implications for dopaminergic models of cortico-striatal learning and suggest a modification of the conventional view that VS BOLD necessarily reflects inputs from dopaminergic VTA neurons signaling an RPE.

SUBMITTER: Klein-Flugge MC

PROVIDER: S-EPMC3219831 | biostudies-literature | 2011 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Dissociable reward and timing signals in human midbrain and ventral striatum.

Klein-Flügge Miriam C MC Hunt Laurence T LT Bach Dominik R DR Dolan Raymond J RJ Behrens Timothy E J TE

Neuron 20111101 4

Reward prediction error (RPE) signals are central to current models of reward-learning. Temporal difference (TD) learning models posit that these signals should be modulated by predictions, not only of magnitude but also timing of reward. Here we show that BOLD activity in the VTA conforms to such TD predictions: responses to unexpected rewards are modulated by a temporal hazard function and activity between a predictive stimulus and reward is depressed in proportion to predicted reward. By cont ...[more]

PMID: 22099466

Similar Datasets

Cholinergic Mesopontine Signals Govern Locomotion and Reward through Dissociable Midbrain Pathways.

Project description:The mesopontine tegmentum, including the pedunculopontine and laterodorsal tegmental nuclei (PPN and LDT), provides major cholinergic inputs to midbrain and regulates locomotion and reward. To delineate the underlying projection-specific circuit mechanisms, we employed optogenetics to control mesopontine cholinergic neurons at somata and at divergent projections within distinct midbrain areas. Bidirectional manipulation of PPN cholinergic cell bodies exerted opposing effects on locomotor behavior and reinforcement learning. These motor and reward effects were separable via limiting photostimulation to PPN cholinergic terminals in the ventral substantia nigra pars compacta (vSNc) or to the ventral tegmental area (VTA), respectively. LDT cholinergic neurons also form connections with vSNc and VTA neurons; however, although photo-excitation of LDT cholinergic terminals in the VTA caused positive reinforcement, LDT-to-vSNc modulation did not alter locomotion or reward. Therefore, the selective targeting of projection-specific mesopontine cholinergic pathways may offer increased benefit in treating movement and addiction disorders.

| S-EPMC4840478 | biostudies-literature

The timing of action determines reward prediction signals in identified midbrain dopamine neurons.

Project description:Animals adapt their behavior in response to informative sensory cues using multiple brain circuits. The activity of midbrain dopaminergic neurons is thought to convey a critical teaching signal: reward-prediction error. Although reward-prediction error signals are thought to be essential to learning, little is known about the dynamic changes in the activity of midbrain dopaminergic neurons as animals learn about novel sensory cues and appetitive rewards. Here we describe a large dataset of cell-attached recordings of identified dopaminergic neurons as naive mice learned a novel cue-reward association. During learning midbrain dopaminergic neuron activity results from the summation of sensory cue-related and movement initiation-related response components. These components are both a function of reward expectation yet they are dissociable. Learning produces an increasingly precise coordination of action initiation following sensory cues that results in apparent reward-prediction error correlates. Our data thus provide new insights into the circuit mechanisms that underlie a critical computation in a highly conserved learning circuit.

| S-EPMC6226028 | biostudies-literature

Neuronal and oscillatory activity during reward processing in the human ventral striatum.

Project description:Accumulated evidence from animal studies implicates the ventral striatum in the processing of reward information. Recently, deep brain stimulation (DBS) surgery has enabled researchers to analyze neurophysiological recordings from humans engaged in reward tasks. We present data recorded from the human ventral striatum during deep brain stimulation surgery as a participant played a video game coupled to the receipt of visual reward images. To our knowledge, we identify the first instances of reward-sensitive single unit activity in the human ventral striatum. Local field potential data suggest that alpha oscillations are sensitive to positive feedback, whereas beta oscillations exhibit significantly higher power during unrewarded trials. We report evidence of alpha-gamma cross-frequency coupling that differentiates between positive and negative feedback.

| S-EPMC3188759 | biostudies-literature

The ventral striatum dissociates information expectation, reward anticipation, and reward receipt.

Project description:Do dopaminergic reward structures represent the expected utility of information similarly to a reward? Optimal experimental design models from Bayesian decision theory and statistics have proposed a theoretical framework for quantifying the expected value of information that might result from a query. In particular, this formulation quantifies the value of information before the answer to that query is known, in situations where payoffs are unknown and the goal is purely epistemic: That is, to increase knowledge about the state of the world. Whether and how such a theoretical quantity is represented in the brain is unknown. Here we use an event-related functional MRI (fMRI) task design to disentangle information expectation, information revelation and categorization outcome anticipation, and response-contingent reward processing in a visual probabilistic categorization task. We identify a neural signature corresponding to the expectation of information, involving the left lateral ventral striatum. Moreover, we show a temporal dissociation in the activation of different reward-related regions, including the nucleus accumbens, medial prefrontal cortex, and orbitofrontal cortex, during information expectation versus reward-related processing.

| S-EPMC7334472 | biostudies-literature

Reward magnitude tracking by neural populations in ventral striatum.

Project description:Evaluation of the magnitudes of intrinsically rewarding stimuli is essential for assigning value and guiding behavior. By combining parametric manipulation of a primary reward, medial forebrain bundle (MFB) microstimulation, with functional magnetic imaging (fMRI) in rodents, we delineated a broad network of structures activated by behaviorally characterized levels of rewarding stimulation. Correlation of psychometric behavioral measurements with fMRI response magnitudes revealed regions whose activity corresponded closely to the subjective magnitude of rewards. The largest and most reliable focus of reward magnitude tracking was observed in the shell region of the nucleus accumbens (NAc). Although the nonlinear nature of neurovascular coupling complicates interpretation of fMRI findings in precise neurophysiological terms, reward magnitude tracking was not observed in vascular compartments and could not be explained by saturation of region-specific hemodynamic responses. In addition, local pharmacological inactivation of NAc changed the profile of animals' responses to rewards of different magnitudes without altering mean reward response rates, further supporting a hypothesis that neural population activity in this region contributes to assessment of reward magnitudes.

| S-EPMC5619692 | biostudies-literature

Ventral Striatum Connectivity During Reward Anticipation in Adolescent Smokers.

Project description:Substance misusers, including adolescent smokers, often have reduced reward system activity during processing of non-drug rewards. Using a psychophysiological interaction approach, we examined functional connectivity with the ventral striatum during reward anticipation in a large (N = 206) sample of adolescent smokers. Increased smoking frequency was associated with (1) increased connectivity with regions involved in saliency and valuation, including the orbitofrontal cortex and (2) reduced connectivity between the ventral striatum and regions associated with inhibition and risk aversion, including the right inferior frontal gyrus. These results demonstrate that functional connectivity during reward processing is relevant to adolescent addiction.

| S-EPMC5684700 | biostudies-literature

Hippocampus leads ventral striatum in replay of place-reward information.

Project description:Associating spatial locations with rewards is fundamental to survival in natural environments and requires the integrity of the hippocampus and ventral striatum. In joint multineuron recordings from these areas, hippocampal-striatal ensembles reactivated together during sleep. This process was especially strong in pairs in which the hippocampal cell processed spatial information and ventral striatal firing correlated to reward. Replay was dominated by cell pairs in which the hippocampal "place" cell fired preferentially before the striatal reward-related neuron. Our results suggest a plausible mechanism for consolidating place-reward associations and are consistent with a central tenet of consolidation theory, showing that the hippocampus leads reactivation in a projection area.

| S-EPMC2717326 | biostudies-literature

Inflammation-induced anhedonia: endotoxin reduces ventral striatum responses to reward.

Project description:BackgroundAlthough inflammatory activity is known to play a role in depression, no work has examined whether experimentally induced systemic inflammation alters neural activity that is associated with anhedonia, a key diagnostic symptom of depression. To investigate this, we examined the effect of an experimental inflammatory challenge on the neural correlates of anhedonia-namely, reduced ventral striatum (VS) activity to reward cues. We also examined whether this altered neural activity related to inflammatory-induced increases in depressed mood.MethodsParticipants (n = 39) were randomly assigned to receive either placebo or low-dose endotoxin, which increases proinflammatory cytokine levels in a safe manner. Cytokine levels were repeatedly assessed through hourly blood draws; self-reported and observer-rated depressed mood were assessed regularly as well. Two hours after drug administration, neural activity was recorded as participants completed a task in which they anticipated monetary rewards.ResultsResults demonstrated that subjects exposed to endotoxin, compared with placebo, showed greater increases in self-reported and observer-rated depressed mood over time, as well as significant reductions in VS activity to monetary reward cues. Moreover, the relationship between exposure to inflammatory challenge and increases in observer-rated depressed mood was mediated by between-group differences in VS activity to anticipated reward.ConclusionsThe data reported here show, for the first time, that inflammation alters reward-related neural responding in humans and that these reward-related neural responses mediate the effects of inflammation on depressed mood. As such, these findings have implications for understanding risk of depression in persons with underlying inflammation.

| S-EPMC3025604 | biostudies-literature

Lateralization and gender differences in the dopaminergic response to unpredictable reward in the human ventral striatum.

Project description:Electrophysiological studies have shown that mesostriatal dopamine (DA) neurons increase activity in response to unpredicted rewards. With respect to other functions of the mesostriatal dopaminergic system, dopamine's actions show prominent laterality effects. Whether changes in DA transmission elicited by rewards also are lateralized, however, has not been investigated. Using [¹¹C]raclopride-PET to assess the striatal DA response to unpredictable monetary rewards, we hypothesized that such rewards would induce an asymmetric reduction in [¹¹C]raclopride binding in the ventral striatum, reflecting lateralization of endogenous dopamine release. In 24 healthy volunteers, differences in the regional D?/? receptor binding potential (?BP) between an unpredictable reward condition and a sensorimotor control condition were measured using the bolus-plus-constant-infusion [¹¹C]raclopride method. During the reward condition subjects randomly received monetary awards while performing a 'slot-machine' task. The ?BP between conditions was assessed in striatal regions-of-interest and compared between left and right sides. We found a significant condition × lateralization interaction in the ventral striatum. A significant reduction in binding potential (BP(ND) ) in the reward condition vs. the control condition was found only in the right ventral striatum, and the ?BP was greater in the right than the left ventral striatum. Unexpectedly, these laterality effects appeared to be partly accounted for by gender differences, as our data showed a significant bilateral BP(ND) reduction in women while in men the reduction reached significance only in the right ventral striatum. These data suggest that DA release in response to unpredictable reward is lateralized in the human ventral striatum, particularly in males.

| S-EPMC3086965 | biostudies-literature

Songbird Ventral Pallidum Sends Diverse Performance Error Signals to Dopaminergic Midbrain.

Project description:Motor skills improve with practice, requiring outcomes to be evaluated against ever-changing performance benchmarks, yet it remains unclear how performance error signals are computed. Here, we show that the songbird ventral pallidum (VP) is required for song learning and sends diverse song timing and performance error signals to the ventral tegmental area (VTA). Viral tracing revealed inputs to VP from auditory and vocal motor thalamus, auditory and vocal motor cortex, and VTA. Our findings show that VP circuits, commonly associated with hedonic functions, signal performance error during motor sequence learning.

| S-EPMC6639146 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data