Browse
Submit Data
Databases
API
Help

Dataset Information

22 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Dopamine encodes real-time reward availability and transitions between reward availability states on different timescales.

ABSTRACT: Optimal behavior requires interpreting environmental cues that indicate when to perform actions. Dopamine is important for learning about reward-predicting events, but its role in adapting to inhibitory cues is unclear. Here we show that when mice can earn rewards in the absence but not presence of an auditory cue, dopamine level in the ventral striatum accurately reflects reward availability in real-time over a sustained period (80 s). In addition, unpredictable transitions between different states of reward availability are accompanied by rapid (~1-2 s) dopamine transients that deflect negatively at the onset and positively at the offset of the cue. This Dopamine encoding of reward availability and transitions between reward availability states is not dependent on reward or activity evoked dopamine release, appears before mice learn the task and is sensitive to motivational state. Our findings are consistent across different techniques including electrochemical recordings and fiber photometry with genetically encoded optical sensors for calcium and dopamine.

SUBMITTER: Kalmbach A

PROVIDER: S-EPMC9249893 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Dopamine transients follow a striatal gradient of reward time horizons.

Project description:Animals make predictions to guide their behavior and update those predictions through experience. Transient increases in dopamine (DA) are thought to be critical signals for updating predictions. However, it is unclear how this mechanism handles a wide range of behavioral timescales-from seconds or less (for example, if singing a song) to potentially hours or more (for example, if hunting for food). Here we report that DA transients in distinct rat striatal subregions convey prediction errors based on distinct time horizons. DA dynamics systematically accelerated from ventral to dorsomedial to dorsolateral striatum, in the tempo of spontaneous fluctuations, the temporal integration of prior rewards and the discounting of future rewards. This spectrum of timescales for evaluative computations can help achieve efficient learning and adaptive motivation for a broad range of behaviors.

| S-EPMC11001583 | biostudies-literature

Dopamine reward prediction errors reflect hidden-state inference across time.

Project description:Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a 'belief state'). Here we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling showed a notable difference between two tasks that differed only with respect to whether reward was delivered in a deterministic manner. Our results favor an associative learning rule that combines cached values with hidden-state inference.

| S-EPMC5374025 | biostudies-literature

Real-time dopamine measurement in awake monkeys.

Project description:Fast-scan cyclic voltammetry (FSCV) is often used to measure real-time dopamine (DA) concentrations in awake, behaving rodents. Extending this technique to work in monkeys would provide a platform for advanced behavioral studies and a primate model for preclinical research. The present study demonstrates the feasibility of DA recordings in two awake monkeys (Macaca mulatta) using a mixture of techniques adapted from rodent, primate and brain slice work. We developed a long carbon fiber electrode to operate in the larger primate brain. This electrode was lowered into the striatum each day using a recording chamber and a detachable micromanipulator system. A manipulator also moved one or more tungsten stimulating electrodes into either the nearby striatum or the ventral tegmental area/substantia nigra pars compacta (VTA/SNc). We developed an electrical stimulation controller to reduce artifacts during electrical stimulation. We also introduce a stimulation-based methodology for estimating distances between electrodes in the brain. Dopamine responses within the striatum were evoked by either stimulation of the striatum near the FSCV electrode, or stimulation within the VTA/SNc. Unexpected juice rewards also evoked dopamine responses in the ventral striatum. Thus, we demonstrate that robust dopamine responses can be recorded from awake, behaving primates with FSCV. In addition, we describe how a stimulation technique borrowed from the neuroprosthetics field can activate the distributed monkey midbrain dopamine system in a way that mimics rodent VTA stimulation.

| S-EPMC4055617 | biostudies-literature

Dopamine prediction error responses integrate subjective value from different reward dimensions.

Project description:Prediction error signals enable us to learn through experience. These experiences include economic choices between different rewards that vary along multiple dimensions. Therefore, an ideal way to reinforce economic choice is to encode a prediction error that reflects the subjective value integrated across these reward dimensions. Previous studies demonstrated that dopamine prediction error responses reflect the value of singular reward attributes that include magnitude, probability, and delay. Obviously, preferences between rewards that vary along one dimension are completely determined by the manipulated variable. However, it is unknown whether dopamine prediction error responses reflect the subjective value integrated from different reward dimensions. Here, we measured the preferences between rewards that varied along multiple dimensions, and as such could not be ranked according to objective metrics. Monkeys chose between rewards that differed in amount, risk, and type. Because their choices were complete and transitive, the monkeys chose "as if" they integrated different rewards and attributes into a common scale of value. The prediction error responses of single dopamine neurons reflected the integrated subjective value inferred from the choices, rather than the singular reward attributes. Specifically, amount, risk, and reward type modulated dopamine responses exactly to the extent that they influenced economic choices, even when rewards were vastly different, such as liquid and food. This prediction error response could provide a direct updating signal for economic values.

| S-EPMC3926061 | biostudies-literature

A Unified Framework for Dopamine Signals across Timescales.

Project description:Rapid phasic activity of midbrain dopamine neurons is thought to signal reward prediction errors (RPEs), resembling temporal difference errors used in machine learning. However, recent studies describing slowly increasing dopamine signals have instead proposed that they represent state values and arise independent from somatic spiking activity. Here we developed experimental paradigms using virtual reality that disambiguate RPEs from values. We examined dopamine circuit activity at various stages, including somatic spiking, calcium signals at somata and axons, and striatal dopamine concentrations. Our results demonstrate that ramping dopamine signals are consistent with RPEs rather than value, and this ramping is observed at all stages examined. Ramping dopamine signals can be driven by a dynamic stimulus that indicates a gradual approach to a reward. We provide a unified computational understanding of rapid phasic and slowly ramping dopamine signals: dopamine neurons perform a derivative-like computation over values on a moment-by-moment basis.

| S-EPMC7736562 | biostudies-literature

Awakening: Predicting external stimulation to force transitions between different brain states.

Project description:A fundamental problem in systems neuroscience is how to force a transition from one brain state to another by external driven stimulation in, for example, wakefulness, sleep, coma, or neuropsychiatric diseases. This requires a quantitative and robust definition of a brain state, which has so far proven elusive. Here, we provide such a definition, which, together with whole-brain modeling, permits the systematic study in silico of how simulated brain stimulation can force transitions between different brain states in humans. Specifically, we use a unique neuroimaging dataset of human sleep to systematically investigate where to stimulate the brain to force an awakening of the human sleeping brain and vice versa. We show where this is possible using a definition of a brain state as an ensemble of "metastable substates," each with a probabilistic stability and occurrence frequency fitted by a generative whole-brain model, fine-tuned on the basis of the effective connectivity. Given the biophysical limitations of direct electrical stimulation (DES) of microcircuits, this opens exciting possibilities for discovering stimulation targets and selecting connectivity patterns that can ensure propagation of DES-induced neural excitation, potentially making it possible to create awakenings from complex cases of brain injury.

| S-EPMC6731634 | biostudies-literature

Real-time electrochemical recording of dopamine release under optogenetic stimulation.

Project description:Dopaminergic PC12 cells can synthesize and release dopamine, providing a good cellular model for investigating dopamine regulation. Optogenetic stimulation of channelrhodopsin-2 provides high spatial and temporal precision for selective stimulation as a powerful neuromodulation tool for neuroscience studies. The aim of this study is to measure dopamine release from dopaminergic PC12 cells under optogenetic stimulation using electrochemical recording of self-assembled monolayers modified microelectrode with amperometric measurement in real time. The activation of PC12 cells under various optogenetic stimulation schemes are characterized by measuring single-cell Ca(2+) imaging. After 10 seconds of optogenetic stimulation, the evoked intracellular Ca(2+) level and dopamine current of channelrhodopsin-2-transfected PC12 cells were 1.6- and 3.5-fold higher than those of the control cells. The optogenetic stimulation effects on Ca(2+) influx and dopamine release were 81% and 63% inhibition by using a Ca(2+) channel antagonist Nifedipine. The results indicate that optogenetic stimulation can evoke voltage-gated Ca(2+) channel-dependent dopamine exocytosis from PC12 cells in a cell specific, temporally precise and dose-dependent manner. This proposed dopamine recording system can be developed to be a good cell model for dopamine regulation and drug screening in vitro, or dopaminergic cell implantation therapy in vivo using optogenetic stimulation in a precise and convenient way.

| S-EPMC3930700 | biostudies-literature

Behavioral encoding across timescales by region-specific dopamine dynamics.

Project description:The dorsal (DS) and ventral striatum (VS) receive dopaminergic projections that control motor functions and reward-related behavior. It remains poorly understood how dopamine release dynamics across different temporal scales in these regions are coupled to behavioral outcomes. Here, we employ the dopamine sensor dLight1.3b together with multiregion fiber photometry and machine learning-based analysis to decode dopamine dynamics across the striatum during self-paced exploratory behavior in mice. Our data show a striking coordination of rapidly fluctuating signal in the DS, carrying information across dopamine levels, with a slower signal in the VS, consisting mainly of slow-paced transients. Importantly, these release dynamics correlated with discrete behavioral motifs, such as turns, running, and grooming on a subsecond-to-minute time scale. Disruption of dopamine dynamics with cocaine caused randomization of action selection sequencing and disturbance of DS-VS coordination. The data suggest that distinct dopamine dynamics of DS and VS jointly encode behavioral sequences during unconstrained activity with DS modulating the stringing together of actions and VS the signal to initiate and sustain the selected action.

| S-EPMC9963838 | biostudies-literature

High-time-resolution time-series transcriptome data of Pseudomonas aeruginosa PAO1 under two inverted oxygen-availability transitions

Project description:We performed high-time-resolution (HTR) transcriptome analyses of Pseudomonas aeruginosa PAO1 (PA) in a continuous cultivation system during the transition from high oxygen tension to low oxygen tension (HLOT) and the reversed transition from low to high oxygen tension (LHOT). From those genes responsive to both transient conditions, we identified 85 essential oxygen-availability responsive genes (EORGs), including the expected ones (arcDABC) encoding enzymes for arginine fermentation. We then predicted a highly accurate regulatory network for the EORGs of PA by integrating information from binding motif searching, literature and inverted HTR datasets. These results not only reveal stringent EORGs of PA and their transcription regulatory network, but also highlight that achieving a high accuracy of the inferred regulatory network might be only feasible for the apparently affected regulators under the given conditions but not for all the expressed regulators in a genome scale.

2013-12-10 | GSE52445 | GEO

Corticostriatal White Matter Integrity and Dopamine D1 Receptor Availability Predict Age Differences in Prefrontal Value Signaling during Reward Learning.

Project description:Probabilistic reward learning reflects the ability to adapt choices based on probabilistic feedback. The dopaminergically innervated corticostriatal circuit in the brain plays an important role in supporting successful probabilistic reward learning. Several components of the corticostriatal circuit deteriorate with age, as it does probabilistic reward learning. We showed previously that D1 receptor availability in NAcc predicts the strength of anticipatory value signaling in vmPFC, a neural correlate of probabilistic learning that is attenuated in older participants and predicts probabilistic reward learning performance. We investigated how white matter integrity in the pathway between nucleus accumbens (NAcc) and ventromedial prefrontal cortex (vmPFC) relates to the strength of anticipatory value signaling in vmPFC in younger and older participants. We found that in a sample of 22 old and 23 young participants, fractional anisotropy in the pathway between NAcc and vmPFC predicted the strength of value signaling in vmPFC independently from D1 receptor availability in NAcc. These findings provide tentative evidence that integrity in the dopaminergic and white matter pathways of corticostriatal circuitry supports the expression of value signaling in vmPFC which supports reward learning, however, the limited sample size calls for independent replication. These and future findings could add to the improved understanding of how corticostriatal integrity contributes to reward learning ability.

| S-EPMC7472214 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data