Physiological state gates acquisition and expression of mesolimbic reward prediction signals.
Ontology highlight
ABSTRACT:
SUBMITTER: Cone JJ
PROVIDER: S-EPMC4763767 | biostudies-other | 2016 Feb
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Optimal decision making mandates organisms learn the relevant features of choice options. Likewise, knowing how much effort we should expend can assume paramount importance. A mesolimbic network supports reward learning, but it is unclear whether other choice features, such as effort learning, rely on this same network. Using computational fMRI, we show parallel encoding of effort and reward prediction errors (PEs) within distinct brain regions, with effort PEs expressed in dorsomedial prefrontal cortex and reward PEs in ventral striatum. We show a common mesencephalic origin for these signals evident in overlapping, but spatially dissociable, dopaminergic midbrain regions expressing both types of PE. During action anticipation, reward and effort expectations were integrated in ventral striatum, consistent with a computation of an overall net benefit of a stimulus. Thus, we show that motivationally relevant stimulus features are learned in parallel dopaminergic pathways, with formation of an integrated utility signal at choice.
| S-EPMC5584432 | biostudies-literature
Project description:Mesolimbic dopamine encodes the benefits of a course of action. However, the value of an appetitive reward depends strongly on an animal's current state. To investigate the relationship between dopamine, value, and physiological state, we monitored sub-second dopamine release in the nucleus accumbens core while rats made choices between food and sucrose solution following selective satiation on one of these reinforcers. Dopamine signals reflected preference for the reinforcers in the new state, decreasing to the devalued reward and, after satiation on food, increasing for the valued sucrose solution. These changes were rapid and selective, with dopamine release returning to pre-satiation patterns when the animals were re-tested in a standard food-restricted state. Such rapid and selective adaptation of dopamine-associated value signals could provide an important signal to promote efficient foraging for a varied diet.
| S-EPMC4835543 | biostudies-literature
Project description:G protein-gated inwardly rectifying potassium (GIRK) channels are critical regulators of neuronal excitability and can be directly activated by ethanol. Constitutive deletion of the GIRK3 subunit has minimal phenotypic consequences, except in response to drugs of abuse. Here we investigated how the GIRK3 subunit contributes to the cellular and behavioral effects of ethanol, as well as to voluntary ethanol consumption. We found that constitutive deletion of GIRK3 in knockout (KO) mice selectively increased ethanol binge-like drinking, without affecting ethanol metabolism, sensitivity to ethanol intoxication, or continuous-access drinking. Virally mediated expression of GIRK3 in the ventral tegmental area (VTA) reversed the phenotype of GIRK3 KO mice and further decreased the intake of their wild-type counterparts. In addition, GIRK3 KO mice showed a blunted response of the mesolimbic dopaminergic (DA) pathway to ethanol, as assessed by ethanol-induced excitation of VTA neurons and DA release in the nucleus accumbens. These findings support the notion that the subunit composition of VTA GIRK channels is a critical determinant of DA neuron sensitivity to drugs of abuse. Furthermore, our study reveals the behavioral impact of this cellular effect, whereby the level of GIRK3 expression in the VTA tunes ethanol intake under binge-type conditions: the more GIRK3, the less ethanol drinking.
| S-EPMC4460485 | biostudies-literature
Project description:Most caregivers of people with dementia (CPWD) experience a high degree of stress due to the demands of providing care, especially when addressing unpredictable behavioral and psychological symptoms of dementia. Such challenging responsibilities make caregivers susceptible to poor sleep quality with detrimental effects on their overall health. Hence, monitoring caregivers' sleep quality can provide important CPWD stress assessment. Most current sleep studies are based on polysomnography, which is expensive and potentially disrupts the caregiving routine. To address these issues, we propose a clinical decision support system to predict sleep quality based on trends of physiological signals in the deep sleep stage. This system utilizes four raw physiological signals using a wearable device (E4 wristband): heart rate variability, electrodermal activity, body movement, and skin temperature. To evaluate the performance of the proposed method, analyses were conducted on a two-week period of sleep monitored on eight CPWD. The best performance is achieved using the random forest classifier with an accuracy of 75% for sleep quality, and 73% for restfulness, respectively. We found that the most important features to detect these measures are sleep efficiency (ratio of amount of time asleep to the amount of time in bed) and skin temperature. The results from our sleep analysis system demonstrate the capability of using wearable sensors to measure sleep quality and restfulness in CPWD.
| S-EPMC6655554 | biostudies-literature
Project description:Theories of the positive symptoms of schizophrenia hypothesize a role for aberrant reinforcement signaling driven by dysregulated dopamine transmission. Recently, we provided evidence of aberrant reward learning in symptomatic, but not asymptomatic patients with schizophrenia, using a novel paradigm, the Salience Attribution Test (SAT). The SAT is a probabilistic reward learning game that employs cues that vary across task-relevant and task-irrelevant dimensions; it provides behavioral indices of adaptive and aberrant reward learning. As an initial step prior to future clinical studies, here we used functional magnetic resonance imaging to examine the neural basis of adaptive and aberrant reward learning during the SAT in healthy volunteers. As expected, cues associated with high relative to low reward probabilities elicited robust hemodynamic responses in a network of structures previously implicated in motivational salience; the midbrain, in the vicinity of the ventral tegmental area, and regions targeted by its dopaminergic projections, i.e. medial dorsal thalamus, ventral striatum and prefrontal cortex (PFC). Responses in the medial dorsal thalamus and polar PFC were strongly correlated with the degree of adaptive reward learning across participants. Finally, and most importantly, differential dorsolateral PFC and middle temporal gyrus (MTG) responses to cues with identical reward probabilities were very strongly correlated with the degree of aberrant reward learning. Participants who showed greater aberrant learning exhibited greater dorsolateral PFC responses, and reduced MTG responses, to cues erroneously inferred to be less strongly associated with reward. The results are discussed in terms of their implications for different theories of associative learning.
| S-EPMC2828543 | biostudies-literature
Project description:Recent theories addressing mesolimbic dopamine's role in reward processing emphasize two apparently distinct functions, one in reinforcement learning (i.e., prediction error) and another in incentive motivation (i.e., the invigoration of reward seeking elicited by reward-paired cues). Here, we evaluate the latter.Using fast-scan cyclic voltammetry, we monitored, in real time, dopamine release in the nucleus accumbens core of rats (n = 9) during a Pavlovian-to-instrumental transfer task in which the effects of a reward-predictive cue on an independently trained instrumental action were assessed. Voltammetric data were parsed into slow and phasic components to determine whether these forms of dopamine signaling were differentially related to task performance.We found that a reward-paired cue, which increased reward-seeking actions, induced an increase in phasic mesolimbic dopamine release and produced slower elevations in extracellular dopamine. Interestingly, phasic dopamine release was temporally related to and positively correlated with lever-press activity generally, while slow dopamine changes were not significantly related to such activity. Importantly, the propensity of the reward-paired cue to increase lever pressing was predicted by the amplitude of phasic dopamine release events, indicating a possible mechanism through which cues initiate reward-seeking actions.These data suggest that those phasic mesolimbic dopamine release events thought to signal reward prediction error may also be related to the incentive motivational impact of reward-paired cues on reward-seeking actions.
| S-EPMC3615104 | biostudies-literature
Project description:The regulatory mechanisms underlying the response to addictive drugs are complex, and increasing evidence indicates that there is a role for appetite-regulating pathways in substance abuse. Leptin, an important adipose hormone that regulates energy balance and appetite, exerts its physiological functions via leptin receptors. However, the role of leptin signaling in regulating the response to cocaine remains unclear. Here we examined the potential role of leptin signaling in cocaine reward using a conditioned place preference (CPP) procedure. Our results showed that inhibition of leptin signaling by intracerebroventricular infusion of the leptin receptor (LepR) antagonist SMLA during cocaine conditioning increased the cocaine-CPP and upregulated the level of dopamine and its metabolites in the nucleus accumbens (NAc). We then selectively knocked down the LepR in the mesolimbic ventral tegmental area (VTA), NAc core and central amygdala (CeA) by injecting AAV-Cre into Leprflox/flox mice. LepR deletion in the VTA increased the dopamine levels in the NAc and enhanced the cocaine-conditioned reward. LepR deletion in the NAc core enhanced the cocaine-conditioned reward and impaired the effect of the D2-dopamine receptor on cocaine-CPP, whereas LepR deletion in the CeA had no effect on cocaine-CPP but increased the anxiety level of mice. In addition, prior exposure to saccharin increased LepR mRNA and STAT3 phosphorylation in the NAc and VTA and impaired cocaine-CPP. These results indicate that leptin signaling is critically involved in cocaine-conditioned reward and the regulation of drug reward by a natural reward and that these effects are dependent on mesolimbic LepR.
| S-EPMC5315559 | biostudies-literature
Project description:Dopamine cell firing can encode errors in reward prediction, providing a learning signal to guide future behavior. Yet dopamine is also a key modulator of motivation, invigorating current behavior. Existing theories propose that fast (phasic) dopamine fluctuations support learning, whereas much slower (tonic) dopamine changes are involved in motivation. We examined dopamine release in the nucleus accumbens across multiple time scales, using complementary microdialysis and voltammetric methods during adaptive decision-making. We found that minute-by-minute dopamine levels covaried with reward rate and motivational vigor. Second-by-second dopamine release encoded an estimate of temporally discounted future reward (a value function). Changing dopamine immediately altered willingness to work and reinforced preceding action choices by encoding temporal-difference reward prediction errors. Our results indicate that dopamine conveys a single, rapidly evolving decision variable, the available reward for investment of effort, which is employed for both learning and motivational functions.
| S-EPMC4696912 | biostudies-literature
Project description:The quick Sequential Organ Failure Assessment (qSOFA) system identifies an individual's risk to progress to poor sepsis-related outcomes using minimal variables. We used Support Vector Machine, Learning Using Concave and Convex Kernels, and Random Forest to predict an increase in qSOFA score using electronic health record (EHR) data, electrocardiograms (ECG), and arterial line signals. We structured physiological signals data in a tensor format and used Canonical Polyadic/Parallel Factors (CP) decomposition for feature reduction. Random Forests trained on ECG data show improved performance after tensor decomposition for predictions in a 6-h time frame (AUROC 0.67 ± 0.06 compared to 0.57 ± 0.08, p=0.01 ). Adding arterial line features can also improve performance (AUROC 0.69 ± 0.07, p<0.01 ), and benefit from tensor decomposition (AUROC 0.71 ± 0.07, p=0.01 ). Adding EHR data features to a tensor-reduced signal model further improves performance (AUROC 0.77 ± 0.06, p<0.01 ). Despite reduction in performance going from an EHR data-informed model to a tensor-reduced waveform data model, the signals-informed model offers distinct advantages. The first is that predictions can be made on a continuous basis in real-time, and second is that these predictions are not limited by the availability of EHR data. Additionally, structuring the waveform features as a tensor conserves structural and temporal information that would otherwise be lost if the data were presented as flat vectors.
| S-EPMC11300462 | biostudies-literature
Project description:The pursuit of knowledge is a basic feature of human nature. However, in domains ranging from health to finance people sometimes choose to remain ignorant. Here, we show that valence is central to the process by which the human brain evaluates the opportunity to gain information, explaining why knowledge may not always be preferred. We reveal that the mesolimbic reward circuitry selectively treats the opportunity to gain knowledge about future favorable outcomes, but not unfavorable outcomes, as if it has positive utility. This neural coding predicts participants' tendency to choose knowledge about future desirable outcomes more often than undesirable ones, and to choose ignorance about future undesirable outcomes more often than desirable ones. Strikingly, participants are willing to pay both for knowledge and ignorance as a function of the expected valence of knowledge. The orbitofrontal cortex (OFC), however, responds to the opportunity to receive knowledge over ignorance regardless of the valence of the information. Connectivity between the OFC and mesolimbic circuitry could contribute to a general preference for knowledge that is also modulated by valence. Our findings characterize the importance of valence in information seeking and its underlying neural computation. This mechanism could lead to suboptimal behavior, such as when people reject medical screenings or monitor investments more during bull than bear markets.
| S-EPMC6077743 | biostudies-literature