Dissociable dopamine dynamics for learning and motivation.
Ontology highlight
ABSTRACT:
SUBMITTER: Mohebi A
PROVIDER: S-EPMC6555489 | biostudies-literature | 2019 Jun
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundIn a changing environment, a challenge for the brain is to flexibly guide adaptive behavior towards survival. Complex behavior and the underlying neural computations emerge from the structural components of the brain across many levels: circuits, cells, and ultimately the signaling complex of proteins at synapses. In line with this logic, dynamic modification of synaptic strength or synaptic plasticity is widely considered the cellular level implementation for adaptive behavior such as learning and memory. Predominantly expressed at excitatory synapses, the postsynaptic cell-adhesion molecule neuroligin-1 (Nlgn1) forms trans-synaptic complexes with presynaptic neurexins. Extensive evidence supports that Nlgn1 is essential for NMDA receptor transmission and long-term potentiation (LTP), both of which are putative synaptic mechanisms underlying learning and memory. Here, employing a comprehensive battery of touchscreen-based cognitive assays, we asked whether impaired NMDA receptor transmission and LTP in mice lacking Nlgn1 does in fact disrupt decision-making. To this end, we addressed two key decision problems: (i) the ability to learn and exploit the associative structure of the environment and (ii) balancing the trade-off between potential rewards and costs, or positive and negative utilities of available actions.ResultsWe found that the capacity to acquire complex associative structures and adjust learned associations was intact. However, loss of Nlgn1 alters motivation leading to a reduced willingness to overcome effort cost for reward and an increased willingness to exert effort to escape an aversive situation. We suggest Nlgn1 may be important for balancing the weighting on positive and negative utilities in reward-cost trade-off.ConclusionsOur findings update canonical views of this key synaptic molecule in behavior and suggest Nlgn1 may be essential for regulating distinct cognitive processes underlying action selection. Our data demonstrate that learning and motivational computations can be dissociated within the same animal model, from a detailed behavioral dissection. Further, these results highlight the complexities in mapping synaptic mechanisms to their behavioral consequences, and the future challenge to elucidate how complex behavior emerges through different levels of neural hardware.
| S-EPMC7646379 | biostudies-literature
Project description:It is becoming increasingly appreciated that affective and/or motivational influences contribute strongly to goal-oriented cognition and behavior. An unresolved question is whether emotional manipulations (i.e., direct induction of affectively valenced subjective experience) and motivational manipulations (e.g., delivery of performance-contingent rewards and punishments) have similar or distinct effects on cognitive control. Prior work has suggested that reward motivation can reliably enhance a proactive mode of cognitive control, whereas other evidence is suggestive that positive emotion improves cognitive flexibility, but reduces proactive control. However, a limitation of the prior research is that reward motivation and positive emotion have largely been studied independently. Here, we directly compared the effects of positive emotion and reward motivation on cognitive control with a tightly matched, within-subjects design, using the AX-continuous performance task paradigm, which allows for relative measurement of proactive versus reactive cognitive control. High-resolution pupillometry was employed as a secondary measure of cognitive dynamics during task performance. Robust increases in behavioral and pupillometric indices of proactive control were observed with reward motivation. The effects of positive emotion were much weaker, but if anything, also reflected enhancement of proactive control, a pattern that diverges from some prior findings. These results indicate that reward motivation has robust influences on cognitive control, while also highlighting the complexity and heterogeneity of positive-emotion effects. The findings are discussed in terms of potential neurobiological mechanisms.
| S-EPMC4072919 | biostudies-literature
Project description:Computations underlying cognitive strategies in human motor learning are poorly understood. Here we investigate such strategies in a common sensorimotor transformation task. We show that strategies assume two forms, likely reflecting distinct working memory representations: discrete caching of stimulus-response contingencies, and time-consuming parametric computations. Reaction times and errors suggest that both strategies are employed during learning, and trade off based on task complexity. Experiments using pressured preparation time further support dissociable strategies: In response caching, time pressure elicits multi-modal distributions of movements; during parametric computations, time pressure elicits a shifting distribution of movements between visual targets and distal goals, consistent with analog re-computing of a movement plan. A generalization experiment reveals that discrete and parametric strategies produce, respectively, more localized or more global transfer effects. These results describe how qualitatively distinct cognitive representations are leveraged for motor learning and produce downstream consequences for behavioral flexibility.
| S-EPMC6318272 | biostudies-literature
Project description:Humans are social creatures and, as such, can be motivated by aspects of social life (e.g., approval from others) to guide decision-making in everyday contexts. Indeed, a common view is that people may have stronger orientation toward social goals or incentives relative to other incentive modalities, such as food or money. However, current studies have only rarely addressed how social incentives compare to other types of rewards in motivating goal-directed behavior. The current study tested this claim; across two separate experiments, the effects of liquid and social incentives were compared in terms of their subsequent impact on task performance and self-reported affect and motivation. Critically, valenced social incentives offered both ecological validity (short video clips-Experiment 1) and continuity with prior stimuli used in the social reward and motivation literature (static images-Experiment 2) when examining their effect on behavior. Across both studies, the results replicate and extend prior work, demonstrating robust effects of liquid incentives on task performance and self-reported affect and motivation, while also supporting an interpretation of weaker motivational and affective effects for social incentives. These patterns of results highlight the complex and wide-ranging effects of social incentives and call into question the effectiveness of social incentives, relative to other incentive modalities, in motivating behavior.
| S-EPMC7509070 | biostudies-literature
Project description:Environmental reward-predictive cues can motivate reward-seeking behaviors. Although this influence is normally adaptive, it can become maladaptive in disordered states, such as addiction. Dopamine release in the nucleus accumbens core (NAc) is known to mediate the motivational impact of reward-predictive cues, but little is known about how other neuromodulatory systems contribute to cue-motivated behavior. Here, we examined the role of the NAc cholinergic receptor system in cue-motivated behavior using a Pavlovian-to-instrumental transfer task designed to assess the motivating influence of a reward-predictive cue over an independently-trained instrumental action. Disruption of NAc muscarinic acetylcholine receptor activity attenuated, whereas blockade of nicotinic receptors augmented cue-induced invigoration of reward seeking. We next examined a potential dopaminergic mechanism for this behavioral effect by combining fast-scan cyclic voltammetry with local pharmacological acetylcholine receptor manipulation. The data show evidence of opposing modulation of cue-evoked dopamine release, with muscarinic and nicotinic receptor antagonists causing suppression and augmentation, respectively, consistent with the behavioral effects of these manipulations. In addition to demonstrating cholinergic modulation of naturally-evoked and behaviorally-relevant dopamine signaling, these data suggest that NAc cholinergic receptors may gate the expression of cue-motivated behavior through modulation of phasic dopamine release.
| S-EPMC5061892 | biostudies-other
Project description:Statistical learning refers to the extraction of probabilistic relationships between stimuli and is increasingly used as a method to understand learning processes. However, numerous cognitive processes are sensitive to the statistical relationships between stimuli and any one measure of learning may conflate these processes; to date little research has focused on differentiating these processes. To understand how multiple processes underlie statistical learning, here we compared, within the same study, operational measures of learning from different tasks that may be differentially sensitive to these processes. In Experiment 1, participants were visually exposed to temporal regularities embedded in a stream of shapes. Their task was to periodically detect whether a shape, whose contrast was staircased to a threshold level, was present or absent. Afterwards, they completed a search task, where statistically predictable shapes were found more quickly. We used the search task to label shape pairs as "learned" or "non-learned", and then used these labels to analyse the detection task. We found a dissociation between learning on the search task and the detection task where only non-learned pairs showed learning effects in the detection task. This finding was replicated in further experiments with recognition memory (Experiment 2) and associative learning tasks (Experiment 3). Taken together, these findings are consistent with the view that statistical learning may comprise a family of processes that can produce dissociable effects on different aspects of behaviour.
| S-EPMC4963038 | biostudies-literature
Project description:Pavlovian conditioning underlies many aspects of pain behavior, including fear and threat detection [1], escape and avoidance learning [2], and endogenous analgesia [3]. Although a central role for the amygdala is well established [4], both human and animal studies implicate other brain regions in learning, notably ventral striatum and cerebellum [5]. It remains unclear whether these regions make different contributions to a single aversive learning process or represent independent learning mechanisms that interact to generate the expression of pain-related behavior. We designed a human parallel aversive conditioning paradigm in which different Pavlovian visual cues probabilistically predicted thermal pain primarily to either the left or right arm and studied the acquisition of conditioned Pavlovian responses using combined physiological recordings and fMRI. Using computational modeling based on reinforcement learning theory, we found that conditioning involves two distinct types of learning process. First, a non-specific "preparatory" system learns aversive facial expressions and autonomic responses such as skin conductance. The associated learning signals-the learned associability and prediction error-were correlated with fMRI brain responses in amygdala-striatal regions, corresponding to the classic aversive (fear) learning circuit. Second, a specific lateralized system learns "consummatory" limb-withdrawal responses, detectable with electromyography of the arm to which pain is predicted. Its related learned associability was correlated with responses in ipsilateral cerebellar cortex, suggesting a novel computational role for the cerebellum in pain. In conclusion, our results show that the overall phenotype of conditioned pain behavior depends on two dissociable reinforcement learning circuits.
| S-EPMC4712170 | biostudies-literature
Project description:Reward-predicting cues evoke activity in midbrain dopamine neurons that encodes fundamental attributes of economic value, including reward magnitude, delay and uncertainty. We found that dopamine release in rat nucleus accumbens encodes anticipated benefits, but not effort-based response costs unless they are atypically low. This neural separation of costs and benefits indicates that mesolimbic dopamine scales with the value of pending rewards, but does not encode the net utility of the action to obtain them.
| S-EPMC2800310 | biostudies-literature
Project description:The current study utilized resting-state functional magnetic resonance imaging (fMRI) to examine how two important non-cognitive skills, grit and growth mindset, are associated with cortico-striatal networks important for learning. Whole-brain seed-to-voxel connectivity was examined for dorsal and ventral striatal seeds. While both grit and growth mindset were associated with functional connectivity between ventral striatal and bilateral prefrontal networks thought to be important for cognitive-behavioral control. There were also clear dissociations between the neural correlates of the two constructs. Grit, the long-term perseverance towards a goal or set of goals, was associated with ventral striatal networks including connectivity to regions such as the medial prefrontal and rostral anterior cingulate cortices implicated in perseverance, delay and receipt of reward. Growth mindset, the belief that effort can improve talents, notably intelligence, was associated with both ventral and dorsal striatal connectivity with regions thought to be important for error-monitoring, such as dorsal anterior cingulate cortex. Our findings may help construct neurocognitive models of these non-cognitive skills and have critical implications for character education. Such education is a key component of social and emotional learning, ensuring that children can rise to challenges in the classroom and in life.
| S-EPMC5040906 | biostudies-literature
Project description:A rat model of diet-induced obesity (DIO) was used to determine dopamine transporter (DAT) function, impulsivity and motivation as neurobehavioral outcomes and predictors of obesity.To evaluate neurobehavioral alterations following the development of DIO induced by an 8-week high-fat diet (HF) exposure, striatal D2-receptor density, DAT function and expression, extracellular dopamine concentrations, impulsivity, and motivation for high- and low-fat reinforcers were determined. To determine predictors of DIO, neurobehavioral antecedents including impulsivity, motivation for high-fat reinforcers, DAT function and extracellular dopamine were evaluated before the 8-week HF exposure.Striatal D2-receptor density was determined by in vitro kinetic analysis of [(3)H]raclopride binding. DAT function was determined using in vitro kinetic analysis of [(3)H]dopamine uptake, methamphetamine-evoked [(3)H]dopamine overflow and no-net flux in vivo microdialysis. DAT cell-surface expression was determined using biotinylation and western blotting. Impulsivity and food-motivated behavior were determined using a delay discounting task and progressive ratio schedule, respectively.Relative to obesity-resistant (OR) rats, obesity-prone (OP) rats exhibited 18% greater body weight following an 8-week HF-diet exposure, 42% lower striatal D2-receptor density, 30% lower total DAT expression, 40% lower in vitro and in vivo DAT function, 45% greater extracellular dopamine and twofold greater methamphetamine-evoked [(3)H]dopamine overflow. OP rats exhibited higher motivation for food, and surprisingly, were less impulsive relative to OR rats. Impulsivity, in vivo DAT function and extracellular dopamine concentration did not predict DIO. Importantly, motivation for high-fat reinforcers predicted the development of DIO.Human studies are limited by their ability to determine if impulsivity, motivation and DAT function are causes or consequences of DIO. The current animal model shows that motivation for high-fat food, but not impulsive behavior, predicts the development of obesity, whereas decreases in striatal DAT function are exhibited only after the development of obesity.
| S-EPMC3856583 | biostudies-literature