Dorsolateral striatum engagement during reversal learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Bergstrom HC
PROVIDER: S-EPMC7497112 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In current models, learning the relationship between environmental stimuli and the outcomes of actions involves both stimulus-driven and goal-directed systems, mediated in part by the DLS and DMS, respectively. However, though these models emphasize the importance of the DLS in governing actions after extensive experience has accumulated, there is growing evidence of DLS engagement from the onset of training. Here, we used in vivo photosilencing to reveal that DLS recruitment interferes with early touchscreen discrimination learning. We also show that the direct output pathway of the DLS is preferentially recruited and causally involved in early learning and find that silencing the normal contribution of the DLS produces plasticity-related alterations in a PL-DMS circuit. These data provide further evidence suggesting that the DLS is recruited in the construction of stimulus-elicited actions that ultimately automate behavior and liberate cognitive resources for other demands, but with a cost to performance at the outset of learning.
| S-EPMC6015733 | biostudies-literature
Project description:Habits are characterized by an insensitivity to their consequences and, as such, can be distinguished from goal-directed actions. The neural basis of the development of demonstrably outcome-insensitive habitual actions in humans has not been previously characterized. In this experiment, we show that extensive training on a free-operant task reduces the sensitivity of participants' behavior to a reduction in outcome value. Analysis of functional magnetic resonance imaging data acquired during training revealed a significant increase in task-related cue sensitivity in a right posterior putamen-globus pallidus region as training progressed. These results provide evidence for a shift from goal-directed to habit-based control of instrumental actions in humans, and suggest that cue-driven activation in a specific region of dorsolateral posterior putamen may contribute to the habitual control of behavior in humans.
| S-EPMC2758609 | biostudies-literature
Project description:The striatum integrates sensorimotor and motivational signals, likely playing a key role in reward-based learning of goal-directed behavior. However, cell type-specific mechanisms underlying reinforcement learning remain to be precisely determined. Here, we investigated changes in membrane potential dynamics of dorsolateral striatal neurons comparing naïve mice and expert mice trained to lick a reward spout in response to whisker deflection. We recorded from three distinct cell types: (i) direct pathway striatonigral neurons, which express type 1 dopamine receptors; (ii) indirect pathway striatopallidal neurons, which express type 2 dopamine receptors; and (iii) tonically active, putative cholinergic, striatal neurons. Task learning was accompanied by cell type-specific changes in the membrane potential dynamics evoked by the whisker deflection and licking in successfully-performed trials. Both striatonigral and striatopallidal types of striatal projection neurons showed enhanced task-related depolarization across learning. Striatonigral neurons showed a prominent increase in a short latency sensory-evoked depolarization in expert compared to naïve mice. In contrast, the putative cholinergic striatal neurons developed a hyperpolarizing response across learning, driving a pause in their firing. Our results reveal cell type-specific changes in striatal membrane potential dynamics across the learning of a simple goal-directed sensorimotor transformation, helpful for furthering the understanding of the various potential roles of different basal ganglia circuits.
| S-EPMC8788857 | biostudies-literature
Project description:The development of alcoholism may involve a shift from goal-directed to habitual drinking. These action control systems are distinct in the dorsal striatum, with the dorsomedial striatum (DMS) important for goal-directed behavior and the dorsolateral striatum (DLS) required for habit formation. Goal-directed behavior can be modeled in rats with a fixed ratio (FR) reinforcement schedule, while a variable interval (VI) schedule promotes habitual behavior (e.g. insensitivity to contingency degradation). Using extracellular recordings from chronically implanted electrodes, we investigated how DMS and DLS neurons encoded lever-press responses and conditioned cues during operant alcohol self-administration in these two models. In rats self-administering 10% alcohol on an FR schedule, the DMS neuronal population showed increased firing at the onset of start-of-session stimuli. During self-administration, the most prominent phasic firing patterns in the DMS occurred at the time of reinforcement and reinforcement-associated cues, while the most prominent phasic activity in the DLS surrounded the lever response. Neural recordings from an additional cohort of rats trained on a VI schedule revealed a similar pattern of results; however, phasic changes in firing were smaller and differences between the medial and lateral dorsal striatum were less marked. In summary, the DMS and DLS exhibited overlapping but specialized phasic firing patterns: DMS excitations were typically time-locked to reinforcement, while DLS excitations were generally associated with lever responses. Furthermore, the regional specificities and magnitudes of phasic firing differed between reinforcement schedules, which may reflect differences in behavioral flexibility, reward expectancy and the action sequences required to procure reinforcement.
| S-EPMC3748264 | biostudies-literature
Project description:We previously found that brain-derived neurotrophic factor (BDNF)-haplodeficient mice exhibit greater ethanol-induced place preference and psychomotor sensitization, and greater ethanol consumption after deprivation, than control mice. We further observed that, in mice, voluntary ethanol intake increases BDNF expression in the dorsal striatum (DS). Here, we determined whether BDNF within the DS regulates ethanol self-administration in Long-Evans rats trained to self-administer a 10% ethanol solution. We observed a greater increase in BDNF expression after ethanol self-administration in the dorsolateral striatum (DLS) than in the dorsomedial striatum (DMS). We further found that downregulation of endogenous BDNF using viral-mediated siRNA in the DLS, but not in the DMS, significantly increased ethanol self-administration. Infusion of exogenous BDNF (0.25 microg/microl/side into the DMS; 0.25 and 0.75 microg/microl/side into the DLS) attenuated responding for ethanol when infused 3 h before the beginning of the self-administration session. Although the decrease in ethanol intake was similar in the DLS and DMS, BDNF infused in the DLS, but not in the DMS, induced an early termination of the drinking episode. Furthermore, the action of BDNF in the DLS was specific for ethanol, as infusion of the neurotrophic factor in the DMS, but not DLS, resulted in a reduction of sucrose intake. Together, these findings demonstrate that the BDNF pathway within the DLS controls the level of ethanol self-administration. Importantly, our results suggest that an endogenous signaling pathway within the same brain region that mediates drug-taking behavior also plays a critical role in gating the level of ethanol intake.
| S-EPMC2855618 | biostudies-literature
Project description:Astrocytes play a key role in the regulation of synaptic strength and are thought to orchestrate synaptic plasticity and memory. Yet, how specifically astrocytes and their neuroactive transmitters control learning and memory is currently an open question. Recent experiments have uncovered an astrocyte-mediated feedback loop in CA1 pyramidal neurons which is started by the release of endocannabinoids by active neurons and closed by astrocytic regulation of the D-serine levels at the dendrites. D-serine is a co-agonist for the NMDA receptor regulating the strength and direction of synaptic plasticity. Activity-dependent D-serine release mediated by astrocytes is therefore a candidate for mediating between long-term synaptic depression (LTD) and potentiation (LTP) during learning. Here, we show that the mathematical description of this mechanism leads to a biophysical model of synaptic plasticity consistent with the phenomenological model known as the BCM model. The resulting mathematical framework can explain the learning deficit observed in mice upon disruption of the D-serine regulatory mechanism. It shows that D-serine enhances plasticity during reversal learning, ensuring fast responses to changes in the external environment. The model provides new testable predictions about the learning process, driving our understanding of the functional role of neuron-glia interaction in learning.
| S-EPMC11245475 | biostudies-literature
Project description:The basal ganglia, and the striatum in particular, are critical for action reinforcement [1,2]. The dorsal striatum, which can be further subdivided into dorsomedial (DMS) and dorsolateral (DLS) striatum, is mainly composed of two subpopulations of striatal medium spiny projection neurons (MSNs): dopamine D1 receptor-expressing MSNs that constitute the striatonigral or direct pathway (dMSNs); and dopamine D2 receptor-expressing MSNs that constitute the striatopallidal or indirect pathway (iMSNs) [3]. It has been suggested that each pathway has opposing roles in reinforcement, with dMSNs being important to learn positive reinforcement and iMSNs to learn to avoid undesired actions (Go/No-Go) [1]. Furthermore, optogenetic self-stimulation of dMSNs in DMS leads to reinforcement of actions, while self-stimulation of iMSNs leads to avoidance of actions [2]. However, in DLS, which has been implicated in the consolidation of well-trained actions and habits in mice [4,5], both pathways are active during lever-pressing for reward [6]. Furthermore, extensive skill training leads to long-lasting potentiation of glutamatergic inputs into both dMSNs and iMSNs [4]. We report here that, in DLS, both dMSNs and iMSNs are involved in positive reinforcement, but support different action strategies.
| S-EPMC4826435 | biostudies-literature
Project description:Reinforcement learning allows organisms to predict future outcomes and to update their beliefs about value in the world. The dorsal-lateral prefrontal cortex (dlPFC) integrates information carried by reward circuits, which can be used to infer the current state of the world under uncertainty. Here, we explored the dlPFC computations related to updating current beliefs during stochastic reversal learning. We recorded the activity of populations up to 1,000 neurons, simultaneously, in two male macaques while they executed a two-armed bandit reversal learning task. Behavioral analyses using a Bayesian framework showed that animals inferred reversals and switched their choice preference rapidly, rather than slowly updating choice values, consistent with state inference. Furthermore, dlPFC neural populations accurately encoded choice preference switches. These results suggest that prefrontal neurons dynamically encode decisions associated with Bayesian subjective values, highlighting the role of the PFC in representing a belief about the current state of the world.
| S-EPMC7422923 | biostudies-literature
Project description:Subjects with schizophrenia are impaired at reinforcement-driven reversal learning from as early as their first episode. The neurobiological basis of this deficit is unknown. We obtained behavioral and fMRI data in 24 unmedicated, primarily first episode, schizophrenia patients and 24 age-, IQ- and gender-matched healthy controls during a reversal learning task. We supplemented our fMRI analysis, focusing on learning from prediction errors, with detailed computational modeling to probe task solving strategy including an ability to deploy an internal goal directed model of the task. Patients displayed reduced functional activation in the ventral striatum (VS) elicited by prediction errors. However, modeling task performance revealed that a subgroup did not adjust their behavior according to an accurate internal model of the task structure, and these were also the more severely psychotic patients. In patients who could adapt their behavior, as well as in controls, task solving was best described by cognitive strategies according to a Hidden Markov Model. When we compared patients and controls who acted according to this strategy, patients still displayed a significant reduction in VS activation elicited by informative errors that precede salient changes of behavior (reversals). Thus, our study shows that VS dysfunction in schizophrenia patients during reward-related reversal learning remains a core deficit even when controlling for task solving strategies. This result highlights VS dysfunction is tightly linked to a reward-related reversal learning deficit in early, unmedicated schizophrenia patients.
| S-EPMC3991847 | biostudies-other
Project description:Dopaminergic projections to the ventral and dorsomedial striatum are important for reward, motivation, and goal-directed learning, whereas projections to the dorsolateral striatum are implicated in motor control, habitual enactment of motor skills, visuospatial learning, and memory. These conclusions are derived from studies of rodents with lesions or pharmacological blockade of dopamine signaling to specific brain regions. In contrast, we investigated the behavioral abilities of dopamine-deficient mice in which dopamine signaling was restored to only the medial striatum by viral rescue. These mice displayed intact spatial memory, visuospatial and discriminatory learning. However, acquisition of operant behavior was delayed, and their motivation to obtain food rewards was blunted. We compare these behavioral results with our published results obtained from mice with dopamine signaling restored only to the dorsolateral striatum. We observe that most behaviors are restored with dopamine signaling restored to either brain region and conclude that the action of dopamine in either one of these nonoverlapping striatal areas can support cognitive processes independently of dopamine signaling in the other area.
| S-EPMC3771669 | biostudies-literature