Dorsolateral striatum engagement during reversal learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Bergstrom HC
PROVIDER: S-EPMC7497112 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In current models, learning the relationship between environmental stimuli and the outcomes of actions involves both stimulus-driven and goal-directed systems, mediated in part by the DLS and DMS, respectively. However, though these models emphasize the importance of the DLS in governing actions after extensive experience has accumulated, there is growing evidence of DLS engagement from the onset of training. Here, we used in vivo photosilencing to reveal that DLS recruitment interferes with early touchscreen discrimination learning. We also show that the direct output pathway of the DLS is preferentially recruited and causally involved in early learning and find that silencing the normal contribution of the DLS produces plasticity-related alterations in a PL-DMS circuit. These data provide further evidence suggesting that the DLS is recruited in the construction of stimulus-elicited actions that ultimately automate behavior and liberate cognitive resources for other demands, but with a cost to performance at the outset of learning.
| S-EPMC6015733 | biostudies-literature
Project description:Habits are characterized by an insensitivity to their consequences and, as such, can be distinguished from goal-directed actions. The neural basis of the development of demonstrably outcome-insensitive habitual actions in humans has not been previously characterized. In this experiment, we show that extensive training on a free-operant task reduces the sensitivity of participants' behavior to a reduction in outcome value. Analysis of functional magnetic resonance imaging data acquired during training revealed a significant increase in task-related cue sensitivity in a right posterior putamen-globus pallidus region as training progressed. These results provide evidence for a shift from goal-directed to habit-based control of instrumental actions in humans, and suggest that cue-driven activation in a specific region of dorsolateral posterior putamen may contribute to the habitual control of behavior in humans.
| S-EPMC2758609 | biostudies-literature
Project description:The development of alcoholism may involve a shift from goal-directed to habitual drinking. These action control systems are distinct in the dorsal striatum, with the dorsomedial striatum (DMS) important for goal-directed behavior and the dorsolateral striatum (DLS) required for habit formation. Goal-directed behavior can be modeled in rats with a fixed ratio (FR) reinforcement schedule, while a variable interval (VI) schedule promotes habitual behavior (e.g. insensitivity to contingency degradation). Using extracellular recordings from chronically implanted electrodes, we investigated how DMS and DLS neurons encoded lever-press responses and conditioned cues during operant alcohol self-administration in these two models. In rats self-administering 10% alcohol on an FR schedule, the DMS neuronal population showed increased firing at the onset of start-of-session stimuli. During self-administration, the most prominent phasic firing patterns in the DMS occurred at the time of reinforcement and reinforcement-associated cues, while the most prominent phasic activity in the DLS surrounded the lever response. Neural recordings from an additional cohort of rats trained on a VI schedule revealed a similar pattern of results; however, phasic changes in firing were smaller and differences between the medial and lateral dorsal striatum were less marked. In summary, the DMS and DLS exhibited overlapping but specialized phasic firing patterns: DMS excitations were typically time-locked to reinforcement, while DLS excitations were generally associated with lever responses. Furthermore, the regional specificities and magnitudes of phasic firing differed between reinforcement schedules, which may reflect differences in behavioral flexibility, reward expectancy and the action sequences required to procure reinforcement.
| S-EPMC3748264 | biostudies-literature
Project description:We previously found that brain-derived neurotrophic factor (BDNF)-haplodeficient mice exhibit greater ethanol-induced place preference and psychomotor sensitization, and greater ethanol consumption after deprivation, than control mice. We further observed that, in mice, voluntary ethanol intake increases BDNF expression in the dorsal striatum (DS). Here, we determined whether BDNF within the DS regulates ethanol self-administration in Long-Evans rats trained to self-administer a 10% ethanol solution. We observed a greater increase in BDNF expression after ethanol self-administration in the dorsolateral striatum (DLS) than in the dorsomedial striatum (DMS). We further found that downregulation of endogenous BDNF using viral-mediated siRNA in the DLS, but not in the DMS, significantly increased ethanol self-administration. Infusion of exogenous BDNF (0.25 microg/microl/side into the DMS; 0.25 and 0.75 microg/microl/side into the DLS) attenuated responding for ethanol when infused 3 h before the beginning of the self-administration session. Although the decrease in ethanol intake was similar in the DLS and DMS, BDNF infused in the DLS, but not in the DMS, induced an early termination of the drinking episode. Furthermore, the action of BDNF in the DLS was specific for ethanol, as infusion of the neurotrophic factor in the DMS, but not DLS, resulted in a reduction of sucrose intake. Together, these findings demonstrate that the BDNF pathway within the DLS controls the level of ethanol self-administration. Importantly, our results suggest that an endogenous signaling pathway within the same brain region that mediates drug-taking behavior also plays a critical role in gating the level of ethanol intake.
| S-EPMC2855618 | biostudies-literature
Project description:The basal ganglia, and the striatum in particular, are critical for action reinforcement [1,2]. The dorsal striatum, which can be further subdivided into dorsomedial (DMS) and dorsolateral (DLS) striatum, is mainly composed of two subpopulations of striatal medium spiny projection neurons (MSNs): dopamine D1 receptor-expressing MSNs that constitute the striatonigral or direct pathway (dMSNs); and dopamine D2 receptor-expressing MSNs that constitute the striatopallidal or indirect pathway (iMSNs) [3]. It has been suggested that each pathway has opposing roles in reinforcement, with dMSNs being important to learn positive reinforcement and iMSNs to learn to avoid undesired actions (Go/No-Go) [1]. Furthermore, optogenetic self-stimulation of dMSNs in DMS leads to reinforcement of actions, while self-stimulation of iMSNs leads to avoidance of actions [2]. However, in DLS, which has been implicated in the consolidation of well-trained actions and habits in mice [4,5], both pathways are active during lever-pressing for reward [6]. Furthermore, extensive skill training leads to long-lasting potentiation of glutamatergic inputs into both dMSNs and iMSNs [4]. We report here that, in DLS, both dMSNs and iMSNs are involved in positive reinforcement, but support different action strategies.
| S-EPMC4826435 | biostudies-literature
Project description:Reinforcement learning allows organisms to predict future outcomes and to update their beliefs about value in the world. The dorsal-lateral prefrontal cortex (dlPFC) integrates information carried by reward circuits, which can be used to infer the current state of the world under uncertainty. Here, we explored the dlPFC computations related to updating current beliefs during stochastic reversal learning. We recorded the activity of populations up to 1,000 neurons, simultaneously, in two male macaques while they executed a two-armed bandit reversal learning task. Behavioral analyses using a Bayesian framework showed that animals inferred reversals and switched their choice preference rapidly, rather than slowly updating choice values, consistent with state inference. Furthermore, dlPFC neural populations accurately encoded choice preference switches. These results suggest that prefrontal neurons dynamically encode decisions associated with Bayesian subjective values, highlighting the role of the PFC in representing a belief about the current state of the world.
| S-EPMC7422923 | biostudies-literature
Project description:Subjects with schizophrenia are impaired at reinforcement-driven reversal learning from as early as their first episode. The neurobiological basis of this deficit is unknown. We obtained behavioral and fMRI data in 24 unmedicated, primarily first episode, schizophrenia patients and 24 age-, IQ- and gender-matched healthy controls during a reversal learning task. We supplemented our fMRI analysis, focusing on learning from prediction errors, with detailed computational modeling to probe task solving strategy including an ability to deploy an internal goal directed model of the task. Patients displayed reduced functional activation in the ventral striatum (VS) elicited by prediction errors. However, modeling task performance revealed that a subgroup did not adjust their behavior according to an accurate internal model of the task structure, and these were also the more severely psychotic patients. In patients who could adapt their behavior, as well as in controls, task solving was best described by cognitive strategies according to a Hidden Markov Model. When we compared patients and controls who acted according to this strategy, patients still displayed a significant reduction in VS activation elicited by informative errors that precede salient changes of behavior (reversals). Thus, our study shows that VS dysfunction in schizophrenia patients during reward-related reversal learning remains a core deficit even when controlling for task solving strategies. This result highlights VS dysfunction is tightly linked to a reward-related reversal learning deficit in early, unmedicated schizophrenia patients.
| S-EPMC3991847 | biostudies-other
Project description:Dopaminergic projections to the ventral and dorsomedial striatum are important for reward, motivation, and goal-directed learning, whereas projections to the dorsolateral striatum are implicated in motor control, habitual enactment of motor skills, visuospatial learning, and memory. These conclusions are derived from studies of rodents with lesions or pharmacological blockade of dopamine signaling to specific brain regions. In contrast, we investigated the behavioral abilities of dopamine-deficient mice in which dopamine signaling was restored to only the medial striatum by viral rescue. These mice displayed intact spatial memory, visuospatial and discriminatory learning. However, acquisition of operant behavior was delayed, and their motivation to obtain food rewards was blunted. We compare these behavioral results with our published results obtained from mice with dopamine signaling restored only to the dorsolateral striatum. We observe that most behaviors are restored with dopamine signaling restored to either brain region and conclude that the action of dopamine in either one of these nonoverlapping striatal areas can support cognitive processes independently of dopamine signaling in the other area.
| S-EPMC3771669 | biostudies-literature
Project description:Hypotheses of striatal orchestration of behavior ascribe distinct functions to striatal subregions, with the dorsolateral striatum (DLS) especially implicated in habitual and skilled performance. Thus neural activity patterns recorded from the DLS, but not the dorsomedial striatum (DMS), should be correlated with habitual and automatized performance. Here, we recorded DMS and DLS neural activity in rats during training in a task promoting habitual lever pressing. Despite improving performance across sessions, clear changes in corresponding neural activity patterns were not evident in DMS or DLS during early training. Although DMS and DLS activity patterns were distinct during early training, their activity was similar following extended training. Finally, performance after extended training was not associated with DMS disengagement, as would be predicted from prior work. These results suggest that behavioral sequences may continue to engage both striatal regions long after initial acquisition, when skilled performance is consolidated.
| S-EPMC6822989 | biostudies-literature
Project description:The dorsal striatum has two functionally-defined subdivisions: a dorsomedial striatum (DMS) region involved in mediating goal-directed behaviors that require conscious effort, and a dorsolateral striatum (DLS) region involved in the execution of habitual behaviors in a familiar sensory context. Consistent with its presumed role in forming stimulus-response (S-R) associations, neurons in DLS receive massive inputs from sensorimotor cortex and are responsive to both active and passive sensory stimulation. While several studies have established that corticostriatal inputs contribute to the stimulus-induced responses observed in the DLS, there is growing awareness that the thalamus has a significant role in conveying sensory-related information to DLS and other parts of the striatum. The thalamostriatal projections to DLS originate mainly from the caudal intralaminar region, which contains the parafascicular (Pf) nucleus, and from higher-order thalamic nuclei such as the medial part of the posterior (POm) nucleus. Based on recent findings, we hypothesize that the thalamostriatal projections from these two regions exert opposing influences on the expression of behavioral habits. This article reviews the subcortical circuits that regulate the transmission of sensory information through these thalamostriatal projection systems, and describes the evidence that indicates these circuits could be manipulated to ameliorate the symptoms of Parkinson's disease (PD) and related neurological disorders.
| S-EPMC5524679 | biostudies-other