Neuronal activity in dorsomedial and dorsolateral striatum under the requirement for temporal credit assignment.
Ontology highlight
ABSTRACT:
SUBMITTER: Her ES
PROVIDER: S-EPMC4887996 | biostudies-other | 2016
REPOSITORIES: biostudies-other
Similar Datasets
Project description:The development of alcoholism may involve a shift from goal-directed to habitual drinking. These action control systems are distinct in the dorsal striatum, with the dorsomedial striatum (DMS) important for goal-directed behavior and the dorsolateral striatum (DLS) required for habit formation. Goal-directed behavior can be modeled in rats with a fixed ratio (FR) reinforcement schedule, while a variable interval (VI) schedule promotes habitual behavior (e.g. insensitivity to contingency degradation). Using extracellular recordings from chronically implanted electrodes, we investigated how DMS and DLS neurons encoded lever-press responses and conditioned cues during operant alcohol self-administration in these two models. In rats self-administering 10% alcohol on an FR schedule, the DMS neuronal population showed increased firing at the onset of start-of-session stimuli. During self-administration, the most prominent phasic firing patterns in the DMS occurred at the time of reinforcement and reinforcement-associated cues, while the most prominent phasic activity in the DLS surrounded the lever response. Neural recordings from an additional cohort of rats trained on a VI schedule revealed a similar pattern of results; however, phasic changes in firing were smaller and differences between the medial and lateral dorsal striatum were less marked. In summary, the DMS and DLS exhibited overlapping but specialized phasic firing patterns: DMS excitations were typically time-locked to reinforcement, while DLS excitations were generally associated with lever responses. Furthermore, the regional specificities and magnitudes of phasic firing differed between reinforcement schedules, which may reflect differences in behavioral flexibility, reward expectancy and the action sequences required to procure reinforcement.
| S-EPMC3748264 | biostudies-literature
Project description:Hypotheses of striatal orchestration of behavior ascribe distinct functions to striatal subregions, with the dorsolateral striatum (DLS) especially implicated in habitual and skilled performance. Thus neural activity patterns recorded from the DLS, but not the dorsomedial striatum (DMS), should be correlated with habitual and automatized performance. Here, we recorded DMS and DLS neural activity in rats during training in a task promoting habitual lever pressing. Despite improving performance across sessions, clear changes in corresponding neural activity patterns were not evident in DMS or DLS during early training. Although DMS and DLS activity patterns were distinct during early training, their activity was similar following extended training. Finally, performance after extended training was not associated with DMS disengagement, as would be predicted from prior work. These results suggest that behavioral sequences may continue to engage both striatal regions long after initial acquisition, when skilled performance is consolidated.
| S-EPMC6822989 | biostudies-literature
Project description:We recently developed a rat model of incubation of methamphetamine craving after choice-based voluntary abstinence. Here, we studied the role of dorsolateral striatum (DLS) and dorsomedial striatum (DMS) in this incubation. We trained rats to self-administer palatable food pellets (6 d, 6 h/d) and methamphetamine (12 d, 6 h/d). We then assessed relapse to methamphetamine seeking under extinction conditions after 1 and 21 abstinence days. Between tests, the rats underwent voluntary abstinence (using a discrete choice procedure between methamphetamine and food; 20 trials/d) for 19 d. We used in situ hybridization to measure the colabeling of the activity marker Fos with Drd1 and Drd2 in DMS and DLS after the tests. Based on the in situ hybridization colabeling results, we tested the causal role of DMS D1 and D2 family receptors, and DMS neuronal ensembles in "incubated" methamphetamine seeking, using selective dopamine receptor antagonists (SCH39166 or raclopride) and the Daun02 chemogenetic inactivation procedure, respectively. Methamphetamine seeking was higher after 21 d of voluntary abstinence than after 1 d (incubation of methamphetamine craving). The incubated response was associated with increased Fos expression in DMS but not in DLS; Fos was colabeled with both Drd1 and Drd2 DMS injections of SCH39166 or raclopride selectively decreased methamphetamine seeking after 21 abstinence days. In Fos-lacZ transgenic rats, selective inactivation of relapse test-activated Fos neurons in DMS on abstinence day 18 decreased incubated methamphetamine seeking on day 21. Results demonstrate a role of DMS dopamine D1 and D2 receptors in the incubation of methamphetamine craving after voluntary abstinence and that DMS neuronal ensembles mediate this incubation. SIGNIFICANCE STATEMENT:In human addicts, abstinence is often self-imposed and relapse can be triggered by exposure to drug-associated cues that induce drug craving. We recently developed a rat model of incubation of methamphetamine craving after choice-based voluntary abstinence. Here, we used classical pharmacology, in situ hybridization, immunohistochemistry, and the Daun02 inactivation procedure to demonstrate a critical role of dorsomedial striatum neuronal ensembles in this new form of incubation of drug craving.
| S-EPMC5296775 | biostudies-literature
Project description:The basal ganglia are implicated in a remarkable range of functions influencing emotion and cognition as well as motor behavior. Current models of basal ganglia function hypothesize that parallel limbic, associative, and motor cortico-basal ganglia loops contribute to this diverse set of functions, but little is yet known about how these loops operate and how their activities evolve during learning. To address these issues, we recorded simultaneously in sensorimotor and associative regions of the striatum as rats learned different versions of a conditional T-maze task. We found highly contrasting patterns of activity in these regions during task performance and found that these different patterns of structured activity developed concurrently, but with sharply different dynamics. Based on the region-specific dynamics of these patterns across learning, we suggest a working model whereby dorsomedial associative loops can modulate the access of dorsolateral sensorimotor loops to the control of action.
| S-EPMC3108575 | biostudies-literature
Project description:In learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain.
| S-EPMC3127803 | biostudies-literature
Project description:Most experimental preparations demonstrate a role for dorsolateral striatum (DLS) in stimulus-response, but not outcome-based, learning. Here, we assessed DLS involvement in a touchscreen-based reversal task requiring mice to update choice following a change in stimulus-reward contingencies. In vivo single-unit recordings in the DLS showed reversal produced a population-level shift from excited to inhibited neuronal activity prior to choices being made. The larger the shift, the faster mice reversed. Furthermore, optogenetic photosilencing DLS neurons during choice increased early reversal errors. These findings suggest dynamic DLS engagement may facilitate reversal, possibly by signaling a change in contingencies to other striatal and cortical regions.
| S-EPMC7497112 | biostudies-literature
Project description:Compulsive behavior is a defining feature of disorders such as substance use disorders. Current evidence suggests that corticostriatal circuits control the expression of established compulsions, but little is known about the mechanisms regulating the development of compulsions. We hypothesized that dopamine, a critical modulator of striatal synaptic plasticity, could control alterations in corticostriatal circuits leading to the development of compulsions (defined here as continued reward seeking in the face of punishment). We used dual-site fiber photometry to measure dopamine axon activity in the dorsomedial striatum (DMS) and the dorsolateral striatum (DLS) as compulsions emerged. Individual variability in the speed with which compulsions emerged was predicted by DMS dopamine axon activity. Amplifying this dopamine signal accelerated animals' transitions to compulsion, whereas inhibition delayed it. In contrast, amplifying DLS dopamine signaling had no effect on the emergence of compulsions. These results establish DMS dopamine signaling as a key controller of the development of compulsive reward seeking.
| S-EPMC8930615 | biostudies-literature
Project description:In current models, learning the relationship between environmental stimuli and the outcomes of actions involves both stimulus-driven and goal-directed systems, mediated in part by the DLS and DMS, respectively. However, though these models emphasize the importance of the DLS in governing actions after extensive experience has accumulated, there is growing evidence of DLS engagement from the onset of training. Here, we used in vivo photosilencing to reveal that DLS recruitment interferes with early touchscreen discrimination learning. We also show that the direct output pathway of the DLS is preferentially recruited and causally involved in early learning and find that silencing the normal contribution of the DLS produces plasticity-related alterations in a PL-DMS circuit. These data provide further evidence suggesting that the DLS is recruited in the construction of stimulus-elicited actions that ultimately automate behavior and liberate cognitive resources for other demands, but with a cost to performance at the outset of learning.
| S-EPMC6015733 | biostudies-literature
Project description:The dorsomedial striatum (DMS) is an important sensorimotor region mediating the acquisition of goal-directed instrumental reward learning and behavioral flexibility. However, whether the DMS also regulates Pavlovian cue-food learning is less clear. The current study used excitotoxic lesions to determine whether the DMS is critical in Pavlovian appetitive learning and behavior, using discriminative conditioning and reversal paradigms. The results showed that DMS lesions transiently retarded cue-food learning and subsequent reversal of this learning. Rats with DMS lesions selectively attenuated responding to a food cue but not a control cue, early in training, suggesting the DMS is involved when initial associations are formed. Similarly, initial reversal learning was attenuated in rats with DMS lesions, which suggests impaired flexibility to adjust behavior when the cue meaning is reversed. We also examined the effect of DMS lesions on food intake during tests with access to a highly palatable food along with standard chow diet. Rats with DMS lesions showed an altered pattern of intake, with an initial reduction in high-fat diet followed by an increase in chow consumption. These results demonstrate that the DMS has a role in mediating cue-food learning and its subsequent reversal, as well as changes in food intake when a choice is provided. Together, these results demonstrate the DMS is involved in reward associative learning and reward consumption, when behavioral flexibility is needed to adjust responding or consumption to match the current value. (PsycINFO Database Record
| S-EPMC5726437 | biostudies-literature
Project description:Understanding how humans make competitive decisions in complex environments is a key goal of decision neuroscience. Typical experimental paradigms constrain behavioral complexity (e.g. choices in discrete-play games), and thus, the underlying neural mechanisms of dynamic social interactions remain incompletely understood. Here, we collected fMRI data while humans played a competitive real-time video game against both human and computer opponents, and then, we used Bayesian non-parametric methods to link behavior to neural mechanisms. Two key cognitive processes characterized behavior in our task: (i) the coupling of one's actions to another's actions (i.e. opponent sensitivity) and (ii) the advantageous timing of a given strategic action. We found that the dorsolateral prefrontal cortex displayed selective activation when the subject's actions were highly sensitive to the opponent's actions, whereas activation in the dorsomedial prefrontal cortex increased proportionally to the advantageous timing of actions to defeat one's opponent. Moreover, the temporoparietal junction tracked both of these behavioral quantities as well as opponent social identity, indicating a more general role in monitoring other social agents. These results suggest that brain regions that are frequently implicated in social cognition and value-based decision-making also contribute to the strategic tracking of the value of social actions in dynamic, multi-agent contexts.
| S-EPMC7308662 | biostudies-literature