Browse
Submit Data
Databases
API
Help

Dataset Information

22 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Action selection and action value in frontal-striatal circuits.

ABSTRACT: The role that frontal-striatal circuits play in normal behavior remains unclear. Two of the leading hypotheses suggest that these circuits are important for action selection or reinforcement learning. To examine these hypotheses, we carried out an experiment in which monkeys had to select actions in two different task conditions. In the first (random) condition, actions were selected on the basis of perceptual inference. In the second (fixed) condition, the animals used reinforcement from previous trials to select actions. Examination of neural activity showed that the representation of the selected action was stronger in lateral prefrontal cortex (lPFC), and occurred earlier in the lPFC than it did in the dorsal striatum (dSTR). In contrast to this, the representation of action values, in both the random and fixed conditions, was stronger in the dSTR. Thus, the dSTR contains an enriched representation of action value, but it followed frontal cortex in action selection.

SUBMITTER: Seo M

PROVIDER: S-EPMC3372873 | biostudies-literature | 2012 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Action selection and action value in frontal-striatal circuits.

Seo Moonsang M Lee Eunjeong E Averbeck Bruno B BB

Neuron 20120601 5

The role that frontal-striatal circuits play in normal behavior remains unclear. Two of the leading hypotheses suggest that these circuits are important for action selection or reinforcement learning. To examine these hypotheses, we carried out an experiment in which monkeys had to select actions in two different task conditions. In the first (random) condition, actions were selected on the basis of perceptual inference. In the second (fixed) condition, the animals used reinforcement from previo ...[more]

PMID: 22681697

Similar Datasets

Striatal action-value neurons reconsidered.

Project description:It is generally believed that during economic decisions, striatal neurons represent the values associated with different actions. This hypothesis is based on studies, in which the activity of striatal neurons was measured while the subject was learning to prefer the more rewarding action. Here we show that these publications are subject to at least one of two critical confounds. First, we show that even weak temporal correlations in the neuronal data may result in an erroneous identification of action-value representations. Second, we show that experiments and analyses designed to dissociate action-value representation from the representation of other decision variables cannot do so. We suggest solutions to identifying action-value representation that are not subject to these confounds. Applying one solution to previously identified action-value neurons in the basal ganglia we fail to detect action-value representations. We conclude that the claim that striatal neurons encode action-values must await new experiments and analyses.

| S-EPMC6008056 | biostudies-literature

Dynamics of striatal action selection and reinforcement learning.

Project description:Spiny projection neurons (SPNs) in dorsal striatum are often proposed as a locus of reinforcement learning in the basal ganglia. Here, we identify and resolve a fundamental inconsistency between striatal reinforcement learning models and known SPN synaptic plasticity rules. Direct-pathway (dSPN) and indirect-pathway (iSPN) neurons, which promote and suppress actions, respectively, exhibit synaptic plasticity that reinforces activity associated with elevated or suppressed dopamine release. We show that iSPN plasticity prevents successful learning, as it reinforces activity patterns associated with negative outcomes. However, this pathological behavior is reversed if functionally opponent dSPNs and iSPNs, which promote and suppress the current behavior, are simultaneously activated by efferent input following action selection. This prediction is supported by striatal recordings and contrasts with prior models of SPN representations. In our model, learning and action selection signals can be multiplexed without interference, enabling learning algorithms beyond those of standard temporal difference models.

| S-EPMC10925202 | biostudies-literature

Cholinergic midbrain afferents modulate striatal circuits and shape encoding of action strategies.

Project description:Assimilation of novel strategies into a consolidated action repertoire is a crucial function for behavioral adaptation and cognitive flexibility. Acetylcholine in the striatum plays a pivotal role in such adaptation, and its release has been causally associated with the activity of cholinergic interneurons. Here we show that the midbrain, a previously unknown source of acetylcholine in the striatum, is a major contributor to cholinergic transmission in the striatal complex. Neurons of the pedunculopontine and laterodorsal tegmental nuclei synapse with striatal cholinergic interneurons and give rise to excitatory responses. Furthermore, they produce uniform inhibition of spiny projection neurons. Inhibition of acetylcholine release from midbrain terminals in the striatum impairs the association of contingencies and the formation of habits in an instrumental task, and mimics the effects observed following inhibition of acetylcholine release from striatal cholinergic interneurons. These results suggest the existence of two hierarchically-organized modes of cholinergic transmission in the striatum, where cholinergic interneurons are modulated by cholinergic neurons of the midbrain.

| S-EPMC7142106 | biostudies-literature

Normal aging and Parkinson's disease are associated with the functional decline of distinct frontal-striatal circuits.

Project description:Impaired ability to shift attention between stimuli (i.e. shifting attentional 'set') is a well-established part of the dysexecutive syndrome in Parkinson's Disease (PD), nevertheless cognitive and neural bases of this deficit remain unclear. In this study, an fMRI-optimised variant of a classic paradigm for assessing attentional control (Hampshire and Owen 2006) was used to contrast activity in dissociable executive circuits in early-stage PD patients and controls. The results demonstrated that the neural basis of the executive performance impairments in PD is accompanied by hypoactivation within the striatum, anterior cingulate cortex (vACC), and inferior frontal sulcus (IFS) regions. By contrast, in aging it is associated with hypoactivation of the anterior insula/inferior frontal operculum (AI/FO) and the pre-supplementary motor area (preSMA). Between group behavioural differences were also observed; whereas normally aging individuals exhibited routine-problem solving deficits, PD patients demonstrated more global task learning deficits. These findings concur with recent research demonstrating model-based reinforcement learning deficits in PD and provide evidence that the AI/FO and IFS circuits are differentially impacted by PD and normal aging.

| S-EPMC5542042 | biostudies-literature

Project description:Appropriate neural representation of value and application of decision strategies are necessary to make optimal investment choices in real life. Normative human aging alters neural selectivity and control processing in brain regions implicated in value-based decision processing including striatal, medial temporal, and frontal areas. However, the specific neural mechanisms of how these age-related functional brain changes modulate value processing in older adults remain unclear. Here, young and older adults performed a lottery-choice functional magnetic resonance imaging experiment in which probabilities of winning different magnitudes of points constituted expected values of stakes. Increasing probability of winning modulated striatal responses in young adults, but modulated medial temporal and ventromedial prefrontal areas instead in older adults. Older adults additionally engaged higher responses in dorso-medio-lateral prefrontal cortices to more unfavorable stakes. Such extrastriatal involvement mediated age-related increase in risk-taking decisions. Furthermore, lower resting-state functional connectivity between lateral prefrontal and striatal areas also predicted lottery-choice task risk-taking that was mediated by higher functional connectivity between prefrontal and medial temporal areas during the task, with this mediation relationship being stronger in older than younger adults. Overall, we report evidence of a systemic neural mechanistic change in processing of probability in mixed-lottery values with age that increases risk-taking of unfavorable stakes in older adults. Moreover, individual differences in age-related effects on baseline frontostriatal communication may be a central determinant of such subsequent age differences in value-based decision neural processing and resulting behaviors.

| S-EPMC6115276 | biostudies-literature

Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value.

Project description:In changing environments, animals must adaptively select actions to achieve their goals. In tasks involving goal-directed action selection, striatal neural activity has been shown to represent the value of competing actions. Striatal representations of action value could potentially bias responses toward actions of higher value. However, no study to date has demonstrated the direct effect of distinct striatal pathways in goal-directed action selection. We found that transient optogenetic stimulation of dorsal striatal dopamine D1 and D2 receptor-expressing neurons during decision-making in mice introduced opposing biases in the distribution of choices. The effect of stimulation on choice was dependent on recent reward history and mimicked an additive change in the action value. Although stimulation before and during movement initiation produced a robust bias in choice behavior, this bias was substantially diminished when stimulation was delayed after response initiation. Together, our data suggest that striatal activity is involved in goal-directed action selection.

| S-EPMC3951287 | biostudies-literature

Mobilization of Medial and Lateral Frontal-Striatal Circuits in Cocaine Users and Controls: An Interleaved TMS/BOLD Functional Connectivity Study.

Project description:The integrity of frontal-striatal circuits is an area of great interest in substance dependence literature, particularly as the field begins to develop neural circuit-specific brain stimulation treatments for these individuals. Prior research indicates that frontal-striatal connectivity is disrupted in chronic cocaine users in a baseline (resting) state. It is unclear, however, if this is also true when these circuits are mobilized by an external source. In this study, we measured the functional and structural integrity of frontal-striatal circuitry involved in limbic arousal and executive control in 36 individuals-18 cocaine-dependent individuals with a history of failed quit attempts and 18 age-matched controls. This was achieved by applying a transcranial magnetic stimulation to the medial prefrontal cortex (Brodmann area 10) and the dorsolateral prefrontal cortex (lateral Brodmann 9) while participants rested in the MRI scanner (TMS/BOLD imaging). Relative to the controls, cocaine users had a lower ventral striatal BOLD response to MPFC stimulation. The dorsal striatal BOLD response to DLPFC stimulation however was not significantly different between the groups. Among controls, DLPFC stimulation led to a reciprocal attenuation of MPFC activity (BA 10), but this pattern did not exist in cocaine users. No relationship was found between regional diffusion metrics and functional activity. Considered together these data suggest that, when engaged, cocaine users can mobilize their executive control system similar to controls, but that the 'set point' for mobilizing their limbic arousal system has been elevated-an interpretation consistent with opponent process theories of addiction.

| S-EPMC5101551 | biostudies-literature

Distributed processing for value-based choice by prelimbic circuits targeting anterior-posterior dorsal striatal subregions in male mice.

Project description:Fronto-striatal circuits have been implicated in cognitive control of behavioral output for social and appetitive rewards. The functional diversity of prefrontal cortical populations is strongly dependent on their synaptic targets, with control of motor output mediated by connectivity to dorsal striatum. Despite evidence for functional diversity along the anterior-posterior striatal axis, it is unclear how distinct fronto-striatal sub-circuits support value-based choice. Here we found segregated prefrontal populations defined by anterior/posterior dorsomedial striatal target. During a feedback-based 2-alternative choice task, single-photon imaging revealed circuit-specific representations of task-relevant information with prelimbic neurons targeting anterior DMS (PL::A-DMS) robustly modulated during choices and negative outcomes, while prelimbic neurons targeting posterior DMS (PL::P-DMS) encoded internal representations of value and positive outcomes contingent on prior choice. Consistent with this distributed coding, optogenetic inhibition of PL::A-DMS circuits strongly impacted choice monitoring and responses to negative outcomes while inhibition of PL::P-DMS impaired task engagement and strategies following positive outcomes. Together our data uncover PL populations engaged in distributed processing for value-based choice.

| S-EPMC10079960 | biostudies-literature

Primate homologs of mouse cortico-striatal circuits.

Project description:With the increasing necessity of animal models in biomedical research, there is a vital need to harmonise findings across species by establishing similarities and differences in rodent and primate neuroanatomy. Using connectivity fingerprint matching, we compared cortico-striatal circuits across humans, non-human primates, and mice using resting-state fMRI data in all species. Our results suggest that the connectivity patterns for the nucleus accumbens and cortico-striatal motor circuits (posterior/lateral putamen) were conserved across species, making them reliable targets for cross-species comparisons. However, a large number of human and macaque striatal voxels were not matched to any mouse cortico-striatal circuit (mouse->human: 85% unassigned; mouse->macaque 69% unassigned; macaque->human; 31% unassigned). These unassigned voxels were localised to the caudate nucleus and anterior putamen, overlapping with executive function and social/language regions of the striatum and connected to prefrontal-projecting cerebellar lobules and anterior prefrontal cortex, forming circuits that seem to be unique for non-human primates and humans.

| S-EPMC7162658 | biostudies-literature

Haloperidol Selectively Remodels Striatal Indirect Pathway Circuits.

Project description:Typical antipsychotic drugs are widely thought to alleviate the positive symptoms of schizophrenia by antagonizing dopamine D2 receptors expressed by striatal spiny projection neurons (SPNs). What is less clear is why antipsychotics have a therapeutic latency of weeks. Using a combination of physiological and anatomical approaches in ex vivo brain slices from transgenic mice, it was found that 2 weeks of haloperidol treatment induced both intrinsic and synaptic adaptations specifically within indirect pathway SPNs (iSPNs). Perphenazine treatment had similar effects. Some of these adaptations were homeostatic, including a drop in intrinsic excitability and pruning of excitatory corticostriatal glutamatergic synapses. However, haloperidol treatment also led to strengthening of a subset of excitatory corticostriatal synapses. This slow remodeling of corticostriatal iSPN circuitry is likely to play a role in mediating the delayed therapeutic action of neuroleptics.

| S-EPMC5312058 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data