Dataset Information

Model-based action planning involves cortico-cerebellar and basal ganglia networks.

ABSTRACT: Humans can select actions by learning, planning, or retrieving motor memories. Reinforcement Learning (RL) associates these processes with three major classes of strategies for action selection: exploratory RL learns state-action values by exploration, model-based RL uses internal models to simulate future states reached by hypothetical actions, and motor-memory RL selects past successful state-action mapping. In order to investigate the neural substrates that implement these strategies, we conducted a functional magnetic resonance imaging (fMRI) experiment while humans performed a sequential action selection task under conditions that promoted the use of a specific RL strategy. The ventromedial prefrontal cortex and ventral striatum increased activity in the exploratory condition; the dorsolateral prefrontal cortex, dorsomedial striatum, and lateral cerebellum in the model-based condition; and the supplementary motor area, putamen, and anterior cerebellum in the motor-memory condition. These findings suggest that a distinct prefrontal-basal ganglia and cerebellar network implements the model-based RL action selection strategy.

SUBMITTER: Fermin AS

PROVIDER: S-EPMC4990901 | biostudies-other | 2016

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Model-based action planning involves cortico-cerebellar and basal ganglia networks.

Fermin Alan S R AS Yoshida Takehiko T Yoshimoto Junichiro J Ito Makoto M Tanaka Saori C SC Doya Kenji K

Scientific reports 20160819

Humans can select actions by learning, planning, or retrieving motor memories. Reinforcement Learning (RL) associates these processes with three major classes of strategies for action selection: exploratory RL learns state-action values by exploration, model-based RL uses internal models to simulate future states reached by hypothetical actions, and motor-memory RL selects past successful state-action mapping. In order to investigate the neural substrates that implement these strategies, we cond ...[more]

PMID: 27539554

Similar Datasets

Project description:ObjectivesThe aim was to describe the contribution of basal ganglia (BG) thalamo-cortical circuitry to the whole-brain functional connectivity in focal epilepsies.MethodsInterictal resting-state fMRI recordings were acquired in 46 persons with focal epilepsies. Of these 46, 22 had temporal lobe epilepsy: 9 left temporal (LTLE), 13 right temporal (RTLE); 15 had frontal lobe epilepsy (FLE); and 9 had parietal/occipital lobe epilepsy (POLE). There were 20 healthy controls. The complete weighted network was analyzed based on correlation matrices of 90 and 194 regions. The network topology was quantified on a global and regional level by measures based on graph theory, and connection-level changes were analyzed by the partial least square method.ResultsIn all patient groups except RTLE, the shift of the functional network topology away from random was observed (normalized clustering coefficient and characteristic path length were higher in patient groups than in controls). Links contributing to this change were found in the cortico-subcortical connections. Weak connections (low correlations) consistently contributed to this modification of the network. The importance of regions changed: decreases in the subcortical areas and both decreases and increases in the cortical areas were observed in node strength, clustering coefficient and eigenvector centrality in patient groups when compared to controls. Node strength decreases of the basal ganglia, i.e. the putamen, caudate, and pallidum, were displayed in LTLE, FLE, and POLE. The connectivity within the basal ganglia-thalamus circuitry was not disturbed; the disturbance concerned the connectivity between the circuitry and the cortex.SignificanceFocal epilepsies affect large-scale brain networks beyond the epileptogenic zones. Cortico-subcortical functional connectivity disturbance was displayed in LTLE, FLE, and POLE. Significant changes in the resting-state functional connectivity between cortical and subcortical structures suggest an important role of the BG and thalamus in focal epilepsies.

Dataset Information

Model-based action planning involves cortico-cerebellar and basal ganglia networks.

Publications

Model-based action planning involves cortico-cerebellar and basal ganglia networks.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets