Dataset Information

Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control.

ABSTRACT: Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although viewed as distinct learning systems, recent animal experiments point toward their complementary role in behavioral learning, and also show the existence of substantial two-way communication between these two brain structures. Based on this notion of co-operative learning, in this paper we hypothesize that the basal ganglia and cerebellar learning systems work in parallel and interact with each other. We envision that such an interaction is influenced by reward modulated heterosynaptic plasticity (RMHP) rule at the thalamus, guiding the overall goal directed behavior. Using a recurrent neural network actor-critic model of the basal ganglia and a feed-forward correlation-based learning model of the cerebellum, we demonstrate that the RMHP rule can effectively balance the outcomes of the two learning systems. This is tested using simulated environments of increasing complexity with a four-wheeled robot in a foraging task in both static and dynamic configurations. Although modeled with a simplified level of biological abstraction, we clearly demonstrate that such a RMHP induced combinatorial learning mechanism, leads to stabler and faster learning of goal-directed behaviors, in comparison to the individual systems. Thus, in this paper we provide a computational model for adaptive combination of the basal ganglia and cerebellum learning systems by way of neuromodulated plasticity for goal-directed decision making in biological and bio-mimetic organisms.

SUBMITTER: Dasgupta S

PROVIDER: S-EPMC4211401 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control.

Dasgupta Sakyasingha S Wörgötter Florentin F Manoonpong Poramate P

Frontiers in neural circuits 20141028

Goal-directed decision making in biological systems is broadly based on associations between conditional and unconditional stimuli. This can be further classified as classical conditioning (correlation-based learning) and operant conditioning (reward-based learning). A number of computational and experimental studies have well established the role of the basal ganglia in reward-based learning, where as the cerebellum plays an important role in developing specific conditioned responses. Although ...[more]

PMID: 25389391

Similar Datasets

Project description:Hypomyelination with atrophy of the basal ganglia and cerebellum is a rare leukoencephalopathy that was identified using magnetic resonance imaging in 2002. In 2013, whole exome sequencing of 11 patients with the disease revealed that they all had the same de novo mutation in TUBB4A, which encodes tubulin ?-4A. We investigated the mutation spectrum in a cohort of 42 patients and the relationship between genotype and phenotype. Patients were selected on the basis of clinical and magnetic resonance imaging abnormalities that are indicative of hypomyelination with atrophy of the basal ganglia and cerebellum. Genetic testing and a clinical inventory were performed, and sequential magnetic resonance images were evaluated using a standard protocol. The heterozygous TUBB4A mutation observed in the first 11 patients was the most common (25 patients). Additionally, 13 other heterozygous mutations were identified, located in different structural domains of tubulin ?-4A. We confirmed that the mutations were de novo in all but three patients. In two of these three cases we lacked parental DNA and in one the mutation was also found in the mother, most likely due to mosaicism. Patients showed a phenotypic continuum ranging from neonatal to childhood disease onset, normal to delayed early development and slow to more rapid neurological deterioration. Neurological symptomatology consisted of extrapyramidal movement abnormalities, spasticity, ataxia, cognitive deficit and sometimes epilepsy. Three patients died and the oldest living patient was 29 years of age. The patients' magnetic resonance images showed an absent or disappearing putamen, variable cerebellar atrophy and highly variable cerebral atrophy. Apart from hypomyelination, myelin loss was evident in several cases. Three severely affected patients had similar, somewhat atypical magnetic resonance image abnormalities. The study results were strongly suggestive of a genotype-phenotype correlation. The 25 patients with the common c.745G>A mutation generally had a less rapidly progressive disease course than the 17 cases with other TUBB4A mutations. Overall, this work demonstrates that the distinctive magnetic resonance imaging pattern for hypomyelination with atrophy of the basal ganglia and cerebellum defines a homogeneous clinical phenotype of variable severity. Patients almost invariably have prominent extrapyramidal movement abnormalities, which are rarely seen in patients with hypomyelination of different origin. A dominant TUBB4A mutation is also associated with dystonia type 4, in which magnetic resonance images of the brain seem normal. It is highly likely that there is a disease continuum associated with TUBB4A mutations, of which hypomyelination with atrophy of the basal ganglia and cerebellum and dystonia type 4 are the extremes. This would indicate that extrapyramidal movement abnormalities constitute the core feature of the disease spectrum related to dominant TUBB4A mutations and that all other features are variable.

Dataset Information

Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control.

Publications

Neuromodulatory adaptive combination of correlation-based learning in cerebellum and reward-based learning in basal ganglia for goal-directed behavior control.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets