Dataset Information

Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum.

ABSTRACT: The role of the cerebellum in non-motor learning is poorly understood. Here, we investigated the activity of Purkinje cells (P-cells) in the mid-lateral cerebellum as the monkey learned to associate one arbitrary symbol with the movement of the left hand and another with the movement of the right hand. During learning, but not when the monkey had learned the association, the simple spike responses of P-cells reported the outcome of the animal's most recent decision without concomitant changes in other sensorimotor parameters such as hand movement, licking, or eye movement. At the population level, P-cells collectively maintained a memory of the most recent decision throughout the entire trial. As the monkeys learned the association, the magnitude of this reward-related error signal approached zero. Our results provide a major departure from the current understanding of cerebellar processing and have critical implications for cerebellum's role in cognitive control.

SUBMITTER: Sendhilnathan N

PROVIDER: S-EPMC8015782 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum.

Sendhilnathan Naveen N Semework Mulugeta M Goldberg Michael E ME Ipata Anna E AE

Neuron 20200127 1

The role of the cerebellum in non-motor learning is poorly understood. Here, we investigated the activity of Purkinje cells (P-cells) in the mid-lateral cerebellum as the monkey learned to associate one arbitrary symbol with the movement of the left hand and another with the movement of the right hand. During learning, but not when the monkey had learned the association, the simple spike responses of P-cells reported the outcome of the animal's most recent decision without concomitant changes in ...[more]

PMID: 32001108

Similar Datasets

Project description:The processing of a visual stimulus can be subdivided into a number of stages. Upon stimulus presentation there is an early phase of feedforward processing where the visual information is propagated from lower to higher visual areas for the extraction of basic and complex stimulus features. This is followed by a later phase where horizontal connections within areas and feedback connections from higher areas back to lower areas come into play. In this later phase, image elements that are behaviorally relevant are grouped by Gestalt grouping rules and are labeled in the cortex with enhanced neuronal activity (object-based attention in psychology). Recent neurophysiological studies revealed that reward-based learning influences these recurrent grouping processes, but it is not well understood how rewards train recurrent circuits for perceptual organization. This paper examines the mechanisms for reward-based learning of new grouping rules. We derive a learning rule that can explain how rewards influence the information flow through feedforward, horizontal and feedback connections. We illustrate the efficiency with two tasks that have been used to study the neuronal correlates of perceptual organization in early visual cortex. The first task is called contour-integration and demands the integration of collinear contour elements into an elongated curve. We show how reward-based learning causes an enhancement of the representation of the to-be-grouped elements at early levels of a recurrent neural network, just as is observed in the visual cortex of monkeys. The second task is curve-tracing where the aim is to determine the endpoint of an elongated curve composed of connected image elements. If trained with the new learning rule, neural networks learn to propagate enhanced activity over the curve, in accordance with neurophysiological data. We close the paper with a number of model predictions that can be tested in future neurophysiological and computational studies.

Dataset Information

Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum.

Publications

Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets