Browse
Submit Data
Databases
API
Help

Dataset Information

34 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Climbing fibers encode a temporal-difference prediction error during cerebellar learning in mice.

ABSTRACT: Climbing fiber inputs to Purkinje cells are thought to be involved in generating the instructive signals that drive cerebellar learning. To investigate how these instructive signals are encoded, we recorded the activity of individual climbing fibers during cerebellum-dependent eyeblink conditioning in mice. We found that climbing fibers signaled both the unexpected delivery and the unexpected omission of the periocular airpuff that served as the instructive signal for eyeblink conditioning. In addition, we observed that climbing fibers activated by periocular airpuffs also responded to stimuli from other sensory modalities if those stimuli were novel or if they predicted that the periocular airpuff was about to be presented. This pattern of climbing fiber activity is markedly similar to the responses of dopamine neurons during reinforcement learning, which have been shown to encode a particular type of instructive signal known as a temporal difference prediction error.

SUBMITTER: Ohmae S

PROVIDER: S-EPMC4754078 | biostudies-literature | 2015 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Climbing fibers encode a temporal-difference prediction error during cerebellar learning in mice.

Ohmae Shogo S Medina Javier F JF

Nature neuroscience 20151109 12

Climbing fiber inputs to Purkinje cells are thought to be involved in generating the instructive signals that drive cerebellar learning. To investigate how these instructive signals are encoded, we recorded the activity of individual climbing fibers during cerebellum-dependent eyeblink conditioning in mice. We found that climbing fibers signaled both the unexpected delivery and the unexpected omission of the periocular airpuff that served as the instructive signal for eyeblink conditioning. In a ...[more]

PMID: 26551541

Similar Datasets

Cerebellar climbing fibers encode expected reward size.

Project description:Climbing fiber inputs to the cerebellum encode error signals that instruct learning. Recently, evidence has accumulated to suggest that the cerebellum is also involved in the processing of reward. To study how rewarding events are encoded, we recorded the activity of climbing fibers when monkeys were engaged in an eye movement task. At the beginning of each trial, the monkeys were cued to the size of the reward that would be delivered upon successful completion of the trial. Climbing fiber activity increased when the monkeys were presented with a cue indicating a large reward, but not a small reward. Reward size did not modulate activity at reward delivery or during eye movements. Comparison between climbing fiber and simple spike activity indicated different interactions for coding of movement and reward. These results indicate that climbing fibers encode the expected reward size and suggest a general role of the cerebellum in associative learning beyond error correction.

| S-EPMC6844644 | biostudies-literature

Temporal difference error prediction signal dysregulation in cocaine dependence.

Project description:Cocaine dependence impacts drug-related, dopamine-dependent reward processing, yet its influence on non-drug reward processing is unclear. Here, we investigated cocaine-mediated effects on reward learning using a natural food reinforcer. Cocaine-dependent subjects (N = 14) and healthy controls (N = 14) learned to associate a visual cue with a juice reward. In subsequent functional imaging sessions they were exposed to trials where juice was received as learned, withheld (negative temporal difference error (NTDE)), or received unexpectedly (positive temporal difference error (PTDE)). Subjects were scanned twice in sessions that were identical, except that cocaine-dependent participants received cocaine or saline 10 min before task onset. In the insula, precentral and postcentral gyri NTDE signals were greater, and PTDE-related function was reduced in cocaine-dependent subjects. Compared with healthy controls, in the cocaine-dependent group PTDE signals were also reduced in medial frontal gyrus and reward-related function, irrespective of predictability, was reduced in the putamen. Group differences in error-related activity were predicted by the time as last self-administered cocaine use, but TDE function was not influenced by acute cocaine. Thus, cocaine dependence seems to engender increased responsiveness to unexpected negative outcomes and reduced sensitivity to positive events in dopaminergic reward regions. Although it remains to be established if these effects are a consequence of or antecedent to cocaine dependence, they likely have implications for the high-cocaine use recidivism rates by contributing to the drive to consume cocaine, perhaps via influence on dopamine-related reward computations. The fact that these effects do not acquiesce to acute cocaine administration might factor in binge-related escalated consumption.

| S-EPMC4023147 | biostudies-other

An imperfect dopaminergic error signal can drive temporal-difference learning.

Project description:An open problem in the field of computational neuroscience is how to link synaptic plasticity to system-level learning. A promising framework in this context is temporal-difference (TD) learning. Experimental evidence that supports the hypothesis that the mammalian brain performs temporal-difference learning includes the resemblance of the phasic activity of the midbrain dopaminergic neurons to the TD error and the discovery that cortico-striatal synaptic plasticity is modulated by dopamine. However, as the phasic dopaminergic signal does not reproduce all the properties of the theoretical TD error, it is unclear whether it is capable of driving behavior adaptation in complex tasks. Here, we present a spiking temporal-difference learning model based on the actor-critic architecture. The model dynamically generates a dopaminergic signal with realistic firing rates and exploits this signal to modulate the plasticity of synapses as a third factor. The predictions of our proposed plasticity dynamics are in good agreement with experimental results with respect to dopamine, pre- and post-synaptic activity. An analytical mapping from the parameters of our proposed plasticity dynamics to those of the classical discrete-time TD algorithm reveals that the biological constraints of the dopaminergic signal entail a modified TD algorithm with self-adapting learning parameters and an adapting offset. We show that the neuronal network is able to learn a task with sparse positive rewards as fast as the corresponding classical discrete-time TD algorithm. However, the performance of the neuronal network is impaired with respect to the traditional algorithm on a task with both positive and negative rewards and breaks down entirely on a task with purely negative rewards. Our model demonstrates that the asymmetry of a realistic dopaminergic signal enables TD learning when learning is driven by positive rewards but not when driven by negative rewards.

| S-EPMC3093351 | biostudies-literature

Non-synaptic signaling from cerebellar climbing fibers modulates Golgi cell activity.

Project description:Golgi cells are the principal inhibitory neurons at the input stage of the cerebellum, providing feedforward and feedback inhibition through mossy fiber and parallel fiber synapses. In vivo studies have shown that Golgi cell activity is regulated by climbing fiber stimulation, yet there is little functional or anatomical evidence for synapses between climbing fibers and Golgi cells. Here, we show that glutamate released from climbing fibers activates ionotropic and metabotropic receptors on Golgi cells through spillover-mediated transmission. The interplay of excitatory and inhibitory conductances provides flexible control over Golgi cell spiking, allowing either excitation or a biphasic sequence of excitation and inhibition following single climbing fiber stimulation. Together with prior studies of spillover transmission to molecular layer interneurons, these results reveal that climbing fibers exert control over inhibition at both the input and output layers of the cerebellar cortex.

| S-EPMC5640426 | biostudies-literature

Cerebellar oscillations driven by synaptic pruning deficits of cerebellar climbing fibers contribute to tremor pathophysiology.

Project description:Essential tremor (ET) is one of the most common movement disorders and the prototypical disorder for abnormal rhythmic movements. However, the pathophysiology of tremor generation in ET remains unclear. Here, we used autoptic cerebral tissue from patients with ET, clinical data, and mouse models to report that synaptic pruning deficits of climbing fiber (CF)-to-Purkinje cell (PC) synapses, which are related to glutamate receptor delta 2 (GluRδ2) protein insufficiency, cause excessive cerebellar oscillations and might be responsible for tremor. The CF-PC synaptic pruning deficits were correlated with the reduction in GluRδ2 expression in the postmortem ET cerebellum. Mice with GluRδ2 insufficiency and CF-PC synaptic pruning deficits develop ET-like tremor that can be suppressed with viral rescue of GluRδ2 protein. Step-by-step optogenetic or pharmacological inhibition of neuronal firing, axonal activity, or synaptic vesicle release confirmed that the activity of the excessive CF-to-PC synapses is required for tremor generation. In vivo electrophysiology in mice showed that excessive cerebellar oscillatory activity is CF dependent and necessary for tremor and optogenetic-driven PC synchronization was sufficient to generate tremor in wild-type animals. Human validation by cerebellar electroencephalography confirmed that excessive cerebellar oscillations also exist in patients with ET. Our findings identify a pathophysiologic contribution to tremor at molecular (GluRδ2), structural (CF-to-PC synapses), physiological (cerebellar oscillations), and behavioral levels (kinetic tremor) that might have clinical applications for treating ET.

| S-EPMC7339589 | biostudies-literature

Developmental switching of perisomatic innervation from climbing fibers to basket cell fibers in cerebellar Purkinje cells.

Project description:In early postnatal development, perisomatic innervation of cerebellar Purkinje cells (PCs) switches from glutamatergic climbing fibers (CFs) to GABAergic basket cell fibers (BFs). Here we examined the switching process in C57BL/6 mice. At postnatal day 7 (P7), most perisomatic synapses were formed by CFs on to somatic spines. The density of CF-spine synapses peaked at P9, when pericellular nest around PCs by CFs was most developed, and CF-spine synapses constituted 88% of the total perisomatic synapses. Thereafter, CF-spine synapses dropped to 63% at P12, 6% at P15, and <1% at P20, whereas BF synapses increased reciprocally. During the switching period, a substantial number of BF synapses existed as BF-spine synapses (37% of the total perisomatic synapses at P15), and free spines surrounded by BFs or Bergmann glia also emerged. By P20, BF-spine synapses and free spines virtually disappeared, and BF-soma synapses became predominant (88%), thus attaining the adult pattern of perisomatic innervation. Parallel with the presynaptic switching, postsynaptic receptor phenotype also switched from glutamatergic to GABAergic. In the active switching period, particularly at P12, fragmental clusters of AMPA-type glutamate receptor were juxtaposed with those of GABA(A) receptor. When examined with serial ultrathin sections, immunogold labeling for glutamate and GABA(A) receptors was often clustered beneath single BF terminals. These results suggest that a considerable fraction of somatic spines is succeeded from CFs to BFs and Bergmann glia in the early postnatal period, and that the switching of postsynaptic receptor phenotypes mainly proceeds under the coverage of BF terminals.

| S-EPMC6623856 | biostudies-literature

A gradual temporal shift of dopamine responses mirrors the progression of temporal difference error in machine learning.

Project description:A large body of evidence has indicated that the phasic responses of midbrain dopamine neurons show a remarkable similarity to a type of teaching signal (temporal difference (TD) error) used in machine learning. However, previous studies failed to observe a key prediction of this algorithm: that when an agent associates a cue and a reward that are separated in time, the timing of dopamine signals should gradually move backward in time from the time of the reward to the time of the cue over multiple trials. Here we demonstrate that such a gradual shift occurs both at the level of dopaminergic cellular activity and dopamine release in the ventral striatum in mice. Our results establish a long-sought link between dopaminergic activity and the TD learning algorithm, providing fundamental insights into how the brain associates cues and rewards that are separated in time.

| S-EPMC9624460 | biostudies-literature

Reliable coding emerges from coactivation of climbing fibers in microbands of cerebellar Purkinje neurons.

Project description:The inferior olive projects climbing fiber axons to cerebellar Purkinje neurons, where they trigger calcium-based dendritic spikes. These responses dynamically shape the immediate spike output of Purkinje cells as well as provide an instructive signal to guide long-term plasticity. Climbing fibers typically fire approximately once a second, and the instructive role is distributed over many such firing events. However, transmission of salient information on an immediate basis needs to occur on a shorter timescale during which a Purkinje cell would typically be activated by a climbing fiber only once. Here we show using in vivo calcium imaging in anesthetized mice and rats that sensory events are rapidly and reliably represented by momentary, simultaneous coactivation of microbands of adjacent Purkinje cells. Microbands were sagittally oriented and spanned up to 100 microm mediolaterally, representing hundreds of Purkinje cells distributed over multiple folia. Spontaneous and sensory-evoked microbands followed boundaries that were close or identical to one another and were desynchronized by olivary injection of the gap junction blocker mefloquine, indicating that excitation to the olive is converted to synchronized firing by electrical coupling. One-time activation of microbands could distinguish a sensory response from spontaneous activity with up to 98% accuracy. Given the anatomy of the olivocerebellar system, microband synchrony may shape the output of neurons in the cerebellar nuclei either via powerful inhibition by Purkinje cells or by direct monosynaptic excitation from the inferior olive.

| S-EPMC2783593 | biostudies-literature

Developmental Rewiring between Cerebellar Climbing Fibers and Purkinje Cells Begins with Positive Feedback Synapse Addition.

Project description:During postnatal development, cerebellar climbing fibers alter their innervation strengths onto supernumerary Purkinje cell targets, generating a one-to-few connectivity pattern in adulthood. To get insight about the processes responsible for this remapping, we reconstructed serial electron microscopy datasets from mice during the first postnatal week. Between days 3 and 7, individual climbing fibers selectively add many synapses onto a subset of Purkinje targets in a positive-feedback manner, without pruning synapses from other targets. Active zone sizes of synapses associated with powerful versus weak inputs are indistinguishable. Changes in synapse number are thus the predominant form of early developmental plasticity. Finally, the numbers of climbing fibers and Purkinje cells in a local region nearly match. Initial over-innervation of Purkinje cells by climbing fibers is therefore economical: the number of axons entering a region is enough to assure that each ultimately retains a postsynaptic target and that none branched there in vain.

| S-EPMC6914268 | biostudies-literature

Classical conditioning drives learned reward prediction signals in climbing fibers across the lateral cerebellum.

Project description:Classical models of cerebellar learning posit that climbing fibers operate according to a supervised learning rule to instruct changes in motor output by signaling the occurrence of movement errors. However, cerebellar output is also associated with non-motor behaviors, and recently with modulating reward association pathways in the VTA. To test how the cerebellum processes reward related signals in the same type of classical conditioning behavior typically studied to evaluate reward processing in the VTA and striatum, we have used calcium imaging to visualize instructional signals carried by climbing fibers across the lateral cerebellum in mice before and after learning. We find distinct climbing fiber responses in three lateral cerebellar regions that can each signal reward prediction. These instructional signals are well suited to guide cerebellar learning based on reward expectation and enable a cerebellar contribution to reward driven behaviors, suggesting a broad role for the lateral cerebellum in reward-based learning.

| S-EPMC6845228 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data