Retroactive modulation of spike timing-dependent plasticity by dopamine.
Ontology highlight
ABSTRACT:
SUBMITTER: Brzosko Z
PROVIDER: S-EPMC4626806 | biostudies-literature | 2015 Oct
REPOSITORIES: biostudies-literature
Publications
Retroactive modulation of spike timing-dependent plasticity by dopamine.
Brzosko Zuzanna Z Schultz Wolfram W Paulsen Ole O
eLife 20151030
Most reinforcement learning models assume that the reward signal arrives after the activity that led to the reward, placing constraints on the possible underlying cellular mechanisms. Here we show that dopamine, a positive reinforcement signal, can retroactively convert hippocampal timing-dependent synaptic depression into potentiation. This effect requires functional NMDA receptors and is mediated in part through the activation of the cAMP/PKA cascade. Collectively, our results support the idea ...[more]
Similar Datasets
Project description:Rhythmic activity has been associated with a wide range of cognitive processes including the encoding of sensory information, navigation, the transfer of information and others. Rhythmic activity in the brain has also been suggested to be used for multiplexing information. Multiplexing is the ability to transmit more than one signal via the same channel. Here we focus on frequency division multiplexing, in which different signals are transmitted in different frequency bands. Recent work showed that spike-timing-dependent plasticity (STDP) can facilitate the transfer of rhythmic activity downstream the information processing pathway. However, STDP has also been known to generate strong winner-take-all like competition between subgroups of correlated synaptic inputs. This competition between different rhythmicity channels, induced by STDP, may prevent the multiplexing of information. Thus, raising doubts whether STDP is consistent with the idea of multiplexing. This study explores whether STDP can facilitate the multiplexing of information across multiple frequency channels, and if so, under what conditions. We address this question in a modelling study, investigating the STDP dynamics of two populations synapsing downstream onto the same neuron in a feed-forward manner. Each population was assumed to exhibit rhythmic activity, albeit in a different frequency band. Our theory reveals that the winner-take-all like competitions between the two populations is limited, in the sense that different rhythmic populations will not necessarily fully suppress each other. Furthermore, we found that for a wide range of parameters, the network converged to a solution in which the downstream neuron responded to both rhythms. Yet, the synaptic weights themselves did not converge to a fixed point, rather remained dynamic. These findings imply that STDP can support the multiplexing of rhythmic information, and demonstrate how functionality (multiplexing of information) can be retained in the face of continuous remodeling of all the synaptic weights. The constraints on the types of STDP rules that can support multiplexing provide a natural test for our theory.
| S-EPMC7351241 | biostudies-literature
Project description:Spike-timing-dependent plasticity (STDP) has been observed in many brain areas such as sensory cortices, where it is hypothesized to structure synaptic connections between neurons. Previous studies have demonstrated how STDP can capture spiking information at short timescales using specific input configurations, such as coincident spiking, spike patterns and oscillatory spike trains. However, the corresponding computation in the case of arbitrary input signals is still unclear. This paper provides an overarching picture of the algorithm inherent to STDP, tying together many previous results for commonly used models of pairwise STDP. For a single neuron with plastic excitatory synapses, we show how STDP performs a spectral analysis on the temporal cross-correlograms between its afferent spike trains. The postsynaptic responses and STDP learning window determine kernel functions that specify how the neuron "sees" the input correlations. We thus denote this unsupervised learning scheme as 'kernel spectral component analysis' (kSCA). In particular, the whole input correlation structure must be considered since all plastic synapses compete with each other. We find that kSCA is enhanced when weight-dependent STDP induces gradual synaptic competition. For a spiking neuron with a "linear" response and pairwise STDP alone, we find that kSCA resembles principal component analysis (PCA). However, plain STDP does not isolate correlation sources in general, e.g., when they are mixed among the input spike trains. In other words, it does not perform independent component analysis (ICA). Tuning the neuron to a single correlation source can be achieved when STDP is paired with a homeostatic mechanism that reinforces the competition between synaptic inputs. Our results suggest that neuronal networks equipped with STDP can process signals encoded in the transient spiking activity at the timescales of tens of milliseconds for usual STDP.
| S-EPMC3390410 | biostudies-literature
Project description:Spike-Timing-Dependent Plasticity (STDP) is a bio-inspired local incremental weight update rule commonly used for online learning in spike-based neuromorphic systems. In STDP, the intensity of long-term potentiation and depression in synaptic efficacy (weight) between neurons is expressed as a function of the relative timing between pre- and post-synaptic action potentials (spikes), while the polarity of change is dependent on the order (causality) of the spikes. Online STDP weight updates for causal and acausal relative spike times are activated at the onset of post- and pre-synaptic spike events, respectively, implying access to synaptic connectivity both in forward (pre-to-post) and reverse (post-to-pre) directions. Here we study the impact of different arrangements of synaptic connectivity tables on weight storage and STDP updates for large-scale neuromorphic systems. We analyze the memory efficiency for varying degrees of density in synaptic connectivity, ranging from crossbar arrays for full connectivity to pointer-based lookup for sparse connectivity. The study includes comparison of storage and access costs and efficiencies for each memory arrangement, along with a trade-off analysis of the benefits of each data structure depending on application requirements and budget. Finally, we present an alternative formulation of STDP via a delayed causal update mechanism that permits efficient weight access, requiring no more than forward connectivity lookup. We show functional equivalence of the delayed causal updates to the original STDP formulation, with substantial savings in storage and access costs and efficiencies for networks with sparse synaptic connectivity as typically encountered in large-scale models in computational neuroscience.
| S-EPMC6499189 | biostudies-literature
Project description:The structural organization of excitatory inputs supporting spike-timing-dependent plasticity (STDP) remains unknown. We performed a spine STDP protocol using two-photon (2P) glutamate uncaging (pre) paired with postsynaptic spikes (post) in layer 5 pyramidal neurons from juvenile mice. Here we report that pre-post pairings that trigger timing-dependent LTP (t-LTP) produce shrinkage of the activated spine neck and increase in synaptic strength; and post-pre pairings that trigger timing-dependent LTD (t-LTD) decrease synaptic strength without affecting spine shape. Furthermore, the induction of t-LTP with 2P glutamate uncaging in clustered spines (<5 μm apart) enhances LTP through a NMDA receptor-mediated spine calcium accumulation and actin polymerization-dependent neck shrinkage, whereas t-LTD was dependent on NMDA receptors and disrupted by the activation of clustered spines but recovered when separated by >40 μm. These results indicate that synaptic cooperativity disrupts t-LTD and extends the temporal window for the induction of t-LTP, leading to STDP only encompassing LTP.
| S-EPMC7449969 | biostudies-literature
Project description:Spike-timing dependent plasticity (STDP) is a widespread plasticity mechanism in the nervous system. The simplest description of STDP only takes into account pairs of pre- and postsynaptic spikes, with potentiation of the synapse when a presynaptic spike precedes a postsynaptic spike and depression otherwise. In light of experiments that explored a variety of spike patterns, the pair-based STDP model has been augmented to account for multiple pre- and postsynaptic spike interactions. As a result, a number of different "multi-spike" STDP models have been proposed based on different experimental observations. The behavior of these models at the population level is crucial for understanding mechanisms of learning and memory. The challenging balance between the stability of a population of synapses and their competitive modification is well studied for pair-based models, but it has not yet been fully analyzed for multi-spike models. Here, we address this issue through numerical simulations of an integrate-and-fire model neuron with excitatory synapses subject to STDP described by three different proposed multi-spike models. We also analytically calculate average synaptic changes and fluctuations about these averages. Our results indicate that the different multi-spike models behave quite differently at the population level. Although each model can produce synaptic competition in certain parameter regions, none of them induces synaptic competition with its originally fitted parameters. The dichotomy between synaptic stability and Hebbian competition, which is well characterized for pair-based STDP models, persists in multi-spike models. However, anti-Hebbian competition can coexist with synaptic stability in some models. We propose that the collective behavior of synaptic plasticity models at the population level should be used as an additional guideline in applying phenomenological models based on observations of single synapses.
| S-EPMC4777380 | biostudies-literature
Project description:Near coincidental pre- and postsynaptic action potentials induce associative long-term potentiation (LTP) or long-term depression (LTD), depending on the order of their timing. Here, we show that in visual cortex the rules of this spike-timing-dependent plasticity are not rigid, but shaped by neuromodulator receptors coupled to adenylyl cyclase (AC) and phospholipase C (PLC) signaling cascades. Activation of the AC and PLC cascades results in phosphorylation of postsynaptic glutamate receptors at sites that serve as specific "tags" for LTP and LTD. As a consequence, the outcome (i.e., whether LTP or LTD) of a given pattern of pre- and postsynaptic firing depends not only on the order of the timing, but also on the relative activation of neuromodulator receptors coupled to AC and PLC. These findings indicate that cholinergic and adrenergic neuromodulation associated with the behavioral state of the animal can control the gating and the polarity of cortical plasticity.
| S-EPMC2756178 | biostudies-literature
Project description:Deep cerebellar nuclei neurons receive both inhibitory (GABAergic) synaptic currents from Purkinje cells (within the cerebellar cortex) and excitatory (glutamatergic) synaptic currents from mossy fibers. Those two deep cerebellar nucleus inputs are thought to be also adaptive, embedding interesting properties in the framework of accurate movements. We show that distributed spike-timing-dependent plasticity mechanisms (STDP) located at different cerebellar sites (parallel fibers to Purkinje cells, mossy fibers to deep cerebellar nucleus cells, and Purkinje cells to deep cerebellar nucleus cells) in close-loop simulations provide an explanation for the complex learning properties of the cerebellum in motor learning. Concretely, we propose a new mechanistic cerebellar spiking model. In this new model, deep cerebellar nuclei embed a dual functionality: deep cerebellar nuclei acting as a gain adaptation mechanism and as a facilitator for the slow memory consolidation at mossy fibers to deep cerebellar nucleus synapses. Equipping the cerebellum with excitatory (e-STDP) and inhibitory (i-STDP) mechanisms at deep cerebellar nuclei afferents allows the accommodation of synaptic memories that were formed at parallel fibers to Purkinje cells synapses and then transferred to mossy fibers to deep cerebellar nucleus synapses. These adaptive mechanisms also contribute to modulate the deep-cerebellar-nucleus-output firing rate (output gain modulation toward optimizing its working range).
| S-EPMC4773604 | biostudies-literature
Project description:Spike timing dependent plasticity (STDP) is a learning rule that modifies synaptic strength as a function of the relative timing of pre- and postsynaptic spikes. When a neuron is repeatedly presented with similar inputs, STDP is known to have the effect of concentrating high synaptic weights on afferents that systematically fire early, while postsynaptic spike latencies decrease. Here we use this learning rule in an asynchronous feedforward spiking neural network that mimics the ventral visual pathway and shows that when the network is presented with natural images, selectivity to intermediate-complexity visual features emerges. Those features, which correspond to prototypical patterns that are both salient and consistently present in the images, are highly informative and enable robust object recognition, as demonstrated on various classification tasks. Taken together, these results show that temporal codes may be a key to understanding the phenomenal processing speed achieved by the visual system and that STDP can lead to fast and selective responses.
| S-EPMC1797822 | biostudies-literature
Project description:Behavioural experience, such as environmental enrichment (EE), induces long-term effects on learning and memory. Learning can be assessed with the Hebbian paradigm, such as spike-timing-dependent plasticity (STDP), which relies on the timing of neuronal activity on either side of the synapse. Although EE is known to control neuronal excitability and consequently spike timing, whether EE shapes STDP remains unknown. Here, using in vivo long-duration intracellular recordings at the corticostriatal synapses we show that EE promotes asymmetric anti-Hebbian STDP, i.e. spike-timing-dependent-potentiation (tLTP) for post-pre pairings and spike-timing-dependent-depression (tLTD) for pre-post pairings, whereas animals grown in standard housing show mainly tLTD and a high failure rate of plasticity. Indeed, in adult rats grown in standard conditions, we observed unidirectional plasticity (mainly symmetric anti-Hebbian tLTD) within a large temporal window (~200 ms). However, rats grown for two months in EE displayed a bidirectional STDP (tLTP and tLTD depending on spike timing) in a more restricted temporal window (~100 ms) with low failure rate of plasticity. We also found that the effects of EE on STDP characteristics are influenced by the anaesthesia status: the deeper the anaesthesia, the higher the absence of plasticity. These findings establish a central role for EE and the anaesthetic regime in shaping in vivo, a synaptic Hebbian learning rule such as STDP.
| S-EPMC6923403 | biostudies-literature
Project description:Norepinephrine (NE) is widely distributed throughout the brain. It modulates intrinsic currents, as well as amplitude and frequency of synaptic transmission affecting the 'signal-to-noise ratio' of sensory responses. In the visual cortex, α₁- and β-adrenergic receptors (AR) gate opposing effects on long-term plasticity of excitatory transmission. Whether and how NE recruits these plastic mechanisms is not clear. Here, we show that NE modulates glutamatergic inputs with different efficacies for α₁- and β-AR. As a consequence, the priming of synapses with different NE concentrations produces dose-dependent competing effects that determine the temporal window of spike-timing dependent plasticity (STDP). While a low NE concentration leads to long-term depression (LTD) over broad positive and negative delays, a high NE concentration results in bidirectional STDP restricted to very narrow intervals. These results indicate that the local availability of NE, released during emotional arousal, determines the compound modulatory effect and the output of STDP.
| S-EPMC3358707 | biostudies-other