Synaptic learning rules for sequence learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Reifenstein ET
PROVIDER: S-EPMC8175084 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Long-term potentiation (LTP) of synaptic transmission underlies aspects of learning and memory. LTP is input-specific at the level of individual synapses, but neural network models predict interactions between plasticity at nearby synapses. Here we show in mouse hippocampal pyramidal cells that LTP at individual synapses reduces the threshold for potentiation at neighbouring synapses. After input-specific LTP induction by two-photon glutamate uncaging or by synaptic stimulation, subthreshold stimuli, which by themselves were too weak to trigger LTP, caused robust LTP and spine enlargement at neighbouring spines. Furthermore, LTP induction broadened the presynaptic-postsynaptic spike interval for spike-timing-dependent LTP within a dendritic neighbourhood. The reduction in the threshold for LTP induction lasted approximately 10 min and spread over approximately 10 microm of dendrite. These local interactions between neighbouring synapses support clustered plasticity models of memory storage and could allow for the binding of behaviourally linked information on the same dendritic branch.
| S-EPMC3425382 | biostudies-other
Project description:Selecting responses in working memory while processing combinations of stimuli depends strongly on their relations stored in long-term memory. However, the learning of XOR-like combinations of stimuli and responses according to complex rules raises the issue of the non-linear separability of the responses within the space of stimuli. One proposed solution is to add neurons that perform a stage of non-linear processing between the stimuli and responses, at the cost of increasing the network size. Based on the non-linear integration of synaptic inputs within dendritic compartments, we propose here an inter-synaptic (IS) learning algorithm that determines the probability of potentiating/depressing each synapse as a function of the co-activity of the other synapses within the same dendrite. The IS learning is effective with random connectivity and without either a priori wiring or additional neurons. Our results show that IS learning generates efficacy values that are sufficient for the processing of XOR-like combinations, on the basis of the sole correlational structure of the stimuli and responses. We analyze the types of dendrites involved in terms of the number of synapses from pre-synaptic neurons coding for the stimuli and responses. The synaptic efficacy values obtained show that different dendrites specialize in the detection of different combinations of stimuli. The resulting behavior of the cortical network model is analyzed as a function of inter-synaptic vs. Hebbian learning. Combinatorial priming effects show that the retrospective activity of neurons coding for the stimuli trigger XOR-like combination-selective prospective activity of neurons coding for the expected response. The synergistic effects of inter-synaptic learning and of mixed-coding neurons are simulated. The results show that, although each mechanism is sufficient by itself, their combined effects improve the performance of the network.
| S-EPMC4148068 | biostudies-literature
Project description:Neural circuits exploit numerous strategies for encoding information. Although the functional significance of individual coding mechanisms has been investigated, ways in which multiple mechanisms interact and integrate are not well understood. The locust olfactory system, in which dense, transiently synchronized spike trains across ensembles of antenna lobe (AL) neurons are transformed into a sparse representation in the mushroom body (MB; a region associated with memory), provides a well-studied preparation for investigating the interaction of multiple coding mechanisms. Recordings made in vivo from the insect MB demonstrated highly specific responses to odors in Kenyon cells (KCs). Typically, only a few KCs from the recorded population of neurons responded reliably when a specific odor was presented. Different odors induced responses in different KCs. Here, we explored with a biologically plausible model the possibility that a form of plasticity may control and tune synaptic weights of inputs to the mushroom body to ensure the specificity of KCs' responses to familiar or meaningful odors. We found that plasticity at the synapses between the AL and the MB efficiently regulated the delicate tuning necessary to selectively filter the intense AL oscillatory output and condense it to a sparse representation in the MB. Activity-dependent plasticity drove the observed specificity, reliability, and expected persistence of odor representations, suggesting a role for plasticity in information processing and making a testable prediction about synaptic plasticity at AL-MB synapses.
| S-EPMC2278376 | biostudies-literature
Project description:Spike-timing-dependent plasticity (STDP) is considered as a primary mechanism underlying formation of new memories during learning. Despite the growing interest in activity-dependent plasticity, it is still unclear whether synaptic plasticity rules inferred from in vitro experiments are correct in physiological conditions. The abnormally high calcium concentration used in in vitro studies of STDP suggests that in vivo plasticity rules may differ significantly from in vitro experiments, especially since STDP depends strongly on calcium for induction. We therefore studied here the influence of extracellular calcium on synaptic plasticity. Using a combination of experimental (patch-clamp recording and Ca2+ imaging at CA3-CA1 synapses) and theoretical approaches, we show here that the classic STDP rule in which pairs of single pre- and postsynaptic action potentials induce synaptic modifications is not valid in the physiological Ca2+ range. Rather, we found that these pairs of single stimuli are unable to induce any synaptic modification in 1.3 and 1.5 mM calcium and lead to depression in 1.8 mM. Plasticity can only be recovered when bursts of postsynaptic spikes are used, or when neurons fire at sufficiently high frequency. In conclusion, the STDP rule is profoundly altered in physiological Ca2+, but specific activity regimes restore a classical STDP profile.
| S-EPMC7777146 | biostudies-literature
Project description:Nonlinear interactions between coactive synapses enable neurons to discriminate between spatiotemporal patterns of inputs. Using patterned postsynaptic stimulation by two-photon glutamate uncaging, here we investigate the sensitivity of synaptic Ca(2+) signalling and long-term plasticity in individual spines to coincident activity of nearby synapses. We find a proximodistally increasing gradient of nonlinear NMDA receptor (NMDAR)-mediated amplification of spine Ca(2+) signals by a few neighbouring coactive synapses along individual perisomatic dendrites. This synaptic cooperativity does not require dendritic spikes, but is correlated with dendritic Na(+) spike propagation strength. Furthermore, we show that repetitive synchronous subthreshold activation of small spine clusters produces input specific, NMDAR-dependent cooperative long-term potentiation at distal but not proximal dendritic locations. The sensitive synaptic cooperativity at distal dendritic compartments shown here may promote the formation of functional synaptic clusters, which in turn can facilitate active dendritic processing and storage of information encoded in spatiotemporal synaptic activity patterns.
| S-EPMC4844677 | biostudies-literature
Project description:It is widely assumed that the complexity of neural circuits enables them to implement diverse learning tasks using just a few generic forms of synaptic plasticity. In contrast, we report that synaptic plasticity can itself be precisely tuned to the requirements of a learning task. We found that the rules for induction of long-term and single-trial plasticity at parallel fiber-to-Purkinje cell synapses vary across cerebellar regions. In the flocculus, associative plasticity in vitro and in vivo is narrowly tuned for an interval of ?120 ms, which compensates for the specific processing delay for error signals to reach the flocculus during oculomotor learning. In the vermis, which supports a range of behavioral functions, plasticity is induced by a range of intervals, with individual cells tuned for different intervals. Thus, plasticity at a single, anatomically defined type of synapse can have properties that vary in a way that is precisely matched to function.
| S-EPMC5165237 | biostudies-literature
Project description:Recent development in the data-driven decision science has seen great advances in individualized decision making. Given data with individual covariates, treatment assignments and outcomes, policy makers best individualized treatment rule (ITR) that maximizes the expected outcome, known as the value function. Many existing methods assume that the training and testing distributions are the same. However, the estimated optimal ITR may have poor generalizability when the training and testing distributions are not identical. In this paper, we consider the problem of finding an optimal ITR from a restricted ITR class where there is some unknown covariate changes between the training and testing distributions. We propose a novel distributionally robust ITR (DR-ITR) framework that maximizes the worst-case value function across the values under a set of underlying distributions that are "close" to the training distribution. The resulting DR-ITR can guarantee the performance among all such distributions reasonably well. We further propose a calibrating procedure that tunes the DR-ITR adaptively to a small amount of calibration data from a target population. In this way, the calibrated DR-ITR can be shown to enjoy better generalizability than the standard ITR based on our numerical studies.
| S-EPMC8221611 | biostudies-literature
Project description:Personalized medicine has received increasing attention among statisticians, computer scientists, and clinical practitioners. A major component of personalized medicine is the estimation of individualized treatment rules (ITRs). Recently, Zhao et al. (2012) proposed outcome weighted learning (OWL) to construct ITRs that directly optimize the clinical outcome. Although OWL opens the door to introducing machine learning techniques to optimal treatment regimes, it still has some problems in performance. (1) The estimated ITR of OWL is affected by a simple shift of the outcome. (2) The rule from OWL tries to keep treatment assignments that subjects actually received. (3) There is no variable selection mechanism with OWL. All of them weaken the finite sample performance of OWL. In this article, we propose a general framework, called Residual Weighted Learning (RWL), to alleviate these problems, and hence to improve finite sample performance. Unlike OWL which weights misclassification errors by clinical outcomes, RWL weights these errors by residuals of the outcome from a regression fit on clinical covariates excluding treatment assignment. We utilize the smoothed ramp loss function in RWL, and provide a difference of convex (d.c.) algorithm to solve the corresponding non-convex optimization problem. By estimating residuals with linear models or generalized linear models, RWL can effectively deal with different types of outcomes, such as continuous, binary and count outcomes. We also propose variable selection methods for linear and nonlinear rules, respectively, to further improve the performance. We show that the resulting estimator of the treatment rule is consistent. We further obtain a rate of convergence for the difference between the expected outcome using the estimated ITR and that of the optimal treatment rule. The performance of the proposed RWL methods is illustrated in simulation studies and in an analysis of cystic fibrosis clinical trial data.
| S-EPMC5607057 | biostudies-literature
Project description:The nucleus accumbens is a forebrain region responsible for drug reward and goal-directed behaviors. It has long been believed that drugs of abuse exert their addictive properties on behavior by altering the strength of synaptic communication over long periods of time. To date, attempts at understanding the relationship between drugs of abuse and synaptic plasticity have relied on the high-frequency long-term potentiation model of T.V. Bliss & T. Lømo [(1973) Journal of Physiology, 232, 331-356]. We examined synaptic plasticity using spike-timing-dependent plasticity, a stimulation paradigm that reflects more closely the in vivo firing patterns of mouse core nucleus accumbens medium spiny neurons and their afferents. In contrast to other brain regions, the same stimulation paradigm evoked bidirectional long-term plasticity. The magnitude of spike-timing-dependent long-term potentiation (tLTP) changed with the delay between action potentials and excitatory post-synaptic potentials, and frequency, whereas that of spike-timing-dependent long-term depression (tLTD) remained unchanged. We showed that tLTP depended on N-methyl-d-aspartate receptors, whereas tLTD relied on action potentials. Importantly, the intracellular calcium signaling pathways mobilised during tLTP and tLTD were different. Thus, calcium-induced calcium release underlies tLTD but not tLTP. Finally, we found that the firing pattern of a subset of medium spiny neurons was strongly inhibited by dopamine receptor agonists. Surprisingly, these neurons were exclusively associated with tLTP but not with tLTD. Taken together, these data point to the existence of two subgroups of medium spiny neurons with distinct properties, each displaying unique abilities to undergo synaptic plasticity.
| S-EPMC3527687 | biostudies-literature
Project description:Learning about the expected value of choice alternatives associated with reward is critical for adaptive behavior. Although human choice preferences are affected by the presentation frequency of reward-related alternatives, this may not be captured by some dominant models of value learning, such as the delta rule. In this study, we examined whether reward learning is driven more by learning the probability of reward provided by each option, or how frequently each option has been rewarded, and assess how well models based on average reward (e.g. the delta model) and models based on cumulative reward (e.g. the decay model) can account for choice preferences. In a binary-outcome choice task, participants selected between pairs of options that had reward probabilities of 0.65 (A) versus 0.35 (B) or 0.75 (C) versus 0.25 (D). Crucially, during training there were twice the number of AB trials as CD trials, such that option A was associated with higher cumulative reward, while option C gave higher average reward. Participants then decided between novel combinations of options (e.g., AC). Most participants preferred option A over C, a result predicted by the Decay model, but not the Delta model. We also compared the Delta and Decay models to both more simplified as well as more complex models that assumed additional mechanisms, such as representation of uncertainty. Overall, models that assume learning about cumulative reward provided the best account of the data.
| S-EPMC6814570 | biostudies-literature