Hippocampal pattern separation supports reinforcement learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Ballard IC
PROVIDER: S-EPMC6403348 | biostudies-literature | 2019 Mar
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Mice display signs of fear when neurons that express cFos during fear conditioning are artificially reactivated. This finding gave rise to the notion that cFos marks neurons that encode specific memories. Here we show that cFos expression patterns in the mouse dentate gyrus (DG) change dramatically from day to day in a water maze spatial learning paradigm, regardless of training level. Optogenetic inhibition of neurons that expressed cFos on the first training day affected performance days later, suggesting that these neurons continue to be important for spatial memory recall. The mechanism preventing repeated cFos expression in DG granule cells involves accumulation of ΔFosB, a long-lived splice variant of FosB. CA1 neurons, in contrast, repeatedly expressed cFos. Thus, cFos-expressing granule cells may encode new features being added to the internal representation during the last training session. This form of timestamping is thought to be required for the formation of episodic memories.
| S-EPMC9606265 | biostudies-literature
Project description:How do we remember emotional events? While emotion often leads to vivid recollection, the precision of emotional memories can be degraded, especially when discriminating among overlapping experiences in memory (i.e., pattern separation). Communication between the amygdala and the hippocampus has been proposed to support emotional memory, but the exact neural mechanisms remain unclear. Here, we used intracranial recordings in pre-surgical epilepsy patients to show that successful pattern separation of emotional stimuli is associated with theta band (3-7 Hz)-coordinated bidirectional interactions between the amygdala and the hippocampus. In contrast, discrimination errors (i.e., failure to discriminate similar stimuli) were associated with alpha band (7-13 Hz)-coordinated unidirectional influence from the amygdala to the hippocampus. These findings imply that alpha band synchrony may impair discrimination of similar emotional events via the amygdala-hippocampal directional coupling, which suggests a target for treatments of psychiatric conditions such as post-traumatic stress disorder, in which aversive experiences are often overgeneralized.
| S-EPMC6605056 | biostudies-literature
Project description:Making decisions in sequentially structured tasks requires integrating distally acquired information. The extensive computational cost of such integration challenges planning methods that integrate online, at decision time. Furthermore, it remains unclear whether 'offline' integration during replay supports planning, and if so which memories should be replayed. Inspired by machine learning, we propose that (a) offline replay of trajectories facilitates integrating representations that guide decisions, and (b) unsigned prediction errors (uncertainty) trigger such integrative replay. We designed a 2-step revaluation task for fMRI, whereby participants needed to integrate changes in rewards with past knowledge to optimally replan decisions. As predicted, we found that (a) multi-voxel pattern evidence for off-task replay predicts subsequent replanning; (b) neural sensitivity to uncertainty predicts subsequent replay and replanning; (c) off-task hippocampus and anterior cingulate activity increase when revaluation is required. These findings elucidate how the brain leverages offline mechanisms in planning and goal-directed behavior under uncertainty.
| S-EPMC6303108 | biostudies-literature
Project description:Pattern separation is a process that minimizes overlap between patterns of neuronal activity representing similar experiences. Theoretical work suggests that the dentate gyrus (DG) performs this role for memory processing but a direct demonstration is lacking. One limitation is the difficulty to measure DG inputs and outputs simultaneously. To rigorously assess pattern separation by DG circuitry, we used mouse brain slices to stimulate DG afferents and simultaneously record DG granule cells (GCs) and interneurons. Output spiketrains of GCs are more dissimilar than their input spiketrains, demonstrating for the first time temporal pattern separation at the level of single neurons in the DG. Pattern separation is larger in GCs than in fast-spiking interneurons and hilar mossy cells, and is amplified in CA3 pyramidal cells. Analysis of the neural noise and computational modelling suggest that this form of pattern separation is not explained by simple randomness and arises from specific presynaptic dynamics. Overall, by reframing the concept of pattern separation in dynamic terms and by connecting it to the physiology of different types of neurons, our study offers a new window of understanding in how hippocampal networks might support episodic memory.
| S-EPMC6437159 | biostudies-literature
Project description:Complex learned behaviors must involve the integrated action of distributed brain circuits. Although the contributions of individual regions to learning have been extensively investigated, much less is known about how distributed brain networks orchestrate their activity over the course of learning. To address this gap, we used fMRI combined with tools from dynamic network neuroscience to obtain time-resolved descriptions of network coordination during reinforcement learning in humans. We found that learning to associate visual cues with reward involves dynamic changes in network coupling between the striatum and distributed brain regions, including visual, orbitofrontal, and ventromedial prefrontal cortex (n = 22; 13 females). Moreover, we found that this flexibility in striatal network coupling correlates with participants' learning rate and inverse temperature, two parameters derived from reinforcement learning models. Finally, we found that episodic learning, measured separately in the same participants at the same time, was related to dynamic connectivity in distinct brain networks. These results suggest that dynamic changes in striatal-centered networks provide a mechanism for information integration during reinforcement learning.SIGNIFICANCE STATEMENT Learning from the outcomes of actions, referred to as reinforcement learning, is an essential part of life. The roles of individual brain regions in reinforcement learning have been well characterized in terms of updating values for actions or cues. Missing from this account, however, is an understanding of how different brain areas interact during learning to integrate sensory and value information. Here we characterize flexible striatal-cortical network dynamics that relate to reinforcement learning behavior.
| S-EPMC5858591 | biostudies-literature
Project description:Emotional arousal, mediated by the amygdala, is known to modulate episodic memories stored by the hippocampus, a region involved in pattern separation (the process by which similar representations are independently stored). While emotional modulation and pattern separation have been examined independently, this study attempts to link the two areas of research to propose an alternative account for how emotion modulates episodic memory. We used an emotional discrimination task designed to tax pattern separation of emotional information by concurrently varying emotional valence and similarity of stimuli. To examine emotional modulation of memory at the level of hippocampal subfields, we used high-resolution fMRI (1.5 mm isotropic) of the medial temporal lobe. Consistent with prior reports, we observed engagement of the hippocampal dentate gyrus (DG) and CA3 during accurate discrimination of highly similar items (behavioral correlate of pattern separation). Furthermore, we observed an emotional modulation of this signal (negative > neutral) specific to trials on which participants accurately discriminated similar emotional items. The amygdala was also modulated by emotion, regardless of the accuracy of discrimination. Additionally, we found aberrant amygdala-hippocampal network activity in a sample of adults with depressive symptoms. In this sample, amygdala activation was enhanced and DG/CA3 activation was diminished during emotional discrimination compared to those without depressive symptoms. Depressive symptom severity was also negatively correlated with DG/CA3 activity. This study suggests a novel mechanistic account for how emotional information is processed by hippocampal subfields as well as how this network may be altered in mood disorders.
| S-EPMC4172604 | biostudies-literature
Project description:Adult hippocampal neurogenesis is a unique form of neural circuit plasticity that results in the generation of new neurons in the dentate gyrus throughout life. Neurons that arise in adults (adult-born neurons) show heightened synaptic plasticity during their maturation and can account for up to ten per cent of the entire granule cell population. Moreover, levels of adult hippocampal neurogenesis are increased by interventions that are associated with beneficial effects on cognition and mood, such as learning, environmental enrichment, exercise and chronic treatment with antidepressants. Together, these properties of adult neurogenesis indicate that this process could be harnessed to improve hippocampal functions. However, despite a substantial number of studies demonstrating that adult-born neurons are necessary for mediating specific cognitive functions, as well as some of the behavioural effects of antidepressants, it is unknown whether an increase in adult hippocampal neurogenesis is sufficient to improve cognition and mood. Here we show that inducible genetic expansion of the population of adult-born neurons through enhancing their survival improves performance in a specific cognitive task in which two similar contexts need to be distinguished. Mice with increased adult hippocampal neurogenesis show normal object recognition, spatial learning, contextual fear conditioning and extinction learning but are more efficient in differentiating between overlapping contextual representations, which is indicative of enhanced pattern separation. Furthermore, stimulation of adult hippocampal neurogenesis, when combined with an intervention such as voluntary exercise, produces a robust increase in exploratory behaviour. However, increasing adult hippocampal neurogenesis alone does not produce a behavioural response like that induced by anxiolytic agents or antidepressants. Together, our findings suggest that strategies that are designed to increase adult hippocampal neurogenesis specifically, by targeting the cell death of adult-born neurons or by other mechanisms, may have therapeutic potential for reversing impairments in pattern separation and dentate gyrus dysfunction such as those seen during normal ageing.
| S-EPMC3084370 | biostudies-literature
Project description:Pattern separation is a central concept in current theories of episodic memory: this computation is thought to support our ability to avoid confusion between similar memories by transforming similar cortical input patterns of neural activity into dissimilar output patterns before their long-term storage in the hippocampus. Because there are many ways one can define patterns of neuronal activity and the similarity between them, pattern separation could in theory be achieved through multiple coding strategies. Using our recently developed assay that evaluates pattern separation in isolated tissue by controlling and recording the input and output spike trains of single hippocampal neurons, we explored neural codes through which pattern separation is performed by systematic testing of different similarity metrics and various time resolutions. We discovered that granule cells, the projection neurons of the dentate gyrus, can exhibit both pattern separation and its opposite computation, pattern convergence, depending on the neural code considered and the statistical structure of the input patterns. Pattern separation is favored when inputs are highly similar, and is achieved through spike time reorganization at short time scales (< 100 ms) as well as through variations in firing rate and burstiness at longer time scales. These multiplexed forms of pattern separation are network phenomena, notably controlled by GABAergic inhibition, that involve many celltypes with input-output transformations that participate in pattern separation to different extents and with complementary neural codes: a rate code for dentate fast-spiking interneurons, a burstiness code for hilar mossy cells and a synchrony code at long time scales for CA3 pyramidal cells. Therefore, the isolated hippocampal circuit itself is capable of performing temporal pattern separation using multiplexed coding strategies that might be essential to optimally disambiguate multimodal mnemonic representations.
| S-EPMC6476466 | biostudies-literature
Project description:Prolonged seizures can disrupt stem cell behavior in the adult hippocampus, an important brain structure for spatial memory. Here, using a mouse model of pilocarpine-induced status epilepticus (SE), we characterized spatiotemporal expression of Lin28a mRNA and proteins after SE. Unlike Lin28a transcripts, induction of LIN28A protein after SE was detected mainly in the subgranular zone, where immunoreactivity was found in progenitors, neuroblasts, and immature and mature granule neurons. To investigate roles of LIN28A in epilepsy, we generated Nestin-Cre:Lin28aloxP/loxP (conditional KO [cKO]) and Nestin-Cre:Lin28a+/+ (WT) mice to block LIN28A upregulation in all neuronal lineages after acute seizure. Adult-generated neuron- and hippocampus-associated cognitive impairments were absent in epileptic LIN28A-cKO mice, as evaluated by pattern separation and contextual fear conditioning tests, respectively, while sham-manipulated WT and cKO animals showed comparable memory function. Moreover, numbers of hilar PROX1-expressing ectopic granule cells (EGCs), together with PROX1+/NEUN+ mature EGCs, were significantly reduced in epileptic cKO mice. Transcriptomics analysis and IHC validation at 3 days after pilocarpine administration provided potential LIN28A downstream targets such as serotonin receptor 4. Collectively, our findings indicate that LIN28A is a potentially novel target for regulation of newborn neuron-associated memory dysfunction in epilepsy by modulating seizure-induced aberrant neurogenesis.
| S-EPMC10906464 | biostudies-literature
Project description:Pattern separation, the process of transforming similar representations or memories into highly dissimilar, nonoverlapping representations, is a key component of many functions ascribed to the hippocampus. Computational models have stressed the role of the hippocampus and, in particular, the dentate gyrus and its projections into the CA3 subregion in pattern separation. We used high-resolution (1.5-millimeter isotropic voxels) functional magnetic resonance imaging to measure brain activity during incidental memory encoding. Although activity consistent with a bias toward pattern completion was observed in CA1, the subiculum, and the entorhinal and parahippocampal cortices, activity consistent with a strong bias toward pattern separation was observed in, and limited to, the CA3/dentate gyrus. These results provide compelling evidence of a key role of the human CA3/dentate gyrus in pattern separation.
| S-EPMC2829853 | biostudies-literature