Browse
Submit Data
Databases
API
Help

Dataset Information

21 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Can sleep protect memories from catastrophic forgetting?

ABSTRACT: Continual learning remains an unsolved problem in artificial neural networks. The brain has evolved mechanisms to prevent catastrophic forgetting of old knowledge during new training. Building upon data suggesting the importance of sleep in learning and memory, we tested a hypothesis that sleep protects old memories from being forgotten after new learning. In the thalamocortical model, training a new memory interfered with previously learned old memories leading to degradation and forgetting of the old memory traces. Simulating sleep after new learning reversed the damage and enhanced old and new memories. We found that when a new memory competed for previously allocated neuronal/synaptic resources, sleep replay changed the synaptic footprint of the old memory to allow overlapping neuronal populations to store multiple memories. Our study predicts that memory storage is dynamic, and sleep enables continual learning by combining consolidation of new memory traces with reconsolidation of old memory traces to minimize interference.

SUBMITTER: Gonzalez OC

PROVIDER: S-EPMC7440920 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Can sleep protect memories from catastrophic forgetting?

González Oscar C OC Sokolov Yury Y Krishnan Giri P GP Delanois Jean Erik JE Bazhenov Maxim M

eLife 20200804

Continual learning remains an unsolved problem in artificial neural networks. The brain has evolved mechanisms to prevent catastrophic forgetting of old knowledge during new training. Building upon data suggesting the importance of sleep in learning and memory, we tested a hypothesis that sleep protects old memories from being forgotten after new learning. In the thalamocortical model, training a new memory interfered with previously learned old memories leading to degradation and forgetting of ...[more]

PMID: 32748786

Similar Datasets

Microglia protect memories formed during sleep deprivation

Project description:Purpose: To determine the specific effects of 6 hours sleep deprivation after a learning event on the transcriptomes of microglia. Sleep deprivation can generate inflammatory responses in the neuronal environment. In turn, this inflammation increases sleep drive, leading to a rebound in sleep duration. Microglia, a type of support cell found exclusively in the brain, have previously been found to release of inflammatory signals and exhibit altered characteristics in response to sleep deprivation. Together, this suggests microglia may be partially responsible for the brain’s response to sleep deprivation through their inflammatory activity. In this study, we fully and selectively ablated microglia from the mouse brain and assessed resulting sleep, circadian, and sleep deprivation phenotypes. We find microglia are dispensable for both homeostatic sleep and circadian function and the sleep rebound response to sleep deprivation. However, we uncover a phenomenon by which microglia appear to be essential for the protection of synapses and associated memories formed during a period of sleep deprivation, further expanding the list of known functions for microglia in synaptic modulation.

2021-05-12 | GSE174231 | GEO

Sleep-like unsupervised replay reduces catastrophic forgetting in artificial neural networks.

Project description:Artificial neural networks are known to suffer from catastrophic forgetting: when learning multiple tasks sequentially, they perform well on the most recent task at the expense of previously learned tasks. In the brain, sleep is known to play an important role in incremental learning by replaying recent and old conflicting memory traces. Here we tested the hypothesis that implementing a sleep-like phase in artificial neural networks can protect old memories during new training and alleviate catastrophic forgetting. Sleep was implemented as off-line training with local unsupervised Hebbian plasticity rules and noisy input. In an incremental learning framework, sleep was able to recover old tasks that were otherwise forgotten. Previously learned memories were replayed spontaneously during sleep, forming unique representations for each class of inputs. Representational sparseness and neuronal activity corresponding to the old tasks increased while new task related activity decreased. The study suggests that spontaneous replay simulating sleep-like dynamics can alleviate catastrophic forgetting in artificial neural networks.

| S-EPMC9755223 | biostudies-literature

REM sleep-active MCH neurons are involved in forgetting hippocampus-dependent memories.

Project description:The neural mechanisms underlying memory regulation during sleep are not yet fully understood. We found that melanin concentrating hormone-producing neurons (MCH neurons) in the hypothalamus actively contribute to forgetting in rapid eye movement (REM) sleep. Hypothalamic MCH neurons densely innervated the dorsal hippocampus. Activation or inhibition of MCH neurons impaired or improved hippocampus-dependent memory, respectively. Activation of MCH nerve terminals in vitro reduced firing of hippocampal pyramidal neurons by increasing inhibitory inputs. Wake- and REM sleep-active MCH neurons were distinct populations that were randomly distributed in the hypothalamus. REM sleep state-dependent inhibition of MCH neurons impaired hippocampus-dependent memory without affecting sleep architecture or quality. REM sleep-active MCH neurons in the hypothalamus are thus involved in active forgetting in the hippocampus.

| S-EPMC7378274 | biostudies-literature

The role of sleep in directed forgetting and remembering of human memories.

Project description:Ample evidence supports a role for sleep in the offline consolidation of memory. However, circumstances exist where forgetting can be as critical as remembering, both in daily life and clinically. Using a directed forgetting paradigm, here, we investigate the impact of explicit cue instruction during learning, prior to sleep, on subsequent remembering and forgetting of memory, after sleep. We demonstrate that sleep, relative to time awake, can selectively ignore the facilitation of items previously cued to be forgotten, yet preferentially enhance recall for items cued to be remembered; indicative of specificity based on prior waking instruction. Moreover, the success of this differential remember/forget effect is strongly correlated with fast sleep spindles over the left superior parietal cortex. Furthermore, electroencephalography source analysis of these spindles revealed a repeating loop of current density between selective memory-related regions of the superior parietal, medial temporal, and right prefrontal cortices. These findings move beyond the classical notion of sleep universally strengthening information. Instead, they suggest a model in which sleep may be more ecologically attuned to instructions present during learning while awake, supporting both remembering and targeted forgetting of human memories.

| S-EPMC3183424 | biostudies-literature

Microglia protect memories formed during sleep deprivation

Project description:Microglia protect memories formed during sleep deprivation

| PRJNA728892 | ENA

Does sleep protect memories against interference? A failure to replicate.

Project description:Across a broad spectrum of memory tasks, retention is superior following a night of sleep compared to a day of wake. However, this result alone does not clarify whether sleep merely slows the forgetting that would otherwise occur as a result of information processing during wakefulness, or whether sleep actually consolidates memories, protecting them from subsequent retroactive interference. Two influential studies suggested that sleep protects memories against the subsequent retroactive interference that occurs when participants learn new yet overlapping information (interference learning). In these studies, interference learning was much less detrimental to memory following a night of sleep compared to a day of wakefulness, an indication that sleep supports this important aspect of memory consolidation. In the current replication study, we repeated the protocol of and, additionally, we examined the impact of intrinsic motivation on performance in sleep and wake participants. We were unable to replicate the finding that sleep protects memories against retroactive interference, with the detrimental effects of interference learning being essentially the same in wake and sleep participants. We also found that while intrinsic motivation benefitted task acquisition it was not a modulator of sleep-wake differences in memory processing. Although we cannot accept the null hypothesis that sleep has no role to play in reducing the negative impact of interference, the findings draw into question prior evidence for sleep's role in protecting memories against interference. Moreover, the current study highlights the importance of replicating key findings in the study of sleep's impact on memory processing before drawing strong conclusions that set the direction of future research.

| S-EPMC7018054 | biostudies-literature

Opposing mechanisms support the voluntary forgetting of unwanted memories.

Project description:Reminders of the past can trigger the recollection of events that one would rather forget. Here, using fMRI, we demonstrate two distinct neural mechanisms that foster the intentional forgetting of such unwanted memories. Both mechanisms impair long-term retention by limiting momentary awareness of the memories, yet they operate in opposite ways. One mechanism, direct suppression, disengages episodic retrieval through the systemic inhibition of hippocampal processing that originates from right dorsolateral prefrontal cortex (PFC). The opposite mechanism, thought substitution, instead engages retrieval processes to occupy the limited focus of awareness with a substitute memory. It is mediated by interactions between left caudal and midventrolateral PFC that support the selective retrieval of substitutes in the context of prepotent, unwanted memories. These findings suggest that we are not at the mercy of passive forgetting; rather, our memories can be shaped by two opposite mechanisms of mnemonic control.

| S-EPMC3480638 | biostudies-literature

Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization.

Project description:Humans and most animals can learn new tasks without forgetting old ones. However, training artificial neural networks (ANNs) on new tasks typically causes them to forget previously learned tasks. This phenomenon is the result of "catastrophic forgetting," in which training an ANN disrupts connection weights that were important for solving previous tasks, degrading task performance. Several recent studies have proposed methods to stabilize connection weights of ANNs that are deemed most important for solving a task, which helps alleviate catastrophic forgetting. Here, drawing inspiration from algorithms that are believed to be implemented in vivo, we propose a complementary method: adding a context-dependent gating signal, such that only sparse, mostly nonoverlapping patterns of units are active for any one task. This method is easy to implement, requires little computational overhead, and allows ANNs to maintain high performance across large numbers of sequentially presented tasks, particularly when combined with weight stabilization. We show that this method works for both feedforward and recurrent network architectures, trained using either supervised or reinforcement-based learning. This suggests that using multiple, complementary methods, akin to what is believed to occur in the brain, can be a highly effective strategy to support continual learning.

| S-EPMC6217392 | biostudies-literature

Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks.

Project description:A long-term goal of AI is to produce agents that can learn a diversity of skills throughout their lifetimes and continuously improve those skills via experience. A longstanding obstacle towards that goal is catastrophic forgetting, which is when learning new information erases previously learned information. Catastrophic forgetting occurs in artificial neural networks (ANNs), which have fueled most recent advances in AI. A recent paper proposed that catastrophic forgetting in ANNs can be reduced by promoting modularity, which can limit forgetting by isolating task information to specific clusters of nodes and connections (functional modules). While the prior work did show that modular ANNs suffered less from catastrophic forgetting, it was not able to produce ANNs that possessed task-specific functional modules, thereby leaving the main theory regarding modularity and forgetting untested. We introduce diffusion-based neuromodulation, which simulates the release of diffusing, neuromodulatory chemicals within an ANN that can modulate (i.e. up or down regulate) learning in a spatial region. On the simple diagnostic problem from the prior work, diffusion-based neuromodulation 1) induces task-specific learning in groups of nodes and connections (task-specific localized learning), which 2) produces functional modules for each subtask, and 3) yields higher performance by eliminating catastrophic forgetting. Overall, our results suggest that diffusion-based neuromodulation promotes task-specific localized learning and functional modularity, which can help solve the challenging, but important problem of catastrophic forgetting.

| S-EPMC5690421 | biostudies-literature

Detecting Changes and Avoiding Catastrophic Forgetting in Dynamic Partially Observable Environments.

Project description:The ability of an agent to detect changes in an environment is key to successful adaptation. This ability involves at least two phases: learning a model of an environment, and detecting that a change is likely to have occurred when this model is no longer accurate. This task is particularly challenging in partially observable environments, such as those modeled with partially observable Markov decision processes (POMDPs). Some predictive learners are able to infer the state from observations and thus perform better with partial observability. Predictive state representations (PSRs) and neural networks are two such tools that can be trained to predict the probabilities of future observations. However, most such existing methods focus primarily on static problems in which only one environment is learned. In this paper, we propose an algorithm that uses statistical tests to estimate the probability of different predictive models to fit the current environment. We exploit the underlying probability distributions of predictive models to provide a fast and explainable method to assess and justify the model's beliefs about the current environment. Crucially, by doing so, the method can label incoming data as fitting different models, and thus can continuously train separate models in different environments. This new method is shown to prevent catastrophic forgetting when new environments, or tasks, are encountered. The method can also be of use when AI-informed decisions require justifications because its beliefs are based on statistical evidence from observations. We empirically demonstrate the benefit of the novel method with simulations in a set of POMDP environments.

| S-EPMC7787001 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data