Memories of control: One-shot episodic learning of item-specific stimulus-control associations.
Ontology highlight
ABSTRACT:
SUBMITTER: Whitehead PS
PROVIDER: S-EPMC7507789 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The one-shot pairing of a stimulus with a specific cognitive control process, such as task switching, can bind the two together in memory. The episodic control-binding hypothesis posits that the formation of temporary stimulus-control bindings, which are held in event-files supported by episodic memory, can guide the contextually appropriate application of cognitive control. Across two experiments, we sought to examine the role of task-focused attention in the encoding and implementation of stimulus-control bindings in episodic event-files. In Experiment 1, we obtained self-reports of mind wandering during encoding and implementation of stimulus-control bindings. Results indicated that, whereas mind wandering during the implementation of stimulus-control bindings does not decrease their efficacy, mind wandering during the encoding of these control-state associations interferes with their successful deployment at a later point. In Experiment 2, we complemented these results by using trial-by-trial pupillometry to measure attention, again demonstrating that attention levels at encoding predict the subsequent implementation of stimulus-control bindings better than attention levels at implementation. These results suggest that, although encoding stimulus-control bindings in episodic memory requires active attention and engagement, once encoded, these bindings are automatically deployed to guide behavior when the stimulus recurs. These findings expand our understanding of how cognitive control processes are integrated into episodic event files.
| S-EPMC8318327 | biostudies-literature
Project description:The role of prediction error (PE) in driving learning is well-established in fields such as classical and instrumental conditioning, reward learning and procedural memory; however, its role in human one-shot declarative encoding is less clear. According to one recent hypothesis, PE reflects the divergence between two probability distributions: one reflecting the prior probability (from previous experiences) and the other reflecting the sensory evidence (from the current experience). Assuming unimodal probability distributions, PE can be manipulated in three ways: (1) the distance between the mode of the prior and evidence, (2) the precision of the prior, and (3) the precision of the evidence. We tested these three manipulations across five experiments, in terms of peoples' ability to encode a single presentation of a scene-item pairing as a function of previous exposures to that scene and/or item. Memory was probed by presenting the scene together with three choices for the previously paired item, in which the two foil items were from other pairings within the same condition as the target item. In Experiment 1, we manipulated the evidence to be either consistent or inconsistent with prior expectations, predicting PE to be larger, and hence memory better, when the new pairing was inconsistent. In Experiments 2a-c, we manipulated the precision of the priors, predicting better memory for a new pairing when the (inconsistent) priors were more precise. In Experiment 3, we manipulated both visual noise and prior exposure for unfamiliar faces, before pairing them with scenes, predicting better memory when the sensory evidence was more precise. In all experiments, the PE hypotheses were supported. We discuss alternative explanations of individual experiments, and conclude the Predictive Interactive Multiple Memory Signals (PIMMS) framework provides the most parsimonious account of the full pattern of results.
| S-EPMC5381756 | biostudies-literature
Project description:Incremental learning, in which new knowledge is acquired gradually through trial and error, can be distinguished from one-shot learning, in which the brain learns rapidly from only a single pairing of a stimulus and a consequence. Very little is known about how the brain transitions between these two fundamentally different forms of learning. Here we test a computational hypothesis that uncertainty about the causal relationship between a stimulus and an outcome induces rapid changes in the rate of learning, which in turn mediates the transition between incremental and one-shot learning. By using a novel behavioral task in combination with functional magnetic resonance imaging (fMRI) data from human volunteers, we found evidence implicating the ventrolateral prefrontal cortex and hippocampus in this process. The hippocampus was selectively "switched" on when one-shot learning was predicted to occur, while the ventrolateral prefrontal cortex was found to encode uncertainty about the causal association, exhibiting increased coupling with the hippocampus for high-learning rates, suggesting this region may act as a "switch," turning on and off one-shot learning as required.
| S-EPMC4412411 | biostudies-literature
Project description:Flexible retrieval mechanisms that allow us to infer relationships across events may also lead to memory errors or distortion when details of one event are misattributed to the related event. Here, we tested how making successful inferences alters representation of overlapping events, leading to false memories. Participants encoded overlapping associations ('AB' and 'BC'), each of which was superimposed on different indoor and outdoor scenes that were pre-exposed prior to associative learning. Participants were subsequently tested on both the directly learned pairs ('AB' and 'BC') and inferred relationships across pairs ('AC'). We predicted that when people make a correct inference, features associated with overlapping events may become integrated in memory. To test this hypothesis, participants completed a final detailed retrieval test, in which they had to recall the scene associated with initially learned 'AB' pairs (or 'BC' pairs). We found that the outcome of inference decisions impacted the degree to which neural patterns elicited during detailed 'AB' retrieval reflected reinstatement of the scene associated with the overlapping 'BC' event. After successful inference, neural patterns in the anterior hippocampus, posterior medial prefrontal cortex, and our content-reinstatement region (left inferior temporal gyrus) were more similar to the overlapping, yet incorrect 'BC' context relative to after unsuccessful inference. Further, greater hippocampal activity during inference was associated with greater reinstatement of the incorrect, overlapping context in our content-reinstatement region, which in turn tracked contextual misattributions during detailed retrieval. These results suggest recombining memories during successful inference can lead to misattribution of contextual details across related events, resulting in false memories.
| S-EPMC8375312 | biostudies-literature
Project description:In many daily tasks, we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning (RL) theory suggests two classes of algorithms solving this credit assignment problem: In classic temporal-difference learning, earlier actions receive reward information only after multiple repetitions of the task, whereas models with eligibility traces reinforce entire sequences of actions from a single experience (one-shot). Here, we show one-shot learning of sequences. We developed a novel paradigm to directly observe which actions and states along a multi-step sequence are reinforced after a single reward. By focusing our analysis on those states for which RL with and without eligibility trace make qualitatively distinct predictions, we find direct behavioral (choice probability) and physiological (pupil dilation) signatures of reinforcement learning with eligibility trace across multiple sensory modalities.
| S-EPMC6897511 | biostudies-literature
Project description:Vivid episodic memories in people have been characterized as the replay of multiple unique events in sequential order [1-3]. The hippocampus plays a critical role in episodic memories in both people and rodents [2, 4-6]. Although rats remember multiple unique episodes [7, 8], it is currently unknown if animals "replay" episodic memories. Therefore, we developed an animal model of episodic memory replay. Here, we show that rats can remember a trial-unique stream of multiple episodes and the order in which these events occurred by engaging hippocampal-dependent episodic memory replay. We document that rats rely on episodic memory replay to remember the order of events rather than relying on non-episodic memories. Replay of episodic memories survives a long retention-interval challenge and interference from the memory of other events, which documents that replay is part of long-term episodic memory. The chemogenetic activating drug clozapine N-oxide (CNO), but not vehicle, reversibly impairs episodic memory replay in rats previously injected bilaterally in the hippocampus with a recombinant viral vector containing an inhibitory designer receptor exclusively activated by a designer drug (DREADD; AAV8-hSyn-hM4Di-mCherry). By contrast, two non-episodic memory assessments are unaffected by CNO, showing selectivity of this hippocampal-dependent impairment. Our approach provides an animal model of episodic memory replay, a process by which the rat searches its representations in episodic memory in sequential order to find information. Our findings using rats suggest that the ability to replay a stream of episodic memories is quite old in the evolutionary timescale.
| S-EPMC5964044 | biostudies-literature
Project description:Even though it is known that sleep benefits declarative memory consolidation, the role of sleep in the storage of temporal sequences has rarely been examined. Thus we explored the influence of sleep on temporal order in an episodic memory task followed by sleep or sleep deprivation. Thirty-four healthy subjects (17 men) aged between 19 and 28 years participated in the randomized, counterbalanced, between-subject design. Parameters of interests were NREM/REM cycles, spindle activity and spindle-related EEG power spectra. Participants of both groups (sleep group/sleep deprivation group) performed retrieval in the evening, morning and three days after the learning night. Results revealed that performance in temporal order memory significantly deteriorated over three days only in sleep deprived participants. Furthermore our data showed a positive relationship between the ratios of the (i) first NREM/REM cycle with more REM being associated with delayed temporal order recall. Most interestingly, data additionally indicated that (ii) memory enhancers in the sleep group show more fast spindle related alpha power at frontal electrode sites possibly indicating access to a yet to be consolidated memory trace. We suggest that distinct sleep mechanisms subserve different aspects of episodic memory and are jointly involved in sleep-dependent memory consolidation.
| S-EPMC3427018 | biostudies-literature
Project description:People remember an event as a coherent scene. Memory of such an episode is thought to reflect binding of a fully integrated representation, rather than memory of unconnected features. However, it is not known whether rodents form bound representations. Here we show that rats remember episodes as bound representations. Rats were presented with multiple features of unique episodes at memory encoding: what (food flavor), where (maze location), source (self-generated food seeking—running to the food site—or experimenter-generated food seeking—placement by the experimenter at the food site), and context (spatial cues in the room where the event occurred). After a delay, the trial continued with a memory assessment in which one flavor replenished at the self-generated—but not at experimenter-generated—locations. We presented rats with multiple overlapping features, in rapid succession, to ensure that successful memory retrieval required them to disambiguate multiple study episodes (using two rooms). We found that binding is resistant to interference from highly similar episodes and survives long retention intervals (∼1 week). Our results suggest that multiple episodic memories are each structured as bound representations, which suggests that nonhumans represent episodic memories using a structure similar to that of people. This finding enhances the translational potential for utilizing animal models of episodic memory to explore the biological mechanisms of memory and validate therapeutic approaches for treating disorders of memory.
| S-EPMC4269559 | biostudies-literature
Project description:We present O2A, a novel method for learning to perform robotic manipulation tasks from a single (one-shot) third-person demonstration video. To our knowledge, it is the first time this has been done for a single demonstration. The key novelty lies in pre-training a feature extractor for creating a perceptual representation for actions that we call "action vectors". The action vectors are extracted using a 3D-CNN model pre-trained as an action classifier on a generic action dataset. The distance between the action vectors from the observed third-person demonstration and trial robot executions is used as a reward for reinforcement learning of the demonstrated task. We report on experiments in simulation and on a real robot, with changes in viewpoint of observation, properties of the objects involved, scene background and morphology of the manipulator between the demonstration and the learning domains. O2A outperforms baseline approaches under different domain shifts and has comparable performance with an Oracle (that uses an ideal reward function). Videos of the results, including demonstrations, can be found in our: project-website.
| S-EPMC8367442 | biostudies-literature
Project description:MotivationProtein phosphorylation is a key regulator of protein function in signal transduction pathways. Kinases are the enzymes that catalyze the phosphorylation of other proteins in a target-specific manner. The dysregulation of phosphorylation is associated with many diseases including cancer. Although the advances in phosphoproteomics enable the identification of phosphosites at the proteome level, most of the phosphoproteome is still in the dark: more than 95% of the reported human phosphosites have no known kinases. Determining which kinase is responsible for phosphorylating a site remains an experimental challenge. Existing computational methods require several examples of known targets of a kinase to make accurate kinase-specific predictions, yet for a large body of kinases, only a few or no target sites are reported.ResultsWe present DeepKinZero, the first zero-shot learning approach to predict the kinase acting on a phosphosite for kinases with no known phosphosite information. DeepKinZero transfers knowledge from kinases with many known target phosphosites to those kinases with no known sites through a zero-shot learning model. The kinase-specific positional amino acid preferences are learned using a bidirectional recurrent neural network. We show that DeepKinZero achieves significant improvement in accuracy for kinases with no known phosphosites in comparison to the baseline model and other methods available. By expanding our knowledge on understudied kinases, DeepKinZero can help to chart the phosphoproteome atlas.Availability and implementationThe source codes are available at https://github.com/Tastanlab/DeepKinZero.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC7320620 | biostudies-literature