O2A: One-Shot Observational Learning with Action Vectors.
Ontology highlight
ABSTRACT:
SUBMITTER: Pauly L
PROVIDER: S-EPMC8367442 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The role of prediction error (PE) in driving learning is well-established in fields such as classical and instrumental conditioning, reward learning and procedural memory; however, its role in human one-shot declarative encoding is less clear. According to one recent hypothesis, PE reflects the divergence between two probability distributions: one reflecting the prior probability (from previous experiences) and the other reflecting the sensory evidence (from the current experience). Assuming unimodal probability distributions, PE can be manipulated in three ways: (1) the distance between the mode of the prior and evidence, (2) the precision of the prior, and (3) the precision of the evidence. We tested these three manipulations across five experiments, in terms of peoples' ability to encode a single presentation of a scene-item pairing as a function of previous exposures to that scene and/or item. Memory was probed by presenting the scene together with three choices for the previously paired item, in which the two foil items were from other pairings within the same condition as the target item. In Experiment 1, we manipulated the evidence to be either consistent or inconsistent with prior expectations, predicting PE to be larger, and hence memory better, when the new pairing was inconsistent. In Experiments 2a-c, we manipulated the precision of the priors, predicting better memory for a new pairing when the (inconsistent) priors were more precise. In Experiment 3, we manipulated both visual noise and prior exposure for unfamiliar faces, before pairing them with scenes, predicting better memory when the sensory evidence was more precise. In all experiments, the PE hypotheses were supported. We discuss alternative explanations of individual experiments, and conclude the Predictive Interactive Multiple Memory Signals (PIMMS) framework provides the most parsimonious account of the full pattern of results.
| S-EPMC5381756 | biostudies-literature
Project description:Incremental learning, in which new knowledge is acquired gradually through trial and error, can be distinguished from one-shot learning, in which the brain learns rapidly from only a single pairing of a stimulus and a consequence. Very little is known about how the brain transitions between these two fundamentally different forms of learning. Here we test a computational hypothesis that uncertainty about the causal relationship between a stimulus and an outcome induces rapid changes in the rate of learning, which in turn mediates the transition between incremental and one-shot learning. By using a novel behavioral task in combination with functional magnetic resonance imaging (fMRI) data from human volunteers, we found evidence implicating the ventrolateral prefrontal cortex and hippocampus in this process. The hippocampus was selectively "switched" on when one-shot learning was predicted to occur, while the ventrolateral prefrontal cortex was found to encode uncertainty about the causal association, exhibiting increased coupling with the hippocampus for high-learning rates, suggesting this region may act as a "switch," turning on and off one-shot learning as required.
| S-EPMC4412411 | biostudies-literature
Project description:In many daily tasks, we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning (RL) theory suggests two classes of algorithms solving this credit assignment problem: In classic temporal-difference learning, earlier actions receive reward information only after multiple repetitions of the task, whereas models with eligibility traces reinforce entire sequences of actions from a single experience (one-shot). Here, we show one-shot learning of sequences. We developed a novel paradigm to directly observe which actions and states along a multi-step sequence are reinforced after a single reward. By focusing our analysis on those states for which RL with and without eligibility trace make qualitatively distinct predictions, we find direct behavioral (choice probability) and physiological (pupil dilation) signatures of reinforcement learning with eligibility trace across multiple sensory modalities.
| S-EPMC6897511 | biostudies-literature
Project description:A vast portion of the mammalian genome is transcribed as long non-coding RNAs (lncRNAs) acting in the cytoplasm with largely unknown functions. Surprisingly, lncRNAs have been shown to interact with ribosomes, encode uncharacterized proteins, or act as ribosome sponges. These functions still remain mostly undetected and understudied owing to the lack of efficient tools for genome-wide simultaneous identification of ribosome-associated lncRNAs and peptide-producing lncRNAs. Here we present AHARIBO, a method for the detection of lncRNAs either untranslated, but associated with ribosomes, or encoding small peptides. Using AHARIBO in mouse embryonic stem cells during neuronal differentiation, we isolated ribosome-protected RNA fragments, translated RNAs and corresponding de novo synthesized polypeptides. Besides identifying mRNAs under active translation and associated ribosomes, we found and distinguished lncRNAs acting as ribosome sponges or encoding micropeptides, laying the ground for a better functional understanding of hundreds lncRNAs.
2021-02-28 | GSE167865 | GEO
Project description:Prior knowledge structures (or schemas) confer multiple behavioral benefits. First, when we encounter information that fits with prior knowledge structures, this information is generally better learned and remembered. Second, prior knowledge can support prospective planning. In humans, memory enhancements related to prior knowledge have been suggested to be supported, in part, by computations in prefrontal and medial temporal lobe (MTL) cortex. Moreover, animal studies further implicate a role for the hippocampus in schema-based facilitation and in the emergence of prospective planning signals following new learning. To date, convergence across the schema-enhanced learning and memory literature may be constrained by the predominant use of hippocampally dependent spatial navigation paradigms in rodents, and non-spatial list-based learning paradigms in humans. Here, we targeted this missing link by examining the effects of prior knowledge on human navigational learning in a hippocampally dependent virtual navigation paradigm that closely relates to foundational studies in rodents. Outside the scanner, participants overlearned Old Paired Associates (OPA- item-location associations) in multiple spatial environments, and they subsequently learned New Paired Associates (NPA-new item-location associations) in the environments while undergoing fMRI. We hypothesized that greater OPA knowledge precision would positively affect NPA learning, and that the hippocampus would be instrumental in translating this new learning into prospective planning of navigational paths to NPA locations. Behavioral results revealed that OPA knowledge predicted one-shot learning of NPA locations, and neural results indicated that one-shot learning was predicted by the rapid emergence of performance-predictive prospective planning signals in hippocampus. Prospective memory relationships were not significant in parahippocampal cortex and were marginally dissociable from the primary hippocampal effect. Collectively, these results extend understanding of how schemas impact learning and performance, showing that the precision of prior spatial knowledge is important for future learning in humans, and that the hippocampus is involved in translating this knowledge into new goal-directed behaviors.
| S-EPMC6288548 | biostudies-literature
Project description:The repeated pairing of a particular stimulus with a specific cognitive control process, such as task switching, can bind the two together in memory, resulting in the formation of stimulus-control associations. These bindings are thought to guide the context-sensitive application of cognitive control, but it is not presently known whether such stimulus-control associations are only acquired through slow, incremental learning or could also be mediated by episodic memories of a single experience, so-called one-shot learning. Here, we tested this episodic control-binding hypothesis by probing whether a single co-occurrence of a stimulus and the control process of task switching would lead to significant performance benefits (reduced task switch cost) when that stimulus later re-occurred under the same as opposed to different control demands. Across three experiments, we demonstrate that item-specific stimulus-control associations can be formed based on a single exposure, providing the first strong evidence for episodic memory guidance of cognitive control.
| S-EPMC7507789 | biostudies-literature
Project description:The one-shot pairing of a stimulus with a specific cognitive control process, such as task switching, can bind the two together in memory. The episodic control-binding hypothesis posits that the formation of temporary stimulus-control bindings, which are held in event-files supported by episodic memory, can guide the contextually appropriate application of cognitive control. Across two experiments, we sought to examine the role of task-focused attention in the encoding and implementation of stimulus-control bindings in episodic event-files. In Experiment 1, we obtained self-reports of mind wandering during encoding and implementation of stimulus-control bindings. Results indicated that, whereas mind wandering during the implementation of stimulus-control bindings does not decrease their efficacy, mind wandering during the encoding of these control-state associations interferes with their successful deployment at a later point. In Experiment 2, we complemented these results by using trial-by-trial pupillometry to measure attention, again demonstrating that attention levels at encoding predict the subsequent implementation of stimulus-control bindings better than attention levels at implementation. These results suggest that, although encoding stimulus-control bindings in episodic memory requires active attention and engagement, once encoded, these bindings are automatically deployed to guide behavior when the stimulus recurs. These findings expand our understanding of how cognitive control processes are integrated into episodic event files.
| S-EPMC8318327 | biostudies-literature
Project description:BackgroundThe state-of-the-art deep learning based cancer type prediction can only predict cancer types whose samples are available during the training where the sample size is commonly large. In this paper, we consider how to utilize the existing training samples to predict cancer types unseen during the training. We hypothesize the existence of a set of type-agnostic expression representations that define the similarity/dissimilarity between samples of the same/different types and propose a novel one-shot learning model called CancerSiamese to learn this common representation. CancerSiamese accepts a pair of query and support samples (gene expression profiles) and learns the representation of similar or dissimilar cancer types through two parallel convolutional neural networks joined by a similarity function.ResultsWe trained CancerSiamese for cancer type prediction for primary and metastatic tumors using samples from the Cancer Genome Atlas (TCGA) and MET500. Network transfer learning was utilized to facilitate the training of the CancerSiamese models. CancerSiamese was tested for different N-way predictions and yielded an average accuracy improvement of 8% and 4% over the benchmark 1-Nearest Neighbor (1-NN) classifier for primary and metastatic tumors, respectively. Moreover, we applied the guided gradient saliency map and feature selection to CancerSiamese to examine 100 and 200 top marker-gene candidates for the prediction of primary and metastatic cancers, respectively. Functional analysis of these marker genes revealed several cancer related functions between primary and metastatic tumors.ConclusionThis work demonstrated, for the first time, the feasibility of predicting unseen cancer types whose samples are limited. Thus, it could inspire new and ingenious applications of one-shot and few-shot learning solutions for improving cancer diagnosis, prognostic, and our understanding of cancer.
| S-EPMC8117642 | biostudies-literature
Project description:Influential theories and computational models suggest error-based learning plays an important role in language acquisition: Children learn new words by generating predictions about upcoming utterances and revising those predictions when they are erroneous. Critically, revising stronger (rather than weaker) predictions should further enhance learning. Although previously demonstrated in adults, such prediction error boost has not been conclusively shown in children. To close this gap, we tested 107 participants between the ages of 5 and 10. We found little evidence that word learning in this age group benefits from a prediction error boost. Moreover, we also failed to replicate previous evidence for such an effect in adults. Based on a detailed task analysis, we suggest the variation in adult findings may be partly explained by differences in encoding strategies and that, relatedly, the protracted development of the episodic memory system might explain why children do not experience robust benefits from having stronger (rather than weaker) predictions disconfirmed.
| S-EPMC10785960 | biostudies-literature
Project description:As a promising research direction in recent decades, active learning allows an oracle to assign labels to typical examples for performance improvement in learning systems. Existing works mainly focus on designing criteria for screening examples of high value to be labeled in a handcrafted manner. Instead of manually developing strategies of querying the user to access labels for the desired examples, we utilized the reinforcement learning algorithm parameterized with the neural network to automatically explore query strategies in active learning when addressing stream-based one-shot classification problems. With the involvement of cross-entropy in the loss function of Q-learning, an efficient policy to decide when and where to predict or query an instance is learned through the developed framework. Compared with a former influential work, the advantages of our method are demonstrated experimentally with two image classification tasks, and it exhibited better performance, quick convergence, relatively good stability and fewer requests for labels.
| S-EPMC6583946 | biostudies-literature