Dataset Information

Multiple systems in macaques for tracking prediction errors and other types of surprise.

ABSTRACT: Animals learn from the past to make predictions. These predictions are adjusted after prediction errors, i.e., after surprising events. Generally, most reward prediction errors models learn the average expected amount of reward. However, here we demonstrate the existence of distinct mechanisms for detecting other types of surprising events. Six macaques learned to respond to visual stimuli to receive varying amounts of juice rewards. Most trials ended with the delivery of either 1 or 3 juice drops so that animals learned to expect 2 juice drops on average even though instances of precisely 2 drops were rare. To encourage learning, we also included sessions during which the ratio between 1 and 3 drops changed. Additionally, in all sessions, the stimulus sometimes appeared in an unexpected location. Thus, 3 types of surprising events could occur: reward amount surprise (i.e., a scalar reward prediction error), rare reward surprise, and visuospatial surprise. Importantly, we can dissociate scalar reward prediction errors-rewards that deviated from the average reward amount expected-and rare reward events-rewards that accorded with the average reward expectation but that rarely occurred. We linked each type of surprise to a distinct pattern of neural activity using functional magnetic resonance imaging. Activity in the vicinity of the dopaminergic midbrain only reflected surprise about the amount of reward. Lateral prefrontal cortex had a more general role in detecting surprising events. Posterior lateral orbitofrontal cortex specifically detected rare reward events regardless of whether they followed average reward amount expectations, but only in learnable reward environments.

SUBMITTER: Grohn J

PROVIDER: S-EPMC7657565 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multiple systems in macaques for tracking prediction errors and other types of surprise.

Grohn Jan J Schüffelgen Urs U Neubert Franz-Xaver FX Bongioanni Alessandro A Verhagen Lennart L Sallet Jerome J Kolling Nils N Rushworth Matthew F S MFS

PLoS biology 20201030 10

Animals learn from the past to make predictions. These predictions are adjusted after prediction errors, i.e., after surprising events. Generally, most reward prediction errors models learn the average expected amount of reward. However, here we demonstrate the existence of distinct mechanisms for detecting other types of surprising events. Six macaques learned to respond to visual stimuli to receive varying amounts of juice rewards. Most trials ended with the delivery of either 1 or 3 juice dro ...[more]

PMID: 33125367

Similar Datasets

Project description:Providing prognostic information at the time of cancer diagnosis has important implications for treatment and monitoring. Although cancer staging, histopathological assessment, molecular features, and clinical variables can provide useful prognostic insights, improving risk stratification remains an active research area. We developed a deep learning system (DLS) to predict disease specific survival across 10 cancer types from The Cancer Genome Atlas (TCGA). We used a weakly-supervised approach without pixel-level annotations, and tested three different survival loss functions. The DLS was developed using 9,086 slides from 3,664 cases and evaluated using 3,009 slides from 1,216 cases. In multivariable Cox regression analysis of the combined cohort including all 10 cancers, the DLS was significantly associated with disease specific survival (hazard ratio of 1.58, 95% CI 1.28-1.70, p<0.0001) after adjusting for cancer type, stage, age, and sex. In a per-cancer adjusted subanalysis, the DLS remained a significant predictor of survival in 5 of 10 cancer types. Compared to a baseline model including stage, age, and sex, the c-index of the model demonstrated an absolute 3.7% improvement (95% CI 1.0-6.5) in the combined cohort. Additionally, our models stratified patients within individual cancer stages, particularly stage II (p = 0.025) and stage III (p<0.001). By developing and evaluating prognostic models across multiple cancer types, this work represents one of the most comprehensive studies exploring the direct prediction of clinical outcomes using deep learning and histopathology images. Our analysis demonstrates the potential for this approach to provide significant prognostic information in multiple cancer types, and even within specific pathologic stages. However, given the relatively small number of cases and observed clinical events for a deep learning task of this type, we observed wide confidence intervals for model performance, thus highlighting that future work will benefit from larger datasets assembled for the purposes for survival modeling.

Project description:Recent advances in imaging technology and fluorescent probes have made it possible to gain information about the dynamics of subcellular processes at unprecedented spatiotemporal scales. Unfortunately, a lack of automated tools to efficiently process the resulting imaging data encoding fine details of the biological processes remains a major bottleneck in utilizing the full potential of these powerful experimental techniques. Here we present a computational tool, called PunctaSpecks, that can characterize fluorescence signals arising from a wide range of biological molecules under normal and pathological conditions. Among other things, the program can calculate the number, areas, life-times, and amplitudes of fluorescence signals arising from multiple sources, track diffusing fluorescence sources like moving mitochondria, and determine the overlap probability of two processes or organelles imaged using indicator dyes of different colors. We have tested PunctaSpecks on synthetic time-lapse movies containing mobile fluorescence objects of various sizes, mimicking the activity of biomolecules. The robustness of the software is tested by varying the level of noise along with random but known pattern of appearing, disappearing, and movement of these objects. Next, we use PunctaSpecks to characterize protein-protein interaction involved in store-operated Ca2+ entry through the formation and activation of plasma membrane-bound ORAI1 channel and endoplasmic reticulum membrane-bound stromal interaction molecule (STIM), the evolution of inositol 1,4,5-trisphosphate (IP3)-induced Ca2+ signals from sub-micrometer size local events into global waves in human cortical neurons, and the activity of Alzheimer's disease-associated β amyloid pores in the plasma membrane. The tool can also be used to study other dynamical processes imaged through fluorescence molecules. The open source algorithm allows for extending the program to analyze more than two types of biomolecules visualized using markers of different colors.

Dataset Information

Multiple systems in macaques for tracking prediction errors and other types of surprise.

Publications

Multiple systems in macaques for tracking prediction errors and other types of surprise.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure