Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Belief state representation in the dopamine system.

ABSTRACT: Learning to predict future outcomes is critical for driving appropriate behaviors. Reinforcement learning (RL) models have successfully accounted for such learning, relying on reward prediction errors (RPEs) signaled by midbrain dopamine neurons. It has been proposed that when sensory data provide only ambiguous information about which state an animal is in, it can predict reward based on a set of probabilities assigned to hypothetical states (called the belief state). Here we examine how dopamine RPEs and subsequent learning are regulated under state uncertainty. Mice are first trained in a task with two potential states defined by different reward amounts. During testing, intermediate-sized rewards are given in rare trials. Dopamine activity is a non-monotonic function of reward size, consistent with RL models operating on belief states. Furthermore, the magnitude of dopamine responses quantitatively predicts changes in behavior. These results establish the critical role of state inference in RL.

SUBMITTER: Babayan BM

PROVIDER: S-EPMC5951832 | biostudies-other | 2018 May

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Publications

Belief state representation in the dopamine system.

Babayan Benedicte M BM Uchida Naoshige N Gershman Samuel J SJ

Nature communications 20180514 1

Learning to predict future outcomes is critical for driving appropriate behaviors. Reinforcement learning (RL) models have successfully accounted for such learning, relying on reward prediction errors (RPEs) signaled by midbrain dopamine neurons. It has been proposed that when sensory data provide only ambiguous information about which state an animal is in, it can predict reward based on a set of probabilities assigned to hypothetical states (called the belief state). Here we examine how dopami ...[more]

PMID: 29760401

Similar Datasets

Evaluating State Space Discovery by Persistent Cohomology in the Spatial Representation System.

Project description:Persistent cohomology is a powerful technique for discovering topological structure in data. Strategies for its use in neuroscience are still undergoing development. We comprehensively and rigorously assess its performance in simulated neural recordings of the brain's spatial representation system. Grid, head direction, and conjunctive cell populations each span low-dimensional topological structures embedded in high-dimensional neural activity space. We evaluate the ability for persistent cohomology to discover these structures for different dataset dimensions, variations in spatial tuning, and forms of noise. We quantify its ability to decode simulated animal trajectories contained within these topological structures. We also identify regimes under which mixtures of populations form product topologies that can be detected. Our results reveal how dataset parameters affect the success of topological discovery and suggest principles for applying persistent cohomology, as well as persistent homology, to experimental neural recordings.

| S-EPMC8060447 | biostudies-literature

Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision.

Project description:Central to the organization of behavior is the ability to predict the values of outcomes to guide choices. The accuracy of such predictions is honed by a teaching signal that indicates how incorrect a prediction was ("reward prediction error," RPE). In several reinforcement learning contexts, such as Pavlovian conditioning and decisions guided by reward history, this RPE signal is provided by midbrain dopamine neurons. In many situations, however, the stimuli predictive of outcomes are perceptually ambiguous. Perceptual uncertainty is known to influence choices, but it has been unclear whether or how dopamine neurons factor it into their teaching signal. To cope with uncertainty, we extended a reinforcement learning model with a belief state about the perceptually ambiguous stimulus; this model generates an estimate of the probability of choice correctness, termed decision confidence. We show that dopamine responses in monkeys performing a perceptually ambiguous decision task comply with the model's predictions. Consequently, dopamine responses did not simply reflect a stimulus' average expected reward value but were predictive of the trial-to-trial fluctuations in perceptual accuracy. These confidence-dependent dopamine responses emerged prior to monkeys' choice initiation, raising the possibility that dopamine impacts impending decisions, in addition to encoding a post-decision teaching signal. Finally, by manipulating reward size, we found that dopamine neurons reflect both the upcoming reward size and the confidence in achieving it. Together, our results show that dopamine responses convey teaching signals that are also appropriate for perceptual decisions.

| S-EPMC5819757 | biostudies-literature

What Is Central to Political Belief System Networks?

Project description:A central challenge for identifying core components of a belief system is examining the position of components within the structure of the entire belief system. We test whether operational (i.e., positions on issues) or symbolic (i.e., affective attachments to political groups and labels) components are most central by modeling a political belief system as a network of interconnected attitudes and beliefs. Across seven waves of representative panel data from New Zealand, we find that symbolic components are more central than operational components (ds range = 0.78-0.97). Symbolic components were also closer than operational components in the network to self-reported voting (d = -2.43), proenvironmental actions (ds = -1.71 and -1.63), and religious behaviors (d = -0.74). These findings are consistent with perspectives that emphasize the importance of symbolic politics in tying belief systems together and motivating behavior, and further the link between political belief system research and network science.

| S-EPMC6676336 | biostudies-literature

Relational representation in the olfactory system.

Project description:The perceptual quality of odors usually is robust to variability in concentration. However, maps of neural activation across the olfactory bulb glomerular layer are not stable in this respect; rather, glomerular odor representations both broaden and intensify as odorant concentrations are increased. The relative levels of activation among glomeruli, in contrast, remain relatively stable across concentrations, suggesting that the representation of odor quality may rely on these relational activity patterns. However, the neural normalization mechanisms enabling extraction of such relational representations are unclear. Using glomerular imaging activity profiles from the rat olfactory bulb together with computational modeling, we here show that (i) global normalization preserves concentration-independent odor-quality information; (ii) perceptual similarities, as assessed behaviorally, are better predicted by normalized than by raw bulbar activity profiles; and (iii) a recurrent excitatory circuit recently described in the olfactory bulb is capable of performing such normalization. We show that global feed-forward normalization in a sensory system is behaviorally relevant, and that a center-surround neural architecture does not necessarily imply center-surround function.

| S-EPMC1794271 | biostudies-literature

Trait representation of embodied cognition in dancers pivoting on the extended mirror neuron system: a resting-state fMRI study.

Project description:IntroductionDance is an art form that integrates the body and mind through movement. Dancers develop exceptional physical and mental abilities that involve various neurocognitive processes linked to embodied cognition. We propose that dancers' primary trait representation is movement-actuated and relies on the extended mirror neuron system (eMNS).MethodsA total of 29 dancers and 28 non-dancer controls were recruited. A hierarchical approach of intra-regional and inter-regional functional connectivity (FC) analysis was adopted to probe trait-like neurodynamics within and between regions in the eMNS during rest. Correlation analyses were employed to examine the associations between dance training, creativity, and the FC within and between different brain regions.ResultsWithin the eMNS, dancers exhibited increased intra-regional FC in various brain regions compared to non-dancers. These regions include the left inferior frontal gyrus, left ventral premotor cortex, left anterior insula, left posterior cerebellum (crus II), and bilateral basal ganglia (putamen and globus pallidus). Dancers also exhibited greater intrinsic inter-regional FC between the cerebellum and the core/limbic mirror areas within the eMNS. In dancers, there was a negative correlation observed between practice intensity and the intrinsic FC within the eMNS involving the cerebellum and basal ganglia. Additionally, FCs from the basal ganglia to the dorsolateral prefrontal cortex were found to be negatively correlated with originality in dancers.DiscussionOur results highlight the proficient communication within the cortical-subcortical hierarchy of the eMNS in dancers, linked to the automaticity and cognitive-motor interactions acquired through training. Altered functional couplings in the eMNS can be regarded as a unique neural signature specific to virtuoso dancers, which might predispose them for skilled dancing performance, perception, and creation.

| S-EPMC10364845 | biostudies-literature

Graph-Theoretic Analysis of Belief System Dynamics under Logic Constraints.

Project description:Opinion formation cannot be modeled solely as an ideological deduction from a set of principles; rather, repeated social interactions and logic constraints among statements are consequential in the construct of belief systems. We address three basic questions in the analysis of social opinion dynamics: (i) Will a belief system converge? (ii) How long does it take to converge? (iii) Where does it converge? We provide graph-theoretic answers to these questions for a model of opinion dynamics of a belief system with logic constraints. Our results make plain the implicit dependence of the convergence properties of a belief system on the underlying social network and on the set of logic constraints that relate beliefs on different statements. Moreover, we provide an explicit analysis of a variety of commonly used large-scale network models.

| S-EPMC6586829 | biostudies-literature

Representation learning of resting state fMRI with variational autoencoder.

Project description:Resting state functional magnetic resonance imaging (rsfMRI) data exhibits complex but structured patterns. However, the underlying origins are unclear and entangled in rsfMRI data. Here we establish a variational auto-encoder, as a generative model trainable with unsupervised learning, to disentangle the unknown sources of rsfMRI activity. After being trained with large data from the Human Connectome Project, the model has learned to represent and generate patterns of cortical activity and connectivity using latent variables. The latent representation and its trajectory represent the spatiotemporal characteristics of rsfMRI activity. The latent variables reflect the principal gradients of the latent trajectory and drive activity changes in cortical networks. Representational geometry captured as covariance or correlation between latent variables, rather than cortical connectivity, can be used as a more reliable feature to accurately identify subjects from a large group, even if only a short period of data is available in each subject. Our results demonstrate that VAE is a valuable addition to existing tools, particularly suited for unsupervised representation learning of resting state fMRI activity.

| S-EPMC8485214 | biostudies-literature

Active Sampling State Dynamically Enhances Olfactory Bulb Odor Representation.

Project description:The olfactory bulb (OB) is the first site of synaptic odor information processing, yet a wealth of contextual and learned information has been described in its activity. To investigate the mechanistic basis of contextual modulation, we use whole-cell recordings to measure odor responses across rapid learning episodes in identified mitral/tufted cells (MTCs). Across these learning episodes, diverse response changes occur already during the first sniff cycle. Motivated mice develop active sniffing strategies across learning that robustly correspond to the odor response changes, resulting in enhanced odor representation. Evoking fast sniffing in different behavioral states demonstrates that response changes during active sampling exceed those predicted from feedforward input alone. Finally, response changes are highly correlated in tufted cells, but not mitral cells, indicating there are cell-type-specific effects on odor representation during active sampling. Altogether, we show that active sampling is strongly associated with enhanced OB responsiveness on rapid timescales.

| S-EPMC6030445 | biostudies-literature

A Multidimensional Array Representation of State-Transition Model Dynamics.

Project description:Cost-effectiveness analyses often rely on cohort state-transition models (cSTMs). The cohort trace is the primary outcome of cSTMs, which captures the proportion of the cohort in each health state over time (state occupancy). However, the cohort trace is an aggregated measure that does not capture information about the specific transitions among health states (transition dynamics). In practice, these transition dynamics are crucial in many applications, such as incorporating transition rewards or computing various epidemiological outcomes that could be used for model calibration and validation (e.g., disease incidence and lifetime risk). In this article, we propose an alternative approach to compute and store cSTMs outcomes that capture both state occupancy and transition dynamics. This approach produces a multidimensional array from which both the state occupancy and the transition dynamics can be recovered. We highlight the advantages of the multidimensional array over the traditional cohort trace and provide potential applications of the proposed approach with an example coded in R to facilitate the implementation of our method.

| S-EPMC7065927 | biostudies-literature

Racial ideology, system justification, and just world belief in African Americans.

Project description:Just world belief and system justification have previously been proposed to explain actions and beliefs of disadvantaged groups, but rarely together and never simultaneously in participants of color. A necessary expansion of work in this area is among African-American participants with differing views of race and how those views influence justice perceptions. Racial ideologies, used in African-American racial identity research, were studied as possible predictors of belief in a just world and system justification scores. The four racial ideologies examined in this study are assimilationist, humanist, nationalist, and oppressed minority. The current study examines belief in a just world and system justification as predicted by racial ideology. Participants (n = 261) responded to an online survey containing racial ideology items from the Multidimensional Model of Racial Identity (MMRI), the General and Personal Just World Scales, and the General System Justification Survey. Hierarchical linear regression was conducted, finding that nationalist ideology significantly predicted system justification and general just world belief.

| S-EPMC10739316 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data