Browse
Submit Data
Databases
API
Help

Dataset Information

19 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Interacting with volatile environments stabilizes hidden-state inference and its brain signatures.

ABSTRACT: Making accurate decisions in uncertain environments requires identifying the generative cause of sensory cues, but also the expected outcomes of possible actions. Although both cognitive processes can be formalized as Bayesian inference, they are commonly studied using different experimental frameworks, making their formal comparison difficult. Here, by framing a reversal learning task either as cue-based or outcome-based inference, we found that humans perceive the same volatile environment as more stable when inferring its hidden state by interaction with uncertain outcomes than by observation of equally uncertain cues. Multivariate patterns of magnetoencephalographic (MEG) activity reflected this behavioral difference in the neural interaction between inferred beliefs and incoming evidence, an effect originating from associative regions in the temporal lobe. Together, these findings indicate that the degree of control over the sampling of volatile environments shapes human learning and decision-making under uncertainty.

SUBMITTER: Weiss A

PROVIDER: S-EPMC8044147 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Hippocampal remapping as hidden state inference.

Project description:Cells in the hippocampus tuned to spatial location (place cells) typically change their tuning when an animal changes context, a phenomenon known as remapping. A fundamental challenge to understanding remapping is the fact that what counts as a ''context change'' has never been precisely defined. Furthermore, different remapping phenomena have been classified on the basis of how much the tuning changes after different types and degrees of context change, but the relationship between these variables is not clear. We address these ambiguities by formalizing remapping in terms of hidden state inference. According to this view, remapping does not directly reflect objective, observable properties of the environment, but rather subjective beliefs about the hidden state of the environment. We show how the hidden state framework can resolve a number of puzzles about the nature of remapping.

| S-EPMC7282808 | biostudies-literature

Dopamine reward prediction errors reflect hidden-state inference across time.

Project description:Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a 'belief state'). Here we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling showed a notable difference between two tasks that differed only with respect to whether reward was delivered in a deterministic manner. Our results favor an associative learning rule that combines cached values with hidden-state inference.

| S-EPMC5374025 | biostudies-literature

Inference-Based Decisions in a Hidden State Foraging Task: Differential Contributions of Prefrontal Cortical Areas.

Project description:Essential features of the world are often hidden and must be inferred by constructing internal models based on indirect evidence. Here, to study the mechanisms of inference, we establish a foraging task that is naturalistic and easily learned yet can distinguish inference from simpler strategies such as the direct integration of sensory data. We show that both mice and humans learn a strategy consistent with optimal inference of a hidden state. However, humans acquire this strategy more than an order of magnitude faster than mice. Using optogenetics in mice, we show that orbitofrontal and anterior cingulate cortex inactivation impacts task performance, but only orbitofrontal inactivation reverts mice from an inference-based to a stimulus-bound decision strategy. These results establish a cross-species paradigm for studying the problem of inference-based decision making and begins to dissect the network of brain regions crucial for its performance.

| S-EPMC7146546 | biostudies-literature

Electrophysiological signatures of resting state networks in the human brain.

Project description:Functional neuroimaging and electrophysiological studies have documented a dynamic baseline of intrinsic (not stimulus- or task-evoked) brain activity during resting wakefulness. This baseline is characterized by slow (<0.1 Hz) fluctuations of functional imaging signals that are topographically organized in discrete brain networks, and by much faster (1-80 Hz) electrical oscillations. To investigate the relationship between hemodynamic and electrical oscillations, we have adopted a completely data-driven approach that combines information from simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Using independent component analysis on the fMRI data, we identified six widely distributed resting state networks. The blood oxygenation level-dependent signal fluctuations associated with each network were correlated with the EEG power variations of delta, theta, alpha, beta, and gamma rhythms. Each functional network was characterized by a specific electrophysiological signature that involved the combination of different brain rhythms. Moreover, the joint EEG/fMRI analysis afforded a finer physiological fractionation of brain networks in the resting human brain. This result supports for the first time in humans the coalescence of several brain rhythms within large-scale brain networks as suggested by biophysical studies.

| S-EPMC1941820 | biostudies-other

Modelling state-transition dynamics in resting-state brain signals by the hidden Markov and Gaussian mixture models.

Project description:Recent studies have proposed that one can summarize brain activity into dynamics among a relatively small number of hidden states and that such an approach is a promising tool for revealing brain function. Hidden Markov models (HMMs) are a prevalent approach to inferring such neural dynamics among discrete brain states. However, the impact of assuming Markovian structure in neural time series data has not been sufficiently examined. Here, to address this situation and examine the performance of the HMM, we compare the model with the Gaussian mixture model (GMM), which is with no temporal regularization and thus a statistically simpler model than the HMM, by applying both models to synthetic time series generated from empirical resting-state functional magnetic resonance imaging (fMRI) data. We compared the GMM and HMM for various sampling frequencies, lengths of recording per participant, numbers of participants and numbers of independent component signals. We find that the HMM attains a better accuracy of estimating the hidden state than the GMM in a majority of cases. However, we also find that the accuracy of the GMM is comparable to that of the HMM under the condition that the sampling frequency is reasonably low (e.g., TR = 2.88 or 3.60 s) or the data are relatively short. These results suggest that the GMM can be a viable alternative to the HMM for investigating hidden-state dynamics under this condition.

| S-EPMC9291560 | biostudies-literature

Uncovering hidden brain state dynamics that regulate performance and decision-making during cognition.

Project description:Human cognition is influenced not only by external task demands but also latent mental processes and brain states that change over time. Here, we use novel Bayesian switching dynamical systems algorithm to identify hidden brain states and determine that these states are only weakly aligned with external task conditions. We compute state transition probabilities and demonstrate how dynamic transitions between hidden states allow flexible reconfiguration of functional brain circuits. Crucially, we identify latent transient brain states and dynamic functional circuits that are optimal for cognition and show that failure to engage these states in a timely manner is associated with poorer task performance and weaker decision-making dynamics. We replicate findings in a large sample (N?=?122) and reveal a robust link between cognition and flexible latent brain state dynamics. Our study demonstrates the power of switching dynamical systems models for investigating hidden dynamic brain states and functional interactions underlying human cognition.

| S-EPMC6021386 | biostudies-literature

Dilated cardiomyopathy mutation E525K in human beta-cardiac myosin stabilizes the interacting-heads motif and super-relaxed state of myosin.

Project description:The auto-inhibited, super-relaxed (SRX) state of cardiac myosin is thought to be crucial for regulating contraction, relaxation, and energy conservation in the heart. We used single ATP turnover experiments to demonstrate that a dilated cardiomyopathy (DCM) mutation (E525K) in human beta-cardiac myosin increases the fraction of myosin heads in the SRX state (with slow ATP turnover), especially in physiological ionic strength conditions. We also utilized FRET between a C-terminal GFP tag on the myosin tail and Cy3ATP bound to the active site of the motor domain to estimate the fraction of heads in the closed, interacting-heads motif (IHM); we found a strong correlation between the IHM and SRX state. Negative stain electron microscopy and 2D class averaging of the construct demonstrated that the E525K mutation increased the fraction of molecules adopting the IHM. Overall, our results demonstrate that the E525K DCM mutation may reduce muscle force and power by stabilizing the auto-inhibited SRX state. Our studies also provide direct evidence for a correlation between the SRX biochemical state and the IHM structural state in cardiac muscle myosin. Furthermore, the E525 residue may be implicated in crucial electrostatic interactions that modulate this conserved, auto-inhibited conformation of myosin.

| S-EPMC9691020 | biostudies-literature

Statistical Inference in Hidden Markov Models Using k-Segment Constraints.

Project description:Hidden Markov models (HMMs) are one of the most widely used statistical methods for analyzing sequence data. However, the reporting of output from HMMs has largely been restricted to the presentation of the most-probable (MAP) hidden state sequence, found via the Viterbi algorithm, or the sequence of most probable marginals using the forward-backward algorithm. In this article, we expand the amount of information we could obtain from the posterior distribution of an HMM by introducing linear-time dynamic programming recursions that, conditional on a user-specified constraint in the number of segments, allow us to (i) find MAP sequences, (ii) compute posterior probabilities, and (iii) simulate sample paths. We collectively call these recursions k-segment algorithms and illustrate their utility using simulated and real examples. We also highlight the prospective and retrospective use of k-segment constraints for fitting HMMs or exploring existing model fits. Supplementary materials for this article are available online.

| S-EPMC4867884 | biostudies-other

DOUBLY DEBIASED LASSO: HIGH-DIMENSIONAL INFERENCE UNDER HIDDEN CONFOUNDING.

Project description:Inferring causal relationships or related associations from observational data can be invalidated by the existence of hidden confounding. We focus on a high-dimensional linear regression setting, where the measured covariates are affected by hidden confounding and propose the Doubly Debiased Lasso estimator for individual components of the regression coefficient vector. Our advocated method simultaneously corrects both the bias due to estimation of high-dimensional parameters as well as the bias caused by the hidden confounding. We establish its asymptotic normality and also prove that it is efficient in the Gauss-Markov sense. The validity of our methodology relies on a dense confounding assumption, i.e. that every confounding variable affects many covariates. The finite sample performance is illustrated with an extensive simulation study and a genomic application.

| S-EPMC9365063 | biostudies-literature

A simple model for learning in volatile environments.

Project description:Sound principles of statistical inference dictate that uncertainty shapes learning. In this work, we revisit the question of learning in volatile environments, in which both the first and second-order statistics of observations dynamically evolve over time. We propose a new model, the volatile Kalman filter (VKF), which is based on a tractable state-space model of uncertainty and extends the Kalman filter algorithm to volatile environments. The proposed model is algorithmically simple and encompasses the Kalman filter as a special case. Specifically, in addition to the error-correcting rule of Kalman filter for learning observations, the VKF learns volatility according to a second error-correcting rule. These dual updates echo and contextualize classical psychological models of learning, in particular hybrid accounts of Pearce-Hall and Rescorla-Wagner. At the computational level, compared with existing models, the VKF gives up some flexibility in the generative model to enable a more faithful approximation to exact inference. When fit to empirical data, the VKF is better behaved than alternatives and better captures human choice data in two independent datasets of probabilistic learning tasks. The proposed model provides a coherent account of learning in stable or volatile environments and has implications for decision neuroscience research.

| S-EPMC7329063 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data