Hippocampal remapping as hidden state inference.
Ontology highlight
ABSTRACT:
SUBMITTER: Sanders H
PROVIDER: S-EPMC7282808 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Midbrain dopamine neurons signal reward prediction error (RPE), or actual minus expected reward. The temporal difference (TD) learning model has been a cornerstone in understanding how dopamine RPEs could drive associative learning. Classically, TD learning imparts value to features that serially track elapsed time relative to observable stimuli. In the real world, however, sensory stimuli provide ambiguous information about the hidden state of the environment, leading to the proposal that TD learning might instead compute a value signal based on an inferred distribution of hidden states (a 'belief state'). Here we asked whether dopaminergic signaling supports a TD learning framework that operates over hidden states. We found that dopamine signaling showed a notable difference between two tasks that differed only with respect to whether reward was delivered in a deterministic manner. Our results favor an associative learning rule that combines cached values with hidden-state inference.
| S-EPMC5374025 | biostudies-literature
Project description:Making accurate decisions in uncertain environments requires identifying the generative cause of sensory cues, but also the expected outcomes of possible actions. Although both cognitive processes can be formalized as Bayesian inference, they are commonly studied using different experimental frameworks, making their formal comparison difficult. Here, by framing a reversal learning task either as cue-based or outcome-based inference, we found that humans perceive the same volatile environment as more stable when inferring its hidden state by interaction with uncertain outcomes than by observation of equally uncertain cues. Multivariate patterns of magnetoencephalographic (MEG) activity reflected this behavioral difference in the neural interaction between inferred beliefs and incoming evidence, an effect originating from associative regions in the temporal lobe. Together, these findings indicate that the degree of control over the sampling of volatile environments shapes human learning and decision-making under uncertainty.
| S-EPMC8044147 | biostudies-literature
Project description:Remapping refers to a decorrelation of hippocampal representations of similar spatial environments. While it has been speculated that remapping may contribute to the resolution of episodic memory interference in humans, direct evidence is surprisingly limited. We tested this idea using high-resolution, pattern-based fMRI analyses. Here we show that activity patterns in human CA3/dentate gyrus exhibit an abrupt, temporally-specific decorrelation of highly similar memory representations that is precisely coupled with behavioral expressions of successful learning. The magnitude of this learning-related decorrelation was predicted by the amount of pattern overlap during initial stages of learning, with greater initial overlap leading to stronger decorrelation. Finally, we show that remapped activity patterns carry relatively more information about learned episodic associations compared to competing associations, further validating the learning-related significance of remapping. Collectively, these findings establish a critical link between hippocampal remapping and episodic memory interference and provide insight into why remapping occurs.
| S-EPMC8355182 | biostudies-literature
Project description:Grid cells in the medial entorhinal cortex encode space with firing fields that are arranged on the nodes of spatial hexagonal lattices. Potential candidates to read out the space information of this grid code and to combine it with other sensory cues are hippocampal place cells. In this paper, we investigate a population of grid cells providing feed-forward input to place cells. The capacity of the underlying synaptic transformation is determined by both spatial acuity and the number of different spatial environments that can be represented. The codes for different environments arise from phase shifts of the periodical entorhinal cortex patterns that induce a global remapping of hippocampal place fields, i.e., a new random assignment of place fields for each environment. If only a single environment is encoded, the grid code can be read out at high acuity with only few place cells. A surplus in place cells can be used to store a space code for more environments via remapping. The number of stored environments can be increased even more efficiently by stronger recurrent inhibition and by partitioning the place cell population such that learning affects only a small fraction of them in each environment. We find that the spatial decoding acuity is much more resilient to multiple remappings than the sparseness of the place code. Since the hippocampal place code is sparse, we thus conclude that the projection from grid cells to the place cells is not using its full capacity to transfer space information. Both populations may encode different aspects of space.
| S-EPMC4256019 | biostudies-literature
Project description:The current dominant view of the hippocampus is that it is a navigation "device" guided by environmental inputs. Yet, a critical aspect of navigation is a sequence of planned, coordinated actions. We examined the role of action in the neuronal organization of the hippocampus by training rats to jump a gap on a linear track. Recording local field potentials and ensembles of single units in the hippocampus, we found that jumping produced a stereotypic behavior associated with consistent electrophysiological patterns, including phase reset of theta oscillations, predictable global firing-rate changes, and population vector shifts of hippocampal neurons. A subset of neurons ("jump cells") were systematically affected by the gap but only in one direction of travel. Novel place fields emerged and others were either boosted or attenuated by jumping, yet the theta spike phase versus animal position relationship remained unaltered. Thus, jumping involves an action plan for the animal to traverse the same route as without jumping, which is faithfully tracked by hippocampal neuronal activity.
| S-EPMC9245695 | biostudies-literature
Project description:Essential features of the world are often hidden and must be inferred by constructing internal models based on indirect evidence. Here, to study the mechanisms of inference, we establish a foraging task that is naturalistic and easily learned yet can distinguish inference from simpler strategies such as the direct integration of sensory data. We show that both mice and humans learn a strategy consistent with optimal inference of a hidden state. However, humans acquire this strategy more than an order of magnitude faster than mice. Using optogenetics in mice, we show that orbitofrontal and anterior cingulate cortex inactivation impacts task performance, but only orbitofrontal inactivation reverts mice from an inference-based to a stimulus-bound decision strategy. These results establish a cross-species paradigm for studying the problem of inference-based decision making and begins to dissect the network of brain regions crucial for its performance.
| S-EPMC7146546 | biostudies-literature
Project description:Neurons in navigational brain regions provide information about position, orientation, and speed relative to environmental landmarks. These cells also change their firing patterns ("remap") in response to changing contextual factors such as environmental cues, task conditions, and behavioral state, which influence neural activity throughout the brain. How can navigational circuits preserve their local computations while responding to global context changes? To investigate this question, we trained recurrent neural network models to track position in simple environments while at the same time reporting transiently-cued context changes. We show that these combined task constraints (navigation and context inference) produce activity patterns that are qualitatively similar to population-wide remapping in the entorhinal cortex, a navigational brain region. Furthermore, the models identify a solution that generalizes to more complex navigation and inference tasks. We thus provide a simple, general, and experimentally-grounded model of remapping as one neural circuit performing both navigation and context inference.
| S-EPMC9900889 | biostudies-literature
Project description:Aversive stimuli can cause hippocampal place cells to remap their firing fields, but it is not known whether remapping plays a role in storing memories of aversive experiences. Here, we addressed this question by performing in vivo calcium imaging of CA1 place cells in freely behaving rats (n = 14). Rats were first trained to prefer a short path over a long path for obtaining food reward, then trained to avoid the short path by delivering a mild footshock. Remapping was assessed by comparing place cell population vector similarity before acquisition versus after extinction of avoidance. Some rats received shock after systemic injections of the amnestic drug scopolamine at a dose (1 mg/kg) that impaired avoidance learning but spared spatial tuning and shock-evoked responses of CA1 neurons. Place cells remapped significantly more following remembered than forgotten shocks (drug-free versus scopolamine conditions); shock-induced remapping did not cause place fields to migrate toward or away from the shocked location and was similarly prevalent in cells that were responsive versus non-responsive to shocks. When rats were exposed to a neutral barrier rather than aversive shock, place cells remapped significantly less in response to the barrier. We conclude that place cell remapping occurs in response to events that are remembered rather than merely perceived and forgotten, suggesting that reorganization of hippocampal population codes may play a role in storing memories for aversive events.
| S-EPMC10368421 | biostudies-literature
Project description:The high storage capacity of the episodic memory system relies on distinct representations for events that are separated in time and space. The spatial component of these computations includes the formation of independent maps by hippocampal place cells across environments, referred to as global remapping. Such remapping is thought to emerge by the switching of input patterns from specialized spatially selective cells in medial entorhinal cortex (mEC), such as grid and border cells. Although it has been shown that acute manipulations of mEC firing patterns are sufficient for inducing hippocampal remapping, it remains unknown whether specialized spatial mEC inputs are necessary for the reorganization of hippocampal spatial representations. Here, we examined remapping in rats without mEC input to the hippocampus and found that highly distinct spatial maps emerged rapidly in every individual rat. Our data suggest that hippocampal spatial computations do not depend on inputs from specialized cell types in mEC.
| S-EPMC5929481 | biostudies-literature
Project description:Hidden Markov models (HMMs) are one of the most widely used statistical methods for analyzing sequence data. However, the reporting of output from HMMs has largely been restricted to the presentation of the most-probable (MAP) hidden state sequence, found via the Viterbi algorithm, or the sequence of most probable marginals using the forward-backward algorithm. In this article, we expand the amount of information we could obtain from the posterior distribution of an HMM by introducing linear-time dynamic programming recursions that, conditional on a user-specified constraint in the number of segments, allow us to (i) find MAP sequences, (ii) compute posterior probabilities, and (iii) simulate sample paths. We collectively call these recursions k-segment algorithms and illustrate their utility using simulated and real examples. We also highlight the prospective and retrospective use of k-segment constraints for fitting HMMs or exploring existing model fits. Supplementary materials for this article are available online.
| S-EPMC4867884 | biostudies-other