Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Learning and executing goal-directed choices by internally generated sequences in spiking neural circuits.

ABSTRACT: Recent neural ensemble recordings have established a link between goal-directed spatial decision making and internally generated neural sequences in the hippocampus of rats. To elucidate the synaptic mechanisms of these sequences underlying spatial decision making processes, we develop and investigate a spiking neural circuit model endowed with a combination of two synaptic plasticity mechanisms including spike-timing dependent plasticity (STDP) and synaptic scaling. In this model, the interplay of the combined synaptic plasticity mechanisms and network dynamics gives rise to neural sequences which propagate ahead of the animals' decision point to reach goal locations. The dynamical properties of these forward-sweeping sequences and the rates of correct binary choices executed by these sequences are quantitatively consistent with experimental observations; this consistency, however, is lost in our model when only one of STDP or synaptic scaling is included. We further demonstrate that such sequence-based decision making in our network model can adaptively respond to time-varying and probabilistic associations of cues and goal locations, and that our model performs as well as an optimal Kalman filter model. Our results thus suggest that the combination of plasticity phenomena on different timescales provides a candidate mechanism for forming internally generated neural sequences and for implementing adaptive spatial decision making.

SUBMITTER: Palmer J

PROVIDER: S-EPMC5552356 | biostudies-other | 2017 Jul

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Similar Datasets

Striatal Low-Threshold Spiking Interneurons Regulate Goal-Directed Learning.

Project description:The dorsomedial striatum (DMS) is critically involved in motor control and reward processing, but the specific neural circuit mediators are poorly understood. Recent evidence highlights the extensive connectivity of low-threshold spiking interneurons (LTSIs) within local striatal circuitry; however, the in vivo function of LTSIs remains largely unexplored. We employed fiber photometry to assess LTSI calcium activity in a range of DMS-mediated behaviors, uncovering specific reward-related activity that is down-modulated during goal-directed learning. Using two mechanistically distinct manipulations, we demonstrated that this down-modulation of LTSI activity is critical for acquisition of novel contingencies, but not for their modification. In contrast, continued LTSI activation slowed instrumental learning. Similar manipulations of fast-spiking interneurons did not reproduce these effects, implying a specific function of LTSIs. Finally, we revealed a role for the γ-aminobutyric acid (GABA)ergic functions of LTSIs in learning. Together, our data provide new insights into this striatal interneuron subclass as important gatekeepers of goal-directed learning.

| S-EPMC8487455 | biostudies-literature

Neural activity in cortico-basal ganglia circuits of juvenile songbirds encodes performance during goal-directed learning.

Project description:Cortico-basal ganglia circuits are thought to mediate goal-directed learning by a process of outcome evaluation to gradually select appropriate motor actions. We investigated spiking activity in core and shell subregions of the cortical nucleus LMAN during development as juvenile zebra finches are actively engaged in evaluating feedback of self-generated behavior in relation to their memorized tutor song (the goal). Spiking patterns of single neurons in both core and shell subregions during singing correlated with acoustic similarity to tutor syllables, suggesting a process of outcome evaluation. Both core and shell neurons encoded tutor similarity via either increases or decreases in firing rate, although only shell neurons showed a significant association at the population level. Tutor similarity predicted firing rates most strongly during early stages of learning, and shell but not core neurons showed decreases in response variability across development, suggesting that the activity of shell neurons reflects the progression of learning.

| S-EPMC5762157 | biostudies-literature

Hippocampal neural activity reflects the economy of choices during goal-directed navigation.

Project description:Distinguishing spatial contexts is likely essential for the well-known role of the hippocampus in episodic memory. We studied whether types of hippocampal neural organization thought to underlie context discrimination are impacted by learned economic considerations of choice behavior. Hippocampal place cells and theta activity were recorded as rats performed a maze-based probability discounting task that involved choosing between a small certain reward or a large probabilistic reward. Different spatial distributions of place fields were observed in response to changes in probability, the outcome of the rats' choice, and whether or not rats were free to make that choice. The degree to which the reward location was represented by place cells scaled with the expected probability of rewards. Theta power increased around the goal location also in proportion to the expected probability of signaled rewards. Furthermore, theta power dynamically varied as specific econometric information was obtained "on the fly" during task performance. Such an economic perspective of memory processing by hippocampal place cells expands our view of the nature of context memories retrieved by hippocampus during adaptive navigation.

| S-EPMC5479754 | biostudies-literature

Recurrent network model for learning goal-directed sequences through reverse replay.

Project description:Reverse replay of hippocampal place cells occurs frequently at rewarded locations, suggesting its contribution to goal-directed path learning. Symmetric spike-timing dependent plasticity (STDP) in CA3 likely potentiates recurrent synapses for both forward (start to goal) and reverse (goal to start) replays during sequential activation of place cells. However, how reverse replay selectively strengthens forward synaptic pathway is unclear. Here, we show computationally that firing sequences bias synaptic transmissions to the opposite direction of propagation under symmetric STDP in the co-presence of short-term synaptic depression or afterdepolarization. We demonstrate that significant biases are created in biologically realistic simulation settings, and this bias enables reverse replay to enhance goal-directed spatial memory on a W-maze. Further, we show that essentially the same mechanism works in a two-dimensional open field. Our model for the first time provides the mechanistic account for the way reverse replay contributes to hippocampal sequence learning for reward-seeking spatial navigation.

| S-EPMC6059768 | biostudies-literature

Neural correlates of goal-directed and non-goal-directed movements.

Project description:What are the cortical neural correlates that distinguish goal-directed and non-goal-directed movements? We investigated this question in the monkey frontal eye field (FEF), which is implicated in voluntary control of saccades. Here, we compared FEF activity associated with goal-directed (G) saccades and non-goal-directed (nG) saccades made by the monkey. Although the FEF neurons discharged before these nG saccades, there were three major differences in the neural activity: First, the variability in spike rate across trials decreased only for G saccades. Second, the local field potential beta-band power decreased during G saccades but did not change during nG saccades. Third, the time from saccade direction selection to the saccade onset was significantly longer for G saccades compared with nG saccades. Overall, our results reveal unexpected differences in neural signatures for G versus nG saccades in a brain area that has been implicated selectively in voluntary control. Taken together, these data add critical constraints to the way we think about saccade generation in the brain.

| S-EPMC8017686 | biostudies-literature

Learning Long Temporal Sequences in Spiking Networks by Multiplexing Neural Oscillations.

Project description:Many cognitive and behavioral tasks-such as interval timing, spatial navigation, motor control, and speech-require the execution of precisely-timed sequences of neural activation that cannot be fully explained by a succession of external stimuli. We show how repeatable and reliable patterns of spatiotemporal activity can be generated in chaotic and noisy spiking recurrent neural networks. We propose a general solution for networks to autonomously produce rich patterns of activity by providing a multi-periodic oscillatory signal as input. We show that the model accurately learns a variety of tasks, including speech generation, motor control, and spatial navigation. Further, the model performs temporal rescaling of natural spoken words and exhibits sequential neural activity commonly found in experimental data involving temporal processing. In the context of spatial navigation, the model learns and replays compressed sequences of place cells and captures features of neural activity such as the emergence of ripples and theta phase precession. Together, our findings suggest that combining oscillatory neuronal inputs with different frequencies provides a key mechanism to generate precisely timed sequences of activity in recurrent circuits of the brain.

| S-EPMC7505196 | biostudies-literature

Internally generated cell assembly sequences in the rat hippocampus.

Project description:A long-standing conjecture in neuroscience is that aspects of cognition depend on the brain's ability to self-generate sequential neuronal activity. We found that reliably and continually changing cell assemblies in the rat hippocampus appeared not only during spatial navigation but also in the absence of changing environmental or body-derived inputs. During the delay period of a memory task, each moment in time was characterized by the activity of a particular assembly of neurons. Identical initial conditions triggered a similar assembly sequence, whereas different conditions gave rise to different sequences, thereby predicting behavioral choices, including errors. Such sequences were not formed in control (nonmemory) tasks. We hypothesize that neuronal representations, evolved for encoding distance in spatial navigation, also support episodic recall and the planning of action sequences.

| S-EPMC2570043 | biostudies-literature

Deconstruction of Corticospinal Circuits for Goal-Directed Motor Skills.

Project description:Corticospinal neurons (CSNs) represent the direct cortical outputs to the spinal cord and play important roles in motor control across different species. However, their organizational principle remains unclear. By using a retrograde labeling system, we defined the requirement of CSNs in the execution of a skilled forelimb food-pellet retrieval task in mice. In vivo imaging of CSN activity during performance revealed the sequential activation of topographically ordered functional ensembles with moderate local mixing. Region-specific manipulations indicate that CSNs from caudal or rostral forelimb area control reaching or grasping, respectively, and both are required in the transitional pronation step. These region-specific CSNs terminate in different spinal levels and locations, therefore preferentially connecting with the premotor neurons of muscles engaged in different steps of the task. Together, our findings suggest that spatially defined groups of CSNs encode different movement modules, providing a logic for parallel-ordered corticospinal circuits to orchestrate multistep motor skills.

| S-EPMC5679421 | biostudies-literature

Brain mechanisms associated with internally directed attention and self-generated thought.

Project description:Internal cognition like imagination and prospection require sustained internally directed attention and involve self-generated thought. This fMRI study aimed to disentangle the brain mechanisms associated with attention-specific and task-specific processes during internally directed cognition. The direction of attention was manipulated by either keeping a relevant stimulus visible throughout the task, or by masking it, so that the task had to be performed "in the mind's eye". The level of self-directed thought was additionally varied between a convergent and a divergent thinking task. Internally directed attention was associated with increased activation in the right anterior inferior parietal lobe (aIPL), bilateral lingual gyrus and the cuneus, as well as with extended deactivations of superior parietal and occipital regions representing parts of the dorsal attention network. The right aIPL further showed increased connectivity with occipital regions suggesting an active top-down mechanism for shielding ongoing internal processes from potentially distracting sensory stimulation in terms of perceptual decoupling. Activation of the default network was not related to internally directed attention per se, but rather to a higher level of self-generated thought. The findings hence shed further light on the roles of inferior and superior parietal cortex for internally directed cognition.

| S-EPMC4785374 | biostudies-literature

Neural spiking for causal inference and learning.

Project description:When a neuron is driven beyond its threshold, it spikes. The fact that it does not communicate its continuous membrane potential is usually seen as a computational liability. Here we show that this spiking mechanism allows neurons to produce an unbiased estimate of their causal influence, and a way of approximating gradient descent-based learning. Importantly, neither activity of upstream neurons, which act as confounders, nor downstream non-linearities bias the results. We show how spiking enables neurons to solve causal estimation problems and that local plasticity can approximate gradient descent using spike discontinuity learning.

| S-EPMC10104331 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data