Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Prefrontal Cortex Predicts State Switches during Reversal Learning.

ABSTRACT: Reinforcement learning allows organisms to predict future outcomes and to update their beliefs about value in the world. The dorsal-lateral prefrontal cortex (dlPFC) integrates information carried by reward circuits, which can be used to infer the current state of the world under uncertainty. Here, we explored the dlPFC computations related to updating current beliefs during stochastic reversal learning. We recorded the activity of populations up to 1,000 neurons, simultaneously, in two male macaques while they executed a two-armed bandit reversal learning task. Behavioral analyses using a Bayesian framework showed that animals inferred reversals and switched their choice preference rapidly, rather than slowly updating choice values, consistent with state inference. Furthermore, dlPFC neural populations accurately encoded choice preference switches. These results suggest that prefrontal neurons dynamically encode decisions associated with Bayesian subjective values, highlighting the role of the PFC in representing a belief about the current state of the world.

SUBMITTER: Bartolo R

PROVIDER: S-EPMC7422923 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Prefrontal Cortex Predicts State Switches during Reversal Learning.

Bartolo Ramon R Averbeck Bruno B BB

Neuron 20200420 6

Reinforcement learning allows organisms to predict future outcomes and to update their beliefs about value in the world. The dorsal-lateral prefrontal cortex (dlPFC) integrates information carried by reward circuits, which can be used to infer the current state of the world under uncertainty. Here, we explored the dlPFC computations related to updating current beliefs during stochastic reversal learning. We recorded the activity of populations up to 1,000 neurons, simultaneously, in two male mac ...[more]

PMID: 32315603

Similar Datasets

Learning-induced plasticity in medial prefrontal cortex predicts preference malleability.

Project description:Learning induces plasticity in neuronal networks. As neuronal populations contribute to multiple representations, we reasoned plasticity in one representation might influence others. We used human fMRI repetition suppression to show that plasticity induced by learning another individual's values impacts upon a value representation for oneself in medial prefrontal cortex (mPFC), a plasticity also evident behaviorally in a preference shift. We show this plasticity is driven by a striatal "prediction error," signaling the discrepancy between the other's choice and a subject's own preferences. Thus, our data highlight that mPFC encodes agent-independent representations of subjective value, such that prediction errors simultaneously update multiple agents' value representations. As the resulting change in representational similarity predicts interindividual differences in the malleability of subjective preferences, our findings shed mechanistic light on complex human processes such as the powerful influence of social interaction on beliefs and preferences.

| S-EPMC4306543 | biostudies-literature

Ventromedial prefrontal cortex compression during concept learning.

Project description:Prefrontal cortex (PFC) is thought to support the ability to focus on goal-relevant information by filtering out irrelevant information, a process akin to dimensionality reduction. Here, we test this dimensionality reduction hypothesis by relating a data-driven approach to characterizing the complexity of neural representation with a theoretically-supported computational model of learning. We find evidence of goal-directed dimensionality reduction within human ventromedial PFC during learning. Importantly, by using computational predictions of each participant's attentional strategies during learning, we find that that the degree of neural compression predicts an individual's ability to selectively attend to concept-specific information. These findings suggest a domain-general mechanism of learning through compression in ventromedial PFC.

| S-EPMC6946809 | biostudies-literature

Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning.

Project description:During development, children improve in learning from feedback to adapt their behavior. However, it is still unclear which neural mechanisms might underlie these developmental changes. In the current study, we used a reinforcement learning model to investigate neurodevelopmental changes in the representation and processing of learning signals. Sixty-seven healthy volunteers between ages 8 and 22 (children: 8-11 years, adolescents: 13-16 years, and adults: 18-22 years) performed a probabilistic learning task while in a magnetic resonance imaging scanner. The behavioral data demonstrated age differences in learning parameters with a stronger impact of negative feedback on expected value in children. Imaging data revealed that the neural representation of prediction errors was similar across age groups, but functional connectivity between the ventral striatum and the medial prefrontal cortex changed as a function of age. Furthermore, the connectivity strength predicted the tendency to alter expectations after receiving negative feedback. These findings suggest that the underlying mechanisms of developmental changes in learning are not related to differences in the neural representation of learning signals per se but rather in how learning signals are used to guide behavior and expectations.

| S-EPMC6283353 | biostudies-literature

The dorsomedial prefrontal cortex prioritizes social learning during rest.

Project description:Sociality is a defining feature of the human experience: We rely on others to ensure survival and cooperate in complex social networks to thrive. Are there brain mechanisms that help ensure we quickly learn about our social world to optimally navigate it? We tested whether portions of the brain's default network engage "by default" to quickly prioritize social learning during the memory consolidation process. To test this possibility, participants underwent functional MRI (fMRI) while viewing scenes from the documentary film, Samsara. This film shows footage of real people and places from around the world. We normed the footage to select scenes that differed along the dimension of sociality, while matched on valence, arousal, interestingness, and familiarity. During fMRI, participants watched the "social" and "nonsocial" scenes, completed a rest scan, and a surprise recognition memory test. Participants showed superior social (vs. nonsocial) memory performance, and the social memory advantage was associated with neural pattern reinstatement during rest in the dorsomedial prefrontal cortex (DMPFC), a key node of the default network. Moreover, it was during early rest that DMPFC social pattern reinstatement was greatest and predicted subsequent social memory performance most strongly, consistent with the "prioritization" account. Results simultaneously update 1) theories of memory consolidation, which have not addressed how social information may be prioritized in the learning process, and 2) understanding of default network function, which remains to be fully characterized. More broadly, the results underscore the inherent human drive to understand our vastly social world.

| S-EPMC10962978 | biostudies-literature

Long-term learning transforms prefrontal cortex representations during working memory.

Project description:The role of the lateral prefrontal cortex (lPFC) in working memory (WM) is debated. Non-human primate (NHP) electrophysiology shows that the lPFC stores WM representations, but human neuroimaging suggests that the lPFC controls WM content in sensory cortices. These accounts are confounded by differences in task training and stimulus exposure. We tested whether long-term training alters lPFC function by densely sampling WM activity using functional MRI. Over 3 months, participants trained on both a WM and serial reaction time (SRT) task, wherein fractal stimuli were embedded within sequences. WM performance improved for trained (but not novel) fractals and, neurally, delay activity increased in distributed lPFC voxels across learning. Item-level WM representations became detectable within lPFC patterns, and lPFC activity reflected sequence relationships from the SRT task. These findings demonstrate that human lPFC develops stimulus-selective responses with learning, and WM representations are shaped by long-term experience, which could reconcile competing accounts of WM functioning.

| S-EPMC9768795 | biostudies-literature

Rapid plasticity in the prefrontal cortex during affective associative learning.

Project description:MultiCS conditioning is an affective associative learning paradigm, in which affective categories consist of many similar and complex stimuli. Comparing visual processing before and after learning, recent MultiCS conditioning studies using time-sensitive magnetoencephalography (MEG) revealed enhanced activation of prefrontal cortex (PFC) regions towards emotionally paired versus neutral stimuli already during short-latency processing stages (i.e., 50 to 80 ms after stimulus onset). The present study aimed at showing that this rapid differential activation develops as a function of the acquisition and not the extinction of the emotional meaning associated with affectively paired stimuli. MEG data of a MultiCS conditioning study were analyzed with respect to rapid changes in PFC activation towards aversively (electric shock) paired and unpaired faces that occurred during the learning of stimulus-reinforcer contingencies. Analyses revealed an increased PFC activation towards paired stimuli during 50 to 80 ms already during the acquisition of contingencies, which emerged after a single pairing with the electric shock. Corresponding changes in stimulus valence could be observed in ratings of hedonic valence, although participants did not seem to be aware of contingencies. These results suggest rapid formation and access of emotional stimulus meaning in the PFC as well as a great capacity for adaptive and highly resolving learning in the brain under challenging circumstances.

| S-EPMC4204938 | biostudies-literature

Anodal tDCS over the medial prefrontal cortex enhances behavioral adaptation after punishments during reversal learning through increased updating of unchosen choice options.

Project description:The medial prefrontal cortex (mPFC) is thought to be central for flexible behavioral adaptation. However, the causal relationship between mPFC activity and this behavior is incompletely understood. We investigated whether transcranial direct current stimulation (tDCS) over the mPFC alters flexible behavioral adaptation during reward-based decision-making, targeting Montreal Neurological Institute (MNI) coordinates X = -8, Y = 62, Z = 12, which has previously been associated with impaired behavioral adaptation in alcohol-dependent patients. Healthy human participants (n = 61) received either anodal (n = 30) or cathodal (n = 31) tDCS versus sham tDCS while performing a reversal learning task. To assess the mechanisms of reinforcement learning (RL) underlying our behavioral observations, we applied computational models that varied with respect to the updating of the unchosen choice option. We observed that anodal stimulation over the mPFC induced increased choice switching after punishments compared with sham stimulation, whereas cathodal stimulation showed no effect on participants' behavior compared with sham stimulation. RL revealed increased updating of the unchosen choice option under anodal as compared with sham stimulation, which accounted well for the increased tendency to switch after punishments. Our findings provide a potential model for tDCS interventions in conditions related to flexible behavioral adaptation, such as addiction.

| S-EPMC8874878 | biostudies-literature

Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex.

Project description:BackgroundCerebral cortical gamma-aminobutyric acidergic interneuron dysfunction is hypothesized to lead to cognitive deficits comorbid with human neuropsychiatric disorders, including schizophrenia, autism, and epilepsy. We have previously shown that mice that harbor mutations in the Plaur gene, which is associated with schizophrenia, have deficits in frontal cortical parvalbumin-expressing interneurons. Plaur mice have impaired reversal learning, similar to deficits observed in patients with schizophrenia.MethodsWe examined the role of parvalbumin interneurons in orbitofrontal cortex during reversal learning by recording single unit activity from 180 control and 224 Plaur mouse neurons during a serial reversal task. Neural activity was analyzed during correct and incorrect decision choices and reward receipt.ResultsNeurons in control mice exhibited strong phasic responses both during discrimination and reversal learning to decisions and rewards, and the strength of the response was correlated with behavioral performance. Although baseline firing was significantly enhanced in Plaur mice, neural selectivity for correct or erroneous decisions was diminished and not correlated with behavior, and reward encoding was downscaled. In addition, Plaur mice showed a significant reduction in the number of neurons that encoded expected outcomes across task phases during the decision period.ConclusionsThese data indicate that parvalbumin interneurons are necessary for the representation of outcomes in orbitofrontal cortex. Deficits in inhibition blunt selective neural firing during key decisions, contributing to behavioral inflexibility. These data provide a potential explanation for disorders of cognitive control that accompany the loss of these gamma-aminobutyric acidergic interneurons in human neuropsychiatric disorders, such as autism, epilepsy, and schizophrenia.

| S-EPMC4312743 | biostudies-literature

Prefrontal Cortex Networks Shift from External to Internal Modes during Learning.

Project description:UnlabelledAs we learn about items in our environment, their neural representations become increasingly enriched with our acquired knowledge. But there is little understanding of how network dynamics and neural processing related to external information changes as it becomes laden with "internal" memories. We sampled spiking and local field potential activity simultaneously from multiple sites in the lateral prefrontal cortex (PFC) and the hippocampus (HPC)-regions critical for sensory associations-of monkeys performing an object paired-associate learning task. We found that in the PFC, evoked potentials to, and neural information about, external sensory stimulation decreased while induced beta-band (∼11-27 Hz) oscillatory power and synchrony associated with "top-down" or internal processing increased. By contrast, the HPC showed little evidence of learning-related changes in either spiking activity or network dynamics. The results suggest that during associative learning, PFC networks shift their resources from external to internal processing.Significance statementAs we learn about items in our environment, their representations in our brain become increasingly enriched with our acquired "top-down" knowledge. We found that in the prefrontal cortex, but not the hippocampus, processing of external sensory inputs decreased while internal network dynamics related to top-down processing increased. The results suggest that during learning, prefrontal cortex networks shift their resources from external (sensory) to internal (memory) processing.

| S-EPMC5039250 | biostudies-literature

Thinning of the lateral prefrontal cortex during adolescence predicts emotion regulation in females.

Project description:Adolescence is a crucial period for the development of adaptive emotion regulation strategies. Despite the fact that structural maturation of the prefrontal cortex during adolescence is often assumed to underlie the maturation of emotion regulation strategies, no longitudinal studies have directly assessed this relationship. This study examined whether use of cognitive reappraisal strategies during late adolescence was predicted by (i) absolute prefrontal cortical thickness during early adolescence and (ii) structural maturation of the prefrontal cortex between early and mid-adolescence. Ninety-two adolescents underwent baseline and follow-up magnetic resonance imaging scans when they were aged approximately 12 and 16 years, respectively. FreeSurfer software was used to obtain cortical thickness estimates for three prefrontal regions [anterior cingulate cortex; dorsolateral prefrontal cortex (dlPFC); ventrolateral prefrontal cortex (vlPFC)]. The Emotion Regulation Questionnaire was completed when adolescents were aged approximately 19 years. Results showed that greater cortical thinning of the left dlPFC and left vlPFC during adolescence was significantly associated with greater use of cognitive reappraisal in females, though no such relationship was evident in males. Furthermore, baseline left dlPFC thickness predicted cognitive reappraisal at trend level. These findings suggest that cortical maturation may play a role in the development of adaptive emotion regulation strategies during adolescence.

| S-EPMC4221226 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data