Prefrontal Cortex Predicts State Switches during Reversal Learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Bartolo R
PROVIDER: S-EPMC7422923 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Prefrontal cortex (PFC) is thought to support the ability to focus on goal-relevant information by filtering out irrelevant information, a process akin to dimensionality reduction. Here, we test this dimensionality reduction hypothesis by relating a data-driven approach to characterizing the complexity of neural representation with a theoretically-supported computational model of learning. We find evidence of goal-directed dimensionality reduction within human ventromedial PFC during learning. Importantly, by using computational predictions of each participant's attentional strategies during learning, we find that that the degree of neural compression predicts an individual's ability to selectively attend to concept-specific information. These findings suggest a domain-general mechanism of learning through compression in ventromedial PFC.
| S-EPMC6946809 | biostudies-literature
Project description:Learning induces plasticity in neuronal networks. As neuronal populations contribute to multiple representations, we reasoned plasticity in one representation might influence others. We used human fMRI repetition suppression to show that plasticity induced by learning another individual's values impacts upon a value representation for oneself in medial prefrontal cortex (mPFC), a plasticity also evident behaviorally in a preference shift. We show this plasticity is driven by a striatal "prediction error," signaling the discrepancy between the other's choice and a subject's own preferences. Thus, our data highlight that mPFC encodes agent-independent representations of subjective value, such that prediction errors simultaneously update multiple agents' value representations. As the resulting change in representational similarity predicts interindividual differences in the malleability of subjective preferences, our findings shed mechanistic light on complex human processes such as the powerful influence of social interaction on beliefs and preferences.
| S-EPMC4306543 | biostudies-literature
Project description:During development, children improve in learning from feedback to adapt their behavior. However, it is still unclear which neural mechanisms might underlie these developmental changes. In the current study, we used a reinforcement learning model to investigate neurodevelopmental changes in the representation and processing of learning signals. Sixty-seven healthy volunteers between ages 8 and 22 (children: 8-11 years, adolescents: 13-16 years, and adults: 18-22 years) performed a probabilistic learning task while in a magnetic resonance imaging scanner. The behavioral data demonstrated age differences in learning parameters with a stronger impact of negative feedback on expected value in children. Imaging data revealed that the neural representation of prediction errors was similar across age groups, but functional connectivity between the ventral striatum and the medial prefrontal cortex changed as a function of age. Furthermore, the connectivity strength predicted the tendency to alter expectations after receiving negative feedback. These findings suggest that the underlying mechanisms of developmental changes in learning are not related to differences in the neural representation of learning signals per se but rather in how learning signals are used to guide behavior and expectations.
| S-EPMC6283353 | biostudies-literature
Project description:MultiCS conditioning is an affective associative learning paradigm, in which affective categories consist of many similar and complex stimuli. Comparing visual processing before and after learning, recent MultiCS conditioning studies using time-sensitive magnetoencephalography (MEG) revealed enhanced activation of prefrontal cortex (PFC) regions towards emotionally paired versus neutral stimuli already during short-latency processing stages (i.e., 50 to 80 ms after stimulus onset). The present study aimed at showing that this rapid differential activation develops as a function of the acquisition and not the extinction of the emotional meaning associated with affectively paired stimuli. MEG data of a MultiCS conditioning study were analyzed with respect to rapid changes in PFC activation towards aversively (electric shock) paired and unpaired faces that occurred during the learning of stimulus-reinforcer contingencies. Analyses revealed an increased PFC activation towards paired stimuli during 50 to 80 ms already during the acquisition of contingencies, which emerged after a single pairing with the electric shock. Corresponding changes in stimulus valence could be observed in ratings of hedonic valence, although participants did not seem to be aware of contingencies. These results suggest rapid formation and access of emotional stimulus meaning in the PFC as well as a great capacity for adaptive and highly resolving learning in the brain under challenging circumstances.
| S-EPMC4204938 | biostudies-literature
Project description:Stress can precipitate or worsen symptoms of many psychiatric illnesses. Dysregulation of the prefrontal cortex (PFC) glutamate system may underlie these disruptions and restoring PFC glutamate signaling has emerged as a promising avenue for the treatment of stress disorders. Recently, we demonstrated that activation of metabotropic glutamate receptor subtype 3 (mGlu3) induces a postsynaptic form of long-term depression (LTD) that is dependent on the activity of another subtype, mGlu5. Stress exposure disrupted this plasticity, but the underlying signaling mechanisms and involvement in higher-order cognition have not yet been investigated. Acute stress was applied by 20-min restraint and early reversal learning was evaluated in an operant-based food-seeking task. We employed whole-cell patch-clamp recordings of layer 5 prelimbic (PL)-PFC pyramidal cells to examine mGlu3-LTD and several mechanistically distinct mGlu5-dependent functions. Acute stress impaired both mGlu3-LTD and early reversal learning. Interestingly, potentiating mGlu5 signaling with the mGlu5 positive allosteric modulator (PAM) VU0409551 rescued stress-induced deficits in both mGlu3-LTD and reversal learning. Other aspects of PL-PFC mGlu5 function were not disrupted following stress; however, signaling downstream of mGlu5-Homer interactions, phosphoinositide-3-kinase (PI3K), Akt, and glycogen synthase kinase 3? was implicated in these phenomena. These findings demonstrate that acute stress disrupts early reversal learning and PL-PFC-dependent synaptic plasticity and that potentiating mGlu5 function can restore these impairments. These findings provide a framework through which modulating coordinated mGlu3/mGlu5 signaling may confer benefits for the treatment of stress-related psychiatric disorders.
| S-EPMC6286225 | biostudies-literature
Project description:Cerebral cortical gamma-aminobutyric acidergic interneuron dysfunction is hypothesized to lead to cognitive deficits comorbid with human neuropsychiatric disorders, including schizophrenia, autism, and epilepsy. We have previously shown that mice that harbor mutations in the Plaur gene, which is associated with schizophrenia, have deficits in frontal cortical parvalbumin-expressing interneurons. Plaur mice have impaired reversal learning, similar to deficits observed in patients with schizophrenia.We examined the role of parvalbumin interneurons in orbitofrontal cortex during reversal learning by recording single unit activity from 180 control and 224 Plaur mouse neurons during a serial reversal task. Neural activity was analyzed during correct and incorrect decision choices and reward receipt.Neurons in control mice exhibited strong phasic responses both during discrimination and reversal learning to decisions and rewards, and the strength of the response was correlated with behavioral performance. Although baseline firing was significantly enhanced in Plaur mice, neural selectivity for correct or erroneous decisions was diminished and not correlated with behavior, and reward encoding was downscaled. In addition, Plaur mice showed a significant reduction in the number of neurons that encoded expected outcomes across task phases during the decision period.These data indicate that parvalbumin interneurons are necessary for the representation of outcomes in orbitofrontal cortex. Deficits in inhibition blunt selective neural firing during key decisions, contributing to behavioral inflexibility. These data provide a potential explanation for disorders of cognitive control that accompany the loss of these gamma-aminobutyric acidergic interneurons in human neuropsychiatric disorders, such as autism, epilepsy, and schizophrenia.
| S-EPMC4312743 | biostudies-literature
Project description:As we learn about items in our environment, their neural representations become increasingly enriched with our acquired knowledge. But there is little understanding of how network dynamics and neural processing related to external information changes as it becomes laden with "internal" memories. We sampled spiking and local field potential activity simultaneously from multiple sites in the lateral prefrontal cortex (PFC) and the hippocampus (HPC)-regions critical for sensory associations-of monkeys performing an object paired-associate learning task. We found that in the PFC, evoked potentials to, and neural information about, external sensory stimulation decreased while induced beta-band (?11-27 Hz) oscillatory power and synchrony associated with "top-down" or internal processing increased. By contrast, the HPC showed little evidence of learning-related changes in either spiking activity or network dynamics. The results suggest that during associative learning, PFC networks shift their resources from external to internal processing.As we learn about items in our environment, their representations in our brain become increasingly enriched with our acquired "top-down" knowledge. We found that in the prefrontal cortex, but not the hippocampus, processing of external sensory inputs decreased while internal network dynamics related to top-down processing increased. The results suggest that during learning, prefrontal cortex networks shift their resources from external (sensory) to internal (memory) processing.
| S-EPMC5039250 | biostudies-literature
Project description:Adolescence is a crucial period for the development of adaptive emotion regulation strategies. Despite the fact that structural maturation of the prefrontal cortex during adolescence is often assumed to underlie the maturation of emotion regulation strategies, no longitudinal studies have directly assessed this relationship. This study examined whether use of cognitive reappraisal strategies during late adolescence was predicted by (i) absolute prefrontal cortical thickness during early adolescence and (ii) structural maturation of the prefrontal cortex between early and mid-adolescence. Ninety-two adolescents underwent baseline and follow-up magnetic resonance imaging scans when they were aged approximately 12 and 16 years, respectively. FreeSurfer software was used to obtain cortical thickness estimates for three prefrontal regions [anterior cingulate cortex; dorsolateral prefrontal cortex (dlPFC); ventrolateral prefrontal cortex (vlPFC)]. The Emotion Regulation Questionnaire was completed when adolescents were aged approximately 19 years. Results showed that greater cortical thinning of the left dlPFC and left vlPFC during adolescence was significantly associated with greater use of cognitive reappraisal in females, though no such relationship was evident in males. Furthermore, baseline left dlPFC thickness predicted cognitive reappraisal at trend level. These findings suggest that cortical maturation may play a role in the development of adaptive emotion regulation strategies during adolescence.
| S-EPMC4221226 | biostudies-literature
Project description:Functional connectivity between the prefrontal cortex (PFC) and striatum (STR) is thought critical for cognition and has been linked to conditions like autism and schizophrenia. We recorded from multiple electrodes in PFC and STR while monkeys acquired new categories. Category learning was accompanied by an increase in beta band synchronization of LFPs between, but not within, the PFC and STR. After learning, different pairs of PFC-STR electrodes showed stronger synchrony for one or the other category, suggesting category-specific functional circuits. This category-specific synchrony was also seen between PFC spikes and STR LFPs, but not the reverse, reflecting the direct monosynaptic connections from the PFC to STR. However, causal connectivity analyses suggested that the polysynaptic connections from STR to the PFC exerted a stronger overall influence. This supports models positing that the basal ganglia "train" the PFC. Category learning may depend on the formation of functional circuits between the PFC and STR.
| S-EPMC4098789 | biostudies-literature
Project description:Communication between cortical and subcortical regions is integral to a wide range of psychological processes and has been implicated in a number of psychiatric conditions. Studies in animals have provided insight into the biochemical and connectivity processes underlying such communication. However, to date no experiments that link these factors in humans in vivo have been carried out. To investigate the role of glutamate in individual differences in communication between the cortex--specifically the medial prefrontal cortex (mPFC)--and subcortical regions in humans, a combination of resting-state fMRI, DTI and MRS was performed. The subcortical target regions were the nucleus accumbens (NAc), dorsomedial thalamus (DMT), and periaqueductal grey (PAG). It was found that functional connectivity between the mPFC and each of the NAc and DMT was positively correlated with mPFC glutamate concentrations, whilst functional connectivity between the mPFC and PAG was negatively correlated with glutamate concentration. The correlations involving mPFC glutamate and FC between the mPFC and each of the DMT and PAG were mirrored by correlations with structural connectivity, providing evidence that the glutamatergic relationship may, in part, be due to direct connectivity. These results are in agreement with existing results from animal studies and may have relevance for MDD and schizophrenia.
| S-EPMC3616113 | biostudies-literature