Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Volatility Facilitates Value Updating in the Prefrontal Cortex.

ABSTRACT: Adaptation of learning and decision-making might depend on the regulation of activity in the prefrontal cortex. Here we examined how volatility of reward probabilities influences learning and neural activity in the primate prefrontal cortex. We found that animals selected recently rewarded targets more often when reward probabilities of different options fluctuated across trials than when they were fixed. Additionally, neurons in the orbitofrontal cortex displayed more sustained activity related to the outcomes of their previous choices when reward probabilities changed over time. Such volatility also enhanced signals in the dorsolateral prefrontal cortex related to the current but not the previous location of the previously rewarded target. These results suggest that prefrontal activity related to choice and reward is dynamically regulated by the volatility of the environment and underscore the role of the prefrontal cortex in identifying aspects of the environment that are responsible for previous outcomes and should be learned.

SUBMITTER: Massi B

PROVIDER: S-EPMC6085887 | biostudies-literature | 2018 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Volatility Facilitates Value Updating in the Prefrontal Cortex.

Massi Bart B Donahue Christopher H CH Lee Daeyeol D

Neuron 20180719 3

Adaptation of learning and decision-making might depend on the regulation of activity in the prefrontal cortex. Here we examined how volatility of reward probabilities influences learning and neural activity in the primate prefrontal cortex. We found that animals selected recently rewarded targets more often when reward probabilities of different options fluctuated across trials than when they were fixed. Additionally, neurons in the orbitofrontal cortex displayed more sustained activity related ...[more]

PMID: 30033151

Similar Datasets

Retrieval practice facilitates memory updating by enhancing and differentiating medial prefrontal cortex representations.

Project description:Updating old memories with new, more current information is critical for human survival, yet the neural mechanisms for memory updating in general and the effect of retrieval practice in particular are poorly understood. Using a three-day A-B/A-C memory updating paradigm, we found that compared to restudy, retrieval practice could strengthen new A-C memories and reduce old A-B memory intrusion, but did not suppress A-B memories. Neural activation pattern analysis revealed that compared to restudy, retrieval practice led to stronger target representation in the medial prefrontal cortex (MPFC) during the final test. Critically, it was only under the retrieval practice condition that the MPFC showed strong and comparable competitor evidence for both correct and incorrect trials during final test, and that the MPFC target representation during updating was predictive of subsequent memory. These results suggest that retrieval practice is able to facilitate memory updating by strongly engaging MPFC mechanisms in memory integration, differentiation and consolidation.

| S-EPMC7272192 | biostudies-literature

Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating.

Project description:Two ideas have dominated neuropsychology concerning the orbitofrontal cortex (OFC). One holds that OFC regulates emotion and enhances behavioral flexibility through inhibitory control. The other ascribes to OFC a role in updating valuations on the basis of current motivational states. Neuroimaging, neurophysiological and clinical observations are consistent with either or both hypotheses. Although these hypotheses are compatible in principle, we present results supporting the latter view of OFC function and arguing against the former. We found that excitotoxic, fiber-sparing lesions confined to OFC in monkeys did not alter either behavioral flexibility, as measured by object reversal learning, or emotion regulation, as assessed by fear of snakes. A follow-up experiment indicated that a previously reported loss of inhibitory control resulted from damage to nearby fiber tracts and not from OFC dysfunction. Thus, OFC has a more specialized role in reward-guided behavior and emotion than has been thought, a function that includes value updating.

| S-EPMC3733248 | biostudies-literature

Context value updating and multidimensional neuronal encoding in the retrosplenial cortex.

Project description:The retrosplenial cortex (RSC) has diverse functional inputs and is engaged by various sensory, spatial, and associative learning tasks. We examine how multiple functional aspects are integrated on the single-cell level in the RSC and how the encoding of task-related parameters changes across learning. Using a visuospatial context discrimination paradigm and two-photon calcium imaging in behaving mice, a large proportion of dysgranular RSC neurons was found to encode multiple task-related dimensions while forming context-value associations across learning. During reversal learning requiring increased cognitive flexibility, we revealed an increased proportion of multidimensional encoding neurons that showed higher decoding accuracy for behaviorally relevant context-value associations. Chemogenetic inactivation of RSC led to decreased behavioral context discrimination during learning phases in which context-value associations were formed, while recall of previously formed associations remained intact. RSC inactivation resulted in a persistent positive behavioral bias in valuing contexts, indicating a role for the RSC in context-value updating.

| S-EPMC8523535 | biostudies-literature

Role of prefrontal cortex and the midbrain dopamine system in working memory updating.

Project description:Humans are adept at switching between goal-directed behaviors quickly and effectively. The prefrontal cortex (PFC) is thought to play a critical role by encoding, updating, and maintaining internal representations of task context in working memory. It has also been hypothesized that the encoding of context representations in PFC is regulated by phasic dopamine gating signals. Here we use multimodal methods to test these hypotheses. First we used functional MRI (fMRI) to identify regions of PFC associated with the representation of context in a working memory task. Next we used single-pulse transcranial magnetic stimulation (TMS), guided spatially by our fMRI findings and temporally by previous event-related EEG recordings, to disrupt context encoding while participants performed the same working memory task. We found that TMS pulses to the right dorsolateral PFC (DLPFC) immediately after context presentation, and well in advance of the response, adversely impacted context-dependent relative to context-independent responses. This finding causally implicates right DLPFC function in context encoding. Finally, using the same paradigm, we conducted high-resolution fMRI measurements in brainstem dopaminergic nuclei (ventral tegmental area and substantia nigra) and found phasic responses after presentation of context stimuli relative to other stimuli, consistent with the timing of a gating signal that regulates the encoding of representations in PFC. Furthermore, these responses were positively correlated with behavior, as well as with responses in the same region of right DLPFC targeted in the TMS experiment, lending support to the hypothesis that dopamine phasic signals regulate encoding, and thereby the updating, of context representations in PFC.

| S-EPMC3523834 | biostudies-other

Subjective value then confidence in human ventromedial prefrontal cortex.

Project description:Two fundamental goals of decision making are to select actions that maximize rewards while minimizing costs and to have strong confidence in the accuracy of a judgment. Neural signatures of these two forms of value: the subjective value (SV) of choice alternatives and the value of the judgment (confidence), have both been observed in ventromedial prefrontal cortex (vmPFC). However, the relationship between these dual value signals and their relative time courses are unknown. Twenty-eight men and women underwent fMRI while performing a two-phase approach-avoidance (Ap-Av) task with mixed-outcomes of monetary rewards paired with painful shock stimuli. Neural responses were measured during offer valuation (offer phase) and choice valuation (commit phase) and analyzed with respect to observed decision outcomes, model-estimated SV and confidence. During the offer phase, vmPFC tracked SV and the decision but not confidence. During the commit phase, vmPFC tracked confidence, computed as the quadratic extension of SV, but not the offer valuation nor the decision. In fact, vmPFC responses from the commit phase were selective for confidence even for reject decisions wherein confidence and SV are inversely related. Conversely, activation of the cognitive control network, including within lateral prefrontal cortex (lPFC) and dorsal anterior cingulate cortex (dACC) was associated with ambivalence, during both the offer and commit phases. Taken together, our results reveal complementary representations in vmPFC during value-based decision making that temporally dissociate such that offer valuation (SV) emerges before decision valuation (confidence).

| S-EPMC7010285 | biostudies-literature

Risk-dependent reward value signal in human prefrontal cortex.

Project description:When making choices under uncertainty, people usually consider both the expected value and risk of each option, and choose the one with the higher utility. Expected value increases the expected utility of an option for all individuals. Risk increases the utility of an option for risk-seeking individuals, but decreases it for risk averse individuals. In 2 separate experiments, one involving imperative (no-choice), the other choice situations, we investigated how predicted risk and expected value aggregate into a common reward signal in the human brain. Blood oxygen level dependent responses in lateral regions of the prefrontal cortex increased monotonically with increasing reward value in the absence of risk in both experiments. Risk enhanced these responses in risk-seeking participants, but reduced them in risk-averse participants. The aggregate value and risk responses in lateral prefrontal cortex contrasted with pure value signals independent of risk in the striatum. These results demonstrate an aggregate risk and value signal in the prefrontal cortex that would be compatible with basic assumptions underlying the mean-variance approach to utility.

| S-EPMC2678436 | biostudies-literature

Prefrontal cortex encodes value pop-out in visual search.

Project description:Recent evidence demonstrates that long-term object value association can enhance visual search efficiency, a phenomenon known as value pop-out. However, the neural mechanism underlying this effect is not fully understood. Given the known role of the ventrolateral prefrontal cortex (vlPFC) in visual search and value memory, we recorded its single-unit activity (n = 526) in two macaque monkeys while they engaged in the value-driven search. Monkeys had to determine whether a high-value target was present within a variable number of low-value objects. Differential neural firing, as well as gamma-band power, indicated the presence of a target within ∼150ms of display onset. Notably, this differential activity was negatively correlated with search time and had reduced set-size dependence during efficient search. On the other hand, neural firing and its variability were higher in inefficient search. These findings implicate vlPFC in rapid detection of valuable targets which would be a crucial skill in competitive environments.

| S-EPMC10481287 | biostudies-literature

Reward value comparison via mutual inhibition in ventromedial prefrontal cortex.

Project description:Recent theories suggest that reward-based choice reflects competition between value signals in the ventromedial prefrontal cortex (vmPFC). We tested this idea by recording vmPFC neurons while macaques performed a gambling task with asynchronous offer presentation. We found that neuronal activity shows four patterns consistent with selection via mutual inhibition: (1) correlated tuning for probability and reward size, suggesting that vmPFC carries an integrated value signal; (2) anti-correlated tuning curves for the two options, suggesting mutual inhibition; (3) neurons rapidly come to signal the value of the chosen offer, suggesting the circuit serves to produce a choice; and (4) after regressing out the effects of option values, firing rates still could predict choice-a choice probability signal. In addition, neurons signaled gamble outcomes, suggesting that vmPFC contributes to both monitoring and choice processes. These data suggest a possible mechanism for reward-based choice and endorse the centrality of vmPFC in that process.

| S-EPMC4086796 | biostudies-literature

Stable and dynamic representations of value in the prefrontal cortex.

Project description:Optimal decision-making requires that stimulus-value associations are kept up to date by constantly comparing the expected value of a stimulus with its experienced outcome. To do this, value information must be held in mind when a stimulus and outcome are separated in time. However, little is known about the neural mechanisms of working memory (WM) for value. Contradicting theories have suggested WM requires either persistent or transient neuronal activity, with stable or dynamic representations, respectively. To test these hypotheses, we recorded neuronal activity in the orbitofrontal and anterior cingulate cortex of two monkeys performing a valuation task. We found that features of all hypotheses were simultaneously present in prefrontal activity, and no single hypothesis was exclusively supported. Instead, mixed dynamics supported robust, time invariant value representations while also encoding the information in a temporally specific manner. We suggest that this hybrid coding is a critical mechanism supporting flexible cognitive abilities.

| S-EPMC7390599 | biostudies-literature

Transient and Persistent Representations of Odor Value in Prefrontal Cortex.

Project description:The representation of odor in olfactory cortex (piriform) is distributive and unstructured and can only be afforded behavioral significance upon learning. We performed 2-photon imaging to examine the representation of odors in piriform and in two downstream areas, the orbitofrontal cortex (OFC) and the medial prefrontal cortex (mPFC), as mice learned olfactory associations. In piriform, we observed that odor responses were largely unchanged during learning. In OFC, 30% of the neurons acquired robust responses to conditioned stimuli (CS+) after learning, and these responses were gated by internal state and task context. Moreover, direct projections from piriform to OFC can be entrained to elicit learned olfactory behavior. CS+ responses in OFC diminished with continued training, whereas persistent representations of both CS+ and CS- odors emerged in mPFC. Optogenetic silencing indicates that these two brain structures function sequentially to consolidate the learning of appetitive associations.

| S-EPMC7886003 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data