Neurocomputational mechanisms underlying the subjective value of information.
Ontology highlight
ABSTRACT:
SUBMITTER: Goh AX
PROVIDER: S-EPMC8669024 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In everyday life, we have to decide whether it is worth exerting effort to obtain rewards. Effort can be experienced in different domains, with some tasks requiring significant cognitive demand and others being more physically effortful. The motivation to exert effort for reward is highly subjective and varies considerably across the different domains of behaviour. However, very little is known about the computational or neural basis of how different effort costs are subjectively weighed against rewards. Is there a common, domain-general system of brain areas that evaluates all costs and benefits? Here, we used computational modelling and functional magnetic resonance imaging (fMRI) to examine the mechanisms underlying value processing in both the cognitive and physical domains. Participants were trained on two novel tasks that parametrically varied either cognitive or physical effort. During fMRI, participants indicated their preferences between a fixed low-effort/low-reward option and a variable higher-effort/higher-reward offer for each effort domain. Critically, reward devaluation by both cognitive and physical effort was subserved by a common network of areas, including the dorsomedial and dorsolateral prefrontal cortex, the intraparietal sulcus, and the anterior insula. Activity within these domain-general areas also covaried negatively with reward and positively with effort, suggesting an integration of these parameters within these areas. Additionally, the amygdala appeared to play a unique, domain-specific role in processing the value of rewards associated with cognitive effort. These results are the first to reveal the neurocomputational mechanisms underlying subjective cost-benefit valuation across different domains of effort and provide insight into the multidimensional nature of motivation.
| S-EPMC5325181 | biostudies-literature
Project description:Immoral behavior often consists of weighing transgression of a moral norm against maximizing personal profits. One important question is to understand why immoral behaviors vary based on who receives specific benefits and what are the neurocomputational mechanisms underlying such moral flexibility. Here, we used model-based functional magnetic resonance imaging to investigate how immoral behaviors change when benefiting oneself or someone else. Participants were presented with offers requiring a tradeoff between a moral cost (i.e. profiting a morally bad cause) and a benefit for either oneself or a charity. Participants were more willing to obtain ill-gotten profits for themselves than for a charity, driven by a devaluation of the moral cost when deciding for their own interests. The subjective value of an immoral offer, computed as a linear summation of the weighed monetary gain and moral cost, recruited the ventromedial prefrontal cortex (PFC) regardless of beneficiaries. Moreover, paralleling the behavioral findings, this region enhanced its functional coupling with mentalizing-related regions while deciding whether to gain morally tainted profits for oneself vs charity. Finally, individual differences in moral preference differentially modulated choice-specific signals in the dorsolateral PFC according to who benefited from the decisions. These findings provide insights for understanding the neurobiological basis of moral flexibility.
| S-EPMC7304519 | biostudies-literature
Project description:Humans are able to adapt to the fast-changing world by estimating statistical regularities of the environment. Although fear can profoundly impact adaptive behaviors, the computational and neural mechanisms underlying this phenomenon remain elusive. Here, we conducted a behavioral experiment (n = 21) and a functional magnetic resonance imaging experiment (n = 37) with a novel cue-biased adaptation learning task, during which we simultaneously manipulated emotional valence (fearful/neutral expressions of the cue) and environmental volatility (frequent/infrequent reversals of reward probabilities). Across 2 experiments, computational modeling consistently revealed a higher learning rate for the environment with frequent versus infrequent reversals following neutral cues. In contrast, this flexible adjustment was absent in the environment with fearful cues, suggesting a suppressive role of fear in adaptation to environmental volatility. This suppressive effect was underpinned by activity of the ventral striatum, hippocampus, and dorsal anterior cingulate cortex (dACC) as well as increased functional connectivity between the dACC and temporal-parietal junction (TPJ) for fear with environmental volatility. Dynamic causal modeling identified that the driving effect was located in the TPJ and was associated with dACC activation, suggesting that the suppression of fear on adaptive behaviors occurs at the early stage of bottom-up processing. These findings provide a neuro-computational account of how fear interferes with adaptation to volatility during dynamic environments.
| S-EPMC10174591 | biostudies-literature
Project description:When choosing between two options, correlates of their value are represented in neural activity throughout the brain. Whether these representations reflect activity that is fundamental to the computational process of value comparison, as opposed to other computations covarying with value, is unknown. We investigated activity in a biophysically plausible network model that transforms inputs relating to value into categorical choices. A set of characteristic time-varying signals emerged that reflect value comparison. We tested these model predictions using magnetoencephalography data recorded from human subjects performing value-guided decisions. Parietal and prefrontal signals matched closely with model predictions. These results provide a mechanistic explanation of neural signals recorded during value-guided choice and a means of distinguishing computational roles of different cortical regions whose activity covaries with value.
| S-EPMC3378494 | biostudies-literature
Project description:Predictions based on learned statistical regularities in the visual world have been shown to facilitate attention and goal-directed behavior by sharpening the sensory representation of goal-relevant stimuli in advance. Yet, how the brain learns to ignore predictable goal-irrelevant or distracting information is unclear. Here, we used EEG and a visual search task in which the predictability of a distractor's location and/or spatial frequency was manipulated to determine how spatial and feature distractor expectations are neurally implemented and reduce distractor interference. We find that expected distractor features could not only be decoded pre-stimulus, but their representation differed from the representation of that same feature when part of the target. Spatial distractor expectations did not induce changes in preparatory neural activity, but a strongly reduced Pd, an ERP index of inhibition. These results demonstrate that neural effects of statistical learning critically depend on the task relevance and dimension (spatial, feature) of predictions.
| S-EPMC7758066 | biostudies-literature
Project description:Prior work on prosocial and self-serving behavior in human economic exchanges has shown that counterparts' high social reputations bias striatal reward signals and elicit cooperation, even when such cooperation is disadvantageous. This phenomenon suggests that the human striatum is modulated by the other's social value, which is insensitive to the individual's own choices to cooperate or defect. We tested an alternative hypothesis that, when people learn from their interactions with others, they encode prediction error updates with respect to their own policy. Under this policy update account striatal signals would reflect positive prediction errors when the individual's choices correctly anticipated not only the counterpart's cooperation but also defection. We examined behavior in three samples using reinforcement learning and model-free analyses and performed an fMRI study of striatal learning signals. In order to uncover the dynamics of goal-directed learning, we introduced reversals in the counterpart's behavior and provided counterfactual (would-be) feedback when the individual chose not to engage with the counterpart. Behavioral data and model-derived prediction error maps (in both whole-brain and a priori striatal region of interest analyses) supported the policy update model. Thus, as people continually adjust their rate of cooperation based on experience, their behavior and striatal learning signals reveal a self-centered instrumental process corresponding to reciprocal altruism.
| S-EPMC6690806 | biostudies-literature
Project description:Computing confidence in one's own and others' decisions is critical for social success. While there has been substantial progress in our understanding of confidence estimates about oneself, little is known about how people form confidence estimates about others. Here, we address this question by asking participants undergoing fMRI to place bets on perceptual decisions made by themselves or one of three other players of varying ability. We show that participants compute confidence in another player's decisions by combining distinct estimates of player ability and decision difficulty - allowing them to predict that a good player may get a difficult decision wrong and that a bad player may get an easy decision right. We find that this computation is associated with an interaction between brain systems implicated in decision-making (LIP) and theory of mind (TPJ and dmPFC). These results reveal an interplay between self- and other-related processes during a social confidence computation.
| S-EPMC9307648 | biostudies-literature
Project description:Over the last two decades, neuroscientists have used antidepressant placebo probes to examine the biological mechanisms implicated in antidepressant placebo effects. However, findings from these studies have not yet elucidated a model-based theory that would explain the mechanism through which antidepressant expectancies evolve to induce persistent mood changes. Emerging evidence suggests that antidepressant placebo effects may be informed by models of reinforcement learning (RL). Such that an individual's expectation of improvement is updated with the arrival of new sensory evidence, by incorporating a reward prediction error (RPE), which signals the mismatch between the expected (expected value) and perceived improvement. Consistent with this framework, neuroimaging studies of antidepressant placebo effects have demonstrated placebo-induced μ-opioid activation and increased blood-oxygen-level dependent (BOLD) responses in regions tracking expected values (e.g., ventromedial prefrontal cortex (vmPFC)) and RPEs (e.g., ventral striatum (VS)). In this study, we will demonstrate the causal contribution of reward learning signals (expected values and RPEs) to antidepressant placebo effects by experimentally manipulating expected values using transcranial magnetic stimulation (TMS) targeting the vmPFC and μ-opioid striatal RPE signal using pharmacological approaches. We hypothesized that antidepressant placebo expectancies are represented in the vmPFC (expected value) and updated by means of μ-opioid-modulated striatal learning signal. In a 3 × 3 factorial double-blind design, we will randomize 120 antidepressant-free individuals with depressive symptoms to one of three between-subject opioid conditions: the μ-opioid agonist buprenorphine, the μ-opioid antagonist naltrexone, or an inert pill. Within each arm, individuals will be assigned to receive three within-subject counterbalanced forms of TMS targeting the vmPFC-intermittent Theta Burst Stimulation (TBS) expected to potentiate the vmPFC, continuous TBS expected to de-potentiate the vmPFC, or sham TBS. These experimental manipulations will be used to modulate trial-by-trial reward learning signals and related brain activity during the Antidepressant Placebo functional MRI (fMRI) Task to address the following aims: (1) investigate the relationship between reward learning signals within the vmPFC-VS circuit and antidepressant placebo effects; (2) examine the causal contribution of vmPFC expected value computations to antidepressant placebo effects; and (3) investigate the causal contribution of μ-opioid-modulated striatal RPEs to antidepressant placebo effects. The proposed study will be the first to investigate the causal contribution of μ-opioid-modulated vmPFC-VS learning signals to antidepressant placebo responses, paving the way for developing novel treatments modulating learning processes and objective means of quantifying and potentially reducing placebo effects during drug development. ClinicalTrials.gov Identifier: NCT04276259.
| S-EPMC7963355 | biostudies-literature
Project description:Little is known about how the brain computes the perceived aesthetic value of complex stimuli such as visual art. Here, we used computational methods in combination with functional neuroimaging to provide evidence that the aesthetic value of a visual stimulus is computed in a hierarchical manner via a weighted integration over both low and high level stimulus features contained in early and late visual cortex, extending into parietal and lateral prefrontal cortices. Feature representations in parietal and lateral prefrontal cortex may in turn be utilized to produce an overall aesthetic value in the medial prefrontal cortex. Such brain-wide computations are not only consistent with a feature-based mechanism for value construction, but also resemble computations performed by a deep convolutional neural network. Our findings thus shed light on the existence of a general neurocomputational mechanism for rapidly and flexibly producing value judgements across an array of complex novel stimuli and situations.
| S-EPMC9873760 | biostudies-literature
Project description:Whether getting vaccinated, buying stocks, or crossing streets, people rarely make decisions alone. Rather, multiple people decide sequentially, setting the stage for information cascades whereby early-deciding individuals can influence others' choices. To understand how information cascades through social systems, it is essential to capture the dynamics of the decision-making process. We introduce the social drift-diffusion model to capture these dynamics. We tested our model using a sequential choice task. The model was able to recover the dynamics of the social decision-making process, accurately capturing how individuals integrate personal and social information dynamically over time and when their decisions were timed. Our results show the importance of the interrelationships between accuracy, confidence, and response time in shaping the quality of information cascades. The model reveals the importance of capturing the dynamics of decision processes to understand how information cascades in social systems, paving the way for applications in other social systems.
| S-EPMC7439644 | biostudies-literature