The neural correlates of subjective value during intertemporal choice.
Ontology highlight
ABSTRACT:
SUBMITTER: Kable JW
PROVIDER: S-EPMC2845395 | biostudies-literature | 2007 Dec
REPOSITORIES: biostudies-literature
Publications
The neural correlates of subjective value during intertemporal choice.
Kable Joseph W JW Glimcher Paul W PW
Nature neuroscience 20071104 12
Neuroimaging studies of decision-making have generally related neural activity to objective measures (such as reward magnitude, probability or delay), despite choice preferences being subjective. However, economic theories posit that decision-makers behave as though different options have different subjective values. Here we use functional magnetic resonance imaging to show that neural activity in several brain regions--particularly the ventral striatum, medial prefrontal cortex and posterior ci ...[more]
Similar Datasets
Project description:People often have to make decisions between immediate rewards and more long-term goals. Such intertemporal judgments are often investigated in the context of monetary choice or drug use, yet not in regard to aggressive behavior. We combined a novel intertemporal aggression paradigm with functional neuroimaging to examine the role of temporal delay in aggressive behavior and the neural correlates thereof. Sixty-one participants (aged 18-22 years; 37 females) exhibited substantial variability in the extent to which they selected immediate acts of lesser aggression versus delayed acts of greater aggression against a same-sex opponent. Choosing delayed-yet-more-severe aggression was increased by provocation and associated with greater self-control. Preferences for delayed aggression were associated with greater activity in the ventromedial prefrontal cortex (VMPFC) during such choices, and reduced functional connectivity between the VMPFC and brain regions implicated in motor impulsivity. Preferences for immediate aggression were associated with reduced functional connectivity between the VMPFC and the frontoparietal control network. Dispositionally aggressive participants exhibited reduced VMPFC activity, which partially explained and suppressed their preferences for delayed aggression. Blunted VMPFC activity may thus be a neural mechanism that promotes reactive aggression towards provocateurs among dispositionally aggressive individuals. These findings demonstrate the utility of an intertemporal framework for investigating aggression and provide further evidence for the similar underlying neurobiology between aggression and other rewarding behaviors.
| S-EPMC7388593 | biostudies-literature
Project description:The laboratory study of how humans and other animals trade-off value and time has a long and storied history, and is the subject of a vast literature. However, despite a long history of study, there is no agreed upon mechanistic explanation of how intertemporal choice preferences arise. Several theorists have recently proposed model-based reinforcement learning as a candidate framework. This framework describes a suite of algorithms by which a model of the environment, in the form of a state transition function and reward function, can be converted on-line into a decision. The state transition function allows the model-based system to make decisions based on projected future states, while the reward function assigns value to each state, together capturing the necessary components for successful intertemporal choice. Empirical work has also pointed to a possible relationship between increased prospection and reduced discounting. In the current paper, we look for direct evidence of a relationship between temporal discounting and model-based control in a large new data set (n?=?168). However, testing the relationship under several different modeling formulations revealed no indication that the two quantities are related.
| S-EPMC5320483 | biostudies-literature
Project description:Value-based decision-making is of central interest in cognitive neuroscience and psychology, as well as in the context of neuropsychiatric disorders characterised by decision-making impairments. Studies examining (neuro-)computational mechanisms underlying choice behaviour typically focus on participants' decisions. However, there is increasing evidence that option valuation might also be reflected in motor response vigour and eye movements, implicit measures of subjective utility. To examine motor response vigour and visual fixation correlates of option valuation in intertemporal choice, we set up a task where the participants selected an option by pressing a grip force transducer, simultaneously tracking fixation shifts between options. As outlined in our preregistration (https://osf.io/k6jct), we used hierarchical Bayesian parameter estimation to model the choices assuming hyperbolic discounting, compared variants of the softmax and drift diffusion model, and assessed the relationship between response vigour and the estimated model parameters. The behavioural data were best explained by a drift diffusion model specifying a non-linear scaling of the drift rate by the subjective value differences. Replicating previous findings, we found a magnitude effect for temporal discounting, such that higher rewards were discounted less. This magnitude effect was further reflected in motor response vigour, such that stronger forces were exerted in the high vs. the low magnitude condition. Bayesian hierarchical linear regression further revealed higher grip forces, faster response times and a lower number of fixation shifts for trials with higher subjective value differences. An exploratory analysis revealed that subjective value sums across options showed an even more pronounced association with trial-wise grip force amplitudes. Our data suggest that subjective utility or implicit valuation is reflected in motor response vigour and visual fixation patterns during intertemporal choice. Taking into account response vigour might thus provide deeper insight into decision-making, reward valuation and maladaptive changes in these processes, e.g. in the context of neuropsychiatric disorders.
| S-EPMC9187114 | biostudies-literature
Project description:People tend to discount rewards or losses that occur in the future. Such delay discounting has been linked to many behavioral and health problems, since people choose smaller short-term gains over greater long-term gains. We investigated whether the effect of delays on the subjective value of rewards is expressed in how people move when they make choices. Over 600 patrons of the RISK LAB exhibition hosted by the Science Gallery Dublin(TM) played a short computer game in which they used a computer mouse to choose between amounts of money at various delays. Typical discounting effects were observed and decision dynamics indicated that choosing smaller short-term rewards became easier (i.e., shorter response times, tighter trajectories, less vacillation) as the delays until later rewards increased. Based on a sequence of choices, subjective values of delayed outcomes were estimated and decision dynamics during initial choices predicted these values. Decision dynamics are affected by subjective values of available options and thus provide a means to estimate such values.
| S-EPMC4751609 | biostudies-other
Project description:Alongside impulsive suicide attempts, clinicians encounter highly premeditated suicidal acts, particularly in older adults. We have previously found that in contrast to the more impulsive suicide attempters' inability to delay gratification, serious and highly planned suicide attempts were associated with greater willingness to wait for larger rewards. This study examined neural underpinnings of intertemporal preference in suicide attempters. We expected that impulsivity and suicide attempts, particularly poorly planned ones, would predict altered paralimbic subjective value representations. We also examined lateral prefrontal and paralimbic correlates of premeditation in suicidal behavior.A total of 48 participants aged 46-90 years underwent extensive clinical and cognitive characterization and completed the delay discounting task in the scanner: 26 individuals with major depression (13 with and 13 without history of suicide attempts) and 22 healthy controls.More impulsive individuals displayed greater activation in the precuneus/posterior cingulate cortex (PCC) to value difference favoring the delayed option. Suicide attempts, particularly better-planned ones, were associated with deactivation of the lateral prefrontal cortex (lPFC) in response to value difference favoring the immediate option. Findings were robust to medication exposure, depression severity and possible brain damage from suicide attempts, among other confounders. Finally, in suicide attempters longer reward delays were associated with diminished parahippocampal responses.Impulsivity was associated with an altered paralimbic (precuneus/PCC) encoding of value difference during intertemporal choice. By contrast, better-planned suicidal acts were associated with altered lPFC representations of value difference. The study provides preliminary evidence of impaired decision processes in both impulsive and premeditated suicidal behavior.
| S-EPMC4797639 | biostudies-literature
Project description:Decision makers often face choices whose consequences unfold over time. To explore the neural basis of such intertemporal choice behavior, we devised a novel two-alternative choice task with probabilistic reward delivery and contrasted two conditions that differed only in whether the outcome was revealed immediately or after some delay. In the immediate condition, we simply varied the reward probability of each option and the outcome was revealed immediately. In the delay condition, the outcome was revealed after a delay during which the reward probability was governed by a constant hazard rate. Functional imaging revealed a set of brain regions, such as the posterior cingulate cortex, parahippocampal gyri, and frontal pole, that exhibited activity uniquely associated with the temporal aspects of the task. This engagement of the so-called "default network" suggests that during intertemporal choice, decision makers simulate the impending delay via a process of prospection.
| S-EPMC2742332 | biostudies-other
Project description:An important and unresolved question is how human brain regions process information and interact with each other in intertemporal choice related to gains and losses. Using psychophysiological interaction and dynamic causal modeling analyses, we investigated the functional interactions between regions involved in the decision-making process while participants performed temporal discounting tasks in both the gains and losses domains. We found two distinct intrinsic valuation systems underlying temporal discounting in the gains and losses domains: gains were specifically evaluated in the medial regions, including the medial prefrontal and orbitofrontal cortices, and losses were evaluated in the lateral dorsolateral prefrontal cortex. In addition, immediate reward or punishment was found to modulate the functional interactions between the dorsolateral prefrontal cortex and distinct regions in both the gains and losses domains: in the gains domain, the mesolimbic regions; in the losses domain, the medial prefrontal cortex, anterior cingulate cortex, and insula. These findings suggest that intertemporal choice of gains and losses might involve distinct valuation systems, and more importantly, separate neural interactions may implement the intertemporal choices of gains and losses. These findings may provide a new biological perspective for understanding the neural mechanisms underlying intertemporal choice of gains and losses.
| S-EPMC6129240 | biostudies-literature
Project description:Impulsive behaviours are common symptoms of attention-deficit hyperactivity disorder (ADHD). Although previous studies have suggested functional models of impulsive behaviour, a full explanation of impulsivity in ADHD remains elusive. To investigate the detailed mechanisms behind impulsive behaviour in ADHD, we applied an economic intertemporal choice task involving gains and losses to adults with ADHD and healthy controls and measured brain activity by functional magnetic resonance imaging. In the intertemporal choice of future gains, we observed no behavioural or neural difference between the two groups. In the intertemporal choice of future losses, adults with ADHD exhibited higher discount rates than the control participants. Furthermore, a comparison of brain activity representing the sensitivity of future loss in the two groups revealed significantly lower activity in the striatum and higher activity in the amygdala in adults with ADHD than in controls. Our preliminary findings suggest that an altered size sensitivity to future loss is involved in apparent impulsive choice behaviour in adults with ADHD and shed light on the multifaceted impulsivity underlying ADHD.
| S-EPMC5928218 | biostudies-literature
Project description:Discounting of future rewards is traditionally interpreted as evidence for an intrinsic preference in favor of sooner rewards. However, temporal discounting can also arise from internal uncertainty in value representations of future events, if one assumes that noisy mental simulations of the future are rationally combined with prior beliefs. Here, we further develop this idea by considering how simulation noise may be adaptively modulated by task demands, based on principles of rational inattention. We show how the optimal allocation of mental effort can give rise to the magnitude effect in intertemporal choice. In a re-analysis of two prior data sets, and in another experiment, we reveal several behavioral signatures of this theoretical account, tying choice stochasticity to the magnitude effect. We conclude that some aspects of temporal discounting may result from a cognitively plausible adaptive response to the costs of information processing.
| S-EPMC7335105 | biostudies-literature
Project description:Sensitivity to satiety constitutes a basic requirement for neuronal coding of subjective reward value. Satiety from natural ongoing consumption affects reward functions in learning and approach behavior. More specifically, satiety reduces the subjective economic value of individual rewards during choice between options that typically contain multiple reward components. The unconfounded assessment of economic reward value requires tests at choice indifference between two options, which is difficult to achieve with sated rewards. By conceptualizing choices between options with multiple reward components ("bundles"), Revealed Preference Theory may offer a solution. Despite satiety, choices against an unaltered reference bundle may remain indifferent when the reduced value of a sated bundle reward is compensated by larger amounts of an unsated reward of the same bundle, and then the value loss of the sated reward is indicated by the amount of the added unsated reward. Here, we show psychophysically titrated choice indifference in monkeys between bundles of differently sated rewards. Neuronal chosen value signals in the orbitofrontal cortex (OFC) followed closely the subjective value change within recording periods of individual neurons. A neuronal classifier distinguishing the bundles and predicting choice substantiated the subjective value change. The choice between conventional single rewards confirmed the neuronal changes seen with two-reward bundles. Thus, reward-specific satiety reduces subjective reward value signals in OFC. With satiety being an important factor of subjective reward value, these results extend the notion of subjective economic reward value coding in OFC neurons.
| S-EPMC8325167 | biostudies-literature