Decisions in Motion: Decision Dynamics during Intertemporal Choice reflect Subjective Evaluation of Delayed Rewards.
Ontology highlight
ABSTRACT:
SUBMITTER: O'Hora D
PROVIDER: S-EPMC4751609 | biostudies-other | 2016
REPOSITORIES: biostudies-other
Similar Datasets
Project description:One characteristic of natural environments is that outcomes vary across time. Animals need to adapt to these environmental changes and adjust their choices accordingly. In this experiment, we investigated the sensitivity with which rats could detect, and adapt to, multiple changes in the environment. Rats chose between two spouts which delivered 5% sucrose rewards with distinct probabilities. Across three phases, reward probabilities changed in size (large or small) and direction (increase or decrease). A discrete trial-structure was used, which allowed the choice process to be decomposed into three distinct response latency measures (choice execution latency, spout sampling duration, and trial-initiation latency). We found that a large decrease in reward probabilities rapidly produced the greatest change in choice proportions. The time taken to execute a choice reflected the differences in reward probabilities across the two spouts in some cases, but also reflected training history. By contrast, the amount of time rats spent responding at reward spouts in anticipation of reward consistently reflected the relative likelihood of reward across the two spouts and not the absolute probability of reward. The latency to initiate the subsequent trial reflected choice evaluation. These three response latencies thus indexed key behavioral correlates of the choice process as it unfolds in time. We discuss how this paradigm can be used to assess the corresponding neural correlates of decision-making.
| S-EPMC4586275 | biostudies-literature
Project description:Value-based decision-making is of central interest in cognitive neuroscience and psychology, as well as in the context of neuropsychiatric disorders characterised by decision-making impairments. Studies examining (neuro-)computational mechanisms underlying choice behaviour typically focus on participants' decisions. However, there is increasing evidence that option valuation might also be reflected in motor response vigour and eye movements, implicit measures of subjective utility. To examine motor response vigour and visual fixation correlates of option valuation in intertemporal choice, we set up a task where the participants selected an option by pressing a grip force transducer, simultaneously tracking fixation shifts between options. As outlined in our preregistration (https://osf.io/k6jct), we used hierarchical Bayesian parameter estimation to model the choices assuming hyperbolic discounting, compared variants of the softmax and drift diffusion model, and assessed the relationship between response vigour and the estimated model parameters. The behavioural data were best explained by a drift diffusion model specifying a non-linear scaling of the drift rate by the subjective value differences. Replicating previous findings, we found a magnitude effect for temporal discounting, such that higher rewards were discounted less. This magnitude effect was further reflected in motor response vigour, such that stronger forces were exerted in the high vs. the low magnitude condition. Bayesian hierarchical linear regression further revealed higher grip forces, faster response times and a lower number of fixation shifts for trials with higher subjective value differences. An exploratory analysis revealed that subjective value sums across options showed an even more pronounced association with trial-wise grip force amplitudes. Our data suggest that subjective utility or implicit valuation is reflected in motor response vigour and visual fixation patterns during intertemporal choice. Taking into account response vigour might thus provide deeper insight into decision-making, reward valuation and maladaptive changes in these processes, e.g. in the context of neuropsychiatric disorders.
| S-EPMC9187114 | biostudies-literature
Project description:Delineating the decision-making mechanisms underlying choice between drug and nondrug rewards remains a challenge. This study adopts an original approach to probe these mechanisms by comparing response latencies during sampling versus choice trials. While lengthening of latencies during choice is predicted in a deliberative choice model (DCM), the race-like response competition mechanism postulated by the Sequential choice model (SCM) predicts a shortening of latencies during choice compared to sampling. Here, we tested these predictions by conducting a retrospective analysis of cocaine-versus-saccharin choice experiments conducted in our laboratory. We found that rats engage deliberative decision-making mechanisms after limited training, but adopt a SCM-like response selection mechanism after more extended training, while their behavior is presumably habitual. Thus, the DCM and SCM may not be general models of choice, as initially formulated, but could be dynamically engaged to control choice behavior across early and extended training.
| S-EPMC8075577 | biostudies-literature
Project description:Impulse Control Disorder (ICD) in Parkinson's disease is a behavioral addiction induced by dopaminergic therapies, but otherwise unclear etiology. The current study investigates the interaction of reward processing variables, dopaminergic therapy, and risky decision-making and subjective feelings in patients with versus without ICD. Patients with (n = 18) and without (n = 12) ICD performed a risky decision-making task both 'on' and 'off' standard-of-care dopaminergic therapies (the task was performed on 2 different days with the order of on and off visits randomized for each patient). During each trial of the task, participants choose between two options, a gamble or a certain reward, and reported how they felt about decision outcomes. Subjective feelings of 'pleasure' are differentially driven by expectations of possible outcomes in patients with, versus without ICD. While off medication, the influence of expectations about risky-decisions on subjective feelings is reduced in patients with ICD versus without ICD. While on medication, the influence of expected outcomes in patients with ICD versus without ICD becomes similar. Computational modeling of behavior supports the idea that latent decision-making factors drive subjective feelings in patients with Parkinson's disease and that ICD status is associated with a change in the relationship between factors associated with risky behavior and subjective feelings about the experienced outcomes. Our results also suggest that dopaminergic medications modulate the impact expectations have on the participants' subjective reports. Altogether our results suggest that expectations about risky decisions may be decoupled from subjective feelings in patients with ICD, and that dopaminergic medications may reengage these circuits and increase emotional reactivity in patients with ICD.
| S-EPMC10912783 | biostudies-literature
Project description:The Monetary Choice Questionnaire (MCQ) is a widely used behavioral task that measures the rate of delay discounting (i.e., k), the degree to which a delayed reward loses its present value as a function of the time to its receipt. Both 21- and 27-item MCQs have been extensively validated and proven valuable in research. Different methods have been developed to streamline MCQ scoring. However, existing scoring methods have yet to tackle the issue of missing responses or provide clear guidance on imputing such data. Due to this lack of knowledge, the present study developed and compared three imputation approaches that leverage the MCQ's structure and prioritize ease of implementation. Additionally, their performance was compared with mode imputation. A Monte Carlo simulation was conducted to evaluate the performance of these approaches in handling various missing responses in each observation across two datasets from prior studies that employed the 21- and 27-item MCQs. One of the three approaches consistently outperformed mode imputation across all performance measures. This approach involves imputing missing values using congruent non-missing responses to the items corresponding to the same k value or introducing random responses when congruent answers are unavailable. This investigation unveils a straightforward method for imputing missing data in the MCQ while ensuring unbiased estimates. Along with the investigation, an R tool was developed for researchers to implement this strategy while streamlining the MCQ scoring process.
| S-EPMC10578570 | biostudies-literature
Project description:A perceptual judgment is typically characterized by constructing psychometric and chronometric functions, i.e., by mapping the accuracies and reaction times of motor choices as functions of a sensory stimulus feature dimension. Here, we show that various saccade metrics (e.g., peak velocity) are similarly modulated as functions of sensory cue viewing time during performance of an urgent-decision task. Each of the newly discovered functions reveals the dynamics of the perceptual evaluation process inherent to the underlying judgment. Remarkably, saccade peak velocity correlates with statistical decision confidence, suggesting that saccade kinematics reflect the degree of certainty with which an urgent perceptual decision is made. The data were explained by a race-to-threshold model that also replicates standard performance measures and cortical oculomotor neuronal activity in the task. The results indicate that, although largely stereotyped, saccade metrics carry subtle but reliable traces of the underlying cognitive processes that give rise to each oculomotor choice.
| S-EPMC6060154 | biostudies-literature
Project description:Perceptual decision-makers often display a constant rate of errors independent of evidence strength. These 'lapses' are treated as a nuisance arising from noise tangential to the decision, e.g. inattention or motor errors. Here, we use a multisensory decision task in rats to demonstrate that these explanations cannot account for lapses' stimulus dependence. We propose a novel explanation: lapses reflect a strategic trade-off between exploiting known rewarding actions and exploring uncertain ones. We tested this model's predictions by selectively manipulating one action's reward magnitude or probability. As uniquely predicted by this model, changes were restricted to lapses associated with that action. Finally, we show that lapses are a powerful tool for assigning decision-related computations to neural structures based on disruption experiments (here, posterior striatum and secondary motor cortex). These results suggest that lapses reflect an integral component of decision-making and are informative about action values in normal and disrupted brain states.
| S-EPMC7846276 | biostudies-literature
Project description:Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called intertemporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neurocognitive processes, outcome anticipation and outcome evaluation, modulate individual variability in intertemporal responses. After completing a behavioral intertemporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome anticipation (stimulus-preceding negativity; SPN), early outcome valuation (feedback-related negativity; FRN), and late outcome evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between intertemporal responses and early outcome evaluation (FRN), indicating that the relationship between outcome evaluation and intertemporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in intertemporal responses, suggesting separate mechanisms underlie the relationship between these two neurocognitive processes and intertemporal responses. Accordingly, we identify two potential neurocognitive modulators of individual variability in intertemporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency bias toward gain (compared to loss) outcomes (P3).
| S-EPMC5409980 | biostudies-literature
Project description:Several theories of self-control [including intertemporal bargaining (Ainslie, 1992) and self-signaling (Bodner and Prelec, 2001)] imply that intertemporal decisions can be more farsighted than would be predicted by the incentive associated with rewards outside a decision context. We examined this hypothesis using behavior and functional neuroimaging. First, subjects expressed preferences between amounts of money delayed by 4 months and smaller amounts available that day. This allowed us to establish "indifference pairs" individualized to each participant: immediate and delayed amounts that were equally preferred. Participants subsequently performed a reaction time functional magnetic resonance imaging task (Knutson et al., 2001a) that provided them with distinct opportunities to win each of the rewards that comprised the indifference pairs. Anatomical region of interest analysis as well as whole-brain analysis indicated greater response recruited by the immediate rewards (relative to the preference-matched delayed rewards) in regions previously implicated as sensitive to incentive value using the same task (including bilateral putamen, bilateral anterior insula, and midbrain). Reaction time to the target was also faster during the immediate relative to delayed reward trials (p < 0.01), and individual differences in reaction time between immediate versus delayed reward trials correlated with variance in magnetic resonance signal in those clusters that responded preferentially to immediate rewards (r = 0.33, p < 0.05). These findings indicate a discrepancy in incentive associated with the immediate versus the preference-matched delayed rewards. This discrepancy may mark the contribution of self-control processes that are recruited during decision-making but that are absent when rewards are individually anticipated.
| S-EPMC2821568 | biostudies-literature
Project description:Pro-sociality, i.e., the preference for outcomes that produce benefits for other individuals, is ubiquitous in humans. Recently, cross-species comparisons of social behavior have offered important new insights into the evolution of pro-sociality. Here, we present a rodent analog of the Pro-social Choice Task that controls strategic components, de-confounds other-regarding choice motives from the animals' natural tendencies to maximize own food access and directly tests the effect of social context on choice allocation. We trained pairs of rats-an actor and a partner rat-in a double T-maze task where actors decided between two alternatives only differing in the reward delivered to the partner. The "own reward" choice yielded a reward only accessible to the actor whereas the "both reward" choice produced an additional reward for a partner (partner condition) or an inanimate toy (toy Condition), located in an adjacent compartment. We found that actors chose "both reward" at levels above chance and more often in the partner than in the toy condition. Moreover, we show that this choice pattern adapts to the current social context and that the observed behavior is stable over time.
| S-EPMC4296215 | biostudies-literature