Reminders of past choices bias decisions for reward in humans.
Ontology highlight
ABSTRACT:
SUBMITTER: Bornstein AM
PROVIDER: S-EPMC5490260 | biostudies-literature | 2017 Jun
REPOSITORIES: biostudies-literature
Publications
Reminders of past choices bias decisions for reward in humans.
Bornstein Aaron M AM Khaw Mel W MW Shohamy Daphna D Daw Nathaniel D ND
Nature communications 20170627
We provide evidence that decisions are made by consulting memories for individual past experiences, and that this process can be biased in favour of past choices using incidental reminders. First, in a standard rewarded choice task, we show that a model that estimates value at decision-time using individual samples of past outcomes fits choices and decision-related neural activity better than a canonical incremental learning model. In a second experiment, we bias this sampling process by inciden ...[more]
Similar Datasets
Project description:Decision-making is guided by memories of option values. However, retrieving items from memory renders them malleable. Here, we show that merely retrieving values from memory and making a choice between options is sufficient both to induce changes to stimulus-reward associations in the hippocampus and to bias future decision-making. After allowing participants to make repeated choices between reward-conditioned stimuli, in the absence of any outcome, we observe that participants prefer stimuli they have previously chosen, and neglect previously unchosen stimuli, over otherwise identical-valued options. Using functional brain imaging, we show that decisions induce changes to hippocampal representations of stimulus-outcome associations. These changes are correlated with future decision biases. Our results indicate that choice-induced preference changes are partially driven by choice-induced modification of memory representations and suggest that merely making a choice - even without experiencing any outcomes - induces associative plasticity.
| S-EPMC7335207 | biostudies-literature
Project description:It is well established that emotions influence our decisions, yet the neural basis of this biasing effect is not well understood. Here we directly recorded local field potentials from the OrbitoFrontal Cortex (OFC) in five human subjects performing a financial decision-making task. We observed a striking increase in gamma-band (36-50 Hz) oscillatory activity that reflected subjects' decisions to make riskier choices. Additionally, these gamma rhythms were linked back to mismatched expectations or "luck" occurring in past trials. Specifically, when a subject expected to win but lost, the trial was defined as "unlucky" and when the subject expected to lose but won, the trial was defined as "lucky". Finally, a fading memory model of luck correlated to an objective measure of emotion, heart rate variability. Our findings suggest OFC may play a pivotal role in processing a subject's internal (emotional) state during financial decision-making, a particularly interesting result in light of the more recent "cognitive map" theory of OFC function.
| S-EPMC5103224 | biostudies-literature
Project description:Discrete choice, coupled with social influence, plays a significant role in evolutionary studies of human fertility, as investigators explore how and why reproductive decisions are made. We have previously proposed that the relative magnitude of social influence can be compared against the transparency of pay-off, also known as the transparency of a decision, through a heuristic diagram that maps decision-making along two axes. The horizontal axis represents the degree to which an agent makes a decision individually versus one that is socially influenced, and the vertical axis represents the degree to which there is transparency in the pay-offs and risks associated with the decision the agent makes. Having previously parametrized the functions that underlie the diagram, we detail here how our estimation methods can be applied to real-world datasets concerning sexual health and contraception.
| S-EPMC4822434 | biostudies-literature
Project description:ImportanceA goal of health care is to reduce symptoms and improve health status, whereas continuing dubious treatments can contribute to complacency, discourage the search for alternatives, and lead to shortfalls in care.ObjectiveTo test a potential bias in intuitive reasoning following a marginal improvement in symptoms after a dubious treatment (post hoc bias).Design, setting, and participantsSurveys eliciting treatment recommendations for hypothetical patients were sent to community members throughout North America recruited via an online survey platform in the early winter months of 2023 and 2024 and presented to health care professionals (pharmacists who were approached in person using a secret shopper technique) in the summer months of 2023.ExposureRespondents received randomized versions of surveys that differed according to whether vague symptoms improved or remained unchanged after a dubious treatment.Main outcomes and measuresThe primary outcome was a recommendation to continue treatment.ResultsIn total, 1497 community members (mean [SD] age, 38.1 [12.5] years; 663 female [55.3%]) and 100 health care professionals were contacted. The first scenario described a patient with a sore throat who took unprescribed antibiotics; respondents were more likely to continue antibiotics after initial treatment if there was a marginal improvement in symptoms vs when symptoms remained unchanged (67 of 150 respondents [45%] vs 25 of respondents [17%]; odds ratio [OR], 3.98 [95% CI, 2.33-6.78]; P < .001). Another scenario described a patient with wrist pain who wore a copper bracelet; respondents were more likely to continue wearing the copper bracelet after initial care was followed by a marginal improvement in symptoms vs when symptoms remained unchanged (78 of 100 respondents [78%] vs 25 of 99 respondents [25%]; OR, 16.19 [95% CI, 5.32-19.52]; P < .001). A third scenario described a patient with fatigue who took unprescribed vitamin B12; respondents were more likely to continue taking vitamin B12 when initial treatment was followed by a marginal improvement in symptoms vs when symptoms remained unchanged (80 of 100 respondents [80%] vs 33 of 100 respondents [33%]; OR, 7.91 [95% CI, 4.18-14.97]; P < .001). Four further scenarios involving dubious treatments found similar results, including when tested on health care professionals.Conclusions and relevanceIn this study of clinical scenarios, a marginal improvement in symptoms led patients to continue a dubious and sometimes costly treatment, suggesting that clinicians should caution patients against post hoc bias.
| S-EPMC11375477 | biostudies-literature
Project description:Autism spectrum disorder (ASD) manifests sensory and perceptual atypicalities. Recent theories suggest that these may reflect a reduced influence of prior information in ASD. Some studies have found reduced adaptation to recent sensory stimuli in ASD. However, the effects of prior stimuli and prior perceptual choices can counteract one-another. Here, we investigated this using two different tasks (in two different cohorts): (i) visual location discrimination and (ii) multisensory (visual-vestibular) heading discrimination. We fit the data using a logistic regression model to dissociate the specific effects of prior stimuli and prior choices. In both tasks, perceptual decisions were biased toward recent choices. Notably, the 'attractive' effect of prior choices was significantly larger in ASD (in both tasks and cohorts), while there was no difference in the influence of prior stimuli. These results challenge theories of reduced priors in ASD, and rather suggest an increased consistency bias for perceptual decisions in ASD.
| S-EPMC8289410 | biostudies-literature
Project description:Classical economic theory contends that the utility of a choice option should be independent of other options. This view is challenged by the attraction effect, in which the relative preference between two options is altered by the addition of a third, asymmetrically dominated option. Here, we leveraged the attraction effect in the context of intertemporal choices to test whether both decisions and reward prediction errors (RPE) in the absence of choice violate the independence of irrelevant alternatives principle. We first demonstrate that intertemporal decision making is prone to the attraction effect in humans. In an independent group of participants, we then investigated how this affects the neural and behavioral valuation of outcomes using a novel intertemporal lottery task and fMRI. Participants' behavioral responses (i.e., satisfaction ratings) were modulated systematically by the attraction effect and this modulation was correlated across participants with the respective change of the RPE signal in the nucleus accumbens. Furthermore, we show that, because exponential and hyperbolic discounting models are unable to account for the attraction effect, recently proposed sequential sampling models might be more appropriate to describe intertemporal choices. Our findings demonstrate for the first time that the attraction effect modulates subjective valuation even in the absence of choice. The findings also challenge the prospect of using neuroscientific methods to measure utility in a context-free manner and have important implications for theories of reinforcement learning and delay discounting.Significance statementMany theories of value-based decision making assume that people first assess the attractiveness of each option independently of each other and then pick the option with the highest subjective value. The attraction effect, however, shows that adding a new option to a choice set can change the relative value of the existing options, which is a violation of the independence principle. Using an intertemporal choice framework, we tested whether such violations also occur when the brain encodes the difference between expected and received rewards (i.e., the reward prediction error). Our results suggest that neither intertemporal choice nor valuation without choice adhere to the independence principle.
| S-EPMC6596571 | biostudies-literature
Project description:Although several studies have emphasized the role of the anterior cingulate cortex (ACC) in associating actions with reward value, its role in guiding choices on the basis of changes in reward value has not been assessed. Accordingly, we compared rhesus monkeys with ACC lesions and controls on object- and action-based reinforcer devaluation tasks. Monkeys were required to associate an object or an action with one of two reward outcomes, and we assessed the monkey's shift in choices of objects or actions after changes in the value of 1 outcome. No group differences emerged on either task. For comparison, we tested the same monkeys on their ability to make choices guided by reward contingency in object- and action-based reversal learning tasks. Monkeys with ACC lesions were impaired in using rewarded trials to sustain the selection of the correct object during object reversal learning. They were also impaired in using errors to guide choices in action reversal learning. These data indicate that the role of the ACC is not restricted to linking specific actions with reward outcomes, as previously reported. Instead, the data suggest a more general role for the ACC in using information about reward and nonreward to sustain effective choice behavior.
| S-EPMC3827710 | biostudies-literature
Project description:In moving pedestrian crowds, the distribution of individuals over different available routes emerges from the decisions of individuals that may be influenced by the actions of others. Understanding this phenomenon not only is important for research into collective behaviour, but also has practical applications for building safety and event management. Here, we study the mechanisms underlying pedestrian route choice, focusing on how time-independent information, such as path lengths, and time-dependent information, such as queue lengths, affect both initial decisions and subsequent changes in route choices. We address these questions using experiments with nearly 140 volunteers and an individual-based model for route choice. Crucially, we consider a wide range of route choice scenarios. We find that initial route choices of pedestrians achieve a balanced usage of available routes. Our model suggests that pedestrians performing trade-offs between exit widths and predicted exit crowdedness can explain this emergent distribution in many contexts. Few pedestrians adjust their route choice in our experiments. Simulations suggest that these decisions could be explained by pedestrians comparing estimates of the time it would take them to reach their target using different routes. Route choice is complex, but our findings suggest that conceptually simple behaviours may explain many movement decisions.
| S-EPMC5332561 | biostudies-literature
Project description:Maximizing is a topic that has received significant attention from researchers and corporate organizations alike. Although extensive previous research has explored how maximizers behave in a decision scenario, a fundamental question remains about why they prefer a larger assortment regardless of whether the decisions are important or not. This study attempts to explore the underlying mechanism of this phenomenon. Four surveys were conducted, and participants from Mturk or Credamo online platforms were recruited (N = 922). The maximizing tendency was measured by either maximization scale or maximizing tendency scale, and perceived importance and preference for a large assortment were measured in different decision scenarios. Across four studies, we find that maximizers perceive the same decision as more important than satisficers (Study 1), and perceived importance serves as the mechanism underlying the maximizers' preference for a large assortment (Study 2). In other words, in maximizers' perceptions and interpretations, even seemingly trivial decisions are important enough to spend great effort on a large assortment. We additionally identified a boundary condition for the effect - cost salience (Studies 3a and 3b). These findings illustrate a pioneering empirical exploration of the difference in the way maximizers and satisficers perceive their decision importance and the reason for maximizers' preference for a large assortment.
| S-EPMC9240276 | biostudies-literature
Project description:Perceptual decision-making is biased by previous events, including the history of preceding choices: observers tend to repeat (or alternate) their judgments of the sensory environment more often than expected by chance. Computational models postulate that these so-called choice history biases result from the accumulation of internal decision signals across trials. Here, we provide psychophysical evidence for such a mechanism and its adaptive utility. Male and female human observers performed different variants of a challenging visual motion discrimination task near psychophysical threshold. In a first experiment, we decoupled categorical perceptual choices and motor responses on a trial-by-trial basis. Choice history bias was explained by previous perceptual choices, not motor responses, highlighting the importance of internal decision signals in action-independent formats. In a second experiment, observers performed the task in stimulus environments containing different levels of autocorrelation and providing no external feedback about choice correctness. Despite performing under overall high levels of uncertainty, observers adjusted both the strength and the sign of their choice history biases to these environments. When stimulus sequences were dominated by either repetitions or alternations, the individual degree of this adjustment of history bias was about as good a predictor of individual performance as individual perceptual sensitivity. The history bias adjustment scaled with two proxies for observers' confidence about their previous choices (accuracy and reaction time). Together, our results are consistent with the idea that action-independent, confidence-modulated decision variables are accumulated across choices in a flexible manner that depends on decision-makers' model of their environment.SIGNIFICANCE STATEMENT Decisions based on sensory input are often influenced by the history of one's preceding choices, manifesting as a bias to systematically repeat (or alternate) choices. We here provide support for the idea that such choice history biases arise from the context-dependent accumulation of a quantity referred to as the decision variable: the variable's sign dictates the choice and its magnitude the confidence about choice correctness. We show that choices are accumulated in an action-independent format and a context-dependent manner, weighted by the confidence about their correctness. This confidence-weighted accumulation of choices enables decision-makers to flexibly adjust their behavior to different sensory environments. The bias adjustment can be as important for optimizing performance as one's sensitivity to the momentary sensory input.
| S-EPMC5858589 | biostudies-literature