Publisher Correction: Learning relative values in the striatum induces violations of normative decision making.
Ontology highlight
ABSTRACT:
SUBMITTER: Klein TA
PROVIDER: S-EPMC6597713 | biostudies-literature | 2019 Jun
REPOSITORIES: biostudies-literature
Publications
Publisher Correction: Learning relative values in the striatum induces violations of normative decision making.
Klein Tilmann A TA Ullsperger Markus M Jocham Gerhard G
Nature communications 20190627 1
An amendment to this paper has been published and can be accessed via a link at the top of the paper. ...[more]
Similar Datasets
Project description:To decide optimally between available options, organisms need to learn the values associated with these options. Reinforcement learning models offer a powerful explanation of how these values are learnt from experience. However, human choices often violate normative principles. We suggest that seemingly counterintuitive decisions may arise as a natural consequence of the learning mechanisms deployed by humans. Here, using fMRI and a novel behavioural task, we show that, when suddenly switched to novel choice contexts, participants' choices are incongruent with values learnt by standard learning algorithms. Instead, behaviour is compatible with the decisions of an agent learning how good an option is relative to an option with which it had previously been paired. Striatal activity exhibits the characteristics of a prediction error used to update such relative option values. Our data suggest that choices can be biased by a tendency to learn option values with reference to the available alternatives.
| S-EPMC5481835 | biostudies-other
Project description: Not available
| S-EPMC8376982 | biostudies-literature
Project description:Learning and memory and navigation literatures emphasize interactions between multiple memory systems: a flexible, planning-based system and a rigid, cached-value system. This has profound implications for decision-making. Recent conceptualizations of flexible decision-making employ prospection and projection arising from a network involving the hippocampus. Recent recordings from rodent hippocampus in decision-making situations have found transient forward-shifted representations. Evaluation of that prediction and subsequent action-selection probably occurs downstream (e.g. in orbitofrontal cortex, in ventral and dorsomedial striatum). Classically, striatum has been identified as a crucial component of the less-flexible, incremental system. Current evidence, however, suggests that striatum is involved in both flexible and stimulus-response decision-making, with dorsolateral striatum involved in stimulus-response strategies and ventral and dorsomedial striatum involved in goal-directed strategies.
| S-EPMC3774291 | biostudies-literature
Project description:Human decision-making almost always takes place under time pressure. When people are engaged in activities such as shopping, driving, or playing chess, they have to continually balance the demands for fast decisions against the demands for accurate decisions. In the cognitive sciences, this balance is thought to be modulated by a response threshold, the neural substrate of which is currently subject to speculation. In a speed decision-making experiment, we presented participants with cues that indicated different requirements for response speed. Application of a mathematical model for the behavioral data confirmed that cueing for speed lowered the response threshold. Functional neuroimaging showed that cueing for speed activates the striatum and the pre-supplementary motor area (pre-SMA), brain structures that are part of a closed-loop motor circuit involved in the preparation of voluntary action plans. Moreover, activation in the striatum is known to release the motor system from global inhibition, thereby facilitating faster but possibly premature actions. Finally, the data show that individual variation in the activation of striatum and pre-SMA is selectively associated with individual variation in the amplitude of the adjustments in the response threshold estimated by the mathematical model. These results demonstrate that when people have to make decisions under time pressure their striatum and pre-SMA show increased levels of activation.
| S-EPMC2582260 | biostudies-literature
Project description: Not available
| S-EPMC8967872 | biostudies-literature
Project description:Punishing norm violations is considered an important motive during rejection of unfair offers in the ultimatum game (UG). The present study investigates the impact of the power to punish norm violations on people's responses to unfairness and associated neural correlates. In the UG condition participants had the power to punish norm violations, while an alternate condition, the impunity game (IG), was presented where participants had no power to punish norm violations since rejection only reduced the responder's income to zero. Results showed that unfair offers were rejected more often in UG compared to IG. At the neural level, anterior insula and dorsal anterior cingulate cortex were more active when participants received and rejected unfair offers in both UG and IG. Moreover, greater dorsolateral prefrontal cortex activity was observed when participants rejected than accepted unfair offers in UG but not in IG. Ventromedial prefrontal cortex activation was higher in UG than IG when unfair offers were accepted as well as when rejecting unfair offers in IG as opposed to UG. Taken together, our results demonstrate that the power to punish norm violations affects not only people's behavioral responses to unfairness but also the neural correlates of the fairness-related social decision-making process.
| S-EPMC4678221 | biostudies-literature
Project description:The ecosystem services (ES) concept has emerged and spread widely recently, to enhance the importance of preserving ecosystems through global change in order to maintain their benefits for human well-being. Numerous studies consider various dimensions of the interactions between ecosystems and land use via ES, but integrated research addressing the complete feedback loop between biodiversity, ES and land use has remained mostly theoretical. Few studies consider feedbacks from ecosystems to land use systems through ES, exploring how ES are taken into account in land management decisions. To fill this gap, we carried out a role-playing game to explore how ES cognition mediates feedbacks from environmental change on farmers' behaviors in a mountain grassland system. On a close to real landscape game board, farmers were faced with changes in ES under climatic and socio-economic scenarios and prompted to plan for the future and to take land management decisions as they deemed necessary. The outcomes of role-playing game were complemented with additional agronomic and ecological data from interviews and fieldwork. The effects of changes in ES on decision were mainly direct, i.e. not affecting knowledge and values, when they constituted situations with which farmers were accustomed. For example, a reduction of forage quantity following droughts led farmers to shift from mowing to grazing. Sometimes, ES cognitions were affected by ES changes or by external factors, leading to an indirect feedback. This happened when fertilization was stopped after farmers learned that it was inefficient in a drought context. Farmers' behaviors did not always reflect their attitudes towards ES because other factors including topographic constraints, social value of farming or farmer individual and household characteristics also influenced land-management decisions. Those results demonstrated the interest to take into account the complete feedback loop between ES and land management decisions to favor more sustainable ES management.
| S-EPMC4182349 | biostudies-literature
Project description:ObjectiveTo provide high-quality healthcare, it is essential to understand values that guide the healthcare decisions of older adults. We investigated the types of values that culturally diverse older adults incorporate in medical decision making.MethodsFocus groups were held with older adults who varied in cognitive status (mildly impaired versus those with normal cognition) and ethnicity (Hispanic and non-Hispanic). Investigators used a qualitative descriptive approach to analyze transcripts and identify themes.ResultsForty-nine individuals (49% with cognitive impairment; 51% Hispanic) participated. Participants expressed a wide range of values relating to individual factors, familial/cultural beliefs and expectations, balancing risks and benefits, receiving decisional support, and considering values other than their own. Participants emphasized that values are individual-specific, influenced by aging, and change throughout life course. Participants described barriers and facilitators that interfere with or promote value solicitation and incorporation during medical encounters.ConclusionStudy findings highlight that in older adults with various health experiences, cognitive and physical health status, and sociocultural backgrounds, medical decisions are influenced by a variety of values.Practical implicationsClinicians should take time to elicit, understand, and reassess the different types of values of older adults.
| S-EPMC8980797 | biostudies-literature
Project description:We investigated a controversy regarding the role of the dorsal striatum (DS) in deliberate decision-making versus late-stage, stimulus-response learning to the point of automatization. Participants learned to associate abstract images with right or left button presses explicitly before strengthening these associations through stimulus-response trials with (i.e., Session 1) and without (i.e., Session 2) feedback. In Session 1, trials were divided into response-selection and feedback events to separately assess decision versus learning processes. Session 3 evaluated stimulus-response automaticity using a location Stroop task. DS activity correlated with response-selection and not feedback events in Phase 1 (i.e., Blocks 1-3), Session 1. Longer response times (RTs), lower accuracy, and greater intertrial variability characterized Phase 1, suggesting deliberation. DS activity extinguished in Phase 2 (i.e., Blocks 4-12), Session 1, once RTs, response variability, and accuracy stabilized, though stimulus-response automatization continued. This was signaled by persisting improvements in RT and accuracy into Session 2. Distraction between Sessions 1 and 2 briefly reintroduced response uncertainty, and correspondingly, significant DS activity reappeared in Block 1 of Session 2 only. Once stimulus-response associations were again refamiliarized and deliberation unnecessary, DS activation disappeared for Blocks 2-8, Session 2. Interference from previously learned right or left button responses with incongruent location judgments in a location Stroop task provided evidence that automaticity of stimulus-specific button-press responses had developed by the end of Session 2. These results suggest that DS mediates decision making and not late-stage learning, reconciling two, independently evolving and well-supported literatures that implicate DS in different cognitive functions. Hum Brain Mapp 38:6133-6156, 2017. © 2017 Wiley Periodicals, Inc.
| S-EPMC6867067 | biostudies-literature
Project description:Depression is a debilitating condition with a high prevalence. Depressed patients have been shown to be diminished in their ability to integrate their reinforcement history to adjust future behaviour during instrumental reward learning tasks. Here, we tested whether such impairments could also be observed in a Pavlovian conditioning task. We recruited and analysed 32 subjects, 15 with depression and 17 healthy controls, to study behavioural group differences in learning and decision-making. Participants had to estimate the probability of some fractal stimuli to be associated with a binary reward, based on a few passive observations. They then had to make a choice between one of the observed fractals and another target for which the reward probability was explicitly given. Computational modelling was used to succinctly describe participants' behaviour. Patients performed worse than controls at the task. Computational modelling revealed that this was caused by behavioural impairments during both learning and decision phases. Depressed subjects showed lower memory of observed rewards and had an impaired ability to use internal value estimations to guide decision-making in our task.
| S-EPMC6138642 | biostudies-literature