Dataset Information

Learning relative values in the striatum induces violations of normative decision making.

ABSTRACT: To decide optimally between available options, organisms need to learn the values associated with these options. Reinforcement learning models offer a powerful explanation of how these values are learnt from experience. However, human choices often violate normative principles. We suggest that seemingly counterintuitive decisions may arise as a natural consequence of the learning mechanisms deployed by humans. Here, using fMRI and a novel behavioural task, we show that, when suddenly switched to novel choice contexts, participants' choices are incongruent with values learnt by standard learning algorithms. Instead, behaviour is compatible with the decisions of an agent learning how good an option is relative to an option with which it had previously been paired. Striatal activity exhibits the characteristics of a prediction error used to update such relative option values. Our data suggest that choices can be biased by a tendency to learn option values with reference to the available alternatives.

SUBMITTER: Klein TA

PROVIDER: S-EPMC5481835 | biostudies-other | 2017 Jun

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Learning relative values in the striatum induces violations of normative decision making.

Klein Tilmann A TA Ullsperger Markus M Jocham Gerhard G

Nature communications 20170620

To decide optimally between available options, organisms need to learn the values associated with these options. Reinforcement learning models offer a powerful explanation of how these values are learnt from experience. However, human choices often violate normative principles. We suggest that seemingly counterintuitive decisions may arise as a natural consequence of the learning mechanisms deployed by humans. Here, using fMRI and a novel behavioural task, we show that, when suddenly switched to ...[more]

PMID: 28631734

Similar Datasets

Project description:BackgroundSurgical patients incur preventable harm from cognitive and judgment errors made under time constraints and uncertainty regarding patients' diagnoses and predicted response to treatment. Decision analysis and techniques of reinforcement learning theoretically can mitigate these challenges but are poorly understood and rarely used clinically. This review seeks to promote an understanding of decision analysis and reinforcement learning by describing their use in the context of surgical decision-making.MethodsCochrane, EMBASE, and PubMed databases were searched from their inception to June 2019. Included were 41 articles about cognitive and diagnostic errors, decision-making, decision analysis, and machine-learning. The articles were assimilated into relevant categories according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines.ResultsRequirements for time-consuming manual data entry and crude representations of individual patients and clinical context compromise many traditional decision-support tools. Decision analysis methods for calculating probability thresholds can inform population-based recommendations that jointly consider risks, benefits, costs, and patient values but lack precision for individual patient-centered decisions. Reinforcement learning, a machine-learning method that mimics human learning, can use a large set of patient-specific input data to identify actions yielding the greatest probability of achieving a goal. This methodology follows a sequence of events with uncertain conditions, offering potential advantages for personalized, patient-centered decision-making. Clinical application would require secure integration of multiple data sources and attention to ethical considerations regarding liability for errors and individual patient preferences.ConclusionTraditional decision-support tools are ill-equipped to accommodate time constraints and uncertainty regarding diagnoses and the predicted response to treatment, both of which often impair surgical decision-making. Decision analysis and reinforcement learning have the potential to play complementary roles in delivering high-value surgical care through sound judgment and optimal decision-making.

Project description:The ecosystem services (ES) concept has emerged and spread widely recently, to enhance the importance of preserving ecosystems through global change in order to maintain their benefits for human well-being. Numerous studies consider various dimensions of the interactions between ecosystems and land use via ES, but integrated research addressing the complete feedback loop between biodiversity, ES and land use has remained mostly theoretical. Few studies consider feedbacks from ecosystems to land use systems through ES, exploring how ES are taken into account in land management decisions. To fill this gap, we carried out a role-playing game to explore how ES cognition mediates feedbacks from environmental change on farmers' behaviors in a mountain grassland system. On a close to real landscape game board, farmers were faced with changes in ES under climatic and socio-economic scenarios and prompted to plan for the future and to take land management decisions as they deemed necessary. The outcomes of role-playing game were complemented with additional agronomic and ecological data from interviews and fieldwork. The effects of changes in ES on decision were mainly direct, i.e. not affecting knowledge and values, when they constituted situations with which farmers were accustomed. For example, a reduction of forage quantity following droughts led farmers to shift from mowing to grazing. Sometimes, ES cognitions were affected by ES changes or by external factors, leading to an indirect feedback. This happened when fertilization was stopped after farmers learned that it was inefficient in a drought context. Farmers' behaviors did not always reflect their attitudes towards ES because other factors including topographic constraints, social value of farming or farmer individual and household characteristics also influenced land-management decisions. Those results demonstrated the interest to take into account the complete feedback loop between ES and land management decisions to favor more sustainable ES management.

Dataset Information

Learning relative values in the striatum induces violations of normative decision making.

Publications

Learning relative values in the striatum induces violations of normative decision making.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets