Representation of probabilistic outcomes during risky decision-making.
Ontology highlight
ABSTRACT:
SUBMITTER: Castegnetti G
PROVIDER: S-EPMC7229012 | biostudies-literature | 2020 May
REPOSITORIES: biostudies-literature
Publications
Representation of probabilistic outcomes during risky decision-making.
Castegnetti Giuseppe G Tzovara Athina A Khemka Saurabh S Melinščak Filip F Barnes Gareth R GR Dolan Raymond J RJ Bach Dominik R DR
Nature communications 20200515 1
Goal-directed behaviour requires prospectively retrieving and evaluating multiple possible action outcomes. While a plethora of studies suggested sequential retrieval for deterministic choice outcomes, it remains unclear whether this is also the case when integrating multiple probabilistic outcomes of the same action. We address this question by capitalising on magnetoencephalography (MEG) in humans who made choices in a risky foraging task. We train classifiers to distinguish MEG field patterns ...[more]
Similar Datasets
Project description:To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats' preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.
| S-EPMC3992205 | biostudies-literature
Project description:Dopamine has been associated with risky decision-making, as well as with pathological gambling, a behavioral addiction characterized by excessive risk-taking behavior. However, the specific mechanisms through which dopamine might act to foster risk-taking and pathological gambling remain elusive. Here we test the hypothesis that this might be achieved, in part, via modulation of subjective probability weighting during decision making. Human healthy controls (n = 21) and pathological gamblers (n = 16) played a decision-making task involving choices between sure monetary options and risky gambles both in the gain and loss domains. Each participant played the task twice, either under placebo or the dopamine D2/D3 receptor antagonist sulpiride, in a double-blind counterbalanced design. A prospect theory modelling approach was used to estimate subjective probability weighting and sensitivity to monetary outcomes. Consistent with prospect theory, we found that participants presented a distortion in the subjective weighting of probabilities, i.e., they overweighted low probabilities and underweighted moderate to high probabilities, both in the gain and loss domains. Compared with placebo, sulpiride attenuated this distortion in the gain domain. Across drugs, the groups did not differ in their probability weighting, although gamblers consistently underweighted losing probabilities in the placebo condition. Overall, our results reveal that dopamine D2/D3 receptor antagonism modulates the subjective weighting of probabilities in the gain domain, in the direction of more objective, economically rational decision making.
| S-EPMC5889481 | biostudies-literature
Project description:Many psychiatric disorders are characterized by abnormal risky decision-making and dysregulated dopamine receptor expression. The current study was designed to determine how different dopamine receptor subtypes modulate risk-taking in young adult rats, using a "Risky Decision-making Task" that involves choices between small "safe" rewards and large "risky" rewards accompanied by adverse consequences. Rats showed considerable, stable individual differences in risk preference in the task, which were not related to multiple measures of reward motivation, anxiety, or pain sensitivity. Systemic activation of D2-like receptors robustly attenuated risk-taking, whereas drugs acting on D1-like receptors had no effect. Systemic amphetamine also reduced risk-taking, an effect which was attenuated by D2-like (but not D1-like) receptor blockade. Dopamine receptor mRNA expression was evaluated in a separate cohort of drug-naive rats characterized in the task. D1 mRNA expression in both nucleus accumbens shell and insular cortex was positively associated with risk-taking, while D2 mRNA expression in orbitofrontal and medial prefrontal cortex predicted risk preference in opposing nonlinear patterns. Additionally, lower levels of D2 mRNA in dorsal striatum were associated with greater risk-taking. These data strongly implicate dopamine signaling in prefrontal cortical-striatal circuitry in modulating decision-making processes involving integration of reward information with risks of adverse consequences.
| S-EPMC3307370 | biostudies-literature
Project description:It is not known whether patients with juvenile myoclonic epilepsy (JME) differ from healthy people in decision making under risk, i.e., when the decision-making context offers explicit information about options, probabilities, and consequences already from the beginning. In this study, we adopted the Game of Dice Task-Double to investigate decision making under risk in a group of 36 patients with JME (mean age 25.25/SD 5.29?years) and a group of 38 healthy controls (mean age 26.03/SD 4.84?years). Participants also underwent a comprehensive neuropsychological assessment focused on frontal executive functions. Significant group differences were found in tests of psychomotor speed and divided attention, with the patients scoring lower than the controls. Importantly, patients made risky decisions more frequently than controls. In the patient group, poor decision making was associated with poor executive control, poor response inhibition, and a short interval since the last seizure episode. Executive control and response inhibition could predict 42% of variance in the frequency of risky decisions. This study indicates that patients with JME with poorer executive functions are more likely to make risky decisions than healthy controls. Decision making under risk is of major importance in every-day life, especially with regard to treatment decisions and adherence to long-term medical therapy. Since even a single disadvantageous decision may have long-lasting consequences, this finding is of high relevance.
| S-EPMC5879545 | biostudies-literature
Project description:Some people love taking risks, while others avoid gambles at all costs. The neural mechanisms underlying individual variation in preference for risky or certain outcomes, however, remain poorly understood. Although behavioral pathologies associated with compulsive gambling, addiction and other psychiatric disorders implicate deficient serotonin signaling in pathological decision making, there is little experimental evidence demonstrating a link between serotonin and risky decision making, in part due to the lack of a good animal model. We used dietary rapid tryptophan depletion (RTD) to acutely lower brain serotonin in three macaques performing a simple gambling task for fluid rewards. To confirm the efficacy of RTD experiments, we measured total plasma tryptophan using high-performance liquid chromatography (HPLC) with electrochemical detection. Reducing brain serotonin synthesis decreased preference for the safe option in a gambling task. Moreover, lowering brain serotonin function significantly decreased the premium required for monkeys to switch their preference to the risky option, suggesting that diminished serotonin signaling enhances the relative subjective value of the risky option. These results implicate serotonin in risk-sensitive decision making and, further, suggest pharmacological therapies for treating pathological risk preferences in disorders such as problem gambling and addiction.
| S-EPMC2799948 | biostudies-literature
Project description:Among young children excessive externalizing behaviors often predict adolescent conduct and substance use disorders. Adolescents with those disorders show aberrant brain function when choosing between risky or cautious options. We therefore asked whether similarly aberrant brain function during risky decision-making accompanies excessive externalizing behaviors among children, hypothesizing an association between externalizing severity and regional intensity of brain activation during risky decision-making.Fifty-eight (58) 9-11 year-old children (both sexes), half community-recruited, half with substance-treated relatives, had parent-rated Child Behavior Checklist Externalizing scores. During fMRI, children repeatedly chose between doing a cautious behavior earning 1 point or a risky behavior that won 5 or lost 10 points. Conservative permutation-based whole-brain regression analyses sought brain regions where, during decision-making, activation significantly associated with externalizing score, with sex, and with their interaction.Before risky responses higher externalizing scores were significantly, negatively associated with neural activation (t's: 2.91-4.76) in regions including medial prefrontal cortex (monitors environmental reward-punishment schedules), insula (monitors internal motivating states, e.g., hunger, anxiety), dopaminergic striatal and midbrain structures (anticipate and mediate reward), and cerebellum (where injuries actually induce externalizing behaviors). Before cautious responses there were no significant externalizing:activation associations (except in post hoc exploratory analyses), no significant sex differences in activation, and no significant sex-by-externalizing interactions.Among children displaying more externalizing behaviors extensive decision-critical brain regions were hypoactive before risky behaviors. Such neural hypoactivity may contribute to the excessive real-life risky decisions that often produce externalizing behaviors. Substance exposure, minimal here, was a very unlikely cause.
| S-EPMC5548624 | biostudies-literature
Project description:Although actuarial data indicate that risk-taking behavior peaks in adolescence, laboratory evidence for this developmental spike remains scarce. One possible explanation for this incongruity is that in the real world adolescents often have only vague information about the potential consequences of their behavior and the likelihoods of those consequences, whereas in the lab these are often clearly stated. How do adolescents behave under such more realistic conditions of ambiguity and uncertainty? We asked 105 participants aged from 8 to 22 years to make three types of choices: (1) choices between options whose possible outcomes and probabilities were fully described (choices under risk); (2) choices between options whose possible outcomes were described but whose probability information was incomplete (choices under ambiguity), and (3) choices between unknown options whose possible outcomes and probabilities could be explored (choices under uncertainty). Relative to children and adults, two adolescent-specific markers emerged. First, adolescents were more accepting of ambiguity; second, they were also more accepting of uncertainty (as indicated by shorter pre-decisional search). Furthermore, this tolerance of the unknown was associated with motivational, but not cognitive, factors. These findings offer novel insights into the psychology of adolescent risk taking.
| S-EPMC5241878 | biostudies-other
Project description:Uncertainty is an inherent property of the environment and a central feature of models of decision-making and learning. Theoretical propositions suggest that one form, unexpected uncertainty, may be used to rapidly adapt to changes in the environment, while being influenced by two other forms: risk and estimation uncertainty. While previous studies have reported neural representations of estimation uncertainty and risk, relatively little is known about unexpected uncertainty. Here, participants performed a decision-making task while undergoing functional magnetic resonance imaging (fMRI), which, in combination with a Bayesian model-based analysis, enabled us to separately examine each form of uncertainty examined. We found representations of unexpected uncertainty in multiple cortical areas, as well as the noradrenergic brainstem nucleus locus coeruleus. Other unique cortical regions were found to encode risk, estimation uncertainty, and learning rate. Collectively, these findings support theoretical models in which several formally separable uncertainty computations determine the speed of learning.
| S-EPMC4885745 | biostudies-literature
Project description:Risk-taking is purported to be central to addictive behaviors. However, for Internet gaming disorder (IGD), a condition conceptualized as a behavioral addiction, the neural processes underlying impaired decision-making (risk evaluation and outcome processing) related to gains and losses have not been systematically investigated. Forty-one males with IGD and 27 healthy comparison (HC) male participants were recruited, and the cups task was used to identify neural processes associated with gain- and loss-related risk- and outcome-processing in IGD. During risk evaluation, the IGD group, compared to the HC participants, showed weaker modulation for experienced risk within the bilateral dorsolateral prefrontal cortex (DLPFC) (t = - 4.07; t = - 3.94; PFWE < 0.05) and inferior parietal lobule (IPL) (t = - 4.08; t = - 4.08; PFWE < 0.05) for potential losses. The modulation of the left DLPFC and bilateral IPL activation were negatively related to addiction severity within the IGD group (r = - 0.55; r = - 0.61; r = - 0.51; PFWE < 0.05). During outcome processing, the IGD group presented greater responses for the experienced reward within the ventral striatum, ventromedial prefrontal cortex, and orbitofrontal cortex (OFC) (t = 5.04, PFWE < 0.05) for potential gains, as compared to HC participants. Within the IGD group, the increased reward-related activity in the right OFC was positively associated with severity of IGD (r = 0.51, PFWE < 0.05). These results provide a neurobiological foundation for decision-making deficits in individuals with IGD and suggest an imbalance between hypersensitivity for reward and weaker risk experience and self-control for loss. The findings suggest a biological mechanism for why individuals with IGD may persist in game-seeking behavior despite negative consequences, and treatment development strategies may focus on targeting these neural pathways in this population.
| S-EPMC5385591 | biostudies-literature
Project description:Gambling disorder is a behavioral addiction associated with impairments in value-based decision-making and cognitive control. These functions are thought to be regulated by dopamine within fronto-striatal circuits, but the role of altered dopamine neurotransmission in the etiology of gambling disorder remains controversial. Preliminary evidence suggests that increasing frontal dopamine tone might improve cognitive functioning in gambling disorder. We therefore examined whether increasing frontal dopamine tone via a single dose of the catechol-O-methyltransferase (COMT) inhibitor tolcapone would reduce risky choice in human gamblers (n = 14) in a randomized double-blind placebo-controlled crossover study. Data were analyzed using hierarchical Bayesian parameter estimation and a combined risky choice drift diffusion model (DDM). Model comparison revealed a nonlinear mapping from value differences to trial-wise drift rates, confirming recent findings. An increase in risk-taking under tolcapone versus placebo was about five times more likely, given the data, than a decrease [Bayes factor (BF) = 0.2]. Examination of drug effects on diffusion model parameters revealed that an increase in the value dependency of the drift rate under tolcapone was about thirteen times more likely than a decrease (BF = 0.073). In contrast, a reduction in the maximum drift rate under tolcapone was about seven times more likely than an increase (BF = 7.51). Results add to previous work on COMT inhibitors in behavioral addictions and to mounting evidence for the applicability of diffusion models in value-based decision-making. Future work should focus on individual genetic, clinical and cognitive factors that might account for heterogeneity in the effects of COMT inhibition.
| S-EPMC7294471 | biostudies-literature