Children's value-based decision making.
Ontology highlight
ABSTRACT:
SUBMITTER: Smith KE
PROVIDER: S-EPMC8993860 | biostudies-literature | 2022 Apr
REPOSITORIES: biostudies-literature
Publications
Children's value-based decision making.
Smith Karen E KE Pollak Seth D SD
Scientific reports 20220408 1
To effectively navigate their environments, infants and children learn how to recognize events predict salient outcomes, such as rewards or punishments. Relatively little is known about how children acquire this ability to attach value to the stimuli they encounter. Studies often examine children's ability to learn about rewards and threats using either classical conditioning or behavioral choice paradigms. Here, we assess both approaches and find that they yield different outcomes in terms of w ...[more]
Similar Datasets
Project description:For decades now, normative theories of perceptual decisions, and their implementation as drift diffusion models, have driven and significantly improved our understanding of human and animal behaviour and the underlying neural processes. While similar processes seem to govern value-based decisions, we still lack the theoretical understanding of why this ought to be the case. Here, we show that, similar to perceptual decisions, drift diffusion models implement the optimal strategy for value-based decisions. Such optimal decisions require the models' decision boundaries to collapse over time, and to depend on the a priori knowledge about reward contingencies. Diffusion models only implement the optimal strategy under specific task assumptions, and cease to be optimal once we start relaxing these assumptions, by, for example, using non-linear utility functions. Our findings thus provide the much-needed theory for value-based decisions, explain the apparent similarity to perceptual decisions, and predict conditions under which this similarity should break down.
| S-EPMC4992126 | biostudies-literature
Project description:Prior research illustrates that memory can guide value-based decision-making. For example, previous work has implicated both working memory and procedural memory (i.e., reinforcement learning) in guiding choice. However, other types of memories, such as episodic memory, may also influence decision-making. Here we test the role for episodic memory-specifically item versus associative memory-in supporting value-based choice. Participants completed a task where they first learned the value associated with trial unique lotteries. After a short delay, they completed a decision-making task where they could choose to reengage with previously encountered lotteries, or new never before seen lotteries. Finally, participants completed a surprise memory test for the lotteries and their associated values. Results indicate that participants chose to reengage more often with lotteries that resulted in high versus low rewards. Critically, participants not only formed detailed, associative memories for the reward values coupled with individual lotteries, but also exhibited adaptive decision-making only when they had intact associative memory. We further found that the relationship between adaptive choice and associative memory generalized to more complex, ecologically valid choice behavior, such as social decision-making. However, individuals more strongly encode experiences of social violations-such as being treated unfairly, suggesting a bias for how individuals form associative memories within social contexts. Together, these findings provide an important integration of episodic memory and decision-making literatures to better understand key mechanisms supporting adaptive behavior.
| S-EPMC4833575 | biostudies-literature
Project description:Attention filters sensory inputs to enhance task-relevant information. It is guided by an "attentional template" that represents the stimulus features that are currently relevant. To understand how the brain learns and uses templates, we trained monkeys to perform a visual search task that required them to repeatedly learn new attentional templates. Neural recordings found that templates were represented across the prefrontal and parietal cortex in a structured manner, such that perceptually neighboring templates had similar neural representations. When the task changed, a new attentional template was learned by incrementally shifting the template toward rewarded features. Finally, we found that attentional templates transformed stimulus features into a common value representation that allowed the same decision-making mechanisms to deploy attention, regardless of the identity of the template. Altogether, our results provide insight into the neural mechanisms by which the brain learns to control attention and how attention can be flexibly deployed across tasks.
| S-EPMC11574977 | biostudies-literature
Project description:Humans and other animals often violate economic principles when choosing between multiple alternatives, but the underlying neurocognitive mechanisms remain elusive. A robust finding is that adding a third option can alter the relative preference for the original alternatives, but studies disagree on whether the third option's value decreases or increases accuracy. To shed light on this controversy, we used and extended the paradigm of one study reporting a positive effect. However, our four experiments with 147 human participants and a reanalysis of the original data revealed that the positive effect is neither replicable nor reproducible. In contrast, our behavioral and eye-tracking results are best explained by assuming that the third option's value captures attention and thereby impedes accuracy. We propose a computational model that accounts for the complex interplay of value, attention, and choice. Our theory explains how choice sets and environments influence the neurocognitive processes of multi-alternative decision making.
| S-EPMC6218187 | biostudies-literature
Project description:Apathy is a common and disabling complication of Parkinson's disease characterized by reduced goal-directed behaviour. Several studies have reported dysfunction within prefrontal cortical regions and projections from brainstem nuclei whose neuromodulators include dopamine, serotonin and noradrenaline. Work in animal and human neuroscience have confirmed contributions of these neuromodulators on aspects of motivated decision-making. Specifically, these neuromodulators have overlapping contributions to encoding the value of decisions, and influence whether to explore alternative courses of action or persist in an existing strategy to achieve a rewarding goal. Building upon this work, we hypothesized that apathy in Parkinson's disease should be associated with an impairment in value-based learning. Using a four-armed restless bandit reinforcement learning task, we studied decision-making in 75 volunteers; 53 patients with Parkinson's disease, with and without clinical apathy, and 22 age-matched healthy control subjects. Patients with apathy exhibited impaired ability to choose the highest value bandit. Task performance predicted an individual patient's apathy severity measured using the Lille Apathy Rating Scale (R = -0.46, P < 0.001). Computational modelling of the patient's choices confirmed the apathy group made decisions that were indifferent to the learnt value of the options, consistent with previous reports of reward insensitivity. Further analysis demonstrated a shift away from exploiting the highest value option and a reduction in perseveration, which also correlated with apathy scores (R = -0.5, P < 0.001). We went on to acquire functional MRI in 59 volunteers; a group of 19 patients with and 20 without apathy and 20 age-matched controls performing the Restless Bandit Task. Analysis of the functional MRI signal at the point of reward feedback confirmed diminished signal within ventromedial prefrontal cortex in Parkinson's disease, which was more marked in apathy, but not predictive of their individual apathy severity. Using a model-based categorization of choice type, decisions to explore lower value bandits in the apathy group activated prefrontal cortex to a similar degree to the age-matched controls. In contrast, Parkinson's patients without apathy demonstrated significantly increased activation across a distributed thalamo-cortical network. Enhanced activity in the thalamus predicted individual apathy severity across both patient groups and exhibited functional connectivity with dorsal anterior cingulate cortex and anterior insula. Given that task performance in patients without apathy was no different to the age-matched control subjects, we interpret the recruitment of this network as a possible compensatory mechanism, which compensates against symptomatic manifestation of apathy in Parkinson's disease.
| S-EPMC10994558 | biostudies-literature
Project description:Heuristics and the application of fast-and-frugal trees may play a role in establishing a clinical decision-making framework for value-based oncology. We determined whether clinical decision-making in oncology can be structured heuristically based on the timeline of the patient's treatment, clinical intuition, and evidence-based medicine. A group of 20 patients with advanced non-small cell lung cancer (NSCLC) were enrolled into the study for extensive treatment analysis and sequential decision-making. The extensive clinical and genomic data allowed us to evaluate the methodology and efficacy of fast-and-frugal trees as a way to quantify clinical decision-making. The results of the small cohort will be used to further advance the heuristic framework as a way of evaluating a large number of patients within registries. Among the cohort whose data was analyzed, substitution and amplification mutations occurred most frequently. The top five most prevalent genomic alterations were TP53 (45%), ALK (40%), LRP1B (30%), CDKN2A (25%), and MYC (25%). These 20 cases were analyzed by this clinical decision-making process and separated into two distinctions: 10 straightforward cases that represented a clearer decision-making path and 10 complex cases that represented a more intricate treatment pathway. The myriad of information from each case and their distinct pathways was applied to create the foundation of a framework for lung cancer decision-making as an aid for oncologists. In late-stage lung cancer patients, the fast-and-frugal heuristics can be utilized as a strategy of quantifying proper decision-making with limited information.
| S-EPMC6057456 | biostudies-literature
Project description:Hypnosis can affect perception, motor function and memory. However, so far no study using neuroimaging has investigated whether hypnosis can influence reward processing and decision-making. Here, we assessed whether posthypnotic suggestions can diminish the attractiveness of unhealthy food and whether this is more effective than diminishing attractiveness by one's own effort via autosuggestion. In total, 16 participants were hypnotized and 16 others were instructed to associate a color cue (blue or green) with disgust regarding specific snacks (sweet or salty). Afterwards, participants bid for snack items shown on an either blue or green background during functional magnetic resonance imaging measurement. Both hypnosis and autosuggestion successfully devalued snacks. This was indicated by participants' decision-making, their self-report and by decreased blood oxygen level-dependent signal in the ventromedial prefrontal cortex (vmPFC), a region known to represent value. Different vmPFC subregions coded for cue and snack type. The cue had significantly stronger effects on vmPFC after hypnosis than after autosuggestion, indicating that hypnosis was more effective in genuinely reducing value. Supporting previous findings, the precuneus was involved in the hypnotic effects by encoding whether a snack was sweet or salty during hypnotic cue presentation. Our results demonstrate that posthypnotic suggestions can influence valuation and decision-making.
| S-EPMC4158362 | biostudies-literature
Project description: Not available
| S-EPMC10933545 | biostudies-literature
Project description:Modifying behavior to maximize reward is integral to adaptive decision-making. In rodents, the μ-opioid receptor (MOR) system encodes motivation and preference for high-value rewards. Yet it remains unclear whether and how human MORs contribute to value-based decision-making. We reasoned that if the human MOR system modulates value-based choice, this would be reflected by opposite effects of agonist and antagonist drugs. In a double-blind pharmacological cross-over study, 30 healthy men received morphine (10 mg), placebo, and the opioid antagonist naltrexone (50 mg). They completed a two-alternative decision-making task known to induce a considerable bias towards the most frequently rewarded response option. To quantify MOR involvement in this bias, we fitted accuracy and reaction time data with the drift-diffusion model (DDM) of decision-making. The DDM analysis revealed the expected bidirectional drug effects for two decision subprocesses. MOR stimulation with morphine increased the preference for the stimulus with high-reward probability (shift in starting point). Compared to placebo, morphine also increased, and naltrexone reduced, the efficiency of evidence accumulation. Since neither drug affected motor-coordination, speed-accuracy trade-off, or subjective state (indeed participants were still blinded after the third session), we interpret the MOR effects on evidence accumulation efficiency as a consequence of changes in effort exerted in the task. Together, these findings support a role for the human MOR system in value-based choice by tuning decision-making towards high-value rewards across stimulus domains.
| S-EPMC5520785 | biostudies-literature
Project description:Uncertainty is an inherent property of the environment and a central feature of models of decision-making and learning. Theoretical propositions suggest that one form, unexpected uncertainty, may be used to rapidly adapt to changes in the environment, while being influenced by two other forms: risk and estimation uncertainty. While previous studies have reported neural representations of estimation uncertainty and risk, relatively little is known about unexpected uncertainty. Here, participants performed a decision-making task while undergoing functional magnetic resonance imaging (fMRI), which, in combination with a Bayesian model-based analysis, enabled us to separately examine each form of uncertainty examined. We found representations of unexpected uncertainty in multiple cortical areas, as well as the noradrenergic brainstem nucleus locus coeruleus. Other unique cortical regions were found to encode risk, estimation uncertainty, and learning rate. Collectively, these findings support theoretical models in which several formally separable uncertainty computations determine the speed of learning.
| S-EPMC4885745 | biostudies-literature