Nuclei accumbens phase synchrony predicts decision-making reversals following negative feedback.
Ontology highlight
ABSTRACT:
SUBMITTER: Cohen MX
PROVIDER: S-EPMC2725399 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Positive feedback plays a major role in the emergence of many collective animal behaviours. In many ants pheromone trails recruit and direct nestmate foragers to food sources. The strong positive feedback caused by trail pheromones allows fast collective responses but can compromise flexibility. Previous laboratory experiments have shown that when the environment changes, colonies are often unable to reallocate their foragers to a more rewarding food source. Here we show both experimentally, using colonies of Lasius niger, and with an agent-based simulation model, that negative feedback caused by crowding at feeding sites allows ant colonies to maintain foraging flexibility even with strong recruitment to food sources. In a constant environment, negative feedback prevents the frequently found bias towards one feeder (symmetry breaking) and leads to equal distribution of foragers. In a changing environment, negative feedback allows a colony to quickly reallocate the majority of its foragers to a superior food patch that becomes available when foraging at an inferior patch is already well underway. The model confirms these experimental findings and shows that the ability of colonies to switch to a superior food source does not require the decay of trail pheromones. Our results help to resolve inconsistencies between collective foraging patterns seen in laboratory studies and observations in the wild, and show that the simultaneous action of negative and positive feedback is important for efficient foraging in mass-recruiting insect colonies.
| S-EPMC3440389 | biostudies-literature
Project description:Repetitive negative thinking (RNT) represents a transdiagnostic risk factor for affective disorders, and stress is theorized to exacerbate this vulnerability. One mechanism by which stress may influence individual differences in psychiatric symptoms is through altered decision-making, and loss aversion in particular. The present study uses multiple methods to investigate the relationships between RNT, stress, and decision-making. We measured RNT in young adults (N = 90) recently exposed to a natural stressor, Hurricane Irma, and tested the influence of RNT on changes in affect, cortisol, and decision-making during a laboratory stress induction two months later. Post-hurricane RNT predicted greater increases in loss averse decision-making (β = 0.30 [0.14, 0.47], p < .001; rp2 = 0.079) and negative affect (β = 0.59 [0.37, 0.81], p < .001; rp2 = 0.319) during the early-phase response to the laboratory stressor, as well as poorer cortisol recovery (β = 0.32, [0.10, 0.54], p = .005; rp2 = 0.095) in the late-phase stress response. Results highlight the role of loss aversion and stress in understanding RNT as an affective vulnerability factor.
| S-EPMC9881836 | biostudies-literature
Project description:To optimize behavior, organisms evaluate the risks and benefits of available choices. The mesolimbic dopamine (DA) system encodes information about response costs and reward delays that bias choices. However, it remains unclear whether subjective value associated with risk-taking behavior is encoded by DA release.Rats (n = 11) were trained on a risk-based decision-making task in which visual cues predicted the opportunity to respond for smaller certain (safer) or larger uncertain (riskier) rewards. Following training, DA release within the nucleus accumbens (NAc) was monitored on a rapid time scale using fast-scan cyclic voltammetry during the risk-based decision-making task.Individual differences in risk-taking behavior were observed as animals displayed a preference for either safe or risky rewards. When only one response option was available, reward predictive cues evoked increases in DA concentration in the NAc core that scaled with each animal's preferred reward contingency. However, when both options were presented simultaneously, cue-evoked DA release signaled the animals preferred reward contingency, regardless of the future choice. Furthermore, DA signaling in the NAc core also tracked unexpected presentations or omissions of rewards following prediction error theory.These results suggest that the dopaminergic projections to the NAc core encode the subjective value of future rewards that may function to influence future decisions to take risks.
| S-EPMC3253943 | biostudies-literature
Project description:In many situations, decision-making behaviors are mostly composed of team patterns (i.e., more than two persons). However, brain-based models that inform how team interactions contribute and impact team collaborative decision-making (TCDM) behavior, is lacking. To examine the neural substrates activated during TCDM in realistic, interpersonal interaction contexts, dyads were asked to model TCDM toward their opponent, in a multi-person prisoner's dilemma game, while neural activity was measured using functional near infrared spectroscopy. These experiments resulted in two main findings. First, there are different neural substrates between TCDM and ISDM, which were modulated by social environmental cues. i.e., the low incentive reward yielded higher activation within the left inferior frontal gyrus (IFG), in individual separately decision-making (ISDM) stage while the dorsolateral prefrontal cortex (DLPFC) and the middle frontopolar area was activated in TCDM stage. The high incentive reward evoked a higher interbrain synchrony (IBS) value in the right IFG in TCDM stage. Second, males showed higher activation in the DLPFC and the middle frontopolar area during ISDM, while females evoked higher IBS in the right IFG during TCDM. These sex effects suggest that in individual social dilemma situations, males and females may separately depend on non-social and social cognitive ability to make decisions, while in the social interaction situations of TCDM, females may depend on both social and non-social cognitive abilities. This study provide a compelling basis and interesting perspective for future neuroscience work of TCDM behaviors.
| S-EPMC8319628 | biostudies-literature
Project description:To make an optimal decision we need to weigh all the available options, compare them with the current goal, and choose the most rewarding one. Depending on the situation an optimal decision could be to either "explore" or "exploit" or "not to take any action" for which the Basal Ganglia (BG) is considered to be a key neural substrate. In an attempt to expand this classical picture of BG function, we had earlier hypothesized that the Indirect Pathway (IP) of the BG could be the subcortical substrate for exploration. In this study we build a spiking network model to relate exploration to synchrony levels in the BG (which are a neural marker for tremor in Parkinson's disease). Key BG nuclei such as the Sub Thalamic Nucleus (STN), Globus Pallidus externus (GPe) and Globus Pallidus internus (GPi) were modeled as Izhikevich spiking neurons whereas the Striatal output was modeled as Poisson spikes. The model is cast in reinforcement learning framework with the dopamine signal representing reward prediction error. We apply the model to two decision making tasks: a binary action selection task (similar to one used by Humphries et al., 2006) and an n-armed bandit task (Bourdaud et al., 2008). The model shows that exploration levels could be controlled by STN's lateral connection strength which also influenced the synchrony levels in the STN-GPe circuit. An increase in STN's lateral strength led to a decrease in exploration which can be thought as the possible explanation for reduced exploratory levels in Parkinson's patients. Our simulations also show that on complete removal of IP, the model exhibits only Go and No-Go behaviors, thereby demonstrating the crucial role of IP in exploration. Our model provides a unified account for synchronization, action section, and explorative behavior.
| S-EPMC4444758 | biostudies-literature
Project description:The focus of this literature review is on the three interacting brain areas that participate in decision-making: basal ganglia, ventral motor thalamic nuclei, and medial prefrontal cortex, with an emphasis on the participation of the ventromedial and ventral anterior motor thalamic nuclei in prefrontal cortical function. Apart from a defining input from the mediodorsal thalamus, the prefrontal cortex receives inputs from ventral motor thalamic nuclei that combine to mediate typical prefrontal functions such as associative learning, action selection, and decision-making. Motor, somatosensory and medial prefrontal cortices are mainly contacted in layer 1 by the ventral motor thalamic nuclei and in layer 3 by thalamocortical input from mediodorsal thalamus. We will review anatomical, electrophysiological, and behavioral evidence for the proposed participation of ventral motor thalamic nuclei and medial prefrontal cortex in rat and mouse motor decision-making.
| S-EPMC6587977 | biostudies-literature
Project description:The nucleus accumbens (NAc) serves as an integral node within cortico-limbic circuitry that regulates various forms of cost-benefit decision making. The dopamine (DA) system has also been implicated in enabling organisms to overcome a variety of costs to obtain more valuable rewards. However, it remains unclear how DA activity within the NAc may regulate decision making involving reward uncertainty. This study investigated the contribution of different DA receptor subtypes in the NAc to risk-based decision making, assessed with a probabilistic discounting task. In well-trained rats, D1 receptor blockade with SCH 23,390 decreased preference for larger, uncertain rewards, which was associated with enhanced negative-feedback sensitivity (ie, an increased tendency to select a smaller/certain option after an unrewarded risky choice). Treatment with a D1 agonist (SKF 81,297) optimized decision making, increasing choice of the risky option when reward probability was high, and decreasing preference under low probability conditions. In stark contrast, neither blockade of NAc D2 receptors with eticlopride, nor stimulation of these receptors with quinpirole or bromocriptine influenced risky choice. In comparison, infusion of the D3-preferring agonist PD 128,907 decreased reward sensitivity and risky choice. Collectively, these results show that mesoaccumbens DA refines risk-reward decision biases via dissociable mechanisms recruiting D1 and D3, but not D2 receptors. D1 receptor activity mitigates the effect of reward omissions on subsequent choices to promote selection of reward options that may have greater long-term utility, whereas excessive D3 receptor activity blunts the impact that larger/uncertain rewards have in promoting riskier choices.
| S-EPMC3671985 | biostudies-other
Project description:Study objectivesTo better understand the sometimes catastrophic effects of sleep loss on naturalistic decision making, we investigated effects of sleep deprivation on decision making in a reversal learning paradigm requiring acquisition and updating of information based on outcome feedback.DesignSubjects were randomized to a sleep deprivation or control condition, with performance testing at baseline, after 2 nights of total sleep deprivation (or rested control), and following 2 nights of recovery sleep. Subjects performed a decision task involving initial learning of go and no go response sets followed by unannounced reversal of contingencies, requiring use of outcome feedback for decisions. A working memory scanning task and psychomotor vigilance test were also administered.SettingSix consecutive days and nights in a controlled laboratory environment with continuous behavioral monitoring.SubjectsTwenty-six subjects (22-40 y of age; 10 women).InterventionsThirteen subjects were randomized to a 62-h total sleep deprivation condition; the others were controls.Measurements and resultsUnlike controls, sleep deprived subjects had difficulty with initial learning of go and no go stimuli sets and had profound impairment adapting to reversal. Skin conductance responses to outcome feedback were diminished, indicating blunted affective reactions to feedback accompanying sleep deprivation. Working memory scanning performance was not significantly affected by sleep deprivation. And although sleep deprived subjects showed expected attentional lapses, these could not account for impairments in reversal learning decision making.ConclusionsSleep deprivation is particularly problematic for decision making involving uncertainty and unexpected change. Blunted reactions to feedback while sleep deprived underlie failures to adapt to uncertainty and changing contingencies. Thus, an error may register, but with diminished effect because of reduced affective valence of the feedback or because the feedback is not cognitively bound with the choice. This has important implications for understanding and managing sleep loss-induced cognitive impairment in emergency response, disaster management, military operations, and other dynamic real-world settings with uncertain outcomes and imperfect information.
| S-EPMC4402662 | biostudies-literature
Project description:To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats' preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.
| S-EPMC3992205 | biostudies-literature
Project description:Emotional feedback, such as faces showing emotions, can influence decision making. Decision making and emotional face processing, mainly mediated by the prefrontal and cingulate cortices, are impaired in suicide attempters. Here, we used functional MRI (fMRI) to study prefrontal activation in suicide attempters during a modified version of the Iowa Gambling Task (IGT) that included emotional face feedback. We randomly distributed the 116 euthymic women (n = 45 suicide attempters, n = 41 affective controls with history of depression without suicide attempt, and n = 30 healthy controls) included in the study in three emotional IGT groups: concordant (safe and risky choices followed by happy and angry faces, respectively), discordant (safe and risky choices followed by angry and happy faces, respectively), and neutral condition (safe and risky choices followed by neutral faces). Considering the two IGT phases (ambiguous and risky), we then analyzed five regions of interest during the risky vs. safe choices: orbitofrontal (OFC), anterior cingulate (ACC), ventrolateral (VLPFC), medial (MPFC) and dorsal prefrontal (DPFC) cortices. We found: (1) impaired decision making and increased DPFC and OFC activation in suicide attempters vs. controls in the discordant condition during the risky phase; (2) reduced VLPFC activation in suicide attempters in the concordant condition during the ambiguous phase; and (3) decreased OFC, ACC and DPFC activation in both control groups in the concordant condition during the ambiguous phase. Suicide attempters showed prefrontal alterations during reward-learning decision making with emotional feedback. Suicide attempters may guide their decisions to avoid social negative feedback despite the expected outcome.
| S-EPMC7501865 | biostudies-literature