A two-neuron system for adaptive goal-directed decision-making in Lymnaea.
Ontology highlight
ABSTRACT:
SUBMITTER: Crossley M
PROVIDER: S-EPMC4895806 | biostudies-other | 2016
REPOSITORIES: biostudies-other
Publications
A two-neuron system for adaptive goal-directed decision-making in Lymnaea.
Crossley Michael M Staras Kevin K Kemenes György G
Nature communications 20160603
During goal-directed decision-making, animals must integrate information from the external environment and their internal state to maximize resource localization while minimizing energy expenditure. How this complex problem is solved by the nervous system remains poorly understood. Here, using a combined behavioural and neurophysiological approach, we demonstrate that the mollusc Lymnaea performs a sophisticated form of decision-making during food-searching behaviour, using a core system consist ...[more]
Similar Datasets
Project description:When we plan for long-range goals, proximal information cannot be exploited in a blindly myopic way, as relevant future information must also be considered. But when a subgoal must be resolved first, irrelevant future information should not interfere with the processing of more proximal, subgoal-relevant information. We explore the idea that decision making in both situations relies on the flexible modulation of the degree to which different pieces of information under consideration are weighted, rather than explicitly decomposing a problem into smaller parts and solving each part independently. We asked participants to find the shortest goal-reaching paths in mazes and modeled their initial path choices as a noisy, weighted information integration process. In a base task where choosing the optimal initial path required weighting starting-point and goal-proximal factors equally, participants did take both constraints into account, with participants who made more accurate choices tending to exhibit more balanced weighting. The base task was then embedded as an initial subtask in a larger maze, where the same two factors constrained the optimal path to a subgoal, and the final goal position was irrelevant to the initial path choice. In this more complex task, participants' choices reflected predominant consideration of the subgoal-relevant constraints, but also some influence of the initially-irrelevant final goal. More accurate participants placed much less weight on the optimality-irrelevant goal and again tended to weight the two initially-relevant constraints more equally. These findings suggest that humans may rely on a graded, task-sensitive weighting of multiple constraints to generate approximately optimal decision outcomes in both hierarchical and non-hierarchical goal-directed tasks.
| S-EPMC9255770 | biostudies-literature
Project description:Everyday decision-making is supported by a dual-system of control comprised of parallel goal-directed and habitual systems. Over the past decade, the two-stage Markov decision task has become popularized for its ability to dissociate between goal-directed and habitual decision-making. While a handful of studies have implemented decision-making tasks online, only one study has validated the task by comparing in-person and web-based performance on the two-stage task in children and young adults. To date, no study has validated the dissociation of goal-directed and habitual behaviors in older adults online. Here, we implemented and validated a web-based version of the two-stage Markov task using parameter simulation and recovery and compared behavioral results from online and in-person participation on the two-stage task in both young and healthy older adults. We found no differences in estimated free parameters between online and in-person participation on the two-stage task. Further, we replicate previous findings that young adults are more goal-directed than older adults both in-person and online. Overall, this work demonstrates that the implementation and use of the two-stage Markov decision task for remote participation is feasible in the older adult demographic, which would allow for the study of decision-making with larger and more diverse samples.
| S-EPMC8276057 | biostudies-literature
Project description:Hospice and palliative care teams face numerous barriers to the meaningful involvement of patients and families in medical decision making, which limits opportunities for exploration of the very values, preferences, and goals that ideally inform serious illness care. Researchers who develop and test interventions to address these barriers have noted the complementary utility of two existing models in supporting collaborative relationships between hospice and palliative care teams and the patients and families they serve: (1) the social problem-solving model, and (2) the integrative model of shared decision making in medical encounters. This paper describes the integration and extension of these two highly synergistic models, resulting in a goal-directed model of collaborative decision making in hospice and palliative care. Directions for practice innovation and research informed by the model are discussed at length.
| S-EPMC9106802 | biostudies-literature
Project description:Recent work has given rise to the view that reward-based decision making is governed by two key controllers: a habit system, which stores stimulus-response associations shaped by past reward, and a goal-oriented system that selects actions based on their anticipated outcomes. The current literature provides a rich body of computational theory addressing habit formation, centering on temporal-difference learning mechanisms. Less progress has been made toward formalizing the processes involved in goal-directed decision making. We draw on recent work in cognitive neuroscience, animal conditioning, cognitive and developmental psychology, and machine learning to outline a new theory of goal-directed decision making. Our basic proposal is that the brain, within an identifiable network of cortical and subcortical structures, implements a probabilistic generative model of reward, and that goal-directed decision making is effected through Bayesian inversion of this model. We present a set of simulations implementing the account, which address benchmark behavioral and neuroscientific findings, and give rise to a set of testable predictions. We also discuss the relationship between the proposed framework and other models of decision making, including recent models of perceptual choice, to which our theory bears a direct connection.
| S-EPMC3767755 | biostudies-literature
Project description:The prelimbic prefrontal cortex is necessary for associating actions with their consequences, enabling goal-directed decision making. We find that the strength of action-outcome conditioning correlates with dendritic spine density in prelimbic cortex, suggesting that new action-outcome learning involves dendritic spine plasticity. To test this, we inhibited the cytoskeletal regulatory factor Rho kinase. We find that the inhibitor fasudil enhances action-outcome memory, resulting in goal-directed behavior in mice that would otherwise express stimulus-response habits. Fasudil transiently reduces prelimbic cortical dendritic spine densities during a period of presumed memory consolidation, but only when paired with new learning. Fasudil also blocks habitual responding for cocaine, an effect that persists over time, across multiple contexts, and depends on actin polymerization. We suggest that Rho kinase inhibition promotes goal-oriented action selection by augmenting the plasticity of prelimbic cortical dendritic spines during the formation of new action-outcome memories.
| S-EPMC5707361 | biostudies-literature
Project description:RATIONALE: Across species, serotonin (5-HT) depletion in the prefrontal cortex (PFC) has been shown to cause impaired performance on tests of cognitive flexibility and the processing of affective information (e.g. information with an 'emotional' content). While recent work has explored the specific role of the orbital PFC herein, the role of the medial PFC remains unclear. OBJECTIVES: The aim of our current experiments was to study the role of medial PFC 5-HT in both the processing of affective information and reversal learning across stimulus modalities. MATERIALS AND METHODS: To this end, we selectively destroyed 5-HT terminals in the medial PFC of male Wistar rats by means of local infusion of the toxin 5,7-dihydroxytryptamine. Both control and lesioned animals were tested in two reversal learning paradigms with either spatial or odour cues and an affective switch from non-preferred to preferred food rewards. RESULTS: Our results indicate that a pellet switch during reversal learning impaired performance in control animals but not in lesioned animals, independent of the stimulus modality. CONCLUSION: These results indicate that lesioned animals are not guided in their behaviour by the affective value of the reward like intact animals and thus that medial prefrontal 5-HT is needed for affective processing in goal-directed behaviour.
| S-EPMC2080349 | biostudies-other
Project description:Involvement of many variables, uncertainty in treatment response, and inter-patient heterogeneity challenge objective decision-making in dynamic treatment regime (DTR) in oncology. Advanced machine learning analytics in conjunction with information-rich dense multi-omics data have the ability to overcome such challenges. We have developed a comprehensive artificial intelligence (AI)-based optimal decision-making framework for assisting oncologists in DTR. In this work, we demonstrate the proposed framework to Knowledge Based Response-Adaptive Radiotherapy (KBR-ART) applications by developing an interactive software tool entitled Adaptive Radiotherapy Clinical Decision Support (ARCliDS). ARCliDS is composed of two main components: Artifcial RT Environment (ARTE) and Optimal Decision Maker (ODM). ARTE is designed as a Markov decision process and modeled via supervised learning. Given a patient's pre- and during-treatment information, ARTE can estimate treatment outcomes for a selected daily dosage value (radiation fraction size). ODM is formulated using reinforcement learning and is trained on ARTE. ODM can recommend optimal daily dosage adjustments to maximize the tumor local control probability and minimize the side effects. Graph Neural Networks (GNN) are applied to exploit the inter-feature relationships for improved modeling performance and a novel double GNN architecture is designed to avoid nonphysical treatment response. Datasets of size 117 and 292 were available from two clinical trials on adaptive RT in non-small cell lung cancer (NSCLC) patients and adaptive stereotactic body RT (SBRT) in hepatocellular carcinoma (HCC) patients, respectively. For training and validation, dense data with 297 features were available for 67 NSCLC patients and 110 features for 71 HCC patients. To increase the sample size for ODM training, we applied Generative Adversarial Networks to generate 10,000 synthetic patients. The ODM was trained on the synthetic patients and validated on the original dataset. We found that, Double GNN architecture was able to correct the nonphysical dose-response trend and improve ARCliDS recommendation. The average root mean squared difference (RMSD) between ARCliDS recommendation and reported clinical decisions using double GNNs were 0.61 [0.03] Gy/frac (mean [sem]) for adaptive RT in NSCLC patients and 2.96 [0.42] Gy/frac for adaptive SBRT HCC compared to the single GNN's RMSDs of 0.97 [0.12] Gy/frac and 4.75 [0.16] Gy/frac, respectively. Overall, For NSCLC and HCC, ARCliDS with double GNNs was able to reproduce 36% and 50% of the good clinical decisions (local control and no side effects) and improve 74% and 30% of the bad clinical decisions, respectively. In conclusion, ARCliDS is the first web-based software dedicated to assist KBR-ART with multi-omics data. ARCliDS can learn from the reported clinical decisions and facilitate AI-assisted clinical decision-making for improving the outcomes in DTR.
| S-EPMC10066294 | biostudies-literature
Project description:The acts of learning and memory are thought to emerge from the modifications of synaptic connections between neurons, as guided by sensory feedback during behavior. However, much is unknown about how such synaptic processes can sculpt and are sculpted by neuronal population dynamics and an interaction with the environment. Here, we embodied a simulated network, inspired by dissociated cortical neuronal cultures, with an artificial animal (an animat) through a sensory-motor loop consisting of structured stimuli, detailed activity metrics incorporating spatial information, and an adaptive training algorithm that takes advantage of spike timing dependent plasticity. By using our design, we demonstrated that the network was capable of learning associations between multiple sensory inputs and motor outputs, and the animat was able to adapt to a new sensory mapping to restore its goal behavior: move toward and stay within a user-defined area. We further showed that successful learning required proper selections of stimuli to encode sensory inputs and a variety of training stimuli with adaptive selection contingent on the animat's behavior. We also found that an individual network had the flexibility to achieve different multi-task goals, and the same goal behavior could be exhibited with different sets of network synaptic strengths. While lacking the characteristic layered structure of in vivo cortical tissue, the biologically inspired simulated networks could tune their activity in behaviorally relevant manners, demonstrating that leaky integrate-and-fire neural networks have an innate ability to process information. This closed-loop hybrid system is a useful tool to study the network properties intermediating synaptic plasticity and behavioral adaptation. The training algorithm provides a stepping stone towards designing future control systems, whether with artificial neural networks or biological animats themselves.
| S-EPMC2265558 | biostudies-literature
Project description:UnlabelledThe basal ganglia (BG) control action selection, motor programs, habits, and goal-directed learning. The striatum, the principal input structure of BG, is predominantly composed of medium-sized spiny neurons (MSNs). Arising from these spatially intermixed MSNs, two inhibitory outputs form two main efferent pathways, the direct and indirect pathways. Striatonigral MSNs give rise to the activating, direct pathway MSNs and striatopallidal MSNs to the inhibitory, indirect pathway (iMSNs). BG output nuclei integrate information from both pathways to fine-tune motor procedures and to acquire complex habits and skills. Therefore, balanced activity between both pathways is crucial for harmonious functions of the BG. Despite the increase in knowledge concerning the role of glutamate NMDA receptors (NMDA-Rs) in the striatum, understanding of the specific functions of NMDA-R iMSNs is still lacking. For this purpose, we generated a conditional knock-out mouse to address the functions of the NMDA-R in the indirect pathway. At the cellular level, deletion of GluN1 in iMSNs leads to a reduction in the number and strength of the excitatory corticostriatopallidal synapses. The subsequent scaling down in input integration leads to dysfunctional changes in BG output, which is seen as reduced habituation, delay in goal-directed learning, lack of associative behavior, and impairment in action selection or skill learning. The NMDA-R deletion in iMSNs causes a decrease in the synaptic strength of striatopallidal neurons, which in turn might lead to a imbalanced integration between direct and indirect MSN pathways, making mice less sensitive to environmental change. Therefore, their ability to learn and adapt to the environment-based experience was significantly affected.Significance statementThe striatum controls habits, locomotion, and goal-directed behaviors by coordinated activation of two antagonistic pathways. Insofar as NMDA receptors (NMDA-Rs) play a key role in synaptic plasticity essential for sustaining these behaviors, we generated a mouse model lacking NMDA-Rs specifically in striatopallidal neurons. To our knowledge, this is the first time that a specific deletion of inhibitory, indirect pathway medium-sized spiny neuron (iMSN) NMDA-Rs has been used to address the role of these receptors in the inhibitory pathway. Importantly, we found that this specific deletion led to a significant reduction in the number and strength of the cortico-iMSN synapses, which resulted in the significant impairments of behaviors orchestrated by the basal ganglia. Our findings indicate that the NMDA-Rs of the indirect pathway are essential for habituation, action selection, and goal-directed learning.
| S-EPMC4854965 | biostudies-literature
Project description:IntroductionGOAL-Hēm is a novel, haemophilia-specific, patient-centred outcome measure (PCOM) based on goal attainment scaling, allowing people with haemophilia (PwH) to set and monitor the attainment of individualized goals for treatment.AimTo provide a thorough overview of the creation, validation, and development of GOAL-Hēm.MethodsClinician workshops were held to develop a haemophilia-specific goal menu. Qualitative data from semistructured interviews with PwH and their caregivers guided further revisions to the goal menu (i.e., goal domains and descriptors). A feasibility study was performed including a 12-week, prospective, noninterventional evaluation involving clinicians and PwH at four US haemophilia treatment centres. Finally, the Patient Voice Study gathered feedback from PwH and their caregivers via an online survey, interviews, and a focus group.ResultsThe feasibility study validated GOAL-Hēm with successful outcomes in construct/content validity and responsiveness, including a large effect in patient- and clinician-rated goal attainments. The Patient Voice Study led to significant refinement of GOAL-Hēm goals and descriptors, resulting in a more straightforward and relatable menu for PwH and their caregivers. Overall, GOAL-Hēm captured qualitative data in areas important to PwH and employed quantitative methods to evaluate meaningful changes in those areas. The individualized tool was well equipped to handle the complex and chronic nature of haemophilia and was endorsed by PwH, their caregivers, and clinicians.ConclusionThe GOAL-Hēm development journey may serve as a roadmap for other PCOMs in a variety of settings, including clinical studies, haemophilia treatment centres for care planning, and as a tool to gather real-world evidence.
| S-EPMC9546188 | biostudies-literature