Hunger improves reinforcement-driven but not planned action.
Ontology highlight
ABSTRACT:
SUBMITTER: van Swieten MMH
PROVIDER: S-EPMC8563670 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Behavioral choice is ubiquitous in the animal kingdom and is central to goal-oriented behavior. Hypothalamic Agouti-related peptide (AgRP) neurons are critical regulators of appetite. Hungry animals, bombarded by multiple sensory stimuli, are known to modify their behavior during times of caloric need, rapidly adapting to a consistently changing environment. Utilizing ARCAgRP neurons as an entry point, we analyzed the hierarchical position of hunger related to rival drive states. Employing a battery of behavioral assays, we found that hunger significantly increases its capacity to suppress competing motivational systems, such as thirst, anxiety-related behavior, innate fear, and social interactions, often only when food is accessible. Furthermore, real-time monitoring of ARCAgRP activity revealed time-locked responses to conspecific investigation in addition to food presentation, further establishing that, even at the level of ARCAgRP neurons, choices are remarkably flexible computations, integrating internal state, external factors, and anticipated yield. VIDEO ABSTRACT.
| S-EPMC5082717 | biostudies-literature
Project description:Hunger is a motivational state that drives eating and food-seeking behaviour. In a psychological sense, hunger sets the goal that guides an animal in the pursuit of food. The biological basis underlying this purposive, goal-directed nature of hunger has been under intense investigation. With its rich behavioural repertoire and genetically tractable nervous system, the fruit fly Drosophila melanogaster has emerged as an excellent model system for studying the neural basis of hunger and hunger-driven behaviour. Here, we review our current understanding of how hunger is sensed, encoded and translated into foraging and feeding behaviours in the fruit fly.
| S-EPMC6451361 | biostudies-literature
Project description:Reinforcement has long been thought to require striatal synaptic plasticity. Indeed, direct striatal manipulations such as self-stimulation of direct-pathway projection neurons (dMSNs) are sufficient to induce reinforcement within minutes. However, it's unclear what role, if any, is played by downstream circuitry. Here, we used dMSN self-stimulation in mice as a model for striatum-driven reinforcement and mapped the underlying circuitry across multiple basal ganglia nuclei and output targets. We found that mimicking the effects of dMSN activation on downstream circuitry, through optogenetic suppression of basal ganglia output nucleus substantia nigra reticulata (SNr) or activation of SNr targets in the brainstem or thalamus, was also sufficient to drive rapid reinforcement. Remarkably, silencing motor thalamus-but not other selected targets of SNr-was the only manipulation that reduced dMSN-driven reinforcement. Together, these results point to an unexpected role for basal ganglia output to motor thalamus in striatum-driven reinforcement.
| S-EPMC6181560 | biostudies-literature
Project description:Diet-induced obesity leads to dysfunctional feeding behavior. However, the precise molecular nodes underlying diet-induced feeding motivation dysregulation are poorly understood. The fruit fly is a simple genetic model system yet displays significant evolutionary conservation to mammalian nutrient sensing and energy balance. Using a longitudinal high-sugar regime in Drosophila, we sought to address how diet-induced changes in adipocyte lipid composition regulate feeding behavior. We observed that subjecting adult Drosophila to a prolonged high-sugar diet degrades the hunger-driven feeding response. Lipidomics analysis reveals that longitudinal exposure to high-sugar diets significantly alters whole-body phospholipid profiles. By performing a systematic genetic screen for phospholipid enzymes in adult fly adipocytes, we identify Pect as a critical regulator of hunger-driven feeding. Pect is a rate-limiting enzyme in the phosphatidylethanolamine (PE) biosynthesis pathway and the fly ortholog of human PCYT2. We show that disrupting Pect activity only in the Drosophila fat cells causes insulin resistance, dysregulated lipoprotein delivery to the brain, and a loss of hunger-driven feeding. Previously human studies have noted a correlation between PCYT2/Pect levels and clinical obesity. Now, our unbiased studies in Drosophila provide causative evidence for adipocyte Pect function in metabolic homeostasis. Altogether, we have uncovered that PE phospholipid homeostasis regulates hunger response.
| S-EPMC9566863 | biostudies-literature
Project description:Performance during instrumental learning is commonly believed to reflect the knowledge that has been acquired up to that point. However, recent work in rodents found that instrumental performance was enhanced during periods when reinforcement was withheld, relative to periods when reinforcement was provided. This suggests that reinforcement may mask acquired knowledge and lead to impaired performance. In the present study, we investigated whether such a beneficial effect of removing reinforcement translates to humans. Specifically, we tested whether performance during learning was improved during non-reinforced relative to reinforced task periods using signal detection theory and a computational modelling approach. To this end, 60 healthy volunteers performed a novel visual go/no-go learning task with deterministic reinforcement. To probe acquired knowledge in the absence of reinforcement, we interspersed blocks without feedback. In these non-reinforced task blocks, we found an increased d', indicative of enhanced instrumental performance. However, computational modelling showed that this improvement in performance was not due to an increased sensitivity of decision making to learnt values, but to a more cautious mode of responding, as evidenced by a reduction of a general response bias. Together with an initial tendency to act, this is sufficient to drive differential changes in hit and false alarm rates that jointly lead to an increased d'. To conclude, the improved instrumental performance in the absence of reinforcement observed in studies using asymmetrically reinforced go/no-go tasks may reflect a change in response bias rather than unmasking latent knowledge.
| S-EPMC9767373 | biostudies-literature
Project description:Spiny projection neurons (SPNs) in dorsal striatum are often proposed as a locus of reinforcement learning in the basal ganglia. Here, we identify and resolve a fundamental inconsistency between striatal reinforcement learning models and known SPN synaptic plasticity rules. Direct-pathway (dSPN) and indirect-pathway (iSPN) neurons, which promote and suppress actions, respectively, exhibit synaptic plasticity that reinforces activity associated with elevated or suppressed dopamine release. We show that iSPN plasticity prevents successful learning, as it reinforces activity patterns associated with negative outcomes. However, this pathological behavior is reversed if functionally opponent dSPNs and iSPNs, which promote and suppress the current behavior, are simultaneously activated by efferent input following action selection. This prediction is supported by striatal recordings and contrasts with prior models of SPN representations. In our model, learning and action selection signals can be multiplexed without interference, enabling learning algorithms beyond those of standard temporal difference models.
| S-EPMC10925202 | biostudies-literature
Project description:The unified global efforts to mitigate the high burden of vitamin and mineral deficiency, known as hidden hunger, in populations around the world are crucial to the achievement of most of the Millennium Development Goals (MDGs). We developed indices and maps of global hidden hunger to help prioritize program assistance, and to serve as an evidence-based global advocacy tool. Two types of hidden hunger indices and maps were created based on i) national prevalence data on stunting, anemia due to iron deficiency, and low serum retinol levels among preschool-aged children in 149 countries; and ii) estimates of Disability Adjusted Life Years (DALYs) attributed to micronutrient deficiencies in 136 countries. A number of countries in sub-Saharan Africa, as well as India and Afghanistan, had an alarmingly high level of hidden hunger, with stunting, iron deficiency anemia, and vitamin A deficiency all being highly prevalent. The total DALY rates per 100,000 population, attributed to micronutrient deficiencies, were generally the highest in sub-Saharan African countries. In 36 countries, home to 90% of the world's stunted children, deficiencies of micronutrients were responsible for 1.5-12% of the total DALYs. The pattern and magnitude of iodine deficiency did not conform to that of other micronutrients. The greatest proportions of children with iodine deficiency were in the Eastern Mediterranean (46.6%), European (44.2%), and African (40.4%) regions. The current indices and maps provide crucial data to optimize the prioritization of program assistance addressing global multiple micronutrient deficiencies. Moreover, the indices and maps serve as a useful advocacy tool in the call for increased commitments to scale up effective nutrition interventions.
| S-EPMC3680387 | biostudies-literature
Project description:Placebo responses in depression exemplify how expectancies and appraisals impact mood. Cognitive and neural mechanisms underlying these responses are still poorly understood, partly due to the difficulty of simulating antidepressant effects and manipulating mood experimentally. To address these challenges, we developed an acute antidepressant placebo experiment involving the intravenous administration of a "fast-acting antidepressant" and a trial-by-trial sham fMRI "neurofeedback" manipulation, purporting to reveal mood-relevant neural responses. Twenty volunteers with major depression underwent this experiment while rating their expected and actual mood improvement. Mixed-effects analyses of trial-by-trial ratings revealed that the "drug" infusion cues induced higher expectancies of mood improvement, while both the "drug" infusion cue and the sham neurofeedback induced a reported mood improvement. Neurofeedback of greater magnitude, compared to lower magnitude, recruited the lateral prefrontal cortex (lPFC). Individuals with greater lPFC responses to neurofeedback displayed: (1) greater effect of previous mood improvement on expectancy ratings and (2) greater effect of sham neurofeedback on mood improvement. Behavioral antidepressant placebo effects were additionally moderated by changes in peripheral β-endorphin plasma levels and depressive symptomatology. These data demonstrate the feasibility of trial-by-trial manipulation of antidepressant placebo-associated expectancies and their reinforcement. We provide initial insights into the role of the lPFC in the interplay between placebo-induced expectancies and mood, as well as preliminary evidence for the role of the opioid system in antidepressant placebo effects.
| S-EPMC6189213 | biostudies-literature
Project description:Hunger elicits diverse, yet coordinated, adaptive responses across species, but the underlying signaling mechanism remains poorly understood. Here, we report on the function and mechanism of the Drosophila insulin-like system in the central regulation of different hunger-driven behaviors. We found that overexpression of Drosophila insulin-like peptides (DILPs) in the nervous system of fasted larvae suppressed the hunger-driven increase of ingestion rate and intake of nonpreferred foods (e.g., a less accessible solid food). Moreover, up-regulation of Drosophila p70/S6 kinase activity in DILP neurons led to attenuated hunger response by fasted larvae, whereas its down-regulation triggered fed larvae to display motivated foraging and feeding. Finally, we provide evidence that neural regulation of food preference but not ingestion rate may involve direct signaling by DILPs to neurons expressing neuropeptide F receptor 1, a receptor for neuropeptide Y-like neuropeptide F. Our study reveals a prominent role of neural Drosophila p70/S6 kinase in the modulation of hunger response by insulin-like and neuropeptide Y-like signaling pathways.
| S-EPMC1201572 | biostudies-literature
Project description:Soft robots driven by stimuli-responsive materials have their own unique advantages over traditional rigid robots such as large actuation, light weight, good flexibility and biocompatibility. However, the large actuation of soft robots inherently co-exists with difficulty in control with high precision. This article presents a soft artificial muscle driven robot mimicking cuttlefish with a fully integrated on-board system including power supply and wireless communication system. Without any motors, the movements of the cuttlefish robot are solely actuated by dielectric elastomer which exhibits muscle-like properties including large deformation and high energy density. Reinforcement learning is used to optimize the control strategy of the cuttlefish robot instead of manual adjustment. From scratch, the swimming speed of the robot is enhanced by 91% with reinforcement learning, reaching to 21?mm/s (0.38 body length per second). The design principle behind the structure and the control of the robot can be potentially useful in guiding device designs for demanding applications such as flexible devices and soft robots.
| S-EPMC6162322 | biostudies-literature