Mice adaptively generate choice variability in a deterministic task.
Ontology highlight
ABSTRACT:
SUBMITTER: Belkaid M
PROVIDER: S-EPMC6972896 | biostudies-literature | 2020 Jan
REPOSITORIES: biostudies-literature
Publications
Mice adaptively generate choice variability in a deterministic task.
Belkaid Marwen M Bousseyrol Elise E Durand-de Cuttoli Romain R Dongelmans Malou M Duranté Etienne K EK Ahmed Yahia Tarek T Didienne Steve S Hanesse Bernadette B Come Maxime M Mourot Alexandre A Naudé Jérémie J Sigaud Olivier O Faure Philippe P
Communications biology 20200121 1
Can decisions be made solely by chance? Can variability be intrinsic to the decision-maker or is it inherited from environmental conditions? To investigate these questions, we designed a deterministic setting in which mice are rewarded for non-repetitive choice sequences, and modeled the experiment using reinforcement learning. We found that mice progressively increased their choice variability. Although an optimal strategy based on sequences learning was theoretically possible and would be more ...[more]
Similar Datasets
Project description:Trial-and-error learning is a universal strategy for establishing which actions are beneficial or harmful in new environments. However, learning stimulus-response associations solely via trial-and-error is often suboptimal, as in many settings dependencies among stimuli and responses can be exploited to increase learning efficiency. Previous studies have shown that in settings featuring such dependencies, humans typically engage high-level cognitive processes and employ advanced learning strategies to improve their learning efficiency. Here we analyze in detail the initial learning phase of a sample of human subjects (N = 85) performing a trial-and-error learning task with deterministic feedback and hidden stimulus-response dependencies. Using computational modeling, we find that the standard Q-learning model cannot sufficiently explain human learning strategies in this setting. Instead, newly introduced deterministic response models, which are theoretically optimal and transform stimulus sequences unambiguously into response sequences, provide the best explanation for 50.6% of the subjects. Most of the remaining subjects either show a tendency towards generic optimal learning (21.2%) or at least partially exploit stimulus-response dependencies (22.3%), while a few subjects (5.9%) show no clear preference for any of the employed models. After the initial learning phase, asymptotic learning performance during the subsequent practice phase is best explained by the standard Q-learning model. Our results show that human learning strategies in the presented trial-and-error learning task go beyond merely associating stimuli and responses via incremental reinforcement. Specifically during initial learning, high-level cognitive processes support sophisticated learning strategies that increase learning efficiency while keeping memory demands and computational efforts bounded. The good asymptotic fit of the Q-learning model indicates that these cognitive processes are successively replaced by the formation of stimulus-response associations over the course of learning.
| S-EPMC6289466 | biostudies-literature
Project description:Reduced dietary protein intake induces adaptive physiological changes in macronutrient preference, energy expenditure, growth, and glucose homeostasis. We demonstrate that deletion of the FGF21 co-receptor ?Klotho (Klb) from the brain produces mice that are unable to mount a physiological response to protein restriction, an effect that is replicated by whole-body deletion of FGF21. Mice forced to consume a low-protein diet exhibit reduced growth, increased energy expenditure, and a resistance to diet-induced obesity, but the loss of FGF21 signaling in the brain completely abrogates that response. When given access to a higher protein alternative, protein-restricted mice exhibit a shift toward protein-containing foods, and central FGF21 signaling is essential for that response. FGF21 is an endocrine signal linking the liver and brain, which regulates adaptive, homeostatic changes in metabolism and feeding behavior during protein restriction.
| S-EPMC6579533 | biostudies-literature
Project description:Mood disorders, including major depressive disorder, can be precipitated by chronic stress. The Y-maze barrier task is an effort-related choice test that measures motivation to expend effort and obtain reward. In mice, chronic stress exposure significantly impacts motivation to work for a higher value reward when a lesser value reward is freely available compared to unstressed mice. Here we describe the chronic corticosterone administration paradigm, which produces a shift in effortful responding in the Y-maze barrier task. In the Y-maze task, one arm contains 4 food pellets, while the other arm contains only 2 pellets. After mice learn to select the high reward arm, barriers with progressively increasing height are then introduced into the high reward arm over multiple test sessions. Unfortunately, most chronic stress paradigms (including corticosterone and social defeat) were developed in male mice and are less effective in female mice. Therefore, we also discuss chronic non-discriminatory social defeat stress (CNSDS), a stress paradigm we developed that is effective in both male and female mice. Repeating results with multiple distinct chronic stressors in male and female mice combined with increased usage of translationally relevant behavior tasks will help to advance the understanding of how chronic stress can precipitate mood disorders.
| S-EPMC7646533 | biostudies-literature
Project description:Nicotinic receptors have been implicated in attentional performance. Nicotine can improve attention in animals and humans, but knowledge about relevant receptor subtypes is very limited.The aim was to examine the role of alpha7 receptors in attentional performance of mice and in effects of nicotine.Mice with targeted deletion of the gene coding for the alpha7 subunit of nicotinic receptors and wild-type controls were trained on a five-choice serial reaction time task with food reinforcers presented under varying parametric conditions. Nicotine was administered in a range of doses (0.001-1.0 mg/kg sc), including those reported to enhance attentional performance.Initially the alpha7(-/-) (knockout) mice responded less accurately and made more anticipatory responses. After task parameters were altered so that the time allowed for responding was reduced and anticipatory (impulsive) responses were punished by a time-out, the pattern of performance deficits changed; there were increased omission errors in alpha7(-/-) mice but normal levels of accuracy and anticipatory responding. Nicotine did not improve any measure of performance, either with the original training parameters or after retraining; the largest dose used (1.0 mg/kg) produced a general impairment of responding in alpha7(-/-) and wild-type mice.alpha7 nicotinic receptor knockout mice are impaired in performance of the 5-CSRTT, suggesting a possible role for alpha7 receptors in attentional processing. However, identification of a protocol for assessing attention-enhancing effects of nicotine in mice may require further modifications of test procedures or the use of different strains of animal.
| S-EPMC1705494 | biostudies-other
Project description:The role of changes of mind and multiple choices has recently received increased attention in the study of perceptual decision-making. Previously, these extensions to standard two-alternative tasks have been studied separately. Here we explored how changes of mind depend on the number of choice-alternatives. To this end, we tested 14 human subjects on a 2- and 4-alternative direction-discrimination task. Changes of mind in the participants' movement trajectories could be observed for two and for four choice alternatives. With fewer alternatives, participants responded faster and more accurately. The frequency of changes of mind, however, did not significantly differ for the different numbers of choice alternatives. Nevertheless, mind-changing improved the participants' final performance, particularly for intermediate difficulty levels, in both experimental conditions. Moreover, the mean reaction times of individual participants were negatively correlated with their overall tendency to make changes of mind. We further reproduced these findings with a multi-alternative attractor model for decision-making, while a simple race model could not account for the experimental data. Our experiment, combined with the theoretical models allowed us to shed light on: (1) the differences in choice behavior between two and four alternatives, (2) the differences between the data of our human subjects and previous monkey data, (3) individual differences between participants, and (4) the inhibitory interaction between neural representations of choice alternatives.
| S-EPMC3420910 | biostudies-literature
Project description:INTRODUCTION:In Essential Tremor (ET), tremor characteristics and the impairment caused by tremor may vary from task to task. A variability of tremor frequency between postural and kinetic tasks has been proposed in ET, suggesting either multiple central oscillating networks, or peripheral or proprioceptive feedback-mechanisms. This electrophysiological study aimed to assess tremor frequencies and amplitudes in tasks involving postural and kinetic tremor, and compare findings within and across tasks, to delineate physiological differences underlying individually affected manual tasks in ET. METHODS:40 ET patients were included in the study. Tremor was characterized clinically, as well as electrophysiologically using accelerometry and digitizing tablet tasks. Tremor amplitude measures and frequencies were extracted for tasks involving kinetic (digital spiral drawing, handwriting), as well as postural tremor. Tremor was compared between and within tasks. RESULTS:Digital spiral tremor frequencies were significantly higher compared to postural tremor frequencies, as measured by accelerometry, with a mean difference of >2 Hz (p < 0.001). Within-task variability of repeated digital spirals revealed a significant amplitude reduction over time in both hands (p < 0.001), with an up to 32% reduction compared to the first spiral. CONCLUSION:ET exhibited a frequency variability, which was dependent on activation condition, suggesting neurophysiologically distinct pathways between postural and kinetic tremor. The reduction of tremor amplitudes observed in repeated digital spiral drawing may be explained by a learning effect or adaptation, and should be considered as non-random factor of variability when using spirals in ET to assess effects of interventions.
| S-EPMC5739030 | biostudies-literature
Project description:People sometimes persistently pursue hard-to-get targets. Why people pursue such targets is unclear. Here, we hypothesized that choice perseverance, which is the tendency to repeat the same choice independent of the obtained outcomes, leads individuals to repeatedly choose a hard-to-get target, which consequently increases their preference for the target. To investigate this hypothesis, we conducted an online experiment involving an avatar choice task in which the participants repeatedly selected one avatar, and the selected avatar expressed their valence reactions through facial expressions and voice. We defined "hard-to-get" and "easy-to-get" avatars by manipulating the outcome probability such that the hard-to-get avatars rarely provided a positive reaction when selected, while the easy-to-get avatars frequently did. We found that some participants repeatedly selected hard-to-get avatars (Pursuit group). Based on a simulation, we found that higher choice perseverance accounted for the pursuit of hard-to-get avatars and that the Pursuit group had significantly higher choice perseverance than the No-pursuit group. Model fitting to the choice data also supported that choice perseverance can account for the pursuit of hard-to-get avatars in the Pursuit group. Moreover, we found that although baseline attractiveness was comparable among all avatars used in the choice task, the attractiveness of the hard-to-get avatars was significantly increased only in the Pursuit group. Taken together, we conclude that people with high choice perseverance pursue hard-to-get targets, rendering such targets more attractive. The tolerance for negative outcomes might be an important factor for succeeding in our lives but sometimes triggers problematic behavior, such as stalking. The present findings may contribute to understanding the psychological mechanisms of passion and perseverance for one's long-term goals, which are more general than the romantic context imitated in avatar choice.
| S-EPMC9488557 | biostudies-literature
Project description:Experiments aiming to understand sensory-motor systems, cognition and behavior necessitate training animals to perform complex tasks. Traditional training protocols require lab personnel to move the animals between home cages and training chambers, to start and end training sessions, and in some cases, to hand-control each training trial. Human labor not only limits the amount of training per day, but also introduces several sources of variability and may increase animal stress. Here we present an automated training system for the 5-choice serial reaction time task (5CSRTT), a classic rodent task often used to test sensory detection, sustained attention and impulsivity. We found that full automation without human intervention allowed rapid, cost-efficient training, and decreased stress as measured by corticosterone levels. Training breaks introduced only a transient drop in performance, and mice readily generalized across training systems when transferred from automated to manual protocols. We further validated our automated training system with wireless optogenetics and pharmacology experiments, expanding the breadth of experimental needs our system may fulfill. Our automated 5CSRTT system can serve as a prototype for fully automated behavioral training, with methods and principles transferrable to a range of rodent tasks.
| S-EPMC7752912 | biostudies-literature
Project description:Alcohol use disorder (AUD) is related to excessive binge alcohol consumption, and there is considerable interest in associated factors that promote intake. AUD has many behavioral facets that enhance inflexibility toward alcohol consumption, including impulsivity, motivation, and attention. Thus, it is important to understand how these factors might promote responding for alcohol and can change after protracted alcohol intake. Previous studies have explored such behavioral factors using responding for sugar in the 5-Choice Serial Reaction Time Task (5-CSRTT), which allows careful separation of impulsivity, attention, and motivation. Importantly, our studies uniquely focus on using alcohol as the reward throughout training and testing sessions, which is critical for beginning to answer central questions relating to behavioral engagement for alcohol. Alcohol preference and consumption in male C57BL/6 mice were determined from the first 9 sessions of 2-h alcohol drinking which were interspersed among 5-CSRTT training. Interestingly, alcohol preference but not consumption level significantly predicted 5-CSRTT responding for alcohol. In contrast, responding for strawberry milk was not related to alcohol preference. Moreover, high-preference (HP) mice made more correct alcohol-directed responses than low-preference (LP) during the first half of each session and had more longer reward latencies in the second half, with no differences when performing for strawberry milk, suggesting that HP motivation for alcohol may reflect "front-loading." Mice were then exposed to an Intermittent Access to alcohol paradigm and retested in 5-CSRTT. While both HP and LP mice increased 5-CSRTT responding for alcohol, but not strawberry milk, LP performance rose to HP levels, with a greater change in correct and premature responding in LP versus HP. Overall, this study provides three significant findings: (1) alcohol was a suitable reward in the 5-CSRTT, allowing dissection of impulsivity, attention, and motivation in relation to alcohol drinking, (2) alcohol preference was a more sensitive indicator of mouse 5-CSRTT performance than consumption, and (3) intermittent alcohol drinking promoted behavioral engagement with alcohol, especially for individuals with less initial engagement.
| S-EPMC9522902 | biostudies-literature
Project description:Cell reprogramming is considered a stochastic process, and it is not clear which cells are prone to be reprogrammed and whether a deterministic step exists. Here, asymmetric cell division (ACD) at the early stage of induced neuronal (iN) reprogramming is shown to play a deterministic role in generating elite cells for reprogramming. Within one day, fibroblasts underwent ACD, with one daughter cell being converted into an iN precursor and the other one remaining as a fibroblast. Inhibition of ACD significantly inhibited iN conversion. Moreover, the daughter cells showed asymmetric DNA segregation and histone marks during cytokinesis, and the cells inheriting newly replicated DNA strands during ACD became iN precursors. These results unravel a deterministic step at the early phase of cell reprogramming and demonstrate a novel role of ACD in cell phenotype change. This work also supports a novel hypothesis that daughter cells with newly replicated DNA strands are elite cells for reprogramming, which remains to be tested in various reprogramming processes.
| S-EPMC8025021 | biostudies-literature