Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla–Wagner model [corrected].
Ontology highlight
ABSTRACT:
SUBMITTER: Rasmussen A
PROVIDER: S-EPMC4653177 | biostudies-other | 2015 Nov
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Classical conditioning plays a critical role in the learning process of biological brains, and many computational models have been built to reproduce the related classical experiments. However, these models can reproduce and explain only a limited range of typical phenomena in classical conditioning. Based on existing biological findings concerning classical conditioning, we build a brain-inspired classical conditioning (BICC) model. Compared with other computational models, our BICC model can reproduce as many as 15 classical experiments, explaining a broader set of findings than other models have, and offers better computational explainability for both the experimental phenomena and the biological mechanisms of classical conditioning. Finally, we validate our theoretical model on a humanoid robot in three classical conditioning experiments (acquisition, extinction, and reacquisition) and a speed generalization experiment, and the results show that our model is computationally feasible as a foundation for brain-inspired robot classical conditioning.
| S-EPMC7808924 | biostudies-literature
Project description:The role of sound in Drosophila melanogaster courtship, along with its perception via the antennae, is well established, as is the ability of this fly to learn in classical conditioning protocols. Here, we demonstrate that a neutral acoustic stimulus paired with a sucrose reward can be used to condition the proboscis-extension reflex, part of normal feeding behavior. This appetitive conditioning produces results comparable to those obtained with chemical stimuli in aversive conditioning protocols. We applied a logistic model with general estimating equations to predict the dynamics of learning, which successfully predicts the outcome of training and provides a quantitative estimate of the rate of learning. Use of acoustic stimuli with appetitive conditioning provides both an alternative to models most commonly used in studies of learning and memory in Drosophila and a means of testing hearing in both sexes, independently of courtship responsiveness.
| S-EPMC3154116 | biostudies-other
Project description:Several species of insects have become model systems for studying learning and memory formation. Although many studies focus on freely moving animals, studies implementing classical conditioning paradigms with harnessed insects have been important for investigating the exact cues that individuals learn and the neural mechanisms underlying learning and memory formation. Here we present a protocol for evoking visual associative learning in wood ants through classical conditioning. In this paradigm, ants are harnessed and presented with a visual cue (a blue cardboard), the conditional stimulus (CS), paired with an appetitive sugar reward, the unconditional stimulus (US). Ants perform a Maxilla-Labium Extension Reflex (MaLER), the unconditional response (UR), which can be used as a readout for learning. Training consists of 10 trials, separated by a 5-minute intertrial interval (ITI). Ants are also tested for memory retention 10 minutes or 1 hour after training. This protocol has the potential to allow researchers to analyze, in a precise and controlled manner, the details of visual memory formation and the neural basis of learning and memory formation in wood ants.
| S-EPMC6235424 | biostudies-literature
Project description:Visual crowding is a breakdown in object identification that occurs in cluttered scenes, a process that represents the principle restriction on visual performance in the periphery. When crowded objects are presented experimentally, a key finding is that observers frequently report nearby flanking items instead of the target. This observation has led to the proposal that crowding reflects increased noise in the positional code for objects; although how the presence of nearby objects might disrupt positional encoding remains unclear. We quantified this disruption using cross-like stimuli, where observers judged whether the horizontal target line was positioned above or below the stimulus midpoint. Overall, observers were poorer at judging position in the presence of crowding flankers. However, offsetting horizontal lines in the flankers also led observers to report that the horizontal line in the target was shifted in the same direction, an effect that held for subthreshold flanker offsets. In short, crowding induced both random and systematic errors in observers' judgment of position, with or without the detection of flanker structure. Computational modeling reveals that perceived position in the presence of flankers follows a weighted average of noisy target- and flanker-line positions, rather than a substitution of flanker-features into the target, as has been proposed previously. Together, our results suggest that crowding is a preattentive process that uses averaging to regularize the noisy representation of position in the periphery.
| S-EPMC2711865 | biostudies-literature
Project description:We experimentally investigate how different information about others' individual contributions affects people's willingness to cooperate in a one-shot linear public goods game. We find that when information about individual contributions is provided, contributions are generally higher than when only average information is available. This effect is particularly strong when others' individual contributions are relatively homogeneous. When both types of information are provided, this effect is moderated. In the case of individual feedback we find the willingness to contribute to be higher the lower the variation in others' contributions, but with pronounced heterogeneity in individuals' reactions. While the majority of people are mainly guided by others' average contributions, more people follow the bad example of a low contributor than the good example of a high contributor. Overall, we provide evidence that information (and lack thereof) about others' individual contributions affects people's willingness to cooperate in systematic ways.
| S-EPMC5788275 | biostudies-literature
Project description:Direct reciprocity, or repeated interaction, is a main mechanism to sustain cooperation under social dilemmas involving two individuals. For larger groups and networks, which are probably more relevant to understanding and engineering our society, experiments employing repeated multiplayer social dilemma games have suggested that humans often show conditional cooperation behavior and its moody variant. Mechanisms underlying these behaviors largely remain unclear. Here we provide a proximate account for this behavior by showing that individuals adopting a type of reinforcement learning, called aspiration learning, phenomenologically behave as conditional cooperator. By definition, individuals are satisfied if and only if the obtained payoff is larger than a fixed aspiration level. They reinforce actions that have resulted in satisfactory outcomes and anti-reinforce those yielding unsatisfactory outcomes. The results obtained in the present study are general in that they explain extant experimental results obtained for both so-called moody and non-moody conditional cooperation, prisoner's dilemma and public goods games, and well-mixed groups and networks. Different from the previous theory, individuals are assumed to have no access to information about what other individuals are doing such that they cannot explicitly use conditional cooperation rules. In this sense, myopic aspiration learning in which the unconditional propensity of cooperation is modulated in every discrete time step explains conditional behavior of humans. Aspiration learners showing (moody) conditional cooperation obeyed a noisy GRIM-like strategy. This is different from the Pavlov, a reinforcement learning strategy promoting mutual cooperation in two-player situations.
| S-EPMC4954710 | biostudies-literature
Project description:Living systems have inspired research on non-biological dynamic materials and systems chemistry to mimic specific complex biological functions. Upon pursuing ever more complex life-inspired non-biological systems, mimicking even the most elementary aspects of learning is a grand challenge. We demonstrate a programmable hydrogel-based model system, whose behaviour is inspired by associative learning, i.e., conditioning, which is among the simplest forms of learning. Algorithmically, associative learning minimally requires responsivity to two different stimuli and a memory element. Herein, nanoparticles form the memory element, where a photoacid-driven pH-change leads to their chain-like assembly with a modified spectral behaviour. On associating selected light irradiation with heating, the gel starts to melt upon the irradiation, originally a neutral stimulus. A logic diagram describes such an evolution of the material response. Coupled chemical reactions drive the system out-of-equilibrium, allowing forgetting and memory recovery. The findings encourage to search non-biological materials towards associative and dynamic properties.
| S-EPMC6646376 | biostudies-literature
Project description:Humans and animals can determine whether a situation is favorable to them and act accordingly. For this, the autonomic tuning of the cardiovascular system to supply energy to active skeletal muscles through the circulatory system is as important as motor control. However, how the autonomic cardiovascular responses are regulated in dynamically changing environments and the neuronal mechanisms underlying these responses remain unclear. To resolve these issues, we recorded the blood pressure and heart rate of head-restrained rats during dynamically changing appetitive and aversive classical conditioning tasks. The rats displayed various associations between conditioned stimuli and unconditioned stimuli in appetitive (sucrose water), neutral (no outcome), and aversive (air puff) blocks. The blood pressure and heart rate in the appetitive block gradually increased in response to the reward-predicting cue and the response to the actual reward vigorously increased. The reward-predictive response was significantly higher than the responses obtained in the neutral and aversive condition blocks. To investigate whether the reward-predictive pressor response was caused by orofacial movements such as anticipatory licking behavior, we separately analyzed high- and low-licking trials. The conditioned pressor response was observed even in trials with low-licking behaviors. Blood pressure and heart rate responses to the air puff-predicting cue in the aversive block were not significantly different from the responses in the neutral block. The conditioned blood pressure response rapidly changed with condition block switching. Furthermore, to examine the contribution of the amygdala as an emotion center to these conditioned responses, we bilaterally microinjected a GABAA receptor agonist, muscimol, into the central nucleus of the amygdala. Pharmacological inactivation of the central nucleus of the amygdala significantly decreased the reward-predictive pressor responses. These results suggest that the blood pressure is adaptively and rapidly regulated by emotional conditioned stimuli and that the central nucleus of the amygdala participates in regulating the pressor response in dynamically changing situations.
| S-EPMC9198497 | biostudies-literature
Project description:The cAMP-dependent protein kinase (PKA) is known to play a critical role in both transcription-independent short-term or intermediate-term memory and transcription-dependent long-term memory (LTM). Although distinct phases of LTM already have been demonstrated in some systems, it is not known whether these phases require distinct temporal patterns of learning-induced PKA activation. This question was addressed in a robust form of associative LTM that emerges within a matter of hours after single-trial food-reward classical conditioning in the pond snail Lymnaea stagnalis. After establishing the molecular and functional identity of the PKA catalytic subunit in the Lymnaea nervous system, we used a combination of PKA activity measurement and inhibition techniques to investigate its role in LTM in intact animals. PKA activity in ganglia involved in single-trial learning showed a short latency but prolonged increase after classical conditioning. However, while increased PKA activity immediately after training (0-10 min) was essential for an early phase of LTM (6 h), the late phase of LTM (24 h) required a prolonged increase in PKA activity. These observations indicate mechanistically different roles for PKA in recent and more remote phases of LTM, which may underpin different cellular and molecular mechanisms required for these phases.
| S-EPMC2632788 | biostudies-literature
Project description:Pathways regulating neuronal vulnerability are poorly understood, yet are central to identifying therapeutic targets for degenerative neurological diseases. Here, we characterize mechanisms underlying neurodegeneration in Niemann-Pick type C (NPC) disease, a lysosomal storage disorder characterized by impaired cholesterol trafficking. To date, the relative contributions of neuronal and glial defects to neuron loss are poorly defined. Using gene targeting, we generate Npc1 conditional null mutant mice. Deletion of Npc1 in mature cerebellar Purkinje cells leads to an age-dependent impairment in motor tasks, including rotarod and balance beam performance. Surprisingly, these mice did not show the early death or weight loss that are characteristic of global Npc1 null mice, suggesting that Purkinje cell degeneration does not underlie these phenotypes. Histological examination revealed the progressive loss of Purkinje cells in an anterior-to-posterior gradient. This cell autonomous neurodegeneration occurs in a spatiotemporal pattern similar to that of global knockout mice. A subpopulation of Purkinje cells in the posterior cerebellum exhibits marked resistance to cell death despite Npc1 deletion. To explore this selective response, we investigated the electrophysiological properties of vulnerable and susceptible Purkinje cell subpopulations. Unexpectedly, Purkinje cells in both subpopulations displayed no electrophysiological abnormalities prior to degeneration. Our data establish that Npc1 deficiency leads to cell autonomous, selective neurodegeneration and suggest that the ataxic symptoms of NPC disease arise from Purkinje cell death rather than cellular dysfunction.
| S-EPMC2816612 | biostudies-literature