Browse
Submit Data
Databases
API
Help

Dataset Information

29 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Brain-inspired classical conditioning model.

ABSTRACT: Classical conditioning plays a critical role in the learning process of biological brains, and many computational models have been built to reproduce the related classical experiments. However, these models can reproduce and explain only a limited range of typical phenomena in classical conditioning. Based on existing biological findings concerning classical conditioning, we build a brain-inspired classical conditioning (BICC) model. Compared with other computational models, our BICC model can reproduce as many as 15 classical experiments, explaining a broader set of findings than other models have, and offers better computational explainability for both the experimental phenomena and the biological mechanisms of classical conditioning. Finally, we validate our theoretical model on a humanoid robot in three classical conditioning experiments (acquisition, extinction, and reacquisition) and a speed generalization experiment, and the results show that our model is computationally feasible as a foundation for brain-inspired robot classical conditioning.

SUBMITTER: Zhao Y

PROVIDER: S-EPMC7808924 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Brain-inspired classical conditioning model.

Zhao Yuxuan Y Zeng Yi Y Qiao Guang G

iScience 20201225 1

Classical conditioning plays a critical role in the learning process of biological brains, and many computational models have been built to reproduce the related classical experiments. However, these models can reproduce and explain only a limited range of typical phenomena in classical conditioning. Based on existing biological findings concerning classical conditioning, we build a brain-inspired classical conditioning (BICC) model. Compared with other computational models, our BICC model can r ...[more]

PMID: 33490893

Similar Datasets

Programmable responsive hydrogels inspired by classical conditioning algorithm.

Project description:Living systems have inspired research on non-biological dynamic materials and systems chemistry to mimic specific complex biological functions. Upon pursuing ever more complex life-inspired non-biological systems, mimicking even the most elementary aspects of learning is a grand challenge. We demonstrate a programmable hydrogel-based model system, whose behaviour is inspired by associative learning, i.e., conditioning, which is among the simplest forms of learning. Algorithmically, associative learning minimally requires responsivity to two different stimuli and a memory element. Herein, nanoparticles form the memory element, where a photoacid-driven pH-change leads to their chain-like assembly with a modified spectral behaviour. On associating selected light irradiation with heating, the gel starts to melt upon the irradiation, originally a neutral stimulus. A logic diagram describes such an evolution of the material response. Coupled chemical reactions drive the system out-of-equilibrium, allowing forgetting and memory recovery. The findings encourage to search non-biological materials towards associative and dynamic properties.

| S-EPMC6646376 | biostudies-literature

Visual Classical Conditioning in Wood Ants.

Project description:Several species of insects have become model systems for studying learning and memory formation. Although many studies focus on freely moving animals, studies implementing classical conditioning paradigms with harnessed insects have been important for investigating the exact cues that individuals learn and the neural mechanisms underlying learning and memory formation. Here we present a protocol for evoking visual associative learning in wood ants through classical conditioning. In this paradigm, ants are harnessed and presented with a visual cue (a blue cardboard), the conditional stimulus (CS), paired with an appetitive sugar reward, the unconditional stimulus (US). Ants perform a Maxilla-Labium Extension Reflex (MaLER), the unconditional response (UR), which can be used as a readout for learning. Training consists of 10 trials, separated by a 5-minute intertrial interval (ITI). Ants are also tested for memory retention 10 minutes or 1 hour after training. This protocol has the potential to allow researchers to analyze, in a precise and controlled manner, the details of visual memory formation and the neural basis of learning and memory formation in wood ants.

| S-EPMC6235424 | biostudies-literature

Complexity in a brain-inspired agent-based model.

Project description:An agent-based model consists of a set of agents representing the components of a system. These agents interact with each other according to rules designed with knowledge of the system in mind. Although rules control the low-level interactions of agents, these models often exhibit emergent behavior at the system level. We apply the agent-based modeling framework to functional brain imaging data. In this model, agents are defined by network nodes and represent brain regions, and links representing functional connectivity between nodes dictate which agents interact. A link between two regions may be positive or negative, depending on the correlation in functional activity between the two regions. Agents are either active or inactive, and systematically update based on the activity of their immediate neighbors. Their dynamics are observed over a certain time period starting from predetermined initial configurations. While the information received by each node is limited by the number of other nodes connected to it, we have shown that this model is capable of producing emergent behavior dependent on global information transfer. Specifically, the system is capable of solving well-described test problems, such as the density classification and synchronization problems. The model is capable of producing a wide range of behaviors varying greatly in complexity, including oscillations with cycles ranging from a few steps to hundreds, and non-repeating patterns over hundreds of thousands of time steps. We believe this wide dynamic range may impart the potential for this system to produce a myriad of brain-like functional states.

| S-EPMC3399043 | biostudies-literature

A Brain-Inspired Model of Theory of Mind.

Project description:Theory of mind (ToM) is the ability to attribute mental states to oneself and others, and to understand that others have beliefs that are different from one's own. Although functional neuroimaging techniques have been widely used to establish the neural correlates implicated in ToM, the specific mechanisms are still not clear. We make our efforts to integrate and adopt existing biological findings of ToM, bridging the gap through computational modeling, to build a brain-inspired computational model for ToM. We propose a Brain-inspired Model of Theory of Mind (Brain-ToM model), and the model is applied to a humanoid robot to challenge the false belief tasks, two classical tasks designed to understand the mechanisms of ToM from Cognitive Psychology. With this model, the robot can learn to understand object permanence and visual access from self-experience, then uses these learned experience to reason about other's belief. We computationally validated that the self-experience, maturation of correlate brain areas (e.g., calculation capability) and their connections (e.g., inhibitory control) are essential for ToM, and they have shown their influences on the performance of the participant robot in false-belief task. The theoretic modeling and experimental validations indicate that the model is biologically plausible, and computationally feasible as a foundation for robot theory of mind.

| S-EPMC7483660 | biostudies-literature

Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla–Wagner model [corrected].

Project description:A central tenet of Rescorla and Wagner's model of associative learning is that the reinforcement value of a paired trial diminishes as the associative strength between the presented stimuli increases. Despite its fundamental importance to behavioral sciences, the neural mechanisms underlying the model have not been fully explored. Here, we present findings that, taken together, can explain why a stronger association leads to a reduced reinforcement value, within the context of eyeblink conditioning. Specifically, we show that learned pause responses in Purkinje cells, which trigger adaptively timed conditioned eyeblinks, suppress the unconditional stimulus (US) signal in a graded manner. Furthermore, by examining how Purkinje cells respond to two distinct conditional stimuli and to a compound stimulus, we provide evidence that could potentially help explain the somewhat counterintuitive overexpectation phenomenon, which was derived from the Rescorla-Wagner model.

| S-EPMC4653177 | biostudies-other

Brain-inspired bodily self-perception model for robot rubber hand illusion.

Project description:The core of bodily self-consciousness involves perceiving ownership of one's body. A central question is how body illusions like the rubber hand illusion (RHI) occur. Existing theoretical models still lack satisfying computational explanations from connectionist perspectives, especially for how the brain encodes body perception and generates illusions from neuronal interactions. Moreover, the integration of disability experiments is also neglected. Here, we integrate biological findings of bodily self-consciousness to propose a brain-inspired bodily self-perception model by which perceptions of bodily self are autonomously constructed without any supervision signals. We successfully validated the model with six RHI experiments and a disability experiment on an iCub humanoid robot and simulated environments. The results show that our model can not only well-replicate the behavioral and neural data of monkeys in biological experiments but also reasonably explain the causes and results of RHI at the neuronal level, thus contributing to the revelation of mechanisms underlying RHI.

| S-EPMC10724368 | biostudies-literature

Classical conditioning through auditory stimuli in Drosophila: methods and models.

Project description:The role of sound in Drosophila melanogaster courtship, along with its perception via the antennae, is well established, as is the ability of this fly to learn in classical conditioning protocols. Here, we demonstrate that a neutral acoustic stimulus paired with a sucrose reward can be used to condition the proboscis-extension reflex, part of normal feeding behavior. This appetitive conditioning produces results comparable to those obtained with chemical stimuli in aversive conditioning protocols. We applied a logistic model with general estimating equations to predict the dynamics of learning, which successfully predicts the outcome of training and provides a quantitative estimate of the rate of learning. Use of acoustic stimuli with appetitive conditioning provides both an alternative to models most commonly used in studies of learning and memory in Drosophila and a means of testing hearing in both sexes, independently of courtship responsiveness.

| S-EPMC3154116 | biostudies-other

Associative Learning by Classical Conditioning in Liquid Crystal Network Actuators.

Project description:Responsive and shape-memory materials allow stimuli-driven switching between fixed states. However, their behavior remains unchanged under repeated stimuli exposure, i.e., their properties do not evolve. By contrast, biological materials allow learning in response to past experiences. Classical conditioning is an elementary form of associative learning, which inspires us to explore simplified routes even for inanimate materials to respond to new, initially neutral stimuli. Here, we demonstrate that soft actuators composed of thermoresponsive liquid crystal networks "learn" to respond to light upon a conditioning process where light is associated with heating. We apply the concept to soft microrobotics, demonstrating a locomotive system that "learns to walk" under periodic light stimulus, and gripping devices able to "recognize" irradiation colors. We anticipate that actuators that algorithmically emulate elementary aspects of associative learning and whose sensitivity to new stimuli can be conditioned depending on past experiences may provide new routes toward adaptive, autonomous soft microrobotics.

| S-EPMC6961496 | biostudies-literature

Learning differentially shapes prefrontal and hippocampal activity during classical conditioning.

Project description:The ability to use sensory cues to inform goal-directed actions is a critical component of behavior. To study how sounds guide anticipatory licking during classical conditioning, we employed high-density electrophysiological recordings from the hippocampal CA1 area and the prefrontal cortex (PFC) in mice. CA1 and PFC neurons undergo distinct learning-dependent changes at the single-cell level and maintain representations of cue identity at the population level. In addition, reactivation of task-related neuronal assemblies during hippocampal awake Sharp-Wave Ripples (aSWRs) changed within individual sessions in CA1 and over the course of multiple sessions in PFC. Despite both areas being highly engaged and synchronized during the task, we found no evidence for coordinated single cell or assembly activity during conditioning trials or aSWR. Taken together, our findings support the notion that persistent firing and reactivation of task-related neural activity patterns in CA1 and PFC support learning during classical conditioning.

| S-EPMC8545395 | biostudies-literature

Classical olfactory conditioning in the oriental fruit fly, Bactrocera dorsalis.

Project description:The oriental fruit fly, Bactrocera dorsalis, is a serious pest of fruits and vegetables. Methyl eugenol (ME), a male attractant, is used to against this fly by mass trapping. Control effect may be influenced by learning, which could modify the olfactory response of the fly to this attractant. To collect the behavioral evidence, studies on the capability of this fly for olfactory learning are necessary. We investigated olfactory learning in male flies with a classical olfactory conditioning procedure using restrained individuals under laboratory conditions. The acquisition of the proboscis extension reflex was used as the criterion for conditioning. A high conditioned response level was found in oriental fruit flies when an odor was presented in paired association with a sucrose reward but not when the odor and sucrose were presented unpaired. We also found that the conditioning performance was influenced by the odor concentration, intertrial interval, and starvation time. A slight sensitization elicited by imbibing sucrose was observed. These results indicate that oriental fruit flies have a high capacity to form an olfactory memory as a result of classical conditioning.

| S-EPMC4383412 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data