Organic neuromorphic electronics for sensorimotor integration and learning in robotics.
Ontology highlight
ABSTRACT:
SUBMITTER: Krauhausen I
PROVIDER: S-EPMC8664264 | biostudies-literature | 2021 Dec
REPOSITORIES: biostudies-literature
Publications
Organic neuromorphic electronics for sensorimotor integration and learning in robotics.
Krauhausen Imke I Koutsouras Dimitrios A DA Melianas Armantas A Keene Scott T ST Lieberth Katharina K Ledanseur Hadrien H Sheelamanthula Rajendar R Giovannitti Alexander A Torricelli Fabrizio F Mcculloch Iain I Blom Paul W M PWM Salleo Alberto A van de Burgt Yoeri Y Gkoupidenis Paschalis P
Science advances 20211210 50
In living organisms, sensory and motor processes are distributed, locally merged, and capable of forming dynamic sensorimotor associations. We introduce a simple and efficient organic neuromorphic circuit for local sensorimotor merging and processing on a robot that is placed in a maze. While the robot is exposed to external environmental stimuli, visuomotor associations are formed on the adaptable neuromorphic circuit. With this on-chip sensorimotor integration, the robot learns to follow a pat ...[more]
Similar Datasets
Project description:Previous studies have shown that sensorimotor processing can often be described by Bayesian learning, in particular the integration of prior and feedback information depending on its degree of reliability. Here we test the hypothesis that the integration process itself can be tuned to the statistical structure of the environment. We exposed human participants to a reaching task in a three-dimensional virtual reality environment where we could displace the visual feedback of their hand position in a two dimensional plane. When introducing statistical structure between the two dimensions of the displacement, we found that over the course of several days participants adapted their feedback integration process in order to exploit this structure for performance improvement. In control experiments we found that this adaptation process critically depended on performance feedback and could not be induced by verbal instructions. Our results suggest that structural learning is an important meta-learning component of Bayesian sensorimotor integration.
| S-EPMC4549275 | biostudies-literature
Project description:The effect of sensory signals coming from skin and muscle afferents on the sensorimotor cortical networks is entitled as sensory-motor integration (SMI). SMI can be studied electrophysiologically by the motor cortex excitability changes in response to peripheral sensory stimulation. These changes include the periods of short afferent inhibition (SAI), afferent facilitation (AF), and late afferent inhibition (LAI). During the early period of motor skill acquisition, motor cortex excitability increases and changes occur in the area covered by the relevant zone of the motor cortex. In the late period, these give place to the morphological changes, such as synaptogenesis. SAI decreases during learning the motor skills, while LAI increases during motor activity. In this review, the role of SMI in the process of motor learning and transcranial magnetic stimulation techniques performed for studying SMI is summarized.
| S-EPMC5758082 | biostudies-other
Project description:The cointegration of artificial neuronal and synaptic devices with homotypic materials and structures can greatly simplify the fabrication of neuromorphic hardware. We demonstrate experimental realization of vanadium dioxide (VO2) artificial neurons and synapses on the same substrate through selective area carrier doping. By locally configuring pairs of catalytic and inert electrodes that enable nanoscale control over carrier density, volatility or nonvolatility can be appropriately assigned to each two-terminal Mott memory device per lithographic design, and both neuron- and synapse-like devices are successfully integrated on a single chip. Feedforward excitation and inhibition neural motifs are demonstrated at hardware level, followed by simulation of network-level handwritten digit and fashion product recognition tasks with experimental characteristics. Spatially selective electron doping opens up previously unidentified avenues for integration of emerging correlated semiconductors in electronic device technologies.
| S-EPMC10022892 | biostudies-literature
Project description:Behavioural studies widely implicate sleep in memory consolidation in the learning of a broad range of behaviours. During sleep, brain regions are reactivated, and specific patterns of neural activity are replayed, consistent with patterns observed in previous waking behaviour. Birdsong learning is a paradigmatic model system for skill learning. Song development in juvenile zebra finches (Taeniopygia guttata) is characterized by sleep-dependent circadian fluctuations in singing behaviour, with immediate post-sleep deterioration in song structure followed by recovery later in the day. In sleeping adult birds, spontaneous bursting activity of forebrain premotor neurons in the robust nucleus of the arcopallium (RA) carries information about daytime singing. Here we show that, in juvenile zebra finches, playback during the day of an adult 'tutor' song induced profound and tutor-song-specific changes in bursting activity of RA neurons during the following night of sleep. The night-time neuronal changes preceded tutor-song-induced changes in singing, first observed the following day. Interruption of auditory feedback greatly reduced sleep bursting and prevented the tutor-song-specific neuronal remodelling. Thus, night-time neuronal activity is shaped by the interaction of the song model (sensory template) and auditory feedback, with changes in night-time activity preceding the onset of practice associated with vocal learning. We hypothesize that night-time bursting induces adaptive changes in premotor networks during sleep as part of vocal learning. By this hypothesis, adaptive changes driven by replay of sensory information at night and by evaluation of sensory feedback during the day interact to produce the complex circadian patterns seen early in vocal development.
| S-EPMC2651989 | biostudies-literature
Project description:Neuromorphic computing memristors are attractive to construct low-power- consumption electronic textiles due to the intrinsic interwoven architecture and promising applications in wearable electronics. Developing reconfigurable fiber-based memristors is an efficient method to realize electronic textiles that capable of neuromorphic computing function. However, the previously reported artificial synapse and neuron need different materials and configurations, making it difficult to realize multiple functions in a single device. Herein, a textile memristor network of Ag/MoS2/HfAlOx/carbon nanotube with reconfigurable characteristics was reported, which can achieve both nonvolatile synaptic plasticity and volatile neuron functions. In addition, a single reconfigurable memristor can realize integrate-and-fire function, exhibiting significant advantages in reducing the complexity of neuron circuits. The firing energy consumption of fiber-based memristive neuron is 1.9 fJ/spike (femtojoule-level), which is at least three orders of magnitude lower than that of the reported biological and artificial neuron (picojoule-level). The ultralow energy consumption makes it possible to create an electronic neural network that reduces the energy consumption compared to human brain. By integrating the reconfigurable synapse, neuron and heating resistor, a smart textile system is successfully constructed for warm fabric application, providing a unique functional reconfiguration pathway toward the next-generation in-memory computing textile system.
| S-EPMC9718838 | biostudies-literature
Project description:Sensory information processing in robot skins currently rely on a centralized approach where signal transduction (on the body) is separated from centralized computation and decision-making, requiring the transfer of large amounts of data from periphery to central processors, at the cost of wiring, latency, fault tolerance and robustness. We envision a decentralized approach where intelligence is embedded in the sensing nodes, using a unique neuromorphic methodology to extract relevant information in robotic skins. Here we specifically address pain perception and the association of nociception with tactile perception to trigger the escape reflex in a sensorized robotic arm. The proposed system comprises self-healable materials and memtransistors as enabling technologies for the implementation of neuromorphic nociceptors, spiking local associative learning and communication. Configuring memtransistors as gated-threshold and -memristive switches, the demonstrated system features in-memory edge computing with minimal hardware circuitry and wiring, and enhanced fault tolerance and robustness.
| S-EPMC7424569 | biostudies-literature
Project description:Stretchable and flexible multifunctional electronic components, including sensors and actuators, have received increasing attention in robotics, electronics, wearable, and healthcare applications. Despite advances, it has remained challenging to design analogs of many electronic components to be highly stretchable, to be efficient to fabricate, and to provide control over electronic performance. Here, we describe highly elastic sensors and interconnects formed from thin, twisted conductive microtubules. These devices consist of twisted assemblies of thin, highly stretchable (>400%) elastomer tubules filled with liquid conductor (eutectic gallium indium, EGaIn), and fabricated using a simple roller coating process. As we demonstrate, these devices can operate as multimodal sensors for strain, rotation, contact force, or contact location. We also show that, through twisting, it is possible to control their mechanical performance and electronic sensitivity. In extensive experiments, we have evaluated the capabilities of these devices, and have prototyped an array of applications in several domains of stretchable and wearable electronics. These devices provide a novel, low cost solution for high performance stretchable electronics with broad applications in industry, healthcare, and consumer electronics, to emerging product categories of high potential economic and societal significance.
| S-EPMC5431990 | biostudies-literature
Project description:The integration of deep learning and theories of reinforcement learning (RL) is a promising avenue to explore novel hypotheses on reward-based learning and decision-making in humans and other animals. Here, we trained deep RL agents and mice in the same sensorimotor task with high-dimensional state and action space and studied representation learning in their respective neural networks. Evaluation of thousands of neural network models with extensive hyperparameter search revealed that learning-dependent enrichment of state-value and policy representations of the task-performance-optimized deep RL agent closely resembled neural activity of the posterior parietal cortex (PPC). These representations were critical for the task performance in both systems. PPC neurons also exhibited representations of the internally defined subgoal, a feature of deep RL algorithms postulated to improve sample efficiency. Such striking resemblance between the artificial and biological networks and their functional convergence in sensorimotor integration offers new opportunities to better understand respective intelligent systems.
| S-EPMC9166289 | biostudies-literature
Project description:Artificial neuromorphic devices can emulate dendric integration, axonal parallel transmission, along with superior energy efficiency in facilitating efficient information processing, offering enormous potential for wearable electronics. However, integrating such circuits into textiles to achieve biomimetic information perception, processing, and control motion feedback remains a formidable challenge. Here, we engineer a quasi-solid-state iontronic synapse fiber (ISF) comprising photoresponsive TiO2, ion storage Co-MoS2, and an ion transport layer. The resulting ISF achieves inherent short-term synaptic plasticity, femtojoule-range energy consumption, and the ability to transduce chemical/optical signals. Multiple ISFs are interwoven into a synthetic neural fabric, allowing the simultaneous propagation of distinct optical signals for transmitting parallel information. Importantly, IFSs with multiple input electrodes exhibit spatiotemporal information integration. As a proof of concept, a textile-based multiplexing neuromorphic sensorimotor system is constructed to connect synaptic fibers with artificial fiber muscles, enabling preneuronal sensing information integration, parallel transmission, and postneuronal information output to control the coordinated motor of fiber muscles. The proposed fiber system holds enormous promise in wearable electronics, soft robotics, and biomedical engineering.
| S-EPMC11331142 | biostudies-literature
Project description:High-performance organic neuromorphic devices with miniaturized device size and computing capability are essential elements for developing brain-inspired humanoid intelligence technique. However, due to the structural inhomogeneity of most organic materials, downscaling of such devices to nanoscale and their high-density integration into compact matrices with reliable device performance remain challenging at the moment. Herein, based on the design of a semicrystalline polymer PBFCL10 with ordered structure to regulate dense and uniform formation of conductive nanofilaments, we realize an organic synapse with the smallest device dimension of 50 nm and highest integration size of 1 Kb reported thus far. The as-fabricated PBFCL10 synapses can switch between 32 conductance states linearly with a high cycle-to-cycle uniformity of 98.89% and device-to-device uniformity of 99.71%, which are the best results of organic devices. A mixed-signal neuromorphic hardware system based on the organic neuromatrix and FPGA controller is implemented to execute spiking-plasticity-related algorithm for decision-making tasks.
| S-EPMC10667342 | biostudies-literature