Project description:Previous studies have shown that sensorimotor processing can often be described by Bayesian learning, in particular the integration of prior and feedback information depending on its degree of reliability. Here we test the hypothesis that the integration process itself can be tuned to the statistical structure of the environment. We exposed human participants to a reaching task in a three-dimensional virtual reality environment where we could displace the visual feedback of their hand position in a two dimensional plane. When introducing statistical structure between the two dimensions of the displacement, we found that over the course of several days participants adapted their feedback integration process in order to exploit this structure for performance improvement. In control experiments we found that this adaptation process critically depended on performance feedback and could not be induced by verbal instructions. Our results suggest that structural learning is an important meta-learning component of Bayesian sensorimotor integration.
Project description:The effect of sensory signals coming from skin and muscle afferents on the sensorimotor cortical networks is entitled as sensory-motor integration (SMI). SMI can be studied electrophysiologically by the motor cortex excitability changes in response to peripheral sensory stimulation. These changes include the periods of short afferent inhibition (SAI), afferent facilitation (AF), and late afferent inhibition (LAI). During the early period of motor skill acquisition, motor cortex excitability increases and changes occur in the area covered by the relevant zone of the motor cortex. In the late period, these give place to the morphological changes, such as synaptogenesis. SAI decreases during learning the motor skills, while LAI increases during motor activity. In this review, the role of SMI in the process of motor learning and transcranial magnetic stimulation techniques performed for studying SMI is summarized.
Project description:The cointegration of artificial neuronal and synaptic devices with homotypic materials and structures can greatly simplify the fabrication of neuromorphic hardware. We demonstrate experimental realization of vanadium dioxide (VO2) artificial neurons and synapses on the same substrate through selective area carrier doping. By locally configuring pairs of catalytic and inert electrodes that enable nanoscale control over carrier density, volatility or nonvolatility can be appropriately assigned to each two-terminal Mott memory device per lithographic design, and both neuron- and synapse-like devices are successfully integrated on a single chip. Feedforward excitation and inhibition neural motifs are demonstrated at hardware level, followed by simulation of network-level handwritten digit and fashion product recognition tasks with experimental characteristics. Spatially selective electron doping opens up previously unidentified avenues for integration of emerging correlated semiconductors in electronic device technologies.
Project description:Sensory information processing in robot skins currently rely on a centralized approach where signal transduction (on the body) is separated from centralized computation and decision-making, requiring the transfer of large amounts of data from periphery to central processors, at the cost of wiring, latency, fault tolerance and robustness. We envision a decentralized approach where intelligence is embedded in the sensing nodes, using a unique neuromorphic methodology to extract relevant information in robotic skins. Here we specifically address pain perception and the association of nociception with tactile perception to trigger the escape reflex in a sensorized robotic arm. The proposed system comprises self-healable materials and memtransistors as enabling technologies for the implementation of neuromorphic nociceptors, spiking local associative learning and communication. Configuring memtransistors as gated-threshold and -memristive switches, the demonstrated system features in-memory edge computing with minimal hardware circuitry and wiring, and enhanced fault tolerance and robustness.
Project description:Behavioural studies widely implicate sleep in memory consolidation in the learning of a broad range of behaviours. During sleep, brain regions are reactivated, and specific patterns of neural activity are replayed, consistent with patterns observed in previous waking behaviour. Birdsong learning is a paradigmatic model system for skill learning. Song development in juvenile zebra finches (Taeniopygia guttata) is characterized by sleep-dependent circadian fluctuations in singing behaviour, with immediate post-sleep deterioration in song structure followed by recovery later in the day. In sleeping adult birds, spontaneous bursting activity of forebrain premotor neurons in the robust nucleus of the arcopallium (RA) carries information about daytime singing. Here we show that, in juvenile zebra finches, playback during the day of an adult 'tutor' song induced profound and tutor-song-specific changes in bursting activity of RA neurons during the following night of sleep. The night-time neuronal changes preceded tutor-song-induced changes in singing, first observed the following day. Interruption of auditory feedback greatly reduced sleep bursting and prevented the tutor-song-specific neuronal remodelling. Thus, night-time neuronal activity is shaped by the interaction of the song model (sensory template) and auditory feedback, with changes in night-time activity preceding the onset of practice associated with vocal learning. We hypothesize that night-time bursting induces adaptive changes in premotor networks during sleep as part of vocal learning. By this hypothesis, adaptive changes driven by replay of sensory information at night and by evaluation of sensory feedback during the day interact to produce the complex circadian patterns seen early in vocal development.
Project description:Stretchable and flexible multifunctional electronic components, including sensors and actuators, have received increasing attention in robotics, electronics, wearable, and healthcare applications. Despite advances, it has remained challenging to design analogs of many electronic components to be highly stretchable, to be efficient to fabricate, and to provide control over electronic performance. Here, we describe highly elastic sensors and interconnects formed from thin, twisted conductive microtubules. These devices consist of twisted assemblies of thin, highly stretchable (>400%) elastomer tubules filled with liquid conductor (eutectic gallium indium, EGaIn), and fabricated using a simple roller coating process. As we demonstrate, these devices can operate as multimodal sensors for strain, rotation, contact force, or contact location. We also show that, through twisting, it is possible to control their mechanical performance and electronic sensitivity. In extensive experiments, we have evaluated the capabilities of these devices, and have prototyped an array of applications in several domains of stretchable and wearable electronics. These devices provide a novel, low cost solution for high performance stretchable electronics with broad applications in industry, healthcare, and consumer electronics, to emerging product categories of high potential economic and societal significance.
Project description:Electronics allowing for visible light to pass through are attractive, where a key challenge is to make the core functional units transparent. Here, it is shown that transparent electronics can be constructed by epitaxial growth of metal-organic frameworks (MOFs) on single-layer graphene (SLG) to give a desirable transparency of 95.7% to 550 nm visible light and an electrical conductivity of 4.0 × 104 S m-1. Through lattice and symmetry match, collective alignment of MOF pores and dense packing of MOFs vertically on SLG are achieved, as directly visualized by electron microscopy. These MOF-on-SLG constructs are capable of room-temperature recognition of gas molecules at the ppb level with a linear range from 10 to 108 ppb, providing real-time gas monitoring function in transparent electronics. The corresponding devices can be fabricated on flexible substrates with large size, 3 × 5 cm, and afford continuous folding for more than 200 times without losing conductivity or transparency.
Project description:An evolvable organic electrochemical transistor (OECT), operating in the hybrid accumulation-depletion mode is reported, which exhibits short-term and long-term memory functionalities. The transistor channel, formed by an electropolymerized conducting polymer, can be formed, modulated, and obliterated in situ and under operation. Enduring changes in channel conductance, analogous to long-term potentiation and depression, are attained by electropolymerization and electrochemical overoxidation of the channel material, respectively. Transient changes in channel conductance, analogous to short-term potentiation and depression, are accomplished by inducing nonequilibrium doping states within the transistor channel. By manipulating the input signal, the strength of the transistor response to a given stimulus can be modulated within a range that spans several orders of magnitude, producing behavior that is directly comparable to short- and long-term neuroplasticity. The evolvable transistor is further incorporated into a simple circuit that mimics classical conditioning. It is forecasted that OECTs that can be physically and electronically modulated under operation will bring about a new paradigm of machine learning based on evolvable organic electronics.
Project description:Emulation of human sensory and motor functions becomes a core technology in bioinspired electronics for next-generation electronic prosthetics and neurologically inspired robotics. An electronic synapse functionalized with an artificial sensory receptor and an artificial motor unit can be a fundamental element of bioinspired soft electronics. Here, we report an organic optoelectronic sensorimotor synapse that uses an organic optoelectronic synapse and a neuromuscular system based on a stretchable organic nanowire synaptic transistor (s-ONWST). The voltage pulses of a self-powered photodetector triggered by optical signals drive the s-ONWST, and resultant informative synaptic outputs are used not only for optical wireless communication of human-machine interfaces but also for light-interactive actuation of an artificial muscle actuator in the same way that a biological muscle fiber contracts. Our organic optoelectronic sensorimotor synapse suggests a promising strategy toward developing bioinspired soft electronics, neurologically inspired robotics, and electronic prostheses.
Project description:Sensorimotor integration regulates goal-directed movements. We study the signaling mechanisms underlying sensorimotor integration in C. elegans during olfactory steering, when the sinusoidal movements of the worm generate an in-phase oscillation in the concentration of the sampled odorant. We show that cholinergic neurotransmission encodes the oscillatory sensory response and the motor state of head undulations by acting through an acetylcholine-gated channel and a muscarinic acetylcholine receptor, respectively. These signals converge on two axonal domains of an interneuron RIA, where the sensory-evoked signal suppresses the motor-encoding signal to transform the spatial information of the odorant into the asymmetry between the axonal activities. The asymmetric synaptic outputs of the RIA axonal domains generate a directional bias in the locomotory trajectory. Experience alters the sensorimotor integration to generate specific behavioral changes. Our study reveals how cholinergic neurotransmission, which can represent sensory and motor information in the mammalian brain, regulates sensorimotor integration during goal-directed locomotions.