Benchmarking neuromorphic systems with Nengo.
Ontology highlight
ABSTRACT:
SUBMITTER: Bekolay T
PROVIDER: S-EPMC4609756 | biostudies-literature | 2015
REPOSITORIES: biostudies-literature
Publications
Benchmarking neuromorphic systems with Nengo.
Bekolay Trevor T Stewart Terrence C TC Eliasmith Chris C
Frontiers in neuroscience 20151019
Nengo is a software package for designing and simulating large-scale neural models. Nengo is architected such that the same Nengo model can be simulated on any of several Nengo backends with few to no modifications. Backends translate a model to specific platforms, which include GPUs and neuromorphic hardware. Nengo also contains a large test suite that can be run with any backend and focuses primarily on functional performance. We propose that Nengo's large test suite can be used to benchmark n ...[more]
Similar Datasets
Project description:We propose and discuss a platform overarching benchmark suite for neuromorphic hardware. This suite covers benchmarks from low-level characterization to high-level application evaluation using benchmark specific metrics. With this rather broad approach we are able to compare various hardware systems including mixed-signal and fully digital neuromorphic architectures. Selected benchmarks are discussed and results for several target platforms are presented revealing characteristic differences between the various systems. Furthermore, a proposed energy model allows to combine benchmark performance metrics with energy efficiency. This model enables the prediction of the energy expenditure of a network on a target system without actually having access to it. To quantify the efficiency gap between neuromorphics and the biological paragon of the human brain, the energy model is used to estimate the energy required for a full brain simulation. This reveals that current neuromorphic systems are at least four orders of magnitude less efficient. It is argued, that even with a modern fabrication process, two to three orders of magnitude are remaining. Finally, for selected benchmarks the performance and efficiency of the neuromorphic solution is compared to standard approaches.
| S-EPMC9201569 | biostudies-literature
Project description:The quest to implement intelligent processing in electronic neuromorphic systems lacks methods for achieving reliable behavioral dynamics on substrates of inherently imprecise and noisy neurons. Here we report a solution to this problem that involves first mapping an unreliable hardware layer of spiking silicon neurons into an abstract computational layer composed of generic reliable subnetworks of model neurons and then composing the target behavioral dynamics as a "soft state machine" running on these reliable subnets. In the first step, the neural networks of the abstract layer are realized on the hardware substrate by mapping the neuron circuit bias voltages to the model parameters. This mapping is obtained by an automatic method in which the electronic circuit biases are calibrated against the model parameters by a series of population activity measurements. The abstract computational layer is formed by configuring neural networks as generic soft winner-take-all subnetworks that provide reliable processing by virtue of their active gain, signal restoration, and multistability. The necessary states and transitions of the desired high-level behavior are then easily embedded in the computational layer by introducing only sparse connections between some neurons of the various subnets. We demonstrate this synthesis method for a neuromorphic sensory agent that performs real-time context-dependent classification of motion patterns observed by a silicon retina.
| S-EPMC3773754 | biostudies-literature
Project description:Optical dimerizers are a powerful new class of optogenetic tools that allow light-inducible control of protein-protein interactions. Such tools have been useful for regulating cellular pathways and processes with high spatiotemporal resolution in live cells, and a growing number of dimerizer systems are available. As these systems have been characterized by different groups using different methods, it has been difficult for users to compare their properties. Here, we set about to systematically benchmark the properties of four optical dimerizer systems, CRY2/CIB1, TULIPs, phyB/PIF3, and phyB/PIF6. Using a yeast transcriptional assay, we find significant differences in light sensitivity and fold-activation levels between the red light regulated systems but similar responses between the CRY2/CIB and TULIP systems. Further comparison of the ability of the CRY2/CIB1 and TULIP systems to regulate a yeast MAPK signaling pathway also showed similar responses, with slightly less background activity in the dark observed with CRY2/CIB. In the process of developing this work, we also generated an improved blue-light-regulated transcriptional system using CRY2/CIB in yeast. In addition, we demonstrate successful application of the CRY2/CIB dimerizers using a membrane-tethered CRY2, which may allow for better local control of protein interactions. Taken together, this work allows for a better understanding of the capacities of these different dimerization systems and demonstrates new uses of these dimerizers to control signaling and transcription in yeast.
| S-EPMC4277767 | biostudies-literature
Project description:Neuromorphic artificial intelligence systems are the future of ultrahigh performance computing clusters to overcome complex scientific and economical challenges. Despite their importance, the advancement in quantum neuromorphic systems is slow without specific device design. To elucidate biomimicking mammalian brain synapses, a new class of quantum topological neuristors (QTN) with ultralow energy consumption (pJ) and higher switching speed (µs) is introduced. Bioinspired neural network characteristics of QTNs are the effects of edge state transport and tunable energy gap in the quantum topological insulator (QTI) materials. With augmented device and QTI material design, top notch neuromorphic behavior with effective learning-relearning-forgetting stages is demonstrated. Critically, to emulate the real-time neuromorphic efficiency, training of the QTNs is demonstrated with simple hand gesture game by interfacing them with artificial neural networks to perform decision-making operations. Strategically, the QTNs prove the possession of incomparable potential to realize next-gen neuromorphic computing for the development of intelligent machines and humanoids.
| S-EPMC10460853 | biostudies-literature
Project description:Neuromorphic systems consisting of artificial neurons and synapses can process complex information with high efficiency to overcome the bottleneck of von Neumann architecture. Artificial neurons are essentially required to possess functions such as leaky integrate-and-fire and output spike. However, previous reported artificial neurons typically have high operation voltage and large leakage current, leading to significant power consumption, which is contrary to the energy-efficient biological model. Here, an oscillatory neuron based on Ag filamentary threshold switching memristor (TS) that has a low operation voltage (<0.6 V) with ultralow power consumption (<1.8 µW) is presented. It can trigger neuronal functions, including leaky integrate-and-fire and threshold-driven spiking output, with high endurance (>108 cycles). Being connected to an external resistor or a resistive switching memristor (RS) as synaptic weight, the TS clearly demonstrates self-oscillation behavior once the input pulse voltage exceeds the threshold voltage. Meanwhile, the oscillation frequency is proportional to the input pulse voltage and the conductance of RS synapse, which can be used to integrate the weighted sum current. As an energy-efficient memristor-based spiking neural network, this combination of TS oscillatory neuron with RS synapse is further evaluated for image recognition achieving an accuracy of 79.2 ± 2.4% for CIFAR-10 subset.
| S-EPMC6827597 | biostudies-literature
Project description:As an elementary processor of neural networks, a neuron performs exotic dynamic functions, such as bifurcation, repetitive firing, and oscillation quenching. To achieve ultrafast neuromorphic signal processing, the realization of photonic equivalents to neuronal dynamic functions has attracted considerable attention. However, despite the nonconservative nature of neurons due to energy exchange between intra- and extra-cellular regions through ion channels, the critical role of non-Hermitian physics in the photonic analogy of a neuron has been neglected. Here, a neuromorphic non-Hermitian photonic system ruled by parity-time symmetry is presented. For a photonic platform that induces the competition between saturable gain and loss channels, dynamical phases are classified with respect to parity-time symmetry and stability. In each phase, unique oscillation quenching functions and nonreciprocal oscillations of light fields are revealed as photonic equivalents of neuronal dynamic functions. The proposed photonic system for neuronal functionalities will become a fundamental building block for light-based neural signal processing.
| S-EPMC6685464 | biostudies-literature
Project description:Realization of brain-like computer has always been human's ultimate dream. Today, the possibility of having this dream come true has been significantly boosted due to the advent of several emerging non-volatile memory devices. Within these innovative technologies, phase-change memory device has been commonly regarded as the most promising candidate to imitate the biological brain, owing to its excellent scalability, fast switching speed, and low energy consumption. In this context, a detailed review concerning the physical principles of the neuromorphic circuit using phase-change materials as well as a comprehensive introduction of the currently available phase-change neuromorphic prototypes becomes imperative for scientists to continuously progress the technology of artificial neural networks. In this paper, we first present the biological mechanism of human brain, followed by a brief discussion about physical properties of phase-change materials that recently receive a widespread application on non-volatile memory field. We then survey recent research on different types of neuromorphic circuits using phase-change materials in terms of their respective geometrical architecture and physical schemes to reproduce the biological events of human brain, in particular for spike-time-dependent plasticity. The relevant virtues and limitations of these devices are also evaluated. Finally, the future prospect of the neuromorphic circuit based on phase-change technologies is envisioned.
| S-EPMC5425657 | biostudies-literature
Project description:Neuromorphic systems are designed with careful consideration of the physical properties of the computational substrate they use. Neuromorphic engineers often exploit physical phenomena to directly implement a desired functionality, enabled by “the isomorphism between physical processes in different media” (Douglas et al., 1995). This bottom-up design methodology could be described as matching computational primitives to physical phenomena. In this paper, we propose a top-down counterpart to the bottom-up approach to neuromorphic design. Our top-down approach, termed “bias matching,” is to match the inductive biases required in a learning system to the hardware constraints of its implementation; a well-known example is enforcing translation equivariance in a neural network by tying weights (replacing vector-matrix multiplications with convolutions), which reduces memory requirements. We give numerous examples from the literature and explain how they can be understood from this perspective. Furthermore, we propose novel network designs based on this approach in the context of collaborative filtering. Our simulation results underline our central conclusions: additional hardware constraints can improve the predictions of a Machine Learning system, and understanding the inductive biases that underlie these performance gains can be useful in finding applications for a given constraint.
| S-EPMC7270357 | biostudies-literature
Project description:The challenges of developing neuromorphic vision systems inspired by the human eye come not only from how to recreate the flexibility, sophistication, and adaptability of animal systems, but also how to do so with computational efficiency and elegance. Similar to biological systems, these neuromorphic circuits integrate functions of image sensing, memory and processing into the device, and process continuous analog brightness signal in real-time. High-integration, flexibility and ultra-sensitivity are essential for practical artificial vision systems that attempt to emulate biological processing. Here, we present a flexible optoelectronic sensor array of 1024 pixels using a combination of carbon nanotubes and perovskite quantum dots as active materials for an efficient neuromorphic vision system. The device has an extraordinary sensitivity to light with a responsivity of 5.1 × 107 A/W and a specific detectivity of 2 × 1016 Jones, and demonstrates neuromorphic reinforcement learning by training the sensor array with a weak light pulse of 1 μW/cm2.
| S-EPMC7979753 | biostudies-literature
Project description:Neuromorphic chips embody computational principles operating in the nervous system, into microelectronic devices. In this domain it is important to identify computational primitives that theory and experiments suggest as generic and reusable cognitive elements. One such element is provided by attractor dynamics in recurrent networks. Point attractors are equilibrium states of the dynamics (up to fluctuations), determined by the synaptic structure of the network; a 'basin' of attraction comprises all initial states leading to a given attractor upon relaxation, hence making attractor dynamics suitable to implement robust associative memory. The initial network state is dictated by the stimulus, and relaxation to the attractor state implements the retrieval of the corresponding memorized prototypical pattern. In a previous work we demonstrated that a neuromorphic recurrent network of spiking neurons and suitably chosen, fixed synapses supports attractor dynamics. Here we focus on learning: activating on-chip synaptic plasticity and using a theory-driven strategy for choosing network parameters, we show that autonomous learning, following repeated presentation of simple visual stimuli, shapes a synaptic connectivity supporting stimulus-selective attractors. Associative memory develops on chip as the result of the coupled stimulus-driven neural activity and ensuing synaptic dynamics, with no artificial separation between learning and retrieval phases.
| S-EPMC4604465 | biostudies-literature