Avalanches and edge-of-chaos learning in neuromorphic nanowire networks.
Ontology highlight
ABSTRACT:
SUBMITTER: Hochstetter J
PROVIDER: S-EPMC8242064 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Neuromorphic systems comprised of self-assembled nanowires exhibit a range of neural-like dynamics arising from the interplay of their synapse-like electrical junctions and their complex network topology. Additionally, various information processing tasks have been demonstrated with neuromorphic nanowire networks. Here, we investigate the dynamics of how these unique systems process information through information-theoretic metrics. In particular, Transfer Entropy (TE) and Active Information Storage (AIS) are employed to investigate dynamical information flow and short-term memory in nanowire networks. In addition to finding that the topologically central parts of networks contribute the most to the information flow, our results also reveal TE and AIS are maximized when the networks transitions from a quiescent to an active state. The performance of neuromorphic networks in memory and learning tasks is demonstrated to be dependent on their internal dynamical states as well as topological structure. Optimal performance is found when these networks are pre-initialised to the transition state where TE and AIS are maximal. Furthermore, an optimal range of information processing resources (i.e. connectivity density) is identified for performance. Overall, our results demonstrate information dynamics is a valuable tool to study and benchmark neuromorphic systems.
| S-EPMC8219687 | biostudies-literature
Project description:Neuromorphic networks are formed by random self-assembly of silver nanowires. Silver nanowires are coated with a polymer layer after synthesis in which junctions between two nanowires act as resistive switches, often compared with neurosynapses. We analyze the role of single junction switching in the dynamical properties of the neuromorphic network. Network transitions to a high-conductance state under the application of a voltage bias higher than a threshold value. The stability and permanence of this state is studied by shifting the voltage bias in order to activate or deactivate the network. A model of the electrical network with atomic switches reproduces the relation between individual nanowire junctions switching events with current pathway formation or destruction. This relation is further manifested in changes in 1/f power-law scaling of the spectral distribution of current. The current fluctuations involved in this scaling shift are considered to arise from an essential equilibrium between formation, stochastic-mediated breakdown of individual nanowire-nanowire junctions and the onset of different current pathways that optimize power dissipation. This emergent dynamics shown by polymer-coated Ag nanowire networks places this system in the class of optimal transport networks, from which new fundamental parallels with neural dynamics and natural computing problem-solving can be drawn.
| S-EPMC6797708 | biostudies-literature
Project description:Graph theory has been extensively applied to the topological mapping of complex networks, ranging from social networks to biological systems. Graph theory has increasingly been applied to neuroscience as a method to explore the fundamental structural and functional properties of human neural networks. Here, we apply graph theory to a model of a novel neuromorphic system constructed from self-assembled nanowires, whose structure and function may mimic that of human neural networks. Simulations of neuromorphic nanowire networks allow us to directly examine their topology at the individual nanowire-node scale. This type of investigation is currently extremely difficult experimentally. We then apply network cartographic approaches to compare neuromorphic nanowire networks with: random networks (including an untrained artificial neural network); grid-like networks and the structural network of C. elegans. Our results demonstrate that neuromorphic nanowire networks exhibit a small-world architecture similar to the biological system of C. elegans, and significantly different from random and grid-like networks. Furthermore, neuromorphic nanowire networks appear more segregated and modular than random, grid-like and simple biological networks and more clustered than artificial neural networks. Given the inextricable link between structure and function in neural networks, these results may have important implications for mimicking cognitive functions in neuromorphic nanowire networks.
| S-EPMC7069063 | biostudies-literature
Project description:In order to realize the full potential of wireless edge artificial intelligence (AI), very large and diverse datasets will often be required for energy-demanding model training on resource-constrained edge devices. This paper proposes a lead federated neuromorphic learning (LFNL) technique, which is a decentralized energy-efficient brain-inspired computing method based on spiking neural networks. The proposed technique will enable edge devices to exploit brain-like biophysiological structure to collaboratively train a global model while helping preserve privacy. Experimental results show that, under the situation of uneven dataset distribution among edge devices, LFNL achieves a comparable recognition accuracy to existing edge AI techniques, while substantially reducing data traffic by >3.5× and computational latency by >2.0×. Furthermore, LFNL significantly reduces energy consumption by >4.5× compared to standard federated learning with a slight accuracy loss up to 1.5%. Therefore, the proposed LFNL can facilitate the development of brain-inspired computing and edge AI.
| S-EPMC9314401 | biostudies-literature
Project description:Many of the unusual properties of Pluto’s orbit are widely accepted as evidence for the orbital migration of the giant planets in early solar system history. However, some properties remain an enigma. Pluto’s long-term orbital stability is supported by two special properties of its orbit that limit the location of its perihelion in azimuth and in latitude. We revisit Pluto’s orbital dynamics with a view to elucidating the individual and collective gravitational effects of the giant planets on constraining its perihelion location. While the resonant perturbations from Neptune account for the azimuthal constraint on Pluto’s perihelion location, we demonstrate that the long-term and steady persistence of the latitudinal constraint is possible only in a narrow range of additional secular forcing which arises fortuitously from the particular orbital architecture of the other giant planets. Our investigations also find that Jupiter has a largely stabilizing influence whereas Uranus has a largely destabilizing influence on Pluto’s orbit. Overall, Pluto’s orbit is rather surprisingly close to a zone of strong chaos.
| S-EPMC9169662 | biostudies-literature
Project description:Physical reservoir computing has recently been attracting attention for its ability to substantially reduce the computational resources required to process time series data. However, the physical reservoirs that have been reported to date have had insufficient computational capacity, and most of them have a large volume, which makes their practical application difficult. Here, we describe the development of a Li+ electrolyte-based ion-gating reservoir (IGR), with ion-electron-coupled dynamics, for use in high-performance physical reservoir computing. A variety of synaptic responses were obtained in response to past experience, which were stored as transient charge density patterns in an electric double layer, at the Li+ electrolyte/diamond interface. Performance for a second-order nonlinear dynamical equation task is one order of magnitude higher than memristor-based reservoirs. The edge-of-chaos state of the IGR enabled the best computational capacity. The IGR described here opens the way for high-performance and integrated neural network devices.
| S-EPMC9750142 | biostudies-literature
Project description:An avalanche or cascade occurs when one event causes one or more subsequent events, which in turn may cause further events in a chain reaction. Avalanching dynamics are studied in many disciplines, with a recent focus on average avalanche shapes, i.e., the temporal profiles of avalanches of fixed duration. At the critical point of the dynamics, the rescaled average avalanche shapes for different durations collapse onto a single universal curve. We apply Markov branching process theory to derive an equation governing the average avalanche shape for cascade dynamics on networks. Analysis of the equation at criticality demonstrates that nonsymmetric average avalanche shapes (as observed in some experiments) occur for certain combinations of dynamics and network topology. We give examples using numerical simulations of models for information spreading, neural dynamics, and behavior adoption and we propose simple experimental tests to quantify whether cascading systems are in the critical state.
| S-EPMC5663919 | biostudies-literature
Project description:Efforts to emulate the formidable information processing capabilities of the brain through neuromorphic engineering have been bolstered by recent progress in the fabrication of nonlinear, nanoscale circuit elements that exhibit synapse-like operational characteristics. However, conventional fabrication techniques are unable to efficiently generate structures with the highly complex interconnectivity found in biological neuronal networks. Here we demonstrate the physical realization of a self-assembled neuromorphic device which implements basic concepts of systems neuroscience through a hardware-based platform comprised of over a billion interconnected atomic-switch inorganic synapses embedded in a complex network of silver nanowires. Observations of network activation and passive harmonic generation demonstrate a collective response to input stimulus in agreement with recent theoretical predictions. Further, emergent behaviors unique to the complex network of atomic switches and akin to brain function are observed, namely spatially distributed memory, recurrent dynamics and the activation of feedforward subnetworks. These devices display the functional characteristics required for implementing unconventional, biologically and neurally inspired computational methodologies in a synthetic experimental system.
| S-EPMC3412809 | biostudies-literature
Project description:The rapid development of artificial neural networks and applied artificial intelligence has led to many applications. However, current software implementation of neural networks is severely limited in terms of performance and energy efficiency. It is believed that further progress requires the development of neuromorphic systems, in which hardware directly mimics the neuronal network structure of a human brain. Here, we propose theoretically and realize experimentally an optical network of nodes performing binary operations. The nonlinearity required for efficient computation is provided by semiconductor microcavities in the strong quantum light-matter coupling regime, which exhibit exciton-polariton interactions. We demonstrate the system performance against a pattern recognition task, obtaining accuracy on a par with state-of-the-art hardware implementations. Our work opens the way to ultrafast and energy-efficient neuromorphic systems taking advantage of ultrastrong optical nonlinearity of polaritons.
| S-EPMC8155323 | biostudies-literature
Project description:Randomly connected networks of neurons exhibit a transition from fixed-point to chaotic activity as the variance of their synaptic connection strengths is increased. In this study, we analytically evaluate how well a small external input can be reconstructed from a sparse linear readout of network activity. At the transition point, known as the edge of chaos, networks display a number of desirable features, including large gains and integration times. Away from this edge, in the nonchaotic regime that has been the focus of most models and studies, gains and integration times fall off dramatically, which implies that parameters must be fine tuned with considerable precision if high performance is required. Here we show that, near the edge, decoding performance is characterized by a critical exponent that takes a different value on the two sides. As a result, when the network units have an odd saturating nonlinear response function, the falloff in gains and integration times is much slower on the chaotic side of the transition. This means that, under appropriate conditions, good performance can be achieved with less fine tuning beyond the edge, within the chaotic regime.
| S-EPMC5558624 | biostudies-other