Draculab: A Python Simulator for Firing Rate Neural Networks With Delayed Adaptive Connections.
Ontology highlight
ABSTRACT:
SUBMITTER: Verduzco-Flores S
PROVIDER: S-EPMC6454197 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
Draculab: A Python Simulator for Firing Rate Neural Networks With Delayed Adaptive Connections.
Verduzco-Flores Sergio S De Schutter Erik E
Frontiers in neuroinformatics 20190402
Draculab is a neural simulator with a particular use scenario: firing rate units with delayed connections, using custom-made unit and synapse models, possibly controlling simulated physical systems. Draculab also has a particular design philosophy. It aims to blur the line between users and developers. Three factors help to achieve this: a simple design using Python's data structures, extensive use of standard libraries, and profusely commented source code. This paper is an introduction to Dracu ...[more]
Similar Datasets
Project description:Traumatic brain injury (TBI) can lead to neurodegeneration in the injured circuitry, either through primary structural damage to the neuron or secondary effects that disrupt key cellular processes. Moreover, traumatic injuries can preferentially impact subpopulations of neurons, but the functional network effects of these targeted degeneration profiles remain unclear. Although isolating the consequences of complex injury dynamics and long-term recovery of the circuit can be difficult to control experimentally, computational networks can be a powerful tool to analyze the consequences of injury. Here, we use the Izhikevich spiking neuron model to create networks representative of cortical tissue. After an initial settling period with spike-timing-dependent plasticity (STDP), networks developed rhythmic oscillations similar to those seen in vivo. As neurons were sequentially removed from the network, population activity rate and oscillation dynamics were significantly reduced. In a successive period of network restructuring with STDP, network activity levels returned to baseline for some injury levels and oscillation dynamics significantly improved. We next explored the role that specific neurons have in the creation and termination of oscillation dynamics. We determined that oscillations initiate from activation of low firing rate neurons with limited structural inputs. To terminate oscillations, high activity excitatory neurons with strong input connectivity activate downstream inhibitory circuitry. Finally, we confirm the excitatory neuron population role through targeted neurodegeneration. These results suggest targeted neurodegeneration can play a key role in the oscillation dynamics after injury.
| S-EPMC7510994 | biostudies-literature
Project description:Macroscopic oscillations in the brain have been observed to be involved in many cognitive tasks but their role is not completely understood. One of the suggested functions of the oscillations is to dynamically modulate communication between neural circuits. The Communication Through Coherence (CTC) theory proposes that oscillations reflect rhythmic changes in excitability of the neuronal populations. Thus, populations need to be properly phase-locked so that input volleys arrive at the peaks of excitability of the receiving population to communicate effectively. Here, we present a modeling study to explore synchronization between neuronal circuits connected with unidirectional projections. We consider an Excitatory-Inhibitory (E-I) network of quadratic integrate-and-fire neurons modeling a Pyramidal-Interneuronal Network Gamma (PING) rhythm. The network receives an external periodic input from either one or two sources, simulating the inputs from other oscillating neural groups. We use recently developed mean-field models which provide an exact description of the macroscopic activity of the spiking network. This low-dimensional mean field model allows us to use tools from bifurcation theory to identify the phase-locked states between the input and the target population as a function of the amplitude, frequency and coherence of the inputs. We identify the conditions for optimal phase-locking and effective communication. We find that inputs with high coherence can entrain the network for a wider range of frequencies. Besides, faster oscillatory inputs than the intrinsic network gamma cycle show more effective communication than inputs with similar frequency. Our analysis further shows that the entrainment of the network by inputs with higher frequency is more robust to distractors, thus giving them an advantage to entrain the network and communicate effectively. Finally, we show that pulsatile inputs can switch between attended inputs in selective attention.
| S-EPMC9154197 | biostudies-literature
Project description:This work investigates the mechanism of the Steady-State Visual Evoked Potential (SSVEP). One theory suggests that different SSVEP neural networks exist whose strongest response are located in different frequency bands. This theory is based on the fact that there are similar SSVEP frequency-amplitude response curves in these bands. Previous studies that employed simultaneous stimuli of different frequencies illustrated that the distribution of these networks were similar, but did not discuss the physical connection between them. By comparing the SSVEP power and distribution under a single-eye stimulus and a simultaneous, dual-eye stimulus, this work demonstrates that the distributions of different SSVEP neural networks are similar to each other and that there should be physical overlapping between them. According to the band-pass filter theory in a signal transferring channel, which we propose in this work for the first time, there are different amounts of neurons that are involved under repetitive stimuli of different frequencies and that the response intensity of each neuron is similar to each other so that the total response (i.e., the SSVEP) that is observed from the scalp is different.
| S-EPMC4782133 | biostudies-other
Project description:Laser-based material removal, or ablation, using ultrafast pulses enables precision micro-scale processing of almost any material for a wide range of applications and is likely to play a pivotal role in providing mass customization capabilities in future manufacturing. However, optimization of the processing parameters can currently take several weeks because of the absence of an appropriate simulator. The difficulties in realizing such a simulator lie in the multi-scale nature of the relevant processes and the high nonlinearity and irreversibility of these processes, which can differ substantially depending on the target material. Here we show that an ultrafast laser ablation simulator can be realized using deep neural networks. The simulator can calculate the three-dimensional structure after irradiation by multiple laser pulses at arbitrary positions and with arbitrary pulse energies, and we applied the simulator to a variety of materials, including dielectrics, semiconductors, and an organic polymer. The simulator successfully predicted their depth profiles after irradiation by a number of pulses, even though the neural networks were trained using single-shot datasets. Our results indicate that deep neural networks trained with single-shot experiments are able to address physics with irreversibility and chaoticity that cannot be accessed using conventional repetitive experiments.
| S-EPMC8990072 | biostudies-literature
Project description:In neuroscience, computational modeling has become an important source of insight into brain states and dynamics. A basic requirement for computational modeling studies is the availability of efficient software for setting up models and performing numerical simulations. While many such tools exist for different families of neural models, there is a lack of tools allowing for both a generic model definition and efficiently parallelized simulations. In this work, we present PyRates, a Python framework that provides the means to build a large variety of rate-based neural models. PyRates provides intuitive access to and modification of all mathematical operators in a graph, thus allowing for a highly generic model definition. For computational efficiency and parallelization, the model is translated into a compute graph. Using the example of two different neural models belonging to the family of rate-based population models, we explain the mathematical formalism, software structure and user interfaces of PyRates. We show via numerical simulations that the behavior of the PyRates model implementations is consistent with the literature. Finally, we demonstrate the computational capacities and scalability of PyRates via a number of benchmark simulations of neural networks differing in size and connectivity.
| S-EPMC6913930 | biostudies-literature
Project description:The impairment of cognitive function in Alzheimer's disease is clearly correlated to synapse loss. However, the mechanisms underlying this correlation are only poorly understood. Here, we investigate how the loss of excitatory synapses in sparsely connected random networks of spiking excitatory and inhibitory neurons alters their dynamical characteristics. Beyond the effects on the activity statistics, we find that the loss of excitatory synapses on excitatory neurons reduces the network's sensitivity to small perturbations. This decrease in sensitivity can be considered as an indication of a reduction of computational capacity. A full recovery of the network's dynamical characteristics and sensitivity can be achieved by firing rate homeostasis, here implemented by an up-scaling of the remaining excitatory-excitatory synapses. Mean-field analysis reveals that the stability of the linearised network dynamics is, in good approximation, uniquely determined by the firing rate, and thereby explains why firing rate homeostasis preserves not only the firing rate but also the network's sensitivity to small perturbations.
| S-EPMC7505475 | biostudies-literature
Project description:Neurons use sequences of action potentials (spikes) to convey information across neuronal networks. In neurophysiology experiments, information about external stimuli or behavioral tasks has been frequently characterized in term of neuronal firing rate. The firing rate is conventionally estimated by averaging spiking responses across multiple similar experiments (or trials). However, there exist a number of applications in neuroscience research that require firing rate to be estimated on a single trial basis. Estimating firing rate from a single trial is a challenging problem and current state-of-the-art methods do not perform well. To address this issue, we develop a new method for estimating firing rate based on a kernel smoothing technique that considers the bandwidth as a random variable with prior distribution that is adaptively updated under an empirical Bayesian framework. By carefully selecting the prior distribution together with Gaussian kernel function, an analytical expression can be achieved for the kernel bandwidth. We refer to the proposed method as Bayesian Adaptive Kernel Smoother (BAKS). We evaluate the performance of BAKS using synthetic spike train data generated by biologically plausible models: inhomogeneous Gamma (IG) and inhomogeneous inverse Gaussian (IIG). We also apply BAKS to real spike train data from non-human primate (NHP) motor and visual cortex. We benchmark the proposed method against established and previously reported methods. These include: optimized kernel smoother (OKS), variable kernel smoother (VKS), local polynomial fit (Locfit), and Bayesian adaptive regression splines (BARS). Results using both synthetic and real data demonstrate that the proposed method achieves better performance compared to competing methods. This suggests that the proposed method could be useful for understanding the encoding mechanism of neurons in cognitive-related tasks. The proposed method could also potentially improve the performance of brain-machine interface (BMI) decoder that relies on estimated firing rate as the input.
| S-EPMC6248928 | biostudies-literature
Project description:PURPOSE:Recently, several attempts were conducted to transfer deep learning to medical image reconstruction. An increasingly number of publications follow the concept of embedding the computed tomography (CT) reconstruction as a known operator into a neural network. However, most of the approaches presented lack an efficient CT reconstruction framework fully integrated into deep learning environments. As a result, many approaches use workarounds for mathematically unambiguously solvable problems. METHODS:PYRO-NN is a generalized framework to embed known operators into the prevalent deep learning framework Tensorflow. The current status includes state-of-the-art parallel-, fan-, and cone-beam projectors, and back-projectors accelerated with CUDA provided as Tensorflow layers. On top, the framework provides a high-level Python API to conduct FBP and iterative reconstruction experiments with data from real CT systems. RESULTS:The framework provides all necessary algorithms and tools to design end-to-end neural network pipelines with integrated CT reconstruction algorithms. The high-level Python API allows a simple use of the layers as known from Tensorflow. All algorithms and tools are referenced to a scientific publication and are compared to existing non-deep learning reconstruction frameworks. To demonstrate the capabilities of the layers, the framework comes with baseline experiments, which are described in the supplementary material. The framework is available as open-source software under the Apache 2.0 licence at https://github.com/csyben/PYRO-NN. CONCLUSIONS:PYRO-NN comes with the prevalent deep learning framework Tensorflow and allows to setup end-to-end trainable neural networks in the medical image reconstruction context. We believe that the framework will be a step toward reproducible research and give the medical physics community a toolkit to elevate medical image reconstruction with new deep learning techniques.
| S-EPMC6899669 | biostudies-literature
Project description:Artificial Neural Networks (ANNs) are bio-inspired models of neural computation that have proven highly effective. Still, ANNs lack a natural notion of time, and neural units in ANNs exchange analog values in a frame-based manner, a computationally and energetically inefficient form of communication. This contrasts sharply with biological neurons that communicate sparingly and efficiently using isomorphic binary spikes. While Spiking Neural Networks (SNNs) can be constructed by replacing the units of an ANN with spiking neurons (Cao et al., 2015; Diehl et al., 2015) to obtain reasonable performance, these SNNs use Poisson spiking mechanisms with exceedingly high firing rates compared to their biological counterparts. Here we show how spiking neurons that employ a form of neural coding can be used to construct SNNs that match high-performance ANNs and match or exceed state-of-the-art in SNNs on important benchmarks, while requiring firing rates compatible with biological findings. For this, we use spike-based coding based on the firing rate limiting adaptation phenomenon observed in biological spiking neurons. This phenomenon can be captured in fast adapting spiking neuron models, for which we derive the effective transfer function. Neural units in ANNs trained with this transfer function can be substituted directly with adaptive spiking neurons, and the resulting Adaptive SNNs (AdSNNs) can carry out competitive classification in deep neural networks without further modifications. Adaptive spike-based coding additionally allows for the dynamic control of neural coding precision: we show empirically how a simple model of arousal in AdSNNs further halves the average required firing rate and this notion naturally extends to other forms of attention as studied in neuroscience. AdSNNs thus hold promise as a novel and sparsely active model for neural computation that naturally fits to temporally continuous and asynchronous applications.
| S-EPMC6332470 | biostudies-literature
Project description:Representations in the cortex are often distributed with graded firing rates in the neuronal populations. The firing rate probability distribution of each neuron to a set of stimuli is often exponential or gamma. In processes in the brain, such as decision-making, that are influenced by the noise produced by the close to random spike timings of each neuron for a given mean rate, the noise with this graded type of representation may be larger than with the binary firing rate distribution that is usually investigated. In integrate-and-fire simulations of an attractor decision-making network, we show that the noise is indeed greater for a given sparseness of the representation for graded, exponential, than for binary firing rate distributions. The greater noise was measured by faster escaping times from the spontaneous firing rate state when the decision cues are applied, and this corresponds to faster decision or reaction times. The greater noise was also evident as less stability of the spontaneous firing state before the decision cues are applied. The implication is that spiking-related noise will continue to be a factor that influences processes such as decision-making, signal detection, short-term memory, and memory recall even with the quite large networks found in the cerebral cortex. In these networks there are several thousand recurrent collateral synapses onto each neuron. The greater noise with graded firing rate distributions has the advantage that it can increase the speed of operation of cortical circuitry.
| S-EPMC3169549 | biostudies-literature