Dataset Information

Stabilizing patterns in time: Neural network approach.

ABSTRACT: Recurrent and feedback networks are capable of holding dynamic memories. Nonetheless, training a network for that task is challenging. In order to do so, one should face non-linear propagation of errors in the system. Small deviations from the desired dynamics due to error or inherent noise might have a dramatic effect in the future. A method to cope with these difficulties is thus needed. In this work we focus on recurrent networks with linear activation functions and binary output unit. We characterize its ability to reproduce a temporal sequence of actions over its output unit. We suggest casting the temporal learning problem to a perceptron problem. In the discrete case a finite margin appears, providing the network, to some extent, robustness to noise, for which it performs perfectly (i.e. producing a desired sequence for an arbitrary number of cycles flawlessly). In the continuous case the margin approaches zero when the output unit changes its state, hence the network is only able to reproduce the sequence with slight jitters. Numerical simulation suggest that in the discrete time case, the longest sequence that can be learned scales, at best, as square root of the network size. A dramatic effect occurs when learning several short sequences in parallel, that is, their total length substantially exceeds the length of the longest single sequence the network can learn. This model easily generalizes to an arbitrary number of output units, which boost its performance. This effect is demonstrated by considering two practical examples for sequence learning. This work suggests a way to overcome stability problems for training recurrent networks and further quantifies the performance of a network under the specific learning scheme.

SUBMITTER: Ben-Shushan N

PROVIDER: S-EPMC5741269 | biostudies-literature | 2017 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Stabilizing patterns in time: Neural network approach.

Ben-Shushan Nadav N Tsodyks Misha M Tsodyks Misha M

PLoS computational biology 20171212 12

Recurrent and feedback networks are capable of holding dynamic memories. Nonetheless, training a network for that task is challenging. In order to do so, one should face non-linear propagation of errors in the system. Small deviations from the desired dynamics due to error or inherent noise might have a dramatic effect in the future. A method to cope with these difficulties is thus needed. In this work we focus on recurrent networks with linear activation functions and binary output unit. We cha ...[more]

PMID: 29232710

Similar Datasets

Project description:This paper presents a novel approach to predicting self-calibration in a pressure sensor using a proposed Levenberg Marquardt Back Propagation Artificial Neural Network (LMBP-ANN) model. The self-calibration algorithm should be able to fix major problems in the pressure sensor such as hysteresis, variation in gain and lack of linearity with high accuracy. The traditional calibration process for this kind of sensor is a time-consuming task because it is usually done through manual and repetitive identification. Furthermore, a traditional computational method is inadequate for solving the problem since it is extremely difficult to resolve the mathematical formula among multiple confounding pressure variables. Accordingly, this paper describes a new self-calibration methodology for nonlinear pressure sensors based on an LMBP-ANN model. The proposed method was achieved using a collected dataset from pressure sensors in real time. The load cell will be used as a reference for measuring the applied force. The proposed method was validated by comparing the output pressure of the trained network with the experimental target pressure (reference). This paper also shows that the proposed model exhibited a remarkable performance than traditional methods with a max mean square error of 0.17325 and an R-value over 0.99 for the total response of training, testing and validation. To verify the proposed model's capability to build a self-calibration algorithm, the model was tested using an untrained input data set. As a result, the proposed LMBP-ANN model for self-calibration purposes is able to successfully predict the desired pressure over time, even the uncertain behaviour of the pressure sensors due to its material creep. This means that the proposed model overcomes the problems of hysteresis, variation in gain and lack of linearity over time. In return, this can be used to enhance the durability of the grasping mechanism, leading to a more robust and secure grasp for paralyzed hands. Furthermore, the exposed analysis approach in this paper can be a useful methodology for the user to evaluate the performance of any measurement system in a real-time environment.

Dataset Information

Stabilizing patterns in time: Neural network approach.

Publications

Stabilizing patterns in time: Neural network approach.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure