Dataset Information

A recurrent neural network for closed-loop intracortical brain-machine interface decoders.

ABSTRACT: Recurrent neural networks (RNNs) are useful tools for learning nonlinear relationships in time series data with complex temporal dependences. In this paper, we explore the ability of a simplified type of RNN, one with limited modifications to the internal weights called an echostate network (ESN), to effectively and continuously decode monkey reaches during a standard center-out reach task using a cortical brain-machine interface (BMI) in a closed loop. We demonstrate that the RNN, an ESN implementation termed a FORCE decoder (from first order reduced and controlled error learning), learns the task quickly and significantly outperforms the current state-of-the-art method, the velocity Kalman filter (VKF), using the measure of target acquire time. We also demonstrate that the FORCE decoder generalizes to a more difficult task by successfully operating the BMI in a randomized point-to-point task. The FORCE decoder is also robust as measured by the success rate over extended sessions. Finally, we show that decoded cursor dynamics are more like naturalistic hand movements than those of the VKF. Taken together, these results suggest that RNNs in general, and the FORCE decoder in particular, are powerful tools for BMI decoder applications.

SUBMITTER: Sussillo D

PROVIDER: S-EPMC3638090 | biostudies-literature | 2012 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A recurrent neural network for closed-loop intracortical brain-machine interface decoders.

Sussillo David D Nuyujukian Paul P Fan Joline M JM Kao Jonathan C JC Stavisky Sergey D SD Ryu Stephen S Shenoy Krishna K

Journal of neural engineering 20120319 2

Recurrent neural networks (RNNs) are useful tools for learning nonlinear relationships in time series data with complex temporal dependences. In this paper, we explore the ability of a simplified type of RNN, one with limited modifications to the internal weights called an echostate network (ESN), to effectively and continuously decode monkey reaches during a standard center-out reach task using a cortical brain-machine interface (BMI) in a closed loop. We demonstrate that the RNN, an ESN implem ...[more]

PMID: 22427488

Similar Datasets

Project description:OBJECTIVE:Intracortical brain-machine interfaces (BMIs) are a promising source of prosthesis control signals for individuals with severe motor disabilities. Previous BMI studies have primarily focused on predicting and controlling whole-arm movements; precise control of hand kinematics, however, has not been fully demonstrated. Here, we investigate the continuous decoding of precise finger movements in rhesus macaques. APPROACH:In order to elicit precise and repeatable finger movements, we have developed a novel behavioral task paradigm which requires the subject to acquire virtual fingertip position targets. In the physical control condition, four rhesus macaques performed this task by moving all four fingers together in order to acquire a single target. This movement was equivalent to controlling the aperture of a power grasp. During this task performance, we recorded neural spikes from intracortical electrode arrays in primary motor cortex. MAIN RESULTS:Using a standard Kalman filter, we could reconstruct continuous finger movement offline with an average correlation of ???=??0.78 between actual and predicted position across four rhesus macaques. For two of the monkeys, this movement prediction was performed in real-time to enable direct brain control of the virtual hand. Compared to physical control, neural control performance was slightly degraded; however, the monkeys were still able to successfully perform the task with an average target acquisition rate of 83.1%. The monkeys' ability to arbitrarily specify fingertip position was also quantified using an information throughput metric. During brain control task performance, the monkeys achieved an average 1.01 bits s-1 throughput, similar to that achieved in previous studies which decoded upper-arm movements to control computer cursors using a standard Kalman filter. SIGNIFICANCE:This is, to our knowledge, the first demonstration of brain control of finger-level fine motor skills. We believe that these results represent an important step towards full and dexterous control of neural prosthetic devices.

Project description:Brain stimulation (BStim) encompasses multiple modalities (e.g., deep brain stimulation, responsive neurostimulation) that utilize electrodes implanted in deep brain structures to treat neurological disorders. Currently, BStim is primarily used to treat movement disorders such as Parkinson's, though indications are expanding to include neuropsychiatric disorders like depression and schizophrenia. Traditional BStim systems are "open-loop" and deliver constant electrical stimulation based on manually-determined parameters. Advancements in BStim have enabled development of "closed-loop" systems that analyze neural biomarkers (e.g., local field potentials in the sub-thalamic nucleus) and adjust electrical modulation in a dynamic, patient-specific, and energy efficient manner. These closed-loop systems enable real-time, context-specific stimulation adjustment to reduce symptom burden. Machine learning (ML) has emerged as a vital component in designing these closed-loop systems as ML models can predict / identify presence of disease symptoms based on neural activity and adaptively learn to modulate stimulation. We queried the US National Library of Medicine PubMed database to understand the role of ML in developing closed-loop BStim systems to treat epilepsy, movement disorders, and neuropsychiatric disorders. Both neural and non-neural network ML algorithms have successfully been leveraged to create closed-loop systems that perform comparably to open-loop systems. For disorders in which the underlying neural pathophysiology is relatively well understood (e.g., Parkinson's, essential tremor), most work has involved refining ML models that can classify neural signals as aberrant or normal. The same is seen for epilepsy, where most current research has focused on identifying optimal ML model design and integrating closed-loop systems into existing devices. For neuropsychiatric disorders, where the underlying pathologic neural circuitry is still being investigated, research is focused on identifying biomarkers (e.g., local field potentials from brain nuclei) that ML models can use to identify onset of symptoms and stratify severity of disease.

Dataset Information

A recurrent neural network for closed-loop intracortical brain-machine interface decoders.

Publications

A recurrent neural network for closed-loop intracortical brain-machine interface decoders.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets