Review: Human Intracortical Recording and Neural Decoding for Brain-Computer Interfaces.
Ontology highlight
ABSTRACT:
SUBMITTER: Brandman DM
PROVIDER: S-EPMC5815832 | biostudies-literature | 2017 Oct
REPOSITORIES: biostudies-literature
Publications
Review: Human Intracortical Recording and Neural Decoding for Brain-Computer Interfaces.
Brandman David M DM Cash Sydney S SS Hochberg Leigh R LR
IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society 20170302 10
Brain-computer interfaces (BCIs) use neural information recorded from the brain for the voluntary control of external devices. The development of BCI systems has largely focused on improving functional independence for individuals with severe motor impairments, including providing tools for communication and mobility. In this review, we describe recent advances in intracortical BCI technology and provide potential directions for further research. ...[more]
Similar Datasets
Project description:Intracortical brain-computer interface (BCI) decoders are typically retrained daily to maintain stable performance. Self-recalibrating decoders aim to remove the burden this may present in the clinic by training themselves autonomously during normal use but have only been developed for continuous control. Here we address the problem for discrete decoding (classifiers).We recorded threshold crossings from 96-electrode arrays implanted in the motor cortex of two rhesus macaques performing center-out reaches in 7 directions over 41 and 36 separate days spanning 48 and 58 days in total for offline analysis.We show that for the purposes of developing a self-recalibrating classifier, tuning parameters can be considered as fixed within days and that parameters on the same electrode move up and down together between days. Further, drift is constrained across time, which is reflected in the performance of a standard classifier which does not progressively worsen if it is not retrained daily, though overall performance is reduced by more than 10% compared to a daily retrained classifier. Two novel self-recalibrating classifiers produce a ~15% increase in classification accuracy over that achieved by the non-retrained classifier to nearly recover the performance of the daily retrained classifier.We believe that the development of classifiers that require no daily retraining will accelerate the clinical translation of BCI systems. Future work should test these results in a closed-loop setting.
| S-EPMC4393645 | biostudies-literature
Project description:As brain-computer interface (BCI) research advances, many new applications are being developed. Tasks can be performed in different environments, and whether a BCI user can switch environments seamlessly will influence the ultimate utility of a clinical device. Here we investigate the importance of the immersiveness of the virtual environment used to train BCI decoders on the resulting decoder and its generalizability between environments. Two participants who had intracortical electrodes implanted in their precentral gyrus used a BCI to control a virtual arm, either viewed immersively through virtual reality goggles or at a distance on a flat television monitor. Each participant performed better with a decoder trained and tested in the environment they had used the most prior to the study, one for each environment type. The neural tuning to the desired movement was minimally influenced by the immersiveness of the environment. Finally, in further testing with one of the participants, we found that decoders trained in one environment generalized well to the other environment, but the order in which the environments were experienced within a session mattered. Overall, experience with an environment was more influential on performance than the immersiveness of the environment, but BCI performance generalized well after accounting for experience.
| S-EPMC11312620 | biostudies-literature
Project description:The efficacy of wireless intracortical brain-computer interfaces (iBCIs) is limited in part by the number of recording channels, which is constrained by the power budget of the implantable system. Designing wireless iBCIs that provide the high-quality recordings of today's wired neural interfaces may lead to inadvertent over-design at the expense of power consumption and scalability. Here, we report analyses of neural signals collected from experimental iBCI measurements in rhesus macaques and from a clinical-trial participant with implanted 96-channel Utah multielectrode arrays to understand the trade-offs between signal quality and decoder performance. Moreover, we propose an efficient hardware design for clinically viable iBCIs, and suggest that the circuit design parameters of current recording iBCIs can be relaxed considerably without loss of performance. The proposed design may allow for an order-of-magnitude power savings and lead to clinically viable iBCIs with a higher channel count.
| S-EPMC8286886 | biostudies-literature
Project description:OBJECTIVE:When using an intracortical BCI (iBCI), users modulate their neural population activity to move an effector towards a target, stop accurately, and correct for movement errors. We call the rules that govern this modulation a 'feedback control policy'. A better understanding of these policies may inform the design of higher-performing neural decoders. APPROACH:We studied how three participants in the BrainGate2 pilot clinical trial used an iBCI to control a cursor in a 2D target acquisition task. Participants used a velocity decoder with exponential smoothing dynamics. Through offline analyses, we characterized the users' feedback control policies by modeling their neural activity as a function of cursor state and target position. We also tested whether users could adapt their policy to different decoder dynamics by varying the gain (speed scaling) and temporal smoothing parameters of the iBCI. MAIN RESULTS:We demonstrate that control policy assumptions made in previous studies do not fully describe the policies of our participants. To account for these discrepancies, we propose a new model that captures (1) how the user's neural population activity gradually declines as the cursor approaches the target from afar, then decreases more sharply as the cursor comes into contact with the target, (2) how the user makes constant feedback corrections even when the cursor is on top of the target, and (3) how the user actively accounts for the cursor's current velocity to avoid overshooting the target. Further, we show that users can adapt their control policy to decoder dynamics by attenuating neural modulation when the cursor gain is high and by damping the cursor velocity more strongly when the smoothing dynamics are high. SIGNIFICANCE:Our control policy model may help to build better decoders, understand how neural activity varies during active iBCI control, and produce better simulations of closed-loop iBCI movements.
| S-EPMC5239755 | biostudies-literature
Project description:OBJECTIVE:Recent reports indicate that making better assumptions about the user's intended movement can improve the accuracy of decoder calibration for intracortical brain-computer interfaces. Several methods now exist for estimating user intent, including an optimal feedback control model, a piecewise-linear feedback control model, ReFIT, and other heuristics. Which of these methods yields the best decoding performance? METHODS:Using data from the BrainGate2 pilot clinical trial, we measured how a steady-state velocity Kalman filter decoder was affected by the choice of intention estimation method. We examined three separate components of the Kalman filter: dimensionality reduction, temporal smoothing, and output gain (speed scaling). RESULTS:The decoder's dimensionality reduction properties were largely unaffected by the intention estimation method. Decoded velocity vectors differed by <5% in terms of angular error and speed vs. target distance curves across methods. In contrast, the smoothing and gain properties of the decoder were greatly affected (> 50% difference in average values). Since the optimal gain and smoothing properties are task-specific (e.g. lower gains are better for smaller targets but worse for larger targets), no one method was better for all tasks. CONCLUSION:Our results show that, when gain and smoothing differences are accounted for, current intention estimation methods yield nearly equivalent decoders and that simple models of user intent, such as a position error vector (target position minus cursor position), perform comparably to more elaborate models. Our results also highlight that simple differences in gain and smoothing properties have a large effect on online performance and can confound decoder comparisons.
| S-EPMC6043406 | biostudies-literature
Project description:OBJECTIVE:Brain-computer interfaces (BCIs) aim to provide a means for people with severe motor disabilities to control their environment directly with neural activity. In intracortical BCIs for people with tetraplegia, the decoder that maps neural activity to desired movements has typically been calibrated using 'open-loop' (OL) imagination of control while a cursor automatically moves to targets on a computer screen. However, because neural activity can vary across contexts, a decoder calibrated using OL data may not be optimal for 'closed-loop' (CL) neural control. Here, we tested whether CL calibration creates a better decoder than OL calibration even when all other factors that might influence performance are held constant, including the amount of data used for calibration and the amount of elapsed time between calibration and testing. APPROACH:Two people with tetraplegia enrolled in the BrainGate2 pilot clinical trial performed a center-out-back task using an intracortical BCI, switching between decoders that had been calibrated on OL versus CL data. MAIN RESULTS:Even when all other variables were held constant, CL calibration improved neural control as well as the accuracy and strength of the tuning model. Updating the CL decoder using additional and more recent data resulted in further improvements. SIGNIFICANCE:Differences in neural activity between OL and CL contexts contribute to the superiority of CL decoders, even prior to their additional 'adaptive' advantage. In the near future, CL decoder calibration may enable robust neural control without needing to pause ongoing, practical use of BCIs, an important step toward clinical utility.
| S-EPMC3775656 | biostudies-literature
Project description:OBJECTIVE:Do movements made with an intracortical BCI (iBCI) have the same movement time properties as able-bodied movements? Able-bodied movement times typically obey Fitts' law: [Formula: see text] (where MT is movement time, D is target distance, R is target radius, and [Formula: see text] are parameters). Fitts' law expresses two properties of natural movement that would be ideal for iBCIs to restore: (1) that movement times are insensitive to the absolute scale of the task (since movement time depends only on the ratio [Formula: see text]) and (2) that movements have a large dynamic range of accuracy (since movement time is logarithmically proportional to [Formula: see text]). APPROACH:Two participants in the BrainGate2 pilot clinical trial made cortically controlled cursor movements with a linear velocity decoder and acquired targets by dwelling on them. We investigated whether the movement times were well described by Fitts' law. MAIN RESULTS:We found that movement times were better described by the equation [Formula: see text], which captures how movement time increases sharply as the target radius becomes smaller, independently of distance. In contrast to able-bodied movements, the iBCI movements we studied had a low dynamic range of accuracy (absence of logarithmic proportionality) and were sensitive to the absolute scale of the task (small targets had long movement times regardless of the [Formula: see text] ratio). We argue that this relationship emerges due to noise in the decoder output whose magnitude is largely independent of the user's motor command (signal-independent noise). Signal-independent noise creates a baseline level of variability that cannot be decreased by trying to move slowly or hold still, making targets below a certain size very hard to acquire with a standard decoder. SIGNIFICANCE:The results give new insight into how iBCI movements currently differ from able-bodied movements and suggest that restoring a Fitts' law-like relationship to iBCI movements may require non-linear decoding strategies.
| S-EPMC5371026 | biostudies-literature
Project description:With the advent of advanced machine learning methods, the performance of brain-computer interfaces (BCIs) has improved unprecedentedly. However, electroencephalography (EEG), a commonly used brain imaging method for BCI, is characterized by a tedious experimental setup, frequent data loss due to artifacts, and is time consuming for bulk trial recordings to take advantage of the capabilities of deep learning classifiers. Some studies have tried to address this issue by generating artificial EEG signals. However, a few of these methods are limited in retaining the prominent features or biomarker of the signal. And, other deep learning-based generative methods require a huge number of samples for training, and a majority of these models can handle data augmentation of one category or class of data at any training session. Therefore, there exists a necessity for a generative model that can generate synthetic EEG samples with as few available trials as possible and generate multi-class while retaining the biomarker of the signal. Since EEG signal represents an accumulation of action potentials from neuronal populations beneath the scalp surface and as spiking neural network (SNN), a biologically closer artificial neural network, communicates via spiking behavior, we propose an SNN-based approach using surrogate-gradient descent learning to reconstruct and generate multi-class artificial EEG signals from just a few original samples. The network was employed for augmenting motor imagery (MI) and steady-state visually evoked potential (SSVEP) data. These artificial data are further validated through classification and correlation metrics to assess its resemblance with original data and in-turn enhanced the MI classification performance.
| S-EPMC8047134 | biostudies-literature
Project description:Intracortical neural microelectrodes, which can directly interface with local neural microcircuits with high spatial and temporal resolution, are critical for neuroscience research, emerging clinical applications, and brain computer interfaces (BCI). However, clinical applications of these devices remain limited mostly by their inability to mitigate inflammatory reactions and support dense neuronal survival at their interfaces. Herein we report the development of microelectrodes primarily composed of extracellular matrix (ECM) proteins, which act as a bio-compatible and an electrochemical interface between the microelectrodes and physiological solution. These ECM-microelectrodes are batch fabricated using a novel combination of micro-transfer-molding and excimer laser micromachining to exhibit final dimensions comparable to those of commercial silicon-based microelectrodes. These are further integrated with a removable insertion stent which aids in intracortical implantation. Results from electrochemical models and in vivo recordings from the rat's cortex indicate that ECM encapsulations have no significant effect on the electrochemical impedance characteristics of ECM-microelectrodes at neurologically relevant frequencies. ECM-microelectrodes are found to support a dense layer of neuronal somata and neurites on the electrode surface with high neuronal viability and exhibited markedly diminished neuroinflammation and glial scarring in early chronic experiments in rats.
| S-EPMC6220172 | biostudies-literature
Project description:Brain-computer interfaces (BCIs) that are based on event-related potentials (ERPs) can estimate to which stimulus a user pays particular attention. In typical BCIs, the user silently counts the selected stimulus (which is repeatedly presented among other stimuli) in order to focus the attention. The stimulus of interest is then inferred from the electroencephalogram (EEG). Detecting attention allocation implicitly could be also beneficial for human-computer interaction (HCI), because it would allow software to adapt to the user's interest. However, a counting task would be inappropriate for the envisaged implicit application in HCI. Therefore, the question was addressed if the detectable neural activity is specific for silent counting, or if it can be evoked also by other tasks that direct the attention to certain stimuli.Thirteen people performed a silent counting, an arithmetic and a memory task. The tasks required the subjects to pay particular attention to target stimuli of a random color. The stimulus presentation was the same in all three tasks, which allowed a direct comparison of the experimental conditions.Classifiers that were trained to detect the targets in one task, according to patterns present in the EEG signal, could detect targets in all other tasks (irrespective of some task-related differences in the EEG).The neural activity detected by the classifiers is not strictly task specific but can be generalized over tasks and is presumably a result of the attention allocation or of the augmented workload. The results may hold promise for the transfer of classification algorithms from BCI research to implicit relevance detection in HCI.
| S-EPMC5085039 | biostudies-other