Brain Machine Interfaces for Vision Restoration: The Current State of Cortical Visual Prosthetics.
Ontology highlight
ABSTRACT:
SUBMITTER: Niketeghad S
PROVIDER: S-EPMC6361050 | biostudies-literature | 2019 Jan
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Advances in recent years have dramatically improved output control by Brain-Machine Interfaces (BMIs). Such devices nevertheless remain robotic and limited in their movements compared to normal human motor performance. Most current BMIs rely on transforming recorded neural activity to a linear state space composed of a set number of fixed degrees of freedom. Here we consider a variety of ways in which BMI design might be advanced further by applying non-linear dynamics observed in normal motor behavior. We consider (i) the dynamic range and precision of natural movements, (ii) differences between cortical activity and actual body movement, (iii) kinematic and muscular synergies, and (iv) the implications of large neuronal populations. We advance the hypothesis that a given population of recorded neurons may transmit more useful information than can be captured by a single, linear model across all movement phases and contexts. We argue that incorporating these various non-linear characteristics will be an important next step in advancing BMIs to more closely match natural motor performance.
| S-EPMC4516874 | biostudies-literature
Project description:Brain-machine interfaces (BMIs) seek to connect brains with machines or computers directly, for application in areas such as prosthesis control. For this application, the accuracy of the decoding of movement intentions is crucial. We aim to improve accuracy by designing a better encoding model of primary motor cortical activity during hand movements and combining this with decoder engineering refinements, resulting in a new unscented Kalman filter based decoder, UKF2, which improves upon our previous unscented Kalman filter decoder, UKF1. The new encoding model includes novel acceleration magnitude, position-velocity interaction, and target-cursor-distance features (the decoder does not require target position as input, it is decoded). We add a novel probabilistic velocity threshold to better determine the user's intent to move. We combine these improvements with several other refinements suggested by others in the field. Data from two Rhesus monkeys indicate that the UKF2 generates offline reconstructions of hand movements (mean CC 0.851) significantly more accurately than the UKF1 (0.833) and the popular position-velocity Kalman filter (0.812). The encoding model of the UKF2 could predict the instantaneous firing rate of neurons (mean CC 0.210), given kinematic variables and past spiking, better than the encoding models of these two decoders (UKF1: 0.138, p-v Kalman: 0.098). In closed-loop experiments where each monkey controlled a computer cursor with each decoder in turn, the UKF2 facilitated faster task completion (mean 1.56 s vs. 2.05 s) and higher Fitts's Law bit rate (mean 0.738 bit/s vs. 0.584 bit/s) than the UKF1. These results suggest that the modeling and decoder engineering refinements of the UKF2 improve decoding performance. We believe they can be used to enhance other decoders as well.
| S-EPMC5177654 | biostudies-literature
Project description:Inherited progressive degeneration of photoreceptors such as retinitis pigmentosa (RP) is the most common cause of blindness leading to severe vision impairment affecting ~1 in 5,000 people worldwide. Although the function and morphology of the photoreceptors get disrupted, there is evidence that the inner retinal neurons such as bipolar cells and the retinal ganglion cells are left intact until later stages. Among several innovative therapeutic options aiming to restore vision, optogenetic therapy can bestow light sensitivity to remaining retinal neurons by ectopic expression of light-sensitive proteins. Since the advent of this technique, a diverse class of opsins (microbial and mammalian opsins), chimeric proteins, ligand-gated ion channels, and switchable opsins have been used to study their potential in vision restoration. These proteins differ in their excitation spectra, response kinetics, and signal amplification cascade. Although most of the studies have reported high fidelity of responses in the retina, only a handful of them have achieved functional vision in the visual cortex. This review is a summary of the visuocortical and behavioral responses after optogenetic treatment of the degenerated retina. This clarifies to what extent improved and meaningful vision can be obtained for therapeutic efficacy and continued clinical progress.
| S-EPMC10469018 | biostudies-literature
Project description:Common causes of blindness are diseases that affect the ocular structures, such as glaucoma, retinitis pigmentosa, and macular degeneration, rendering the eyes no longer sensitive to light. The visual pathway, however, as a predominantly central structure, is largely spared in these cases. It is thus widely thought that a device-based prosthetic approach to restoration of visual function will be effective and will enjoy similar success as cochlear implants have for restoration of auditory function. In this article the authors review the potential locations for stimulation electrode placement for visual prostheses, assessing the anatomical and functional advantages and disadvantages of each. Of particular interest to the neurosurgical community is placement of deep brain stimulating electrodes in thalamic structures that has shown substantial promise in an animal model. The theory of operation of visual prostheses is discussed, along with a review of the current state of knowledge. Finally, the visual prosthesis is proposed as a model for a general high-fidelity machine-brain interface.
| S-EPMC2848996 | biostudies-literature
Project description:Visual impairments are common after traumatic brain injury (TBI) and negatively affect quality of life. We describe a 39-year-old woman with a severe TBI who was evaluated by the inpatient optometry and vision rehabilitation service with findings of complete right homonymous hemianopia and right cranial nerve III palsy with 30-degree right exotropia (eye turn out) and complete right ptosis (eyelid will not open). The 30-degree exotropia advantageously generated 30 degrees of right visual field expansion when the right ptosis was treated with a magnetic levator prosthesis, which restores eyelid opening. Once opened, the patient used visual field expansion derived from a right exotropia to overcome functional impairments caused by right hemianopia. Field expansion improved the patient's wheelchair mobility and reaching tasks during inpatient therapy. This is the first report of visual field expansion by strabismus facilitated by correction of ptosis. Strabismus should be considered for its potential field expansion benefits when homonymous visual deficits are present, before considering patching. A multidisciplinary vision rehabilitation team is well suited to make this determination.
| S-EPMC5322227 | biostudies-literature
Project description:Brain machine interfaces (BMIs) are devices that convert neural signals into commands to directly control artificial actuators, such as limb prostheses. Previous real-time methods applied to decoding behavioral commands from the activity of populations of neurons have generally relied upon linear models of neural tuning and were limited in the way they used the abundant statistical information contained in the movement profiles of motor tasks. Here, we propose an n-th order unscented Kalman filter which implements two key features: (1) use of a non-linear (quadratic) model of neural tuning which describes neural activity significantly better than commonly-used linear tuning models, and (2) augmentation of the movement state variables with a history of n-1 recent states, which improves prediction of the desired command even before incorporating neural activity information and allows the tuning model to capture relationships between neural activity and movement at multiple time offsets simultaneously. This new filter was tested in BMI experiments in which rhesus monkeys used their cortical activity, recorded through chronically implanted multielectrode arrays, to directly control computer cursors. The 10th order unscented Kalman filter outperformed the standard Kalman filter and the Wiener filter in both off-line reconstruction of movement trajectories and real-time, closed-loop BMI operation.
| S-EPMC2705792 | biostudies-literature
Project description:A set of electroencephalogram (EEG) data from 29 subjects obtained from a study, in which the subjects performed a set of tests based on visual stimuli and motor images of the hands is presented. Three types of data are provided in this article: (1) Signals based on visual events (VEP), (2) signals based on steady state visual events (SSVEP) and (3) signals based upon Motor Imagery (MI). Several research projects have used this data to test the detection of visual stimuli, classification and selection of characteristics of brain signals, EEG preprocessing and for optimization processes based on heuristic algorithms and algorithms based upon collective animal intelligence. The data was acquired using an Emotiv Epoc + portable EEG with 14 data channels and two reference channels.
| S-EPMC6581785 | biostudies-literature
Project description:Sensory feedback is very important for movement control. However, feedback information has not been directly used to update movement prediction model in the previous BMI studies, although the closed-loop BMI system provides the visual feedback to users. Here, we propose a BMI framework combining image processing as the feedback information with a novel prediction method. The feedback-prediction algorithm (FPA) generates feedback information from the positions of objects and modifies movement prediction according to the information. The FPA predicts a target among objects based on the movement direction predicted from the neural activity. After the target selection, the FPA modifies the predicted direction toward the target and modulates the magnitude of the predicted vector to easily reach the target. The FPA repeats the modification in every prediction time points. To evaluate the improvements of prediction accuracy provided by the feedback, we compared the prediction performances with feedback (FPA) and without feedback. We demonstrated that accuracy of movement prediction can be considerably improved by the FPA combining feedback information. The accuracy of the movement prediction was significantly improved for all subjects (P<0.001) and 32.1% of the mean error was reduced. The BMI performance will be improved by combining feedback information and it will promote the development of a practical BMI system.
| S-EPMC4116198 | biostudies-literature
Project description:Despite technical advances in brain machine interfaces (BMI), for as-yet unknown reasons the ability to control a BMI remains limited to a subset of users. We investigate whether individual differences in BMI control based on motor imagery (MI) are related to differences in MI ability. We assessed whether differences in kinesthetic and visual MI, in the behavioral accuracy of MI, and in electroencephalographic variables, were able to differentiate between high- versus low-aptitude BMI users. High-aptitude BMI users showed higher MI accuracy as captured by subjective and behavioral measurements, pointing to a prominent role of kinesthetic rather than visual imagery. Additionally, for the first time, we applied mental chronometry, a measure quantifying the degree to which imagined and executed movements share a similar temporal profile. We also identified enhanced lateralized ?-band oscillations over sensorimotor cortices during MI in high- versus low-aptitude BMI users. These findings reveal that subjective, behavioral, and EEG measurements of MI are intimately linked to BMI control. We propose that poor BMI control cannot be ascribed only to intrinsic limitations of EEG recordings and that specific questionnaires and mental chronometry can be used as predictors of BMI performance (without the need to record EEG activity).
| S-EPMC4823701 | biostudies-other
Project description:In this study, we proposed a new type of hybrid visual stimuli for steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), which incorporate various periodic motions into conventional flickering stimuli (FS) or pattern reversal stimuli (PRS). Furthermore, we investigated optimal periodic motions for each FS and PRS to enhance the performance of SSVEP-based BCIs. Periodic motions were implemented by changing the size of the stimulus according to four different temporal functions denoted by none, square, triangular, and sine, yielding a total of eight hybrid visual stimuli. Additionally, we developed the extended version of filter bank canonical correlation analysis (FBCCA), which is a state-of-the-art training-free classification algorithm for SSVEP-based BCIs, to enhance the classification accuracy for PRS-based hybrid visual stimuli. Twenty healthy individuals participated in the SSVEP-based BCI experiment to discriminate four visual stimuli with different frequencies. An average classification accuracy and information transfer rate (ITR) were evaluated to compare the performances of SSVEP-based BCIs for different hybrid visual stimuli. Additionally, the user's visual fatigue for each of the hybrid visual stimuli was also evaluated. As the result, for FS, the highest performances were reported when the periodic motion of the sine waveform was incorporated for all window sizes except for 3 s. For PRS, the periodic motion of the square waveform showed the highest classification accuracies for all tested window sizes. A significant statistical difference in the performance between the two best stimuli was not observed. The averaged fatigue scores were reported to be 5.3 ± 2.05 and 4.05 ± 1.28 for FS with sine-wave periodic motion and PRS with square-wave periodic motion, respectively. Consequently, our results demonstrated that FS with sine-wave periodic motion and PRS with square-wave periodic motion could effectively improve the BCI performances compared to conventional FS and PRS. In addition, thanks to its low visual fatigue, PRS with square-wave periodic motion can be regarded as the most appropriate visual stimulus for the long-term use of SSVEP-based BCIs, particularly for window sizes equal to or larger than 2 s.
| S-EPMC9534124 | biostudies-literature