Dataset Information

A Robust Screen-Free Brain-Computer Interface for Robotic Object Selection.

ABSTRACT: Brain signals represent a communication modality that can allow users of assistive robots to specify high-level goals, such as the object to fetch and deliver. In this paper, we consider a screen-free Brain-Computer Interface (BCI), where the robot highlights candidate objects in the environment using a laser pointer, and the user goal is decoded from the evoked responses in the electroencephalogram (EEG). Having the robot present stimuli in the environment allows for more direct commands than traditional BCIs that require the use of graphical user interfaces. Yet bypassing a screen entails less control over stimulus appearances. In realistic environments, this leads to heterogeneous brain responses for dissimilar objects-posing a challenge for reliable EEG classification. We model object instances as subclasses to train specialized classifiers in the Riemannian tangent space, each of which is regularized by incorporating data from other objects. In multiple experiments with a total of 19 healthy participants, we show that our approach not only increases classification performance but is also robust to both heterogeneous and homogeneous objects. While especially useful in the case of a screen-free BCI, our approach can naturally be applied to other experimental paradigms with potential subclass structure.

SUBMITTER: Kolkhorst H

PROVIDER: S-EPMC7806045 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Robust Screen-Free Brain-Computer Interface for Robotic Object Selection.

Kolkhorst Henrich H Veit Joseline J Burgard Wolfram W Tangermann Michael M

Frontiers in robotics and AI 20200331

Brain signals represent a communication modality that can allow users of assistive robots to specify high-level goals, such as the object to fetch and deliver. In this paper, we consider a screen-free Brain-Computer Interface (BCI), where the robot highlights candidate objects in the environment using a laser pointer, and the user goal is decoded from the evoked responses in the electroencephalogram (EEG). Having the robot present stimuli in the environment allows for more direct commands than t ...[more]

PMID: 33501206

Similar Datasets

Project description:BackgroundExcessive reliance on wheelchairs in individuals with tetraplegia or paraplegia due to spinal cord injury (SCI) leads to many medical co-morbidities, such as cardiovascular disease, metabolic derangements, osteoporosis, and pressure ulcers. Treatment of these conditions contributes to the majority of SCI health care costs. Restoring able-body-like ambulation in this patient population can potentially reduce the incidence of these medical co-morbidities, in addition to increasing independence and quality of life. However, no biomedical solution exists that can reverse this loss of neurological function, and hence novel methods are needed. Brain-computer interface (BCI) controlled lower extremity prostheses may constitute one such novel approach.MethodsOne able-bodied subject and one subject with paraplegia due to SCI underwent electroencephalogram (EEG) recordings while engaged in alternating epochs of idling and walking kinesthetic motor imagery (KMI). These data were analyzed to generate an EEG prediction model for online BCI operation. A commercial robotic gait orthosis (RoGO) system (suspended over a treadmill) was interfaced with the BCI computer to allow for computerized control. The subjects were then tasked to perform five, 5-min-long online sessions where they ambulated using the BCI-RoGO system as prompted by computerized cues. The performance of this system was assessed with cross-correlation analysis, and omission and false alarm rates.ResultsThe offline accuracy of the EEG prediction model averaged 86.30% across both subjects (chance: 50%). The cross-correlation between instructional cues and the BCI-RoGO walking epochs averaged across all subjects and all sessions was 0.812 ± 0.048 (p-value <10(-4)). Also, there were on average 0.8 false alarms per session and no omissions.ConclusionThese results provide preliminary evidence that restoring brain-controlled ambulation after SCI is feasible. Future work will test the function of this system in a population of subjects with SCI. If successful, this may justify the future development of BCI-controlled lower extremity prostheses for free overground walking for those with complete motor SCI. Finally, this system can also be applied to incomplete motor SCI, where it could lead to improved neurological outcomes beyond those of standard physiotherapy.

Project description:Free communication is one of the cornerstones of modern civilisation. While manual keyboards currently allow us to interface with computers and manifest our thoughts, a next frontier is communication without manual input. Brain-computer interface (BCI) spellers often achieve this by decoding patterns of neural activity as users attend to flickering keyboard displays. To date, the highest performing spellers report typing rates of ~10.00 words/minute. While impressive, these rates are typically calculated for experienced users repetitively typing single phrases. It is therefore not clear whether naïve users are able to achieve such high rates with the added cognitive load of genuine free communication, which involves continuously generating and spelling novel words and phrases. In two experiments, we developed an open-source, high-performance, non-invasive BCI speller and examined its feasibility for free communication. The BCI speller required users to focus their visual attention on a flickering keyboard display, thereby producing unique cortical activity patterns for each key, which were decoded using filter-bank canonical correlation analysis. In Experiment 1, we tested whether seventeen naïve users could maintain rapid typing during prompted free word association. We found that information transfer rates were indeed slower during this free communication task than during typing of a cued character sequence. In Experiment 2, we further evaluated the speller's efficacy for free communication by developing a messaging interface, allowing users to engage in free conversation. The results showed that free communication was possible, but that information transfer was reduced by voluntary textual corrections and turn-taking during conversation. We evaluated a number of factors affecting the suitability of BCI spellers for free communication, and make specific recommendations for improving classification accuracy and usability. Overall, we found that developing a BCI speller for free communication requires a focus on usability over reduced character selection time, and as such, future performance appraisals should be based on genuine free communication scenarios.

Dataset Information

A Robust Screen-Free Brain-Computer Interface for Robotic Object Selection.

Publications

A Robust Screen-Free Brain-Computer Interface for Robotic Object Selection.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets