Dataset Information

Toward a compact hybrid brain-computer interface (BCI): Performance evaluation of multi-class hybrid EEG-fNIRS BCIs with limited number of channels.

ABSTRACT: It has been demonstrated that the performance of typical unimodal brain-computer interfaces (BCIs) can be noticeably improved by combining two different BCI modalities. This so-called "hybrid BCI" technology has been studied for decades; however, hybrid BCIs that particularly combine electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) (hereafter referred to as hBCIs) have not been widely used in practical settings. One of the main reasons why hBCI systems are so unpopular is that their hardware is generally too bulky and complex. Therefore, to make hBCIs more appealing, it is necessary to implement a lightweight and compact hBCI system with minimal performance degradation. In this study, we investigated the feasibility of implementing a compact hBCI system with significantly less EEG channels and fNIRS source-detector (SD) pairs, but that can achieve a classification accuracy high enough to be used in practical BCI applications. EEG and fNIRS data were acquired while participants performed three different mental tasks consisting of mental arithmetic, right-hand motor imagery, and an idle state. Our analysis results showed that the three mental states could be classified with a fairly high classification accuracy of 77.6 ± 12.1% using an hBCI system with only two EEG channels and two fNIRS SD pairs.

SUBMITTER: Kwon J

PROVIDER: S-EPMC7080269 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Toward a compact hybrid brain-computer interface (BCI): Performance evaluation of multi-class hybrid EEG-fNIRS BCIs with limited number of channels.

Kwon Jinuk J Shin Jaeyoung J Im Chang-Hwan CH

PloS one 20200318 3

It has been demonstrated that the performance of typical unimodal brain-computer interfaces (BCIs) can be noticeably improved by combining two different BCI modalities. This so-called "hybrid BCI" technology has been studied for decades; however, hybrid BCIs that particularly combine electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) (hereafter referred to as hBCIs) have not been widely used in practical settings. One of the main reasons why hBCI systems are so unpopu ...[more]

PMID: 32187208

Similar Datasets

Project description:We report results of a study that utilizes a BCI to drive an interactive interface countermeasure that allows users to self-regulate sustained attention while performing an ecologically valid, long-duration business logistics task. An engagement index derived from EEG signals was used to drive the BCI while fNIRS measured hemodynamic activity for the duration of the task. Participants (n = 30) were split into three groups (1) no countermeasures (NOCM), (2) continuous countermeasures (CCM), and (3) event synchronized, level-dependent countermeasures (ECM). We hypothesized that the ability to self-regulate sustained attention through a neurofeedback mechanism would result in greater task engagement, decreased error rate and improved task performance. Data were analyzed by wavelet coherence analysis, statistical analysis, performance metrics and self-assessed cognitive workload via RAW-TLX. We found that when the BCI was used to deliver continuous interface countermeasures (CCM), task performance was moderately enhanced in terms of total 14,785 (σ = 423) and estimated missed sales 7.46% (σ = 1.76) when compared to the NOCM 14,529 (σ = 510), 9.79% (σ = 2.75), and the ECM 14,180 (σ = 875), 9.62% (σ = 4.91) groups. An "actions per minute" (APM) metric was used to determine interface interaction activity which showed that overall the CCM and ECM groups had a higher APM of 3.460 (SE = 0.140) and 3.317 (SE = 0.139) respectively when compared with the NOCM group 2.65 (SE = 0.097). Statistical analysis showed a significant difference between ECM - NOCM and CCM - NOCM (p < 0.001) groups, but no significant difference between the ECM - CCM groups. Analysis of the RAW-TLX scores showed that the CCM group had lowest total score 7.27 (σ = 3.1) when compared with the ECM 9.7 (σ = 3.3) and NOCM 9.2 (σ = 3.4) groups. No statistical difference was found between the RAW-TLX or the subscales, except for self-perceived performance (p < 0.028) comparing the CCM and ECM groups. The results suggest that providing a means to self-regulate sustained attention has the potential to keep operators engaged over long periods, and moderately increase on-task performance while decreasing on-task error.

Project description:Tremor is the most common movement disorder encountered during daily neurological practice. Tremor in the upper limbs causes functional disability and social inconvenience, impairing daily life activities. The response of tremor to pharmacotherapy is variable. Therefore, a combination of drugs is often required. Surgery is considered when the response to medications is not sufficient. However, about one third of patients are refractory to current treatments. New bioengineering therapies are emerging as possible alternatives. Our study was carried out in the framework of the European project "Tremor" (ICT-2007-224051). The main purpose of this challenging project was to develop and validate a new treatment for upper limb tremor based on the combination of functional electrical stimulation (FES; which has been shown to reduce upper limb tremor) with a brain-computer interface (BCI). A BCI-driven detection of voluntary movement is used to trigger FES in a closed-loop approach. Neurological tremor is detected using a matrix of EMG electrodes and inertial sensors embedded in a wearable textile. The identification of the intentionality of movement is a critical aspect to optimize this complex system. We propose a multimodal detection of the intentionality of movement by fusing signals from EEG, EMG and kinematic sensors (gyroscopes and accelerometry). Parameters of prediction of movement are extracted in order to provide global prediction plots and trigger FES properly. In particular, quality parameters (QPs) for the EEG signals, corticomuscular coherence and event-related desynchronization/synchronization (ERD/ERS) parameters are combined in an original algorithm which takes into account the refractoriness/responsiveness of tremor. A simulation study of the relationship between the threshold of ERD/ERS of artificial EEG traces and the QPs is also provided. Very interestingly, values of QPs were much greater than those obtained for the corticomuscular module alone.

Project description:ObjectivePilot testing of real time functional magnetic resonance imaging (rt-fMRI) and real time functional near infrared spectroscopy (rt-fNIRS) as brain computer interface (BCI) neural feedback systems combined with motor learning for motor recovery in chronic severely impaired stroke survivors.ApproachWe enrolled a four-case series and administered three sequential rt-fMRI and ten rt-fNIRS neural feedback sessions interleaved with motor learning sessions. Measures were: Arm Motor Assessment Tool, functional domain (AMAT-F; 13 complex functional tasks), Fugl-Meyer arm coordination scale (FM); active wrist extension range of motion (ROM); volume of activation (fMRI); and fNIRS HbO concentration. Performance during neural feedback was assessed, in part, using percent successful brain modulations during rt-fNIRS.Main resultsPre-/post-treatment mean clinically significant improvement in AMAT-F (.49 ± 0.22) and FM (10.0 ± 3.3); active wrist ROM improvement ranged from 20° to 50°. Baseline to follow-up change in brain signal was as follows: fMRI volume of activation was reduced in almost all ROIs for three subjects, and for one subject there was an increase or no change; fNIRS HbO was within normal range, except for one subject who increased beyond normal at post-treatment. During rt-fNIRS neural feedback training, there was successful brain signal modulation (42%-78%).SignificanceSeverely impaired stroke survivors successfully engaged in spatially focused BCI systems, rt-fMRI and rt-fNIRS, to clinically significantly improve motor function. At the least, equivalency in motor recovery was demonstrated with prior long-duration motor learning studies (without neural feedback), indicating that no loss of motor improvement resulted from substituting neural feedback sessions for motor learning sessions. Given that the current neural feedback protocol did not prevent the motor improvements observed in other long duration studies, even in the presence of fewer sessions of motor learning in the current work, the results support further study of neural feedback and its potential for recovery of motor function in stroke survivors. In future work, expanding the sophistication of either or both rt-fMRI and rt-fNIRS could hold the potential for further reducing the number of hours of training needed and/or the degree of recovery. ClinicalTrials.gov ID: NCT02856035.

Dataset Information

Toward a compact hybrid brain-computer interface (BCI): Performance evaluation of multi-class hybrid EEG-fNIRS BCIs with limited number of channels.

Publications

Toward a compact hybrid brain-computer interface (BCI): Performance evaluation of multi-class hybrid EEG-fNIRS BCIs with limited number of channels.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets