Dataset Information

Brain-computer interface control in a virtual reality environment and applications for the internet of things.

ABSTRACT: Brain-computer interfaces (BCIs) have enabled individuals to control devices such as spellers, robotic arms, drones, and wheelchairs, but often these BCI applications are restricted to research laboratories. With the advent of virtual reality (VR) systems and the internet of things (IoT) we can couple these technologies to offer real-time control of a user's virtual and physical environment. Likewise, BCI applications are often single-use with user's having no control outside of the restrictions placed upon the applications at the time of creation. Therefore, there is a need to create a tool that allows users the flexibility to create and modularize aspects of BCI applications for control of IoT devices and VR environments. Using a popular video game engine, Unity, and coupling it with BCI2000, we can create diverse applications that give the end-user additional autonomy during the task at hand. We demonstrate the validity of controlling a Unity-based VR environment and several commercial IoT devices via direct neural interfacing processed through BCI2000.

SUBMITTER: Coogan CG

PROVIDER: S-EPMC6157750 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Brain-computer interface control in a virtual reality environment and applications for the internet of things.

Coogan Christopher G CG He Bin B

IEEE access : practical innovations, open solutions 20180227

Brain-computer interfaces (BCIs) have enabled individuals to control devices such as spellers, robotic arms, drones, and wheelchairs, but often these BCI applications are restricted to research laboratories. With the advent of virtual reality (VR) systems and the internet of things (IoT) we can couple these technologies to offer real-time control of a user's virtual and physical environment. Likewise, BCI applications are often single-use with user's having no control outside of the restrictions ...[more]

PMID: 30271700

Similar Datasets

Project description:Human-robot interaction is a rapidly developing field and robots have been taking more active roles in our daily lives. Patient care is one of the fields in which robots are becoming more present, especially for people with disabilities. People with neurodegenerative disorders might not consciously or voluntarily produce movements other than those involving the eyes or eyelids. In this context, Brain-Computer Interface (BCI) systems present an alternative way to communicate or interact with the external world. In order to improve the lives of people with disabilities, this paper presents a novel BCI to control an assistive robot with user's eye artifacts. In this study, eye artifacts that contaminate the electroencephalogram (EEG) signals are considered a valuable source of information thanks to their high signal-to-noise ratio and intentional generation. The proposed methodology detects eye artifacts from EEG signals through characteristic shapes that occur during the events. The lateral movements are distinguished by their ordered peak and valley formation and the opposite phase of the signals measured at F7 and F8 channels. This work, as far as the authors' knowledge, is the first method that used this behavior to detect lateral eye movements. For the blinks detection, a double-thresholding method is proposed by the authors to catch both weak blinks as well as regular ones, differentiating itself from the other algorithms in the literature that normally use only one threshold. Real-time detected events with their virtual time stamps are fed into a second algorithm, to further distinguish between double and quadruple blinks from single blinks occurrence frequency. After testing the algorithm offline and in realtime, the algorithm is implemented on the device. The created BCI was used to control an assistive robot through a graphical user interface. The validation experiments including 5 participants prove that the developed BCI is able to control the robot.

Project description:Augmented reality (AR) enhances the user's environment by projecting virtual objects into the real world in real-time. Brain-computer interfaces (BCIs) are systems that enable users to control external devices with their brain signals. BCIs can exploit AR technology to interact with the physical and virtual world and to explore new ways of displaying feedback. This is important for users to perceive and regulate their brain activity or shape their communication intentions while operating in the physical world. In this study, twelve healthy participants were introduced to and asked to choose between two motor-imagery tasks: mental drawing and interacting with a virtual cube. Participants first performed a functional localizer run, which was used to select a single fNIRS channel for decoding their intentions in eight subsequent choice-encoding runs. In each run participants were asked to select one choice of a six-item list. A rotating AR cube was displayed on a computer screen as the main stimulus, where each face of the cube was presented for 6 s and represented one choice of the six-item list. For five consecutive trials, participants were instructed to perform the motor-imagery task when the face of the cube that represented their choice was facing them (therewith temporally encoding the selected choice). In the end of each run, participants were provided with the decoded choice based on a joint analysis of all five trials. If the decoded choice was incorrect, an active error-correction procedure was applied by the participant. The choice list provided in each run was based on the decoded choice of the previous run. The experimental design allowed participants to navigate twice through a virtual menu that consisted of four levels if all choices were correctly decoded. Here we demonstrate for the first time that by using AR feedback and flexible choice encoding in form of search trees, we can increase the degrees of freedom of a BCI system. We also show that participants can successfully navigate through a nested menu and achieve a mean accuracy of 74% using a single motor-imagery task and a single fNIRS channel.

Project description:Spatial navigation is influenced by landmarks, which are prominent visual features in the environment. Although previous research has focused on finding advantages of landmarks on wayfinding via experimentation; however, less attention has been given to identifying the key attributes of landmarks that facilitate wayfinding, including the study of neural correlates (involving electroencephalogram, EEG analyses). In this paper, we combine behavioral measures, virtual environment, and EEG signal-processing to provide a holistic investigation about the influence of landmarks on performance during navigation in a maze-like environment. In an experiment, participants were randomly divided into two conditions, Landmark-enriched (LM+; N = 17) and Landmark-devoid (LM-; N = 18), and asked to navigate from an initial location to a goal location in a maze. In the LM+ condition, there were landmarks placed at certain locations, which participants could use for wayfinding in the maze. However, in the LM- condition, such landmarks were not present. Beyond behavioral analyses of data, analyses were carried out of the EEG data collected using a 64-channel device. Results revealed that participants took less time and committed fewer errors in navigating the maze in the LM+ condition compared to the LM- condition. EEG analyses of the data revealed that the left-hemispheric activation was more prominent in the LM+ condition compared to the LM- condition. The event-related desynchronization/synchronization (ERD/ERS) of the theta frequency band, revealed activation in the left posterior inferior and superior regions in the LM+ condition compared to the LM- condition, suggesting an occurrence of an object-location binding in the LM+ condition along with spatial transformation between representations. Moreover, directed transfer function method, which measures information flow between two regions, showed a higher number of active channels in the LM- condition compared to the LM+ condition, exhibiting additional wiring cost associated with the cognitive demands when no landmark was available. These findings reveal pivotal role of the left-hemispheric region (especially, parietal cortex), which indicates the integration of available sensory cues and current memory requirements to encode contextual information of landmarks. Overall, this research helps to understand the role of brain regions and processes that are utilized when people use landmarks in navigating maze-like environments.

Dataset Information

Brain-computer interface control in a virtual reality environment and applications for the internet of things.

Publications

Brain-computer interface control in a virtual reality environment and applications for the internet of things.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets