Browse
Submit Data
Databases
API
Help

Dataset Information

22 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Navigation of a telepresence robot via covert visuospatial attention and real-time fMRI.

ABSTRACT: Brain-computer interfaces (BCIs) allow people with severe neurological impairment and without ability to control their muscles to regain some control over their environment. The BCI user performs a mental task to regulate brain activity, which is measured and translated into commands controlling some external device. We here show that healthy participants are capable of navigating a robot by covertly shifting their visuospatial attention. Covert Visuospatial Attention (COVISA) constitutes a very intuitive brain function for spatial navigation and does not depend on presented stimuli or on eye movements. Our robot is equipped with motors and a camera that sends visual feedback to the user who can navigate it from a remote location. We used an ultrahigh field MRI scanner (7 Tesla) to obtain fMRI signals that were decoded in real time using a support vector machine. Four healthy subjects with virtually no training succeeded in navigating the robot to at least three of four target locations. Our results thus show that with COVISA BCI, realtime robot navigation can be achieved. Since the magnitude of the fMRI signal has been shown to correlate well with the magnitude of spectral power changes in the gamma frequency band in signals measured by intracranial electrodes, the COVISA concept may in future translate to intracranial application in severely paralyzed people.

SUBMITTER: Andersson P

PROVIDER: S-EPMC3536975 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Real-time decoding of brain responses to visuospatial attention using 7T fMRI.

Project description:Brain-Computer interface technologies mean to create new communication channels between our mind and our environment, independent of the motor system, by detecting and classifying self regulation of local brain activity. BCIs can provide patients with severe paralysis a means to communicate and to live more independent lives. There has been a growing interest in using invasive recordings for BCI to improve the signal quality. This also potentially gives access to new control strategies previously inaccessible by non-invasive methods. However, before surgery, the best implantation site needs to be determined. The blood-oxygen-level dependent signal changes measured with fMRI have been shown to agree well spatially with those found with invasive electrodes, and are the best option for pre-surgical localization. We show, using real-time fMRI at 7T, that eye movement-independent visuospatial attention can be used as a reliable control strategy for BCIs. At this field strength even subtle signal changes can be detected in single trials thanks to the high contrast-to-noise ratio. A group of healthy subjects were instructed to move their attention between three (two peripheral and one central) spatial target regions while keeping their gaze fixated at the center. The activated regions were first located and thereafter the subjects were given real-time feedback based on the activity in these regions. All subjects managed to regulate local brain areas without training, which suggests that visuospatial attention is a promising new target for intracranial BCI. ECoG data recorded from one epilepsy patient showed that local changes in gamma-power can be used to separate the three classes.

| S-EPMC3215723 | biostudies-literature

Real-time decoding of covert attention in higher-order visual areas.

Project description:Brain-computer-interfaces (BCI) provide a means of using human brain activations to control devices for communication. Until now this has only been demonstrated in primary motor and sensory brain regions, using surgical implants or non-invasive neuroimaging techniques. Here, we provide proof-of-principle for the use of higher-order brain regions involved in complex cognitive processes such as attention. Using realtime fMRI, we implemented an online 'winner-takes-all approach' with quadrant-specific parameter estimates, to achieve single-block classification of brain activations. These were linked to the covert allocation of attention to real-world images presented at 4-quadrant locations. Accuracies in three target regions were significantly above chance, with individual decoding accuracies reaching upto 70%. By utilising higher order mental processes, 'cognitive BCIs' access varied and therefore more versatile information, potentially providing a platform for communication in patients who are unable to speak or move due to brain injury.

| S-EPMC5864512 | biostudies-literature

Real-time fMRI neurofeedback in adolescents with attention deficit hyperactivity disorder.

Project description:Attention Deficit Hyperactivity Disorder (ADHD) is associated with poor self-control, underpinned by inferior fronto-striatal deficits. Real-time functional magnetic resonance neurofeedback (rtfMRI-NF) allows participants to gain self-control over dysregulated brain regions. Despite evidence for beneficial effects of electrophysiological-NF on ADHD symptoms, no study has applied the spatially superior rtfMRI-NF neurotherapy to ADHD. A randomized controlled trial tested the efficacy of rtfMRI-NF of right inferior prefrontal cortex (rIFG), a key region that is compromised in ADHD and upregulated with psychostimulants, on improvement of ADHD symptoms, cognition, and inhibitory fMRI activation. To control for region-specificity, an active control group received rtfMRI-NF of the left parahippocampal gyrus (lPHG). Thirty-one ADHD boys were randomly allocated and had to learn to upregulate their target brain region in an average of 11 rtfMRI-NF runs over 2 weeks. Feedback was provided through a video-clip of a rocket that had to be moved up into space. A transfer session without feedback tested learning retention as a proximal measure of transfer to everyday life. Both NF groups showed significant linear activation increases with increasing number of runs in their respective target regions and significant reduction in ADHD symptoms after neurotherapy and at 11-month follow-up. Only the group targeting rIFG, however, showed a transfer effect, which correlated with ADHD symptom reductions, improved at trend level in sustained attention, and showed increased IFG activation during an inhibitory fMRI task. This proof-of-concept study demonstrates for the first time feasibility, safety, and shorter- and longer-term efficacy of rtfMRI-NF of rIFG in adolescents with ADHD. Hum Brain Mapp 38:3190-3209, 2017. © 2017 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

| S-EPMC5434828 | biostudies-literature

How automatic speed control based on distance affects user behaviours in telepresence robot navigation within dense conference-like environments.

Project description:Telepresence robots allow users to be spatially and socially present in remote environments. Yet, it can be challenging to remotely operate telepresence robots, especially in dense environments such as academic conferences or workplaces. In this paper, we primarily focus on the effect that a speed control method, which automatically slows the telepresence robot down when getting closer to obstacles, has on user behaviors. In our first user study, participants drove the robot through a static obstacle course with narrow sections. Results indicate that the automatic speed control method significantly decreases the number of collisions. For the second study we designed a more naturalistic, conference-like experimental environment with tasks that require social interaction, and collected subjective responses from the participants when they were asked to navigate through the environment. While about half of the participants preferred automatic speed control because it allowed for smoother and safer navigation, others did not want to be influenced by an automatic mechanism. Overall, the results suggest that automatic speed control simplifies the user interface for telepresence robots in static dense environments, but should be considered as optionally available, especially in situations involving social interactions.

| S-EPMC7676718 | biostudies-literature

Concurrent TMS-fMRI reveals dynamic interhemispheric influences of the right parietal cortex during exogenously cued visuospatial attention.

Project description:We used concurrent transcranial magnetic stimulation and functional MRI (TMS-fMRI) during a visuospatial cueing paradigm in humans, to study the causal role of the right angular gyrus (AG) as a source of attentional control. Our findings show that TMS over the right AG (high vs. low intensity) modulates neural responses interhemispherically, in a manner that varies dynamically with the current attentional condition. The behavioural impact of such TMS depended not only on the target hemifield but also on exogenous cue validity, facilitating spatial reorienting to invalidly cued right visual targets. On a neural level, right AG TMS had corresponding interhemispheric effects in the left AG and left retinotopic cortex, including area V1. We conclude that the direction of covert visuospatial attention can involve dynamic interplay between the right AG and remote interconnected regions of the opposite left hemisphere, whereas our findings also suggest that the right AG can influence responses in the retinotopic visual cortex.

| S-EPMC3437477 | biostudies-literature

Online spatial normalization for real-time FMRI.

Project description:Real-time functional magnetic resonance imaging (rtfMRI) is a recently emerged technique that demands fast data processing within a single repetition time (TR), such as a TR of 2 seconds. Data preprocessing in rtfMRI has rarely involved spatial normalization, which can not be accomplished in a short time period. However, spatial normalization may be critical for accurate functional localization in a stereotactic space and is an essential procedure for some emerging applications of rtfMRI. In this study, we introduced an online spatial normalization method that adopts a novel affine registration (AFR) procedure based on principal axes registration (PA) and Gauss-Newton optimization (GN) using the self-adaptive ? parameter, termed PA-GN(?) AFR and nonlinear registration (NLR) based on discrete cosine transform (DCT). In AFR, PA provides an appropriate initial estimate of GN to induce the rapid convergence of GN. In addition, the ? parameter, which relies on the change rate of cost function, is employed to self-adaptively adjust the iteration step of GN. The accuracy and performance of PA-GN(?) AFR were confirmed using both simulation and real data and compared with the traditional AFR. The appropriate cutoff frequency of the DCT basis function in NLR was determined to balance the accuracy and calculation load of the online spatial normalization. Finally, the validity of the online spatial normalization method was further demonstrated by brain activation in the rtfMRI data.

| S-EPMC4106896 | biostudies-literature

Combinatorial brain decoding of people's whereabouts during visuospatial navigation.

Project description:Complex behavior typically relies upon many different processes which are related to activity in multiple brain regions. In contrast, neuroimaging analyses typically focus upon isolated processes. Here we present a new approach, combinatorial brain decoding, in which we decode complex behavior by combining the information which we can retrieve from the neural signals about the many different sub-processes. The case in point is visuospatial navigation. We explore the extent to which the route travelled by human subjects (N = 3) in a complex virtual maze can be decoded from activity patterns as measured with functional magnetic resonance imaging. Preliminary analyses suggest that it is difficult to directly decode spatial position from regions known to contain an explicit cognitive map of the environment, such as the hippocampus. Instead, we were able to indirectly derive spatial position from the pattern of activity in visual and motor cortex. The non-spatial representations in these regions reflect processes which are inherent to navigation, such as which stimuli are perceived at which point in time and which motor movement is executed when (e.g., turning left at a crossroad). Highly successful decoding of routes followed through the maze was possible by combining information about multiple aspects of navigation events across time and across multiple cortical regions. This "proof of principle" study highlights how visuospatial navigation is related to the combined activity of multiple brain regions, and establishes combinatorial brain decoding as a means to study complex mental events that involve a dynamic interplay of many cognitive processes.

| S-EPMC3657635 | biostudies-literature

Zero-derivation in Korean: the effect of covert structure in real-time processing.

Project description:Korean words like balgda 'bright/become bright' and gilda 'long/become long' are categorially ambiguous; they can appear as both adjectives and verbs. Some suggest that these words are listed under separate lexical entries, while others propose that they share one single lexical entry, and that the verb form is morphologically derived from the base adjective through a process called zero derivation. This study presents the results of a real-time experiment that investigates whether these words involve zero derivation and if so, how zero derivation may affect the real-time processing of these words. Our findings suggest that the reader recognizes the base adjective and obtains the derived-verb form by virtue of adding a covert category-changing morpheme in real-time sentence processing. This study provides promising evidence of the zero derivation of Korean categorially ambiguous adjectives and verbs, as well as crosslinguistic evidence of the role of covert structure in lexical access.

| S-EPMC10751375 | biostudies-literature

Real-time fMRI data for testing OpenNFT functionality.

Project description:Here, we briefly describe the real-time fMRI data that is provided for testing the functionality of the open-source Python/Matlab framework for neurofeedback, termed Open NeuroFeedback Training (OpenNFT, Koush et al. [1]). The data set contains real-time fMRI runs from three anonymized participants (i.e., one neurofeedback run per participant), their structural scans and pre-selected ROIs/masks/weights. The data allows for simulating the neurofeedback experiment without an MR scanner, exploring the software functionality, and measuring data processing times on the local hardware. In accordance with the descriptions in our main article, we provide data of (1) periodically displayed (intermittent) activation-based feedback; (2) intermittent effective connectivity feedback, based on dynamic causal modeling (DCM) estimations; and (3) continuous classification-based feedback based on support-vector-machine (SVM) estimations. The data is available on our public GitHub repository: https://github.com/OpenNFT/OpenNFT_Demo/releases.

| S-EPMC5547236 | biostudies-literature

From real-time adaptation to social learning in robot ecosystems.

Project description:While evolutionary robotics can create novel morphologies and controllers that are well-adapted to their environments, learning is still the most efficient way to adapt to changes that occur on shorter time scales. Learning proposals for evolving robots to date have focused on new individuals either learning a controller from scratch, or building on the experience of direct ancestors and/or robots with similar configurations. Here we propose and demonstrate a novel means for social learning of gait patterns, based on sensorimotor synchronization. Using movement patterns of other robots as input can drive nonlinear decentralized controllers such as CPGs into new limit cycles, hence encouraging diversity of movement patterns. Stable autonomous controllers can then be locked in, which we demonstrate using a quasi-Hebbian feedback scheme. We propose that in an ecosystem of robots evolving in a heterogeneous environment, such a scheme may allow for the emergence of generalist task-solvers from a population of specialists.

| S-EPMC10584317 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data