Dataset Information

Robust detection of event-related potentials in a user-voluntary short-term imagery task.

ABSTRACT: Event-related potentials (ERPs) represent neuronal activity in the brain elicited by external visual or auditory stimulation and are widely used in brain-computer interface (BCI) systems. The ERP responses are elicited a few milliseconds after attending to an oddball stimulus; target and non-target stimuli are repeatedly flashed, and the ERP trials are averaged over time in order to improve their decoding accuracy. To reduce this time-consuming process, previous studies have attempted to evoke stronger ERP responses by changing certain experimental parameters like color, size, or the use of a face image as a target symbol. Since these exogenous potentials can be naturally evoked by merely looking at a target symbol, the BCI system could generate unintended commands while subjects are gazing at one of the symbols in a non-intentional mental state. We approached this problem of unintended command generation by assuming that a greater effort by the user in a short-term imagery task would evoke a discriminative ERP response. Three tasks were defined: passive attention, counting, and pitch-imagery. Users were instructed to passively attend to a target symbol, or to perform a mental tally of the number of target presentations, or to perform the novel task of imagining a high-pitch tone when the target symbol was highlighted. The decoding accuracy were 71.4%, 83.5%, and 89.2% for passive attention, counting, and pitch-imagery, respectively, after the fourth averaging procedure. We found stronger deflections in the N500 component corresponding to the levels of mental effort (passive attention: -1.094 ±0.88 ?V, counting: -2.226 ±0.97 ?V, and pitch-imagery: -2.883 ±0.74 ?V), which highly influenced the decoding accuracy. In addition, the rate of binary classification between passive attention and pitch-imagery tasks was 73.5%, which is an adequate classification rate that motivated us to propose a two-stage classification strategy wherein the target symbols are estimated in the first stage and the passive or active mental state is decoded in the second stage. In this study, we found that the ERP response and the decoding accuracy are highly influenced by the user's voluntary mental tasks. This could lead to a useful approach in practical ERP systems in two respects. Firstly, the user-voluntary tasks can be easily utilized in many different types of BCI systems, and performance enhancement is less dependent on the manipulation of the system's external, visual stimulus parameters. Secondly, we propose an ERP system that classifies the brain state as intended or unintended by considering the measurable differences between passively gazing and actively performing the pitch-imagery tasks in the EEG signal thus minimizing unintended commands to the BCI system.

SUBMITTER: Lee MH

PROVIDER: S-EPMC6932761 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Robust detection of event-related potentials in a user-voluntary short-term imagery task.

Lee Min-Ho MH Williamson John J Kee Young-Jin YJ Fazli Siamac S Lee Seong-Whan SW

PloS one 20191226 12

Event-related potentials (ERPs) represent neuronal activity in the brain elicited by external visual or auditory stimulation and are widely used in brain-computer interface (BCI) systems. The ERP responses are elicited a few milliseconds after attending to an oddball stimulus; target and non-target stimuli are repeatedly flashed, and the ERP trials are averaged over time in order to improve their decoding accuracy. To reduce this time-consuming process, previous studies have attempted to evoke s ...[more]

PMID: 31877161

Similar Datasets

Project description:Bioacoustic sensors, sometimes known as autonomous recording units (ARUs), can record sounds of wildlife over long periods of time in scalable and minimally invasive ways. Deriving per-species abundance estimates from these sensors requires detection, classification, and quantification of animal vocalizations as individual acoustic events. Yet, variability in ambient noise, both over time and across sensors, hinders the reliability of current automated systems for sound event detection (SED), such as convolutional neural networks (CNN) in the time-frequency domain. In this article, we develop, benchmark, and combine several machine listening techniques to improve the generalizability of SED models across heterogeneous acoustic environments. As a case study, we consider the problem of detecting avian flight calls from a ten-hour recording of nocturnal bird migration, recorded by a network of six ARUs in the presence of heterogeneous background noise. Starting from a CNN yielding state-of-the-art accuracy on this task, we introduce two noise adaptation techniques, respectively integrating short-term (60 ms) and long-term (30 min) context. First, we apply per-channel energy normalization (PCEN) in the time-frequency domain, which applies short-term automatic gain control to every subband in the mel-frequency spectrogram. Secondly, we replace the last dense layer in the network by a context-adaptive neural network (CA-NN) layer, i.e. an affine layer whose weights are dynamically adapted at prediction time by an auxiliary network taking long-term summary statistics of spectrotemporal features as input. We show that PCEN reduces temporal overfitting across dawn vs. dusk audio clips whereas context adaptation on PCEN-based summary statistics reduces spatial overfitting across sensor locations. Moreover, combining them yields state-of-the-art results that are unmatched by artificial data augmentation alone. We release a pre-trained version of our best performing system under the name of BirdVoxDetect, a ready-to-use detector of avian flight calls in field recordings.

Project description:Event-related potentials (ERPs) summarize electrophysiological brain response to specific stimuli. They can be considered as correlated functions of time with both spatial correlation across electrodes and nested correlations within subjects. Commonly used analytical methods for ERPs often focus on pre-determined extracted components and/or ignore the correlation among electrodes or subjects, which can miss important insights, and tend to be sensitive to outlying subjects, time points or electrodes. Motivated by ERP data in a smoking cessation study, we introduce a Bayesian spatial functional regression framework that models the entire ERPs as spatially correlated functional responses and the stimulus types as covariates. This novel framework relies on mixed models to characterize the effects of stimuli while simultaneously accounting for the multilevel correlation structure. The spatial correlation among the ERP profiles is captured through basis-space Matérn assumptions that allow either separable or nonseparable spatial correlations over time. We induce both adaptive regularization over time and spatial smoothness across electrodes via a correlated normal-exponential-gamma (CNEG) prior on the fixed effect coefficient functions. Our proposed framework includes both Gaussian models as well as robust models using heavier-tailed distributions to make the regression automatically robust to outliers. We introduce predictive methods to select among Gaussian vs. robust models and models with separable vs. non-separable spatiotemporal correlation structures. Our proposed analysis produces global tests for stimuli effects across entire time (or time-frequency) and electrode domains, plus multiplicity-adjusted pointwise inference based on experiment-wise error rate or false discovery rate to flag spatiotemporal (or spatio-temporal-frequency) regions that characterize stimuli differences, and can also produce inference for any prespecified waveform components. Our analysis of the smoking cessation ERP data set reveals numerous effects across different types of visual stimuli.

Project description:Previous research has pointed out that the combination of orthographic and semantic-associative training is a more advantageous strategy for the lexicalization of novel written word-forms than their single orthographic training. However, paradigms used previously involve explicit stimuli categorization (lexical decision), which likely influence word learning. In the present study, we used a more automatic task (silent reading) to determine the advantage of the associative training, by comparing the brain electrical signals elicited in combined (orthographic and semantic) and single (only orthographic) training conditions. In addition, the learning effect (in terms of similar neurophysiological activity between novel and known words) was also tested under a categorization paradigm, enabling determination of the possible influence of the training task in the lexicalization process. Results indicated that novel words repeatedly associated with meaningful cues showed a higher attenuation of N400 responses than those trained in the single orthographic condition, confirming the higher facilitation in the lexico-semantic processing of these stimuli, as a consequence of semantic associations. Moreover, only when the combined training was carried out in the reading task did novel words show similar N400 responses to those elicited by known words, suggesting the achievement of a similar lexical processing to known words. Crucially, when the training is carried out under a demanding task context (lexical decision), known words exhibited positive enhancement within the N400 time window, contributing to maintaining N400 differences with novel trained words and confounding the outcome of the learning. Such deflection-compatible with the modulation of the categorization-related P300 component-suggests that novel word learning could be influenced by the activation of categorization-related processes. Thus, the use of low-demand tasks arises as a more appropriate approach to study novel word learning, enabling the build-up process of mental representations, which probably depends on pure lexical and semantic factors rather than being guided by categorization demands.

Project description:Attention-deficit hyperactivity disorder (ADHD) is characterized by deficits in executive functions and decision making during childhood and adolescence. Contradictory results exist whether altered event-related potentials (ERPs) in adults are associated with the tendency of ADHD patients toward risky behavior. Clinically diagnosed ADHD patients (n = 18) and healthy controls (n = 18), aged between 18 and 29 (median 22 Yo), were screened with the Conners' Adult ADHD Rating Scales and assessed by the Mini-International Neuropsychiatric Interview, adult ADHD Self-Report Scale, and by the 60-item HEXACO Personality Inventory. The characteristic personality traits of ADHD patients were the high level of impulsiveness associated with lower values of agreeableness. All participants performed a probability gambling task (PGT) with two frequencies of the feedback information of the outcome. For each trial, ERPs were triggered by the self-paced trial onset and by the gamble selection. After trial onset, N2-P3a ERP component associated with the attentional load peaked earlier in the ADHD group than in controls. An N500 component related to the feedback frequency condition after trial onset and an N400-like component after gamble selection suggest a large affective stake of the decision making and an emphasized post-decisional evaluation of the choice made by the ADHD participants. By combining ERPs, related to the emotions associated with the feedback frequency condition, and behavioral analyses during completion of PGT, this study provides new findings on the neural dynamics that differentiate controls and young ADHD adults. In the patients' group, we raise the hypothesis that the activity of frontocentral and centroparietal neural circuits drive the decision-making processes dictated by an impaired cognitive workload followed by the build-up of large emotional feelings generated by the conflict toward the outcome of the gambling choice. Our results can be used for new investigations aimed at studying the fine spatiotemporal distribution of cortical activity, and the neural circuits that underly the generation of that activity, associated with the behavioral deficits characteristic of ADHD.

Dataset Information

Robust detection of event-related potentials in a user-voluntary short-term imagery task.

Publications

Robust detection of event-related potentials in a user-voluntary short-term imagery task.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets