Browse
Submit Data
Databases
API
Help

Dataset Information

14 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Keyword Spotting Using Human Electrocorticographic Recordings.

ABSTRACT: Neural keyword spotting could form the basis of a speech brain-computer-interface for menu-navigation if it can be done with low latency and high specificity comparable to the "wake-word" functionality of modern voice-activated AI assistant technologies. This study investigated neural keyword spotting using motor representations of speech via invasively-recorded electrocorticographic signals as a proof-of-concept. Neural matched filters were created from monosyllabic consonant-vowel utterances: one keyword utterance, and 11 similar non-keyword utterances. These filters were used in an analog to the acoustic keyword spotting problem, applied for the first time to neural data. The filter templates were cross-correlated with the neural signal, capturing temporal dynamics of neural activation across cortical sites. Neural vocal activity detection (VAD) was used to identify utterance times and a discriminative classifier was used to determine if these utterances were the keyword or non-keyword speech. Model performance appeared to be highly related to electrode placement and spatial density. Vowel height (/a/ vs /i/) was poorly discriminated in recordings from sensorimotor cortex, but was highly discriminable using neural features from superior temporal gyrus during self-monitoring. The best performing neural keyword detection (5 keyword detections with two false-positives across 60 utterances) and neural VAD (100% sensitivity, ~1 false detection per 10 utterances) came from high-density (2 mm electrode diameter and 5 mm pitch) recordings from ventral sensorimotor cortex, suggesting the spatial fidelity and extent of high-density ECoG arrays may be sufficient for the purpose of speech brain-computer-interfaces.

SUBMITTER: Milsap G

PROVIDER: S-EPMC6389788 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Time-frequency characterization of electrocorticographic recordings of epileptic patients using frequency-entropy similarity: a comparison to other bi-variate measures.

Project description:Expert evaluation of electrocorticographic (ECoG) recordings forms the linchpin of seizure onset zone localization in the evaluation of epileptic patients for surgical resection. Numerous methods have been developed to analyze these complex recordings, including uni-variate (characterizing single channels), bi-variate (comparing channel pairs) and multivariate measures. Developing reliable algorithms may be helpful in clinical tasks such as localization of epileptogenic zones and seizure anticipation, as well as enabling better understanding of neuronal function and dynamics. Recently we have developed the frequency-entropy (F-E) similarity measure, and have tested its capability in mapping the epileptogenic zones. The F-E similarity measure compares time-frequency characterizations of two recordings. In this study, we examine the method's principles and utility and compare it to previously described bi-variate correspondence measures such as correlation, coherence, mean phase coherence and spectral comparison methods. Specially designed synthetic signals were used for illuminating theoretical differences between the measures. Intracranial recordings of four epileptic patients were then used for the measures' comparative analysis by creating a mean inter-electrode matrix for each of the correspondence measures and comparing the structure of these matrices during the inter-ictal and ictal periods. We found that the F-E similarity measure is able to discover spectral and temporal features in data which are hidden for the other measures and are important for foci localization.

| S-EPMC3017949 | biostudies-literature

Identifying the Attended Speaker Using Electrocorticographic (ECoG) Signals.

Project description:People affected by severe neuro-degenerative diseases (e.g., late-stage amyotrophic lateral sclerosis (ALS) or locked-in syndrome) eventually lose all muscular control. Thus, they cannot use traditional assistive communication devices that depend on muscle control, or brain-computer interfaces (BCIs) that depend on the ability to control gaze. While auditory and tactile BCIs can provide communication to such individuals, their use typically entails an artificial mapping between the stimulus and the communication intent. This makes these BCIs difficult to learn and use. In this study, we investigated the use of selective auditory attention to natural speech as an avenue for BCI communication. In this approach, the user communicates by directing his/her attention to one of two simultaneously presented speakers. We used electrocorticographic (ECoG) signals in the gamma band (70-170 Hz) to infer the identity of attended speaker, thereby removing the need to learn such an artificial mapping. Our results from twelve human subjects show that a single cortical location over superior temporal gyrus or pre-motor cortex is typically sufficient to identify the attended speaker within 10 s and with 77% accuracy (50% accuracy due to chance). These results lay the groundwork for future studies that may determine the real-time performance of BCIs based on selective auditory attention to speech.

| S-EPMC4776341 | biostudies-literature

A Gaussian Process Model of Human Electrocorticographic Data.

Project description:We present a model-based method for inferring full-brain neural activity at millimeter-scale spatial resolutions and millisecond-scale temporal resolutions using standard human intracranial recordings. Our approach makes the simplifying assumptions that different people's brains exhibit similar correlational structure, and that activity and correlation patterns vary smoothly over space. One can then ask, for an arbitrary individual's brain: given recordings from a limited set of locations in that individual's brain, along with the observed spatial correlations learned from other people's recordings, how much can be inferred about ongoing activity at other locations throughout that individual's brain? We show that our approach generalizes across people and tasks, thereby providing a person- and task-general means of inferring high spatiotemporal resolution full-brain neural dynamics from standard low-density intracranial recordings.

| S-EPMC7472198 | biostudies-literature

SPOTting Model Parameters Using a Ready-Made Python Package.

Project description:The choice for specific parameter estimation methods is often more dependent on its availability than its performance. We developed SPOTPY (Statistical Parameter Optimization Tool), an open source python package containing a comprehensive set of methods typically used to calibrate, analyze and optimize parameters for a wide range of ecological models. SPOTPY currently contains eight widely used algorithms, 11 objective functions, and can sample from eight parameter distributions. SPOTPY has a model-independent structure and can be run in parallel from the workstation to large computation clusters using the Message Passing Interface (MPI). We tested SPOTPY in five different case studies to parameterize the Rosenbrock, Griewank and Ackley functions, a one-dimensional physically based soil moisture routine, where we searched for parameters of the van Genuchten-Mualem function and a calibration of a biogeochemistry model with different objective functions. The case studies reveal that the implemented SPOTPY methods can be used for any model with just a minimal amount of code for maximal power of parameter optimization. They further show the benefit of having one package at hand that includes number of well performing parameter search methods, since not every case study can be solved sufficiently with every algorithm or every objective function.

| S-EPMC4682995 | biostudies-literature

Detection of Residents With Progress Issues Using a Keyword-Specific Algorithm.

Project description:BackgroundThe literature suggests that specific keywords included in summative rotation assessments might be an early indicator of abnormal progress or failure.ObjectiveThis study aims to determine the possible relationship between specific keywords on in-training evaluation reports (ITERs) and subsequent abnormal progress or failure. The goal is to create a functional algorithm to identify residents at risk of failure.MethodsA database of all ITERs from all residents training in accredited programs at Université Laval between 2001 and 2013 was created. An instructional designer reviewed all ITERs and proposed terms associated with reinforcing and underperformance feedback. An algorithm based on these keywords was constructed by recursive partitioning using classification and regression tree methods. The developed algorithm was tuned to achieve 100% sensitivity while maximizing specificity.ResultsThere were 41 618 ITERs for 3292 registered residents. Residents with failure to progress were detected for family medicine (6%, 67 of 1129) and 36 other specialties (4%, 78 of 2163), while the positive predictive values were 23.3% and 23.4%, respectively. The low positive predictive value may be a reflection of residents improving their performance after receiving feedback or a reluctance by supervisors to ascribe a "fail" or "in difficulty" score on the ITERs.ConclusionsClassification and regression trees may be helpful to identify pertinent keywords and create an algorithm, which may be implemented in an electronic assessment system to detect future residents at risk of poor performance.

| S-EPMC6919172 | biostudies-literature

Decoding flexion of individual fingers using electrocorticographic signals in humans.

Project description:Brain signals can provide the basis for a non-muscular communication and control system, a brain-computer interface (BCI), for people with motor disabilities. A common approach to creating BCI devices is to decode kinematic parameters of movements using signals recorded by intracortical microelectrodes. Recent studies have shown that kinematic parameters of hand movements can also be accurately decoded from signals recorded by electrodes placed on the surface of the brain (electrocorticography (ECoG)). In the present study, we extend these results by demonstrating that it is also possible to decode the time course of the flexion of individual fingers using ECoG signals in humans, and by showing that these flexion time courses are highly specific to the moving finger. These results provide additional support for the hypothesis that ECoG could be the basis for powerful clinically practical BCI systems, and also indicate that ECoG is useful for studying cortical dynamics related to motor function.

| S-EPMC3664231 | biostudies-literature

Decoding three-dimensional reaching movements using electrocorticographic signals in humans.

Project description:Electrocorticography (ECoG) signals have emerged as a potential control signal for brain-computer interface (BCI) applications due to balancing signal quality and implant invasiveness. While there have been numerous demonstrations in which ECoG signals were used to decode motor movements and to develop BCI systems, the extent of information that can be decoded has been uncertain. Therefore, we sought to determine if ECoG signals could be used to decode kinematics (speed, velocity, and position) of arm movements in 3D space.To investigate this, we designed a 3D center-out reaching task that was performed by five epileptic patients undergoing temporary placement of ECoG arrays. We used the ECoG signals within a hierarchical partial-least squares (PLS) regression model to perform offline prediction of hand speed, velocity, and position.The hierarchical PLS regression model enabled us to predict hand speed, velocity, and position during 3D reaching movements from held-out test sets with accuracies above chance in each patient with mean correlation coefficients between 0.31 and 0.80 for speed, 0.27 and 0.54 for velocity, and 0.22 and 0.57 for position. While beta band power changes were the most significant features within the model used to classify movement and rest, the local motor potential and high gamma band power changes, were the most important features in the prediction of kinematic parameters.We believe that this study represents the first demonstration that truly three-dimensional movements can be predicted from ECoG recordings in human patients. Furthermore, this prediction underscores the potential to develop BCI systems with multiple degrees of freedom in human patients using ECoG.

| S-EPMC5535759 | biostudies-literature

Passive functional mapping of receptive language areas using electrocorticographic signals.

Project description:ObjectiveTo validate the use of passive functional mapping using electrocorticographic (ECoG) broadband gamma signals for identifying receptive language cortex.MethodsWe mapped language function in 23 patients using ECoG and using electrical cortical stimulation (ECS) in a subset of 15 subjects.ResultsThe qualitative comparison between cortical sites identified by ECoG and ECS show a high concordance. A quantitative comparison indicates a high level of sensitivity (95%) and a lower level of specificity (59%). Detailed analysis reveals that 82% of all cortical sites identified by ECoG were within one contact of a site identified by ECS.ConclusionsThese results show that passive functional mapping reliably localizes receptive language areas, and that there is a substantial concordance between the ECoG- and ECS-based methods. They also point to a more refined understanding of the differences between ECoG- and ECS-based mappings. This refined understanding helps to clarify the instances in which the two methods disagree and can explain why neurosurgical practice has established the concept of a "safety margin."SignificancePassive functional mapping using ECoG signals provides a fast, robust, and reliable method for identifying receptive language areas without many of the risks and limitations associated with ECS.

| S-EPMC6414063 | biostudies-literature

Electrocorticographic Encoding of Human Gait in the Leg Primary Motor Cortex.

Project description:While prior noninvasive (e.g., electroencephalographic) studies suggest that the human primary motor cortex (M1) is active during gait processes, the limitations of noninvasive recordings make it impossible to determine whether M1 is involved in high-level motor control (e.g., obstacle avoidance, walking speed), low-level motor control (e.g., coordinated muscle activation), or only nonmotor processes (e.g., integrating/relaying sensory information). This study represents the first invasive electroneurophysiological characterization of the human leg M1 during walking. Two subjects with an electrocorticographic grid over the interhemispheric M1 area were recruited. Both exhibited generalized ?-band (40-200 Hz) synchronization across M1 during treadmill walking, as well as periodic ?-band changes within each stride (across multiple walking speeds). Additionally, these changes appeared to be of motor, rather than sensory, origin. However, M1 activity during walking shared few features with M1 activity during individual leg muscle movements, and was not highly correlated with lower limb trajectories on a single channel basis. These findings suggest that M1 primarily encodes high-level gait motor control (i.e., walking duration and speed) instead of the low-level patterns of leg muscle activation or movement trajectories. Therefore, M1 likely interacts with subcortical/spinal networks, which are responsible for low-level motor control, to produce normal human walking.

| S-EPMC6248549 | biostudies-literature

Characterizing Cochlear implant artefact removal from EEG recordings using a real human model.

Project description:Electroencephography (EEG) recordings from CI listeners are contaminated by electrical artefacts that make it difficult to extract neural responses. Previously, we have removed these artefacts by means of interpolation and spatial filtering. However, the extent to which this method can effectively reduce electrical artefacts has not been fully investigated. Here, we assessed the effectiveness of interpolation and spatial filtering to remove electrical artefacts using recordings from a human head specimen implanted with a CI.•Electrical artefacts were obtained using amplitude-modulated (AM'ed) pulse trains presented at several pulse rates (100-to-902 pps) or using high rate pulse trains (902 pps) in which either a pair of electrodes or AM frequencies alternated periodically at a rate of 1Hz.•By adding auditory change complex (ACC), auditory steady-state response (ASSR), or auditory change following response (AC-FR) template waveforms to the contaminated recordings, we show that interpolation allows for effective artefact removal for pulse rates below 400 pps whilst interpolation and spatial filtering are effective at higher pulse rates, with minimal distortions for ACC and AC-FR, and with a degree of amplitude- and phase-distortions for ASSR.•Recordings from CI listeners agreed with simulations, demonstrating that reliable responses can be recovered.

| S-EPMC8374497 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data