Dataset Information

Using Coherence-based spectro-spatial filters for stimulus features prediction from electro-corticographic recordings.

ABSTRACT: The traditional approach in neuroscience relies on encoding models where brain responses are related to different stimuli in order to establish dependencies. In decoding tasks, on the contrary, brain responses are used to predict the stimuli, and traditionally, the signals are assumed stationary within trials, which is rarely the case for natural stimuli. We hypothesize that a decoding model assuming each experimental trial as a realization of a random process more likely reflects the statistical properties of the undergoing process compared to the assumption of stationarity. Here, we propose a Coherence-based spectro-spatial filter that allows for reconstructing stimulus features from brain signal's features. The proposed method extracts common patterns between features of the brain signals and the stimuli that produced them. These patterns, originating from different recording electrodes are combined, forming a spatial filter that produces a unified prediction of the presented stimulus. This approach takes into account frequency, phase, and spatial distribution of brain features, hence avoiding the need to predefine specific frequency bands of interest or phase relationships between stimulus and brain responses manually. Furthermore, the model does not require the tuning of hyper-parameters, reducing significantly the computational load attached to it. Using three different cognitive tasks (motor movements, speech perception, and speech production), we show that the proposed method consistently improves stimulus feature predictions in terms of correlation (group averages of 0.74 for motor movements, 0.84 for speech perception, and 0.74 for speech production) in comparison with other methods based on regularized multivariate regression, probabilistic graphical models and artificial neural networks. Furthermore, the model parameters revealed those anatomical regions and spectral components that were discriminant in the different cognitive tasks. This novel method does not only provide a useful tool to address fundamental neuroscience questions, but could also be applied to neuroprosthetics.

SUBMITTER: Delgado Saa J

PROVIDER: S-EPMC7203138 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using Coherence-based spectro-spatial filters for stimulus features prediction from electro-corticographic recordings.

Delgado Saa Jaime J Christen Andy A Martin Stephanie S Pasley Brian N BN Knight Robert T RT Giraud Anne-Lise AL

Scientific reports 20200506 1

The traditional approach in neuroscience relies on encoding models where brain responses are related to different stimuli in order to establish dependencies. In decoding tasks, on the contrary, brain responses are used to predict the stimuli, and traditionally, the signals are assumed stationary within trials, which is rarely the case for natural stimuli. We hypothesize that a decoding model assuming each experimental trial as a realization of a random process more likely reflects the statistica ...[more]

PMID: 32376909

Similar Datasets

Project description:Objective assessment of auditory discrimination has often been measured using the Auditory Change Complex (ACC), which is a cortically generated potential elicited by a change occurring within an ongoing, long-duration auditory stimulus. In cochlear implant users, the electrically-evoked ACC has been used to measure electrode discrimination by changing the stimulating electrode during stimulus presentation. In addition to this cortical component, subcortical measures provide further information about early auditory processing in both normal hearing listeners and cochlear implant users. In particular, the frequency-following response (FFR) is thought to reflect the auditory encoding at the level of the brainstem. Interestingly, recent research suggests that it is possible to simultaneously measure both subcortical and cortical physiological activity. The aim of this research was twofold: first, to understand the scope for simultaneously recording both the FFR (subcortical) and ACC (cortical) responses in normal hearing adults. Second, to determine the best recording parameters for optimizing the simultaneous capture of both responses with clinical applications in mind. Electrophysiological responses were recorded in 10 normally-hearing adults while they listened to 16-second-long pure tone sequences. The carrier frequency of these sequences was either steady or alternating periodically throughout the sequence, generating an ACC response to each alternation-the alternating ACC paradigm. In the "alternating" sequences, both the alternating rate and the carrier frequency varied parametrically. We investigated three alternating rates (1, 2.5, and 6.5 Hz) and seven frequency pairs covering the low-, mid-, and high-frequency range, including narrow and wide frequency separations. Our results indicate that both the slowest (1 Hz) and medium (2.5 Hz) alternation rates led to significant FFR and ACC responses in most frequency ranges tested. Low carrier frequencies led to larger FFR amplitudes, larger P1 amplitudes, and N1-P2 amplitude difference at slow alternation rates. No significant relationship was found between subcortical and cortical response amplitudes, in line with different generators and processing levels across the auditory pathway. Overall, the alternating ACC paradigm can be used to measure sub-cortical and cortical responses as indicators of auditory early neural encoding (FFR) and sound discrimination (ACC) in the pathway, and these are best obtained at slow alternation rates (1 Hz) in the low-frequency range (300-1200 Hz).

Project description:Visual attention is thought to be driven by the interplay between low-level visual features and task dependent information content of local image regions, as well as by spatial viewing biases. Though dependent on experimental paradigms and model assumptions, this idea has given rise to varying claims that either bottom-up or top-down mechanisms dominate visual attention. To contribute toward a resolution of this discussion, here we quantify the influence of these factors and their relative importance in a set of classification tasks. Our stimuli consist of individual image patches (bubbles). For each bubble we derive three measures: a measure of salience based on low-level stimulus features, a measure of salience based on the task dependent information content derived from our subjects' classification responses and a measure of salience based on spatial viewing biases. Furthermore, we measure the empirical salience of each bubble based on our subjects' measured eye gazes thus characterizing the overt visual attention each bubble receives. A multivariate linear model relates the three salience measures to overt visual attention. It reveals that all three salience measures contribute significantly. The effect of spatial viewing biases is highest and rather constant in different tasks. The contribution of task dependent information is a close runner-up. Specifically, in a standardized task of judging facial expressions it scores highly. The contribution of low-level features is, on average, somewhat lower. However, in a prototypical search task, without an available template, it makes a strong contribution on par with the two other measures. Finally, the contributions of the three factors are only slightly redundant, and the semi-partial correlation coefficients are only slightly lower than the coefficients for full correlations. These data provide evidence that all three measures make significant and independent contributions and that none can be neglected in a model of human overt visual attention.

Project description:Our goal was to identify spatial filtering methods that would improve decoding of continuous arm movements from epidural field potentials as well as demonstrate the use of the epidural signals in a closed-loop brain-machine interface (BMI) system in monkeys.Eleven spatial filtering options were compared offline using field potentials collected from 64-channel high-density epidural arrays in monkeys. Arrays were placed over arm/hand motor cortex in which intracortical microelectrodes had previously been implanted and removed leaving focal cortical damage but no lasting motor deficits. Spatial filters tested included: no filtering, common average referencing (CAR), principle component analysis, and eight novel modifications of the common spatial pattern (CSP) algorithm. The spatial filtering method and decoder combination that performed the best offline was then used online where monkeys controlled cursor velocity using continuous wrist position decoded from epidural field potentials in real time.Optimized CSP methods improved continuous wrist position decoding accuracy by 69% over CAR and by 80% compared to no filtering. Kalman decoders performed better than linear regression decoders and benefitted from including more spatially-filtered signals but not from pre-smoothing the calculated power spectra. Conversely, linear regression decoders required fewer spatially-filtered signals and were improved by pre-smoothing the power values. The 'position-to-velocity' transformation used during online control enabled the animals to generate smooth closed-loop movement trajectories using the somewhat limited position information available in the epidural signals. The monkeys' online performance significantly improved across days of closed-loop training.Most published BMI studies that use electrocorticographic signals to decode continuous limb movements either use no spatial filtering or CAR. This study suggests a substantial improvement in decoding accuracy could be attained by using our new version of the CSP algorithm that extends the traditional CSP method for use with continuous limb movement data.

Dataset Information

Using Coherence-based spectro-spatial filters for stimulus features prediction from electro-corticographic recordings.

Publications

Using Coherence-based spectro-spatial filters for stimulus features prediction from electro-corticographic recordings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets