Dataset Information

Multimodal Integration of M/EEG and f/MRI Data in SPM12.

ABSTRACT: We describe the steps involved in analysis of multi-modal, multi-subject human neuroimaging data using the SPM12 free and open source software (https://www.fil.ion.ucl.ac.uk/spm/) and a publically-available dataset organized according to the Brain Imaging Data Structure (BIDS) format (https://openneuro.org/datasets/ds000117/). The dataset contains electroencephalographic (EEG), magnetoencephalographic (MEG), and functional and structural magnetic resonance imaging (MRI) data from 16 subjects who undertook multiple runs of a simple task performed on a large number of famous, unfamiliar and scrambled faces. We demonstrate: (1) batching and scripting of preprocessing of multiple runs/subjects of combined MEG and EEG data, (2) creation of trial-averaged evoked responses, (3) source-reconstruction of the power (induced and evoked) across trials within a time-frequency window around the "N/M170" evoked component, using structural MRI for forward modeling and simultaneous inversion (fusion) of MEG and EEG data, (4) group-based optimisation of spatial priors during M/EEG source reconstruction using fMRI data on the same paradigm, and (5) statistical mapping across subjects of cortical source power increases for faces vs. scrambled faces.

SUBMITTER: Henson RN

PROVIDER: S-EPMC6491835 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multimodal Integration of M/EEG and f/MRI Data in SPM12.

Henson Richard N RN Abdulrahman Hunar H Flandin Guillaume G Litvak Vladimir V

Frontiers in neuroscience 20190424

We describe the steps involved in analysis of multi-modal, multi-subject human neuroimaging data using the SPM12 free and open source software (https://www.fil.ion.ucl.ac.uk/spm/) and a publically-available dataset organized according to the Brain Imaging Data Structure (BIDS) format (https://openneuro.org/datasets/ds000117/). The dataset contains electroencephalographic (EEG), magnetoencephalographic (MEG), and functional and structural magnetic resonance imaging (MRI) data from 16 subjects who ...[more]

PMID: 31068770

Similar Datasets

Project description:Objective/methodsNeuroimaging research has predominantly focused on exploring how cortical or subcortical brain abnormalities are related to language dysfunction in patients with neurological disease through the use of single modality imaging. Still, limited knowledge exists on how various MRI measures relate to each other and to patients' language performance. In this study, we explored the relationship between measures of regional cortical thickness, gray-white matter contrast (GWMC), white matter diffusivity [mean diffusivity (MD) and fractional anisotropy (FA)] and the relative contributions of these MRI measures to predicting language function across patients with temporal lobe epilepsy (TLE) and healthy controls. T1- and diffusion-weighted MRI data were collected from 56 healthy controls and 52 patients with TLE. By focusing on frontotemporal regions implicated in language function, we reduced each domain of MRI data to its principal component (PC) and quantified the correlations among these PCs and the ability of these PCs to explain the variation in vocabulary, naming and fluency. We followed up our significant findings by assessing the predictive power of the implicated PCs with respect to language impairment in our sample.ResultsWe found significant positive associations between PCs representing cortical thickness, GWMC and FA that appeared to be partially mediated by changes in total brain volume. We also found a significant association between reduced FA and increased MD after controlling for confounding factors (e.g., age, field strength, total brain volume). Reduced FA was significantly associated with reductions in visual naming while increased MD was associated with reductions in auditory naming scores, even after controlling for the variability explained by reductions in hippocampal volumes. Inclusion of FA and MD PCs in predictive models of language impairment resulted in significant improvements in sensitivity and specificity of the predictions.ConclusionsQuantitative MRI measures from T1 and diffusion-weighted scans are unlikely to represent perfectly orthogonal vectors of disease in individuals with epilepsy. On the contrary, they exhibit highly intercorrelated PCs in their factor structures, which is consistent with an underlying pathological process that affects both the cortical and the subcortical structures simultaneously. In addition to hippocampal volume, the PCs of diffusion weighted measures (FA and MD) increase the sensitivity and specificity for determining naming impairment in patients with TLE. These findings underline the importance of combining multimodal imaging measures to better predict language performance in TLE that could extend to other patients with prominent language impairments.

Project description:Magnetic resonance imaging (MRI) has been proposed as a source of information for automatic prediction of individual diagnosis in schizophrenia. Optimal integration of data from different MRI modalities is an active area of research aimed at increasing diagnostic accuracy. Based on a sample of 96 patients with schizophrenia and a matched sample of 115 healthy controls that had undergone a single multimodal MRI session, we generated individual brain maps of gray matter vbm, 1back, and 2back levels of activation (nback fMRI), maps of amplitude of low-frequency fluctuations (resting-state fMRI), and maps of weighted global brain connectivity (resting-state fMRI). Four unimodal classifiers (Ridge, Lasso, Random Forests, and Gradient boosting) were applied to these maps to evaluate their classification accuracies. Based on the assignments made by the algorithms on test individuals, we quantified the amount of predictive information shared between maps (what we call redundancy analysis). Finally, we explored the added accuracy provided by a set of multimodal strategies that included post-classification integration based on probabilities, two-step sequential integration, and voxel-level multimodal integration through one-dimensional-convolutional neural networks (1D-CNNs). All four unimodal classifiers showed the highest test accuracies with the 2back maps (80% on average) achieving a maximum of 84% with the Lasso. Redundancy levels between brain maps were generally low (overall mean redundancy score of 0.14 in a 0-1 range), indicating that each brain map contained differential predictive information. The highest multimodal accuracy was delivered by the two-step Ridge classifier (87%) followed by the Ridge maximum and mean probability classifiers (both with 85% accuracy) and by the 1D-CNN, which achieved the same accuracy as the best unimodal classifier (84%). From these results, we conclude that from all MRI modalities evaluated task-based fMRI may be the best unimodal diagnostic option in schizophrenia. Low redundancy values point to ample potential for accuracy improvements through multimodal integration, with the two-step Ridge emerging as a suitable strategy.

Project description:The amounts and types of available multimodal tumor data are rapidly increasing, and their integration is critical for fully understanding the underlying cancer biology and personalizing treatment. However, the development of methods for effectively integrating multimodal data in a principled manner is lagging behind our ability to generate the data. In this article, we introduce an extension to a multiview nonnegative matrix factorization algorithm (NNMF) for dimensionality reduction and integration of heterogeneous data types and compare the predictive modeling performance of the method on unimodal and multimodal data. We also present a comparative evaluation of our novel multiview approach and current data integration methods. Our work provides an efficient method to extend an existing dimensionality reduction method. We report rigorous evaluation of the method on large-scale quantitative protein and phosphoprotein tumor data from the Clinical Proteomic Tumor Analysis Consortium (CPTAC) acquired using state-of-the-art liquid chromatography mass spectrometry. Exome sequencing and RNA-Seq data were also available from The Cancer Genome Atlas for the same tumors. For unimodal data, in case of breast cancer, transcript levels were most predictive of estrogen and progesterone receptor status and copy number variation of human epidermal growth factor receptor 2 status. For ovarian and colon cancers, phosphoprotein and protein levels were most predictive of tumor grade and stage and residual tumor, respectively. When multiview NNMF was applied to multimodal data to predict outcomes, the improvement in performance is not overall statistically significant beyond unimodal data, suggesting that proteomics data may contain more predictive information regarding tumor phenotypes than transcript levels, probably due to the fact that proteins are the functional gene products and therefore a more direct measurement of the functional state of the tumor. Here, we have applied our proposed approach to multimodal molecular data for tumors, but it is generally applicable to dimensionality reduction and joint analysis of any type of multimodal data.

Dataset Information

Multimodal Integration of M/EEG and f/MRI Data in SPM12.

Publications

Multimodal Integration of M/EEG and f/MRI Data in SPM12.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure