Multidataset Independent Subspace Analysis With Application to Multimodal Fusion.
Ontology highlight
ABSTRACT:
SUBMITTER: Silva RF
PROVIDER: S-EPMC7877797 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The extraction of common and distinct biomedical signatures among different populations allows for a more detailed study of the group-specific as well as distinct information of different populations. A number of subspace analysis algorithms have been developed and successfully applied to data fusion, however they are limited to joint analysis of only a couple of datasets. Since subspace analysis is very promising for analysis of multi-subject medical imaging data as well, we focus on this problem and propose a new method based on independent vector analysis (IVA) for common subspace extraction (IVA-CS) for multi-subject data analysis. IVA-CS leverages the strength of IVA in identification of a complete subspace structure across multiple datasets along with an efficient solution that uses only second-order statistics. We propose a subset analysis approach within IVA-CS to mitigate issues in estimation in IVA due to high dimensionality, both in terms of components estimated and the number of datasets. We introduce a scheme to determine a desirable size for the subset that is high enough to exploit the dependence across datasets and is not affected by the high dimensionality issue. We demonstrate the success of IVA-CS in extracting complex subset structures and apply the method to analysis of functional magnetic resonance imaging data from 179 subjects and show that it successfully identifies shared and complementary brain patterns from patients with schizophrenia (SZ) and healthy controls group. Two components with linked resting-state networks are identified to be unique to the SZ group providing evidence of functional dysconnectivity. IVA-CS also identifies subgroups of SZs that show significant differences in terms of their brain networks and clinical symptoms.
| S-EPMC7319052 | biostudies-literature
Project description:Previous structural and functional neuroimaging studies have implicated distributed brain regions and networks in depression. However, there are no robust imaging biomarkers that are specific to depression, which may be due to clinical heterogeneity and neurobiological complexity. A dimensional approach and fusion of imaging modalities may yield a more coherent view of the neuronal correlates of depression. We used linked independent component analysis to fuse cortical macrostructure (thickness, area, gray matter density), white matter diffusion properties and resting-state functional magnetic resonance imaging default mode network amplitude in patients with a history of depression (n = 170) and controls (n = 71). We used univariate and machine learning approaches to assess the relationship between age, sex, case-control status, and symptom loads for depression and anxiety with the resulting brain components. Univariate analyses revealed strong associations between age and sex with mainly global but also regional specific brain components, with varying degrees of multimodal involvement. In contrast, there were no significant associations with case-control status, nor symptom loads for depression and anxiety with the brain components, nor any interaction effects with age and sex. Machine learning revealed low model performance for classifying patients from controls and predicting symptom loads for depression and anxiety, but high age prediction accuracy. Multimodal fusion of brain imaging data alone may not be sufficient for dissecting the clinical and neurobiological heterogeneity of depression. Precise clinical stratification and methods for brain phenotyping at the individual level based on large training samples may be needed to parse the neuroanatomy of depression.
| S-EPMC7267936 | biostudies-literature
Project description:An influential theory of mammalian vision, known as the efficient coding hypothesis, holds that early stages in the visual cortex attempts to form an efficient coding of ecologically valid stimuli. Although numerous authors have successfully modelled some aspects of early vision mathematically, closer inspection has found substantial discrepancies between the predictions of some of these models and observations of neurons in the visual cortex. In particular analysis of linear-non-linear models of simple-cells using Independent Component Analysis has found a strong bias towards features on the horoptor. In order to investigate the link between the information content of binocular images, mathematical models of complex cells and physiological recordings, we applied Independent Subspace Analysis to binocular image patches in order to learn a set of complex-cell-like models. We found that these complex-cell-like models exhibited a wide range of binocular disparity-discriminability, although only a minority exhibited high binocular discrimination scores. However, in common with the linear-non-linear model case we found that feature detection was limited to the horoptor suggesting that current mathematical models are limited in their ability to explain the functionality of the visual cortex.
| S-EPMC4794214 | biostudies-literature
Project description:Abstract No specific migraine biomarkers have been found in single?modality MRI studies. We aimed at establishing biomarkers for episodic and chronic migraine using diverse MRI modalities. We employed canonical correlation analysis and joint independent component analysis to find structural connectivity abnormalities that are related to gray matter morphometric alterations. The number of streamlines (trajectories of estimated fiber?tracts from tractography) was employed as structural connectivity measure, while cortical curvature, thickness, surface area, and volume were used as gray matter parameters. These parameters were compared between 56 chronic and 54 episodic migraine patients, and 50 healthy controls. Cortical curvature alterations were associated with abnormalities in the streamline count in episodic migraine patients compared to controls, with higher curvature values in the frontal and temporal poles being related to a higher streamline count. Lower streamline count was found in migraine compared to controls in connections between cortical regions within each of the four lobes. Higher streamline count was found in migraine in connections between subcortical regions, the insula, and the cingulate and orbitofrontal cortex, and between the insula and the temporal region. The connections between the caudate nucleus and the orbitofrontal cortex presented worse connectivity in chronic compared to episodic migraine. The hippocampus was involved in connections with higher and lower number of streamlines in chronic migraine. Strengthening of structural networks involving pain processing and subcortical regions coexists in migraine with weakening of cortical networks within each lobe. The multimodal analysis offers a new insight about the association between brain structure and connectivity. Planchuelo?Gómez et al. associate structural connectivity with gray matter morphometry. In chronic and episodic migraine, strengthened connectivity with pain processing regions, and higher cortical curvature related to weakened connectivity within each lobe were found. These results give a new insight about migraine neuroimaging biomarkers.
| S-EPMC7856653 | biostudies-literature
Project description:Multimodal sentiment analysis is an essential task in natural language processing which refers to the fact that machines can analyze and recognize emotions through logical reasoning and mathematical operations after learning multimodal emotional features. For the problem of how to consider the effective fusion of multimodal data and the relevance of multimodal data in multimodal sentiment analysis, we propose an attention-based mechanism feature relevance fusion multimodal sentiment analysis model (AFR-BERT). In the data pre-processing stage, text features are extracted using the pre-trained language model BERT (Bi-directional Encoder Representation from Transformers), and the BiLSTM (Bi-directional Long Short-Term Memory) is used to obtain the internal information of the audio. In the data fusion phase, the multimodal data fusion network effectively fuses multimodal features through the interaction of text and audio information. During the data analysis phase, the multimodal data association network analyzes the data by exploring the correlation of fused information between text and audio. In the data output phase, the model outputs the results of multimodal sentiment analysis. We conducted extensive comparative experiments on the publicly available sentiment analysis datasets CMU-MOSI and CMU-MOSEI. The experimental results show that AFR-BERT improves on the classical multimodal sentiment analysis model in terms of relevant performance metrics. In addition, ablation experiments and example analysis show that the multimodal data analysis network in AFR-BERT can effectively capture and analyze the sentiment features in text and audio.
| S-EPMC9462790 | biostudies-literature
Project description:Brain aging is a complex process that requires a multimodal approach. Neuroimaging can provide insights into brain morphology, functional organization, and vascular dynamics. However, most neuroimaging studies of aging have focused on each imaging modality separately, limiting the understanding of interrelations between processes identified by different modalities and their relevance to cognitive decline in aging. Here, we used a data-driven multimodal approach, linked independent component analysis (ICA), to jointly analyze magnetic resonance imaging (MRI) of grey matter volume, cerebrovascular, and functional network topographies in relation to measures of fluid intelligence. Neuroimaging and cognitive data from the Cambridge Centre for Ageing and Neuroscience study were used, with healthy participants aged 18-88 years (main dataset n = 215 and secondary dataset n = 433). Using linked ICA, functional network activities were characterized in independent components but not captured in the same component as structural and cerebrovascular patterns. Split-sample (n = 108/107) and out-of-sample (n = 433) validation analyses using linked ICA were also performed. Global grey matter volume with regional cerebrovascular changes and the right frontoparietal network activity were correlated with age-related and individual differences in fluid intelligence. This study presents the insights from linked ICA to bring together measurements from multiple imaging modalities, with independent and additive information. We propose that integrating multiple neuroimaging modalities allows better characterization of brain pattern variability and changes associated with healthy aging.
| S-EPMC9704789 | biostudies-literature
Project description:The medical image fusion is the process of coalescing multiple images from multiple imaging modalities to obtain a fused image with a large amount of information for increasing the clinical applicability of medical images. In this paper, we attempt to give an overview of multimodal medical image fusion methods, putting emphasis on the most recent advances in the domain based on (1) the current fusion methods, including based on deep learning, (2) imaging modalities of medical image fusion, and (3) performance analysis of medical image fusion on mainly data set. Finally, the conclusion of this paper is that the current multimodal medical image fusion research results are more significant and the development trend is on the rise but with many challenges in the research field.
| S-EPMC7195632 | biostudies-literature
Project description:A new method for multimodal sensor fusion is introduced. The technique relies on a two-stage process. In the first stage, a multimodal generative model is constructed from unlabelled training data. In the second stage, the generative model serves as a reconstruction prior and the search manifold for the sensor fusion tasks. The method also handles cases where observations are accessed only via subsampling i.e. compressed sensing. We demonstrate the effectiveness and excellent performance on a range of multimodal fusion experiments such as multisensory classification, denoising, and recovery from subsampled observations.
| S-EPMC9898225 | biostudies-literature
Project description:In many computer vision and machine learning applications, the data sets distribute on certain low-dimensional subspaces. Subspace clustering is a powerful technology to find the underlying subspaces and cluster data points correctly. However, traditional subspace clustering methods can only be applied on data from one source, and how to extend these methods and enable the extensions to combine information from various data sources has become a hot area of research. Previous multi-view subspace methods aim to learn multiple subspace representation matrices simultaneously and these learning task for different views are treated equally. After obtaining representation matrices, they stack up the learned representation matrices as the common underlying subspace structure. However, for many problems, the importance of sources and the importance of features in one source both can be varied, which makes the previous approaches ineffective. In this paper, we propose a novel method called Robust Auto-weighted Multi-view Subspace Clustering (RAMSC). In our method, the weight for both the sources and features can be learned automatically via utilizing a novel trick and introducing a sparse norm. More importantly, the objective of our method is a common representation matrix which directly reflects the common underlying subspace structure. A new efficient algorithm is derived to solve the formulated objective with rigorous theoretical proof on its convergency. Extensive experimental results on five benchmark multi-view datasets well demonstrate that the proposed method consistently outperforms the state-of-the-art methods.
| S-EPMC5441581 | biostudies-literature
Project description:Image-based cell classification has become a common tool to identify phenotypic changes in cell populations. However, this methodology is limited to organisms possessing well-characterized species-specific reagents (e.g., antibodies) that allow cell identification, clustering, and convolutional neural network (CNN) training. In the absence of such reagents, the power of image-based classification has remained mostly off-limits to many research organisms. We have developed an image-based classification methodology we named Image3C (Image-Cytometry Cell Classification) that does not require species-specific reagents nor pre-existing knowledge about the sample. Image3C combines image-based flow cytometry with an unbiased, high-throughput cell clustering pipeline and CNN integration. Image3C exploits intrinsic cellular features and non-species-specific dyes to perform de novo cell composition analysis and detect changes between different conditions. Therefore, Image3C expands the use of image-based analyses of cell population composition to research organisms in which detailed cellular phenotypes are unknown or for which species-specific reagents are not available.
| S-EPMC8370771 | biostudies-literature