Browse
Submit Data
Databases
API
Help

Dataset Information

16 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

A Distributed and Integrated Method of Moments for High-Dimensional Correlated Data Analysis.

ABSTRACT: This paper is motivated by a regression analysis of electroencephalography (EEG) neuroimaging data with high-dimensional correlated responses with multi-level nested correlations. We develop a divide-and-conquer procedure implemented in a fully distributed and parallelized computational scheme for statistical estimation and inference of regression parameters. Despite significant efforts in the literature, the computational bottleneck associated with high-dimensional likelihoods prevents the scalability of existing methods. The proposed method addresses this challenge by dividing responses into subvectors to be analyzed separately and in parallel on a distributed platform using pairwise composite likelihood. Theoretical challenges related to combining results from dependent data are overcome in a statistically efficient way using a meta-estimator derived from Hansen's generalized method of moments. We provide a rigorous theoretical framework for efficient estimation, inference, and goodness-of-fit tests. We develop an R package for ease of implementation. We illustrate our method's performance with simulations and the analysis of the EEG data, and find that iron deficiency is significantly associated with two auditory recognition memory related potentials in the left parietal-occipital region of the brain.

SUBMITTER: Hector EC

PROVIDER: S-EPMC8218880 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

A penalized linear mixed model with generalized method of moments for prediction analysis on high-dimensional multi-omics data.

Project description:With the advances in high-throughput biotechnologies, high-dimensional multi-layer omics data become increasingly available. They can provide both confirmatory and complementary information to disease risk and thus have offered unprecedented opportunities for risk prediction studies. However, the high-dimensionality and complex inter/intra-relationships among multi-omics data have brought tremendous analytical challenges. Here we present a computationally efficient penalized linear mixed model with generalized method of moments estimator (MpLMMGMM) for the prediction analysis on multi-omics data. Our method extends the widely used linear mixed model proposed for genomic risk predictions to model multi-omics data, where kernel functions are used to capture various types of predictive effects from different layers of omics data and penalty terms are introduced to reduce the impact of noise. Compared with existing penalized linear mixed models, the proposed method adopts the generalized method of moments estimator and it is much more computationally efficient. Through extensive simulation studies and the analysis of positron emission tomography imaging outcomes, we have demonstrated that MpLMMGMM can simultaneously consider a large number of variables and efficiently select those that are predictive from the corresponding omics layers. It can capture both linear and nonlinear predictive effects and achieves better prediction performance than competing methods.

| S-EPMC9310531 | biostudies-literature

Randomly distributed embedding making short-term high-dimensional data predictable.

Project description:Future state prediction for nonlinear dynamical systems is a challenging task, particularly when only a few time series samples for high-dimensional variables are available from real-world systems. In this work, we propose a model-free framework, named randomly distributed embedding (RDE), to achieve accurate future state prediction based on short-term high-dimensional data. Specifically, from the observed data of high-dimensional variables, the RDE framework randomly generates a sufficient number of low-dimensional "nondelay embeddings" and maps each of them to a "delay embedding," which is constructed from the data of a to be predicted target variable. Any of these mappings can perform as a low-dimensional weak predictor for future state prediction, and all of such mappings generate a distribution of predicted future states. This distribution actually patches all pieces of association information from various embeddings unbiasedly or biasedly into the whole dynamics of the target variable, which after operated by appropriate estimation strategies, creates a stronger predictor for achieving prediction in a more reliable and robust form. Through applying the RDE framework to data from both representative models and real-world systems, we reveal that a high-dimension feature is no longer an obstacle but a source of information crucial to accurate prediction for short-term data, even under noise deterioration.

| S-EPMC6205453 | biostudies-literature

Identification of crucial genes correlated with esophageal cancer by integrated high-throughput data analysis.

Project description:BACKGROUND:Esophageal cancer (ESCA) is one of the most deadly malignancies in the world. Although the management and treatment of patients with ESCA have improved, the overall 5-year survival rate is still very poor. METHODS:The study aimed to identify potential key genes associated with the pathogenesis and prognosis of ESCA. In the study, integrated bioinformatics methods were used to screen differentially expressed genes (DEGs) between ESCA and normal tissue in the data set of gene expression profiles. The hub gene in DEGs was further analyzed by protein-protein interaction (PPI) network and survival analysis to explore its relationship with the pathogenesis and poor prognosis of ESCA. RESULTS:134 up-regulated genes and 183 down-regulated genes were obtained in ESCA compared with normal tissues. Moreover, the PPI network was established with 176 nodes and 800 interactions. Ten hub genes (AURKA, CDC20, BUB1, TOP2A, ASPM, DLGAP5, TPX2, CENPF, UBE2C, and NEK2) were filtered out based on the degree value. Functional enrichment analysis indicated that a variety of extracellular related items and ECM-receptor interaction pathway were all correlated with the ESCA. CONCLUSIONS:The results of this study would provide some guidance for further study of diagnostic and prognostic biomarkers to promote ESCA treatment.

| S-EPMC7254712 | biostudies-literature

pETM: a penalized Exponential Tilt Model for analysis of correlated high-dimensional DNA methylation data.

Project description:DNA methylation plays an important role in many biological processes and cancer progression. Recent studies have found that there are also differences in methylation variations in different groups other than differences in methylation means. Several methods have been developed that consider both mean and variance signals in order to improve statistical power of detecting differentially methylated loci. Moreover, as methylation levels of neighboring CpG sites are known to be strongly correlated, methods that incorporate correlations have also been developed. We previously developed a network-based penalized logistic regression for correlated methylation data, but only focusing on mean signals. We have also developed a generalized exponential tilt model that captures both mean and variance signals but only examining one CpG site at a time.In this article, we proposed a penalized Exponential Tilt Model (pETM) using network-based regularization that captures both mean and variance signals in DNA methylation data and takes into account the correlations among nearby CpG sites. By combining the strength of the two models we previously developed, we demonstrated the superior power and better performance of the pETM method through simulations and the applications to the 450K DNA methylation array data of the four breast invasive carcinoma cancer subtypes from The Cancer Genome Atlas (TCGA) project. The developed pETM method identifies many cancer-related methylation loci that were missed by our previously developed method that considers correlations among nearby methylation loci but not variance signals.The R package 'pETM' is publicly available through CRAN: http://cran.r-project.org .sw2206@columbia.edu.Supplementary data are available at Bioinformatics online.

| S-EPMC5860278 | biostudies-literature

A method for analysis of phenotypic change for phenotypes described by high-dimensional data.

Project description:The analysis of phenotypic change is important for several evolutionary biology disciplines, including phenotypic plasticity, evolutionary developmental biology, morphological evolution, physiological evolution, evolutionary ecology and behavioral evolution. It is common for researchers in these disciplines to work with multivariate phenotypic data. When phenotypic variables exceed the number of research subjects--data called 'high-dimensional data'--researchers are confronted with analytical challenges. Parametric tests that require high observation to variable ratios present a paradox for researchers, as eliminating variables potentially reduces effect sizes for comparative analyses, yet test statistics require more observations than variables. This problem is exacerbated with data that describe 'multidimensional' phenotypes, whereby a description of phenotype requires high-dimensional data. For example, landmark-based geometric morphometric data use the Cartesian coordinates of (potentially) many anatomical landmarks to describe organismal shape. Collectively such shape variables describe organism shape, although the analysis of each variable, independently, offers little benefit for addressing biological questions. Here we present a nonparametric method of evaluating effect size that is not constrained by the number of phenotypic variables, and motivate its use with example analyses of phenotypic change using geometric morphometric data. Our examples contrast different characterizations of body shape for a desert fish species, associated with measuring and comparing sexual dimorphism between two populations. We demonstrate that using more phenotypic variables can increase effect sizes, and allow for stronger inferences.

| S-EPMC4815463 | biostudies-literature

A Matrix-free Likelihood Method for Exploratory Factor Analysis of High-dimensional Gaussian Data.

Project description:This paper proposes a novel profile likelihood method for estimating the covariance parameters in exploratory factor analysis of high-dimensional Gaussian datasets with fewer observations than number of variables. An implicitly restarted Lanczos algorithm and a limited-memory quasi-Newton method are implemented to develop a matrix-free framework for likelihood maximization. Simulation results show that our method is substantially faster than the expectation-maximization solution without sacrificing accuracy. Our method is applied to fit factor models on data from suicide attempters, suicide ideators and a control group.

| S-EPMC7540940 | biostudies-literature

Model averaging in calibration of near-infrared instruments with correlated high-dimensional data

Project description: Not available

| S-EPMC10810656 | biostudies-literature

Procrustes Analysis for High-Dimensional Data.

Project description:The Procrustes-based perturbation model (Goodall in J R Stat Soc Ser B Methodol 53(2):285-321, 1991) allows minimization of the Frobenius distance between matrices by similarity transformation. However, it suffers from non-identifiability, critical interpretation of the transformed matrices, and inapplicability in high-dimensional data. We provide an extension of the perturbation model focused on the high-dimensional data framework, called the ProMises (Procrustes von Mises-Fisher) model. The ill-posed and interpretability problems are solved by imposing a proper prior distribution for the orthogonal matrix parameter (i.e., the von Mises-Fisher distribution) which is a conjugate prior, resulting in a fast estimation process. Furthermore, we present the Efficient ProMises model for the high-dimensional framework, useful in neuroimaging, where the problem has much more than three dimensions. We found a great improvement in functional magnetic resonance imaging connectivity analysis because the ProMises model permits incorporation of topological brain information in the alignment's estimation process.

| S-EPMC9636303 | biostudies-literature

A new data assimilation method for high-dimensional models.

Project description:In the variational data assimilation (VarDA), the typical way for gradient computation is using the adjoint method. However, the adjoint method has many problems, such as low accuracy, difficult implementation and considerable complexity, for high-dimensional models. To overcome these shortcomings, a new data assimilation method based on dual number automatic differentiation (AD) is proposed. The important advantages of the method lies in that the coding of the tangent-linear/adjoint model is no longer necessary and that the value of the cost function and its corresponding gradient vector can be obtained simultaneously through only one forward computation in dual number space. The numerical simulations for data assimilation are implemented for a typical nonlinear advection equation and a parabolic equation. The results demonstrate that the new method can reconstruct the initial conditions of the high-dimensional nonlinear dynamical system conveniently and accurately. Additionally, the estimated initial values can converge to the true values quickly, even if noise is present in the observations.

| S-EPMC5805242 | biostudies-other

Method of moments approach for generalized differential gene expression analysis (Perturb-seq)

Project description:Differential expression analysis of scRNA-seq data is central for characterizing how experimental factors affect the distribution of gene expression. However, distinguishing between biological and technical sources of cell-cell variability and assessing the statistical significance of quantitative comparisons between cell groups remains challenging. Here, we introduce memento, a tool designed to address these limitations by providing statistically robust and computationally efficient differential expression analysis of the mean, variability, and gene correlation from scRNA-seq. We applied memento to analyze 70,000 tracheal epithelial cells to identify interferon response genes with distinct variability and correlation patterns, 160,000 T cells perturbed with CRISPR-Cas9 to reconstruct gene-regulatory networks that control T cell activation, 1.2 million PMBCs to map cell-type-specific cis expression quantitative trait loci (eQTLs), and arbitrary cell groups within the entire 50 million cell CELLxGENE Discover data corpus. In all cases, memento identified more significant and reproducible differences in mean expression but also identified differences in variability and gene correlation that suggest distinct transcriptional regulation mechanisms imparted by cytokines, genetic perturbations, and natural genetic variation. These results demonstrate that memento is a first-in-class method for the quantitative analysis of scRNA-seq data, scalable to millions of cells and thousands of samples.

2024-10-24 | GSE274751 | GEO

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data