Integrative analysis of relative abundance data and presence-absence data of the microbiome using the LDM.
Ontology highlight
ABSTRACT: Summary
We previously developed the LDM for testing hypotheses about the microbiome that performs the test at both the community level and the individual taxon level. The LDM can be applied to relative abundance data and presence-absence data separately, which work well when associated taxa are abundant and rare, respectively. Here, we propose LDM-omni3 that combines LDM analyses at the relative abundance and presence-absence data scales, thereby offering optimal power across scenarios with different association mechanisms. The new LDM-omni3 test is available for the wide range of data types and analyses that are supported by the LDM.Availability and implementation
The LDM-omni3 test has been added to the R package LDM, which is available on GitHub at https://github.com/yijuanhu/LDM.Supplementary information
Supplementary data are available at Bioinformatics online.
SUBMITTER: Zhu Z
PROVIDER: S-EPMC9113255 | biostudies-literature | 2022 May
REPOSITORIES: biostudies-literature
Publications
Integrative analysis of relative abundance data and presence-absence data of the microbiome using the LDM.
Zhu Zhengyi Z Satten Glen A GA Hu Yi-Juan YJ
Bioinformatics (Oxford, England) 20220501 10
<h4>Summary</h4>We previously developed the LDM for testing hypotheses about the microbiome that performs the test at both the community level and the individual taxon level. The LDM can be applied to relative abundance data and presence-absence data separately, which work well when associated taxa are abundant and rare, respectively. Here, we propose LDM-omni3 that combines LDM analyses at the relative abundance and presence-absence data scales, thereby offering optimal power across scenarios w ...[more]
Similar Datasets
Project description:MotivationMany methods for testing association between the microbiome and covariates of interest (e.g. clinical outcomes, environmental factors) assume that these associations are driven by changes in the relative abundance of taxa. However, these associations may also result from changes in which taxa are present and which are absent. Analyses of such presence-absence associations face a unique challenge: confounding by library size (total sample read count), which occurs when library size is associated with covariates in the analysis. It is known that rarefaction (subsampling to a common library size) controls this bias, but at the potential cost of information loss as well as the introduction of a stochastic component into the analysis. Currently, there is a need for robust and efficient methods for testing presence-absence associations in the presence of such confounding, both at the community level and at the individual-taxon level, that avoid the drawbacks of rarefaction.ResultsWe have previously developed the linear decomposition model (LDM) that unifies the community-level and taxon-level tests into one framework. Here, we present an extension of the LDM for testing presence-absence associations. The extended LDM is a non-stochastic approach that repeatedly applies the LDM to all rarefied taxa count tables, averages the residual sum-of-squares (RSS) terms over the rarefaction replicates, and then forms an F-statistic based on these average RSS terms. We show that this approach compares favorably to averaging the F-statistic from R rarefaction replicates, which can only be calculated stochastically. The flexible nature of the LDM allows discrete or continuous traits or interactions to be tested while allowing confounding covariates to be adjusted for. Our simulations indicate that our proposed method is robust to any systematic differences in library size and has better power than alternative approaches. We illustrate our method using an analysis of data on inflammatory bowel disease (IBD) in which cases have systematically smaller library sizes than controls.Availabilityand implementationThe R package LDM is available on GitHub at https://github.com/yijuanhu/LDM in formats appropriate for Macintosh or Windows.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC8289387 | biostudies-literature
Project description:MotivationMicrobiome data analysis faces the challenge of sparsity, with many entries recorded as zeros. In differential abundance analysis, the presence of excessive zeros in data violates distributional assumptions and creates ties, leading to an increased risk of type I errors and reduced statistical power.ResultsWe developed a novel normalization method, called censoring-based analysis of microbiome proportions (CAMP), for microbiome data by treating zeros as censored observations, transforming raw read counts into tie-free time-to-event-like data. This enables the use of survival analysis techniques, like the Cox proportional hazards model, for differential abundance analysis. Extensive simulations demonstrate that CAMP achieves proper type I error control and high power. Applying CAMP to a human gut microbiome dataset, we identify 60 new differentially abundant taxa across geographic locations, showcasing its usefulness. CAMP overcomes sparsity challenges, enabling improved statistical analysis and providing valuable insights into microbiome data in various contexts.Availability and implementationThe R package is available at https://github.com/lapsumchan/CAMP.
| S-EPMC10885211 | biostudies-literature
Project description:BackgroundThe rapid growth of high-throughput sequencing-based microbiome profiling has yielded tremendous insights into human health and physiology. Data generated from high-throughput sequencing of 16S rRNA gene amplicons are often preprocessed into composition or relative abundance. However, reproducibility has been lacking due to the myriad of different experimental and computational approaches taken in these studies. Microbiome studies may report varying results on the same topic, therefore, meta-analyses examining different microbiome studies to provide consistent and robust results are important. So far, there is still a lack of implemented methods to properly examine differential relative abundances of microbial taxonomies and to perform meta-analysis examining the heterogeneity and overall effects across microbiome studies.ResultsWe developed an R package 'metamicrobiomeR' that applies Generalized Additive Models for Location, Scale and Shape (GAMLSS) with a zero-inflated beta (BEZI) family (GAMLSS-BEZI) for analysis of microbiome relative abundance datasets. Both simulation studies and application to real microbiome data demonstrate that GAMLSS-BEZI well performs in testing differential relative abundances of microbial taxonomies. Importantly, the estimates from GAMLSS-BEZI are log (odds ratio) of relative abundances between comparison groups and thus are analogous between microbiome studies. As such, we also apply random effects meta-analysis models to pool estimates and their standard errors across microbiome studies. We demonstrate the meta-analysis examples and highlight the utility of our package on four studies comparing gut microbiomes between male and female infants in the first six months of life.ConclusionsGAMLSS-BEZI allows proper examination of microbiome relative abundance data. Random effects meta-analysis models can be directly applied to pool comparable estimates and their standard errors to evaluate the overall effects and heterogeneity across microbiome studies. The examples and workflow using our 'metamicrobiomeR' package are reproducible and applicable for the analyses and meta-analyses of other microbiome studies.
| S-EPMC6469060 | biostudies-literature
Project description:MotivationMethods for analyzing microbiome data generally fall into one of two groups: tests of the global hypothesis of any microbiome effect, which do not provide any information on the contribution of individual operational taxonomic units (OTUs); and tests for individual OTUs, which do not typically provide a global test of microbiome effect. Without a unified approach, the findings of a global test may be hard to resolve with the findings at the individual OTU level. Further, many tests of individual OTU effects do not preserve the false discovery rate (FDR).ResultsWe introduce the linear decomposition model (LDM), that provides a single analysis path that includes global tests of any effect of the microbiome, tests of the effects of individual OTUs while accounting for multiple testing by controlling the FDR, and a connection to distance-based ordination. The LDM accommodates both continuous and discrete variables (e.g. clinical outcomes, environmental factors) as well as interaction terms to be tested either singly or in combination, allows for adjustment of confounding covariates, and uses permutation-based P-values that can control for sample correlation. The LDM can also be applied to transformed data, and an 'omnibus' test can easily combine results from analyses conducted on different transformation scales. We also provide a new implementation of PERMANOVA based on our approach. For global testing, our simulations indicate the LDM provided correct type I error and can have comparable power to existing distance-based methods. For testing individual OTUs, our simulations indicate the LDM controlled the FDR well. In contrast, DESeq2 often had inflated FDR; MetagenomeSeq generally had the lowest sensitivity. The flexibility of the LDM for a variety of microbiome studies is illustrated by the analysis of data from two microbiome studies. We also show that our implementation of PERMANOVA can outperform existing implementations.Availability and implementationThe R package LDM is available on GitHub at https://github.com/yijuanhu/LDM in formats appropriate for Macintosh or Windows.Contactyijuan.hu@emory.edu.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC8453243 | biostudies-literature
Project description:The human microbiome plays critical roles in human health and has been linked to many diseases. While advanced sequencing technologies can characterize the composition of the microbiome in unprecedented detail, it remains challenging to disentangle the complex interplay between human microbiome and disease risk factors due to the complicated nature of microbiome data. Excessive numbers e f zero values, high dimensionality, the hierarchical phylogenetic tree and compositional structure are compounded and consequently make existing methods inadequate to appropriately address these issues. We propose a multivariate two-part zero-inflated logistic normal (MZILN) model to analyze the association of disease risk factors with individual microbial taxa and overall microbial community composition. This approach can naturally handle excessive numbers e f zeros and the compositional data structure with the discrete part and the logistic-normal part e f the model. For parameter estimation, an estimating equations approach is employed that enables us to address the complex inter-taxa correlation structure induced by the hierarchical phylogenetic tree structure and the compositional data structure. This model is able to incorporate standard regularization approaches to deal with high dimensionality. Simulation shews that our model outperforms existing methods. Our approach is also compared to ethers using the analysis of real microbiome data.
| S-EPMC6432796 | biostudies-literature
Project description:Concerns have been raised about the use of relative abundance data derived from next generation sequencing as a proxy for absolute abundances. For example, in the differential abundance setting, compositional effects in relative abundance data may give rise to spurious differences (false positives) when considered from the absolute perspective. In practice however, relative abundances are often transformed by renormalization strategies intended to compensate for these effects and the scope of the practical problem remains unclear. We used simulated data to explore the consistency of differential abundance calling on renormalized relative abundances versus absolute abundances and find that, while overall consistency is high, with a median sensitivity (true positive rates) of 0.91 and specificity (1-false positive rates) of 0.89, consistency can be much lower where there is widespread change in the abundance of features across conditions. We confirm these findings on a large number of real data sets drawn from 16S metabarcoding, expression array, bulk RNA-seq, and single-cell RNA-seq experiments, where data sets with the greatest change between experimental conditions are also those with the highest false positive rates. Finally, we evaluate the predictive utility of summary features of relative abundance data themselves. Estimates of sparsity and the prevalence of feature-level change in relative abundance data give reasonable predictions of discrepancy in differential abundance calling in simulated data and can provide useful bounds for worst-case outcomes in real data.
| S-EPMC9302745 | biostudies-literature
Project description:Benthic invertebrates are the most commonly used organisms used to assess ecological status as required by the EU Water Framework Directive (WFD). For WFD-compliant assessments, benthic invertebrate communities are sampled, identified and counted. Taxa × abundance matrices are used to calculate indices and the resulting scores are compared to reference values to determine the ecological status class. DNA-based tools, such as DNA metabarcoding, provide a new and precise method for species identification but cannot deliver robust abundance data. To evaluate the applicability of DNA-based tools to ecological status assessment, we evaluated whether the results derived from presence/absence data are comparable to those derived from abundance data. We analysed benthic invertebrate community data obtained from 13,312 WFD assessments of German streams. Broken down to 30 official stream types, we compared assessment results based on abundance and presence/absence data for the assessment modules "organic pollution" (i.e., the saprobic index) and "general degradation" (a multimetric index) as well as their underlying metrics. In 76.6% of cases, the ecological status class did not change after transforming abundance data to presence/absence data. In 12% of cases, the status class was reduced by one (e.g., from good to moderate), and in 11.2% of cases, the class increased by one. In only 0.2% of cases, the status shifted by two classes. Systematic stream type-specific deviations were found and differences between abundance and presence/absence data were most prominent for stream types where abundance information contributed directly to one or several metrics of the general degradation module. For a single stream type, these deviations led to a systematic shift in status from 'good' to 'moderate' (n = 201; with only n = 3 increasing). The systematic decrease in scores was observed, even when considering simulated confidence intervals for abundance data. Our analysis suggests that presence/absence data can yield similar assessment results to those for abundance-based data, despite type-specific deviations. For most metrics, it should be possible to intercalibrate the two data types without substantial efforts. Thus, benthic invertebrate taxon lists generated by standardised DNA-based methods should be further considered as a complementary approach.
| S-EPMC6927632 | biostudies-literature
Project description:Sustainable management of terrestrial hunting requires managers to set quotas restricting offtake. This often takes place in the absence of reliable information on the population size, and as a consequence, quotas are set in an arbitrary fashion, leading to population decline and revenue loss. In this investigation, we show how an indirect measure of abundance can be used to set quotas in a sustainable manner, even in the absence of information on population size. Focusing on lion hunting in Africa, we developed a simple algorithm to convert changes in the number of safari days required to kill a lion into a quota for the following year. This was tested against a simulation model of population dynamics, accounting for uncertainties in demography, observation, and implementation. Results showed it to reliably set sustainable quotas despite these uncertainties, providing a robust foundation for the conservation of hunted species.
| S-EPMC3890814 | biostudies-other
Project description:Motivation: An important feature of microbiome count data is the presence of a large number of zeros. A common strategy to handle these excess zeros is to add a small number called pseudo-count (e.g., 1). Other strategies include using various probability models to model the excess zero counts. Although adding a pseudo-count is simple and widely used, as demonstrated in this paper, it is not ideal. On the other hand, methods that model excess zeros using a probability model often make an implicit assumption that all zeros can be explained by a common probability models. As described in this article, this is not always recommended as there are potentially three types/sources of zeros in a microbiome data. The purpose of this paper is to develop a simple methodology to identify and accomodate three different types of zeros and to test hypotheses regarding the relative abundance of taxa in two or more experimental groups. Another major contribution of this paper is to perform constrained (directional or ordered) inference when there are more than two ordered experimental groups (e.g., subjects ordered by diet or age groups or environmental exposure groups). As far as we know this is the first paper that addresses such problems in the analysis of microbiome data. Results: Using extensive simulation studies, we demonstrate that the proposed methodology not only controls the false discovery rate at a desired level of significance while competing well in terms of power with DESeq2, a popular procedure derived from RNASeq literature. As expected, the method using pseudo-counts tends to be very conservative and the classical t-test that ignores the underlying simplex structure in the data has an inflated FDR.
| S-EPMC5682008 | biostudies-literature
Project description:Many monitoring programmes of species abundance and biomass increasingly face financial pressures. Occupancy is often easier and cheaper to measure than abundance or biomass. We, therefore, explored whether measuring occupancy is a viable alternative to measuring abundance and biomass. Abundance- or biomass-occupancy relationships were studied for sixteen macrozoobenthos species collected across the entire Dutch Wadden Sea in eight consecutive summers. Because the form and strength of these relationships are scale-dependent, the analysis was completed at different spatiotemporal scales. Large differences in intercept and slope of abundance- or biomass-occupancy relationships were found. Abundance, not biomass, was generally positively correlated with occupancy. Only at the largest scale, seven species showed reasonably strong abundance-occupancy relationships with large coefficients of determination and small differences in observed and predicted values (RMSE). Otherwise, and at all the other scales, intraspecific abundance and biomass relationships were poor. Our results showed that there is no generic relationship between a species' abundance or biomass and its occupancy. We discuss how ecological differences between species could cause such large variation in these relationships. Future technologies might allow estimating a species' abundance or biomass directly from eDNA sampling data, but for now, we need to rely on traditional sampling technology.
| S-EPMC5813040 | biostudies-literature