Analysing microbiome intervention design studies: Comparison of alternative multivariate statistical methods
Ontology highlight
ABSTRACT:
SUBMITTER: Khomich M
PROVIDER: S-EPMC8601541 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundTargeted metagenomics and IS-Pro method are two of the many methods that have been used to study the microbiome. The two methods target different regions of the 16 S rRNA gene. The aim of this study was to compare targeted metagenomics and IS-Pro methods for the ability to discern the microbial composition of the lung microbiome of COPD patients.MethodsSpontaneously expectorated sputum specimens were collected from COPD patients. Bacterial DNA was extracted and used for targeted metagenomics and IS-Pro method. The analysis was performed using QIIME2 (targeted metagenomics) and IS-Pro software (IS-Pro method). Additionally, a laboratory cost per isolate and time analysis was performed for each method.ResultsStatistically significant differences were observed in alpha diversity when targeted metagenomics and IS-Pro methods' data were compared using the Shannon diversity measure (p-value = 0.0006) but not with the Simpson diversity measure (p-value = 0.84). Distinct clusters with no overlap between the two technologies were observed for beta diversity. Targeted metagenomics had a lower relative abundance of phyla, such as the Proteobacteria, and higher relative abundance of phyla, such as Firmicutes when compared to the IS-Pro method. Haemophilus, Prevotella and Streptococcus were most prevalent genera across both methods. Targeted metagenomics classified 23 % (144/631) of OTUs to a species level, whereas IS-Pro method classified 86 % (55/64) of OTUs to a species level. However, unclassified OTUs accounted for a higher relative abundance when using the IS-Pro method (35 %) compared to targeted metagenomics (5 %). The two methods performed comparably in terms of cost and time; however, the IS-Pro method was more user-friendly.ConclusionsIt is essential to understand the value of different methods for characterisation of the microbiome. Targeted metagenomics and IS-Pro methods showed differences in ability in identifying and characterising OTUs, diversity and microbial composition of the lung microbiome. The IS-Pro method might miss relevant species and could inflate the abundance of Proteobacteria. However, the IS-Pro kit identified most of the important lung pathogens, such as Burkholderia and Pseudomonas and may work in a more diagnostics-orientated setting. Both methods were comparable in terms of cost and time; however, the IS-Pro method was easier to use.
| S-EPMC8371770 | biostudies-literature
Project description:Background: Integrated microbiome and metabolomics analyses hold the potential to reveal interactions between host and microbiota in relation to disease risks. However, there are few studies evaluating how field methods influence fecal microbiome characterization and metabolomics profiling. Methods: Five fecal collection methods [immediate freezing at -20°C without preservative, OMNIgene GUT, 95% ethanol, RNAlater, and Flinders Technology Associates (FTA) cards] were used to collect 40 fecal samples from eight healthy volunteers. We performed gut microbiota 16S rRNA sequencing, untargeted metabolomics profiling, and targeted metabolomics focusing on short chained fatty acids (SCFAs). Metrics included ?-diversity and ?-diversity as well as distributions of predominant phyla. To evaluate the concordance with the "gold standard" immediate freezing, the intraclass correlation coefficients (ICCs) for alternate fecal collection systems were calculated. Correlations between SCFAs and gut microbiota were also examined. Results: The FTA cards had the highest ICCs compared to the immediate freezing method for ?-diversity indices (ICCs = 0.96, 0.96, 0.76 for Shannon index, Simpson's Index, Chao-1 Index, respectively), followed by OMNIgene GUT, RNAlater, and 95% ethanol. High ICCs (all >0.88) were observed for all methods for the ?-diversity metric. For untargeted metabolomics, in comparison to immediate freezing which detected 621 metabolites at ?75% detectability level, 95% ethanol showed the largest overlapping set of metabolites (n = 430; 69.2%), followed by FTA cards (n = 330; 53.1%) and OMNIgene GUT (n = 213; 34.3%). Both OMNIgene GUT (ICCs = 0.82, 0.93, 0.64) and FTA cards (ICCs = 0.87, 0.85, 0.54) had acceptable ICCs for the top three predominant SCFAs (butyric acid, propionic acid and acetic acid). Nominally significant correlations between bacterial genera and SCFAs (P < 0.05) were observed in fecal samples collected by different methods. Of note, a high correlation between the genus Blautia (known butyrate producer) and butyric acid was observed for both immediate freezing (r = 0.83) and FTA cards (r = 0.74). Conclusions: Four alternative fecal collection methods are generally comparable with immediate freezing, but there are differences in certain measures of the gut microbiome and fecal metabolome across methods. Choice of method depends on the research interests, simplicity of fecal collection procedures and ease of transportation to the lab, especially for large epidemiological studies.
| S-EPMC6127643 | biostudies-literature
Project description:The establishment of human gut microbiota commences initially in utero. Meconium-the first fecal material passed after birth-can be used to study fetal gut contents; however, processing meconium samples for microbiome studies presents significant technical challenges. Meconium hosts a low biomass microbiome, is tar-like in texture and contains high concentrations of PCR inhibitors. This study aimed to evaluate four different DNA extraction methods to elucidate the most effective method for bacterial DNA recovery and sequencing analysis from first-pass meconium. Samples from five infants were collected and processed using the following extraction kits: (1) Qiagen QIAamp DNA Stool Mini (QS); (2) Qiagen QIAamp DNA Microbiome (QM); (3) MoBio PowerSoil (PS); (4) MoBio MagAttract PowerMicrobiome (PM). Additionally, Kit PM was employed with a double inhibitor removal treatment (IRT) step (PM2). Bacterial DNA recovery was assessed by qPCR. Any PCR inhibition in samples was measured by spiking DNA eluates with 0.1 ng of pure Streptococcus agalactiae (GBS) DNA followed by qPCR quantitation. Kit PM yielded the highest average total DNA yield (79.3 ng per gram of meconium). Samples extracted with kit PS had the highest detectable levels of 16S rRNA gene by qPCR. The ability of each kit to overcome PCR inhibition varied, with qPCR on GBS-spiked DNA from kits QS, QM, PS, and PM recovering 87.1, 91.0, 88.8, and 37.9% GBS DNA, respectively. Double IRT improved the performance of kit PM, increasing GBS recovery to 56.5%. However, once DNA yield was normalized to the level recovered with the other kits 100% of GBS DNA was detected, suggesting that levels of PCR inhibitors are related to DNA yield from kit PM. Ion Torrent 16S rRNA gene sequencing revealed a high level of inter-kit variation in meconium microbiome structure. In particular, kit QM showed a bias toward extracting Firmicute DNA, while the other kits extracted primarily Proteobacterial DNA. Choice of extraction kit greatly impacts on the ability to extract and detect bacterial DNA in meconium and on the microbiome community structure generated from these samples.
| S-EPMC5826226 | biostudies-literature
Project description:RNA sequencing (RNA-seq) is widely used for RNA quantification in the environmental, biological and medical sciences. It enables the description of genome-wide patterns of expression and the identification of regulatory interactions and networks. The aim of RNA-seq data analyses is to achieve rigorous quantification of genes/transcripts to allow a reliable prediction of differential expression (DE), despite variation in levels of noise and inherent biases in sequencing data. This can be especially challenging for datasets in which gene expression differences are subtle, as in the behavioural transcriptomics test dataset from D. melanogaster that we used here. We investigated the power of existing approaches for quality checking mRNA-seq data and explored additional, quantitative quality checks. To accommodate nested, multi-level experimental designs, we incorporated sample layout into our analyses. We employed a subsampling without replacement-based normalization and an identification of DE that accounted for the hierarchy and amplitude of effect sizes within samples, then evaluated the resulting differential expression call in comparison to existing approaches. In a final step to test for broader applicability, we applied our approaches to a published set of H. sapiens mRNA-seq samples, The dataset-tailored methods improved sample comparability and delivered a robust prediction of subtle gene expression changes. The proposed approaches have the potential to improve key steps in the analysis of RNA-seq data by incorporating the structure and characteristics of biological experiments.
| S-EPMC5549751 | biostudies-literature
Project description:Joint association analysis of multiple traits in a genome-wide association study (GWAS), i.e. a multivariate GWAS, offers several advantages over analyzing each trait in a separate GWAS. In this study we directly compared a number of multivariate GWAS methods using simulated data. We focused on six methods that are implemented in the software packages PLINK, SNPTEST, MultiPhen, BIMBAM, PCHAT and TATES, and also compared them to standard univariate GWAS, analysis of the first principal component of the traits, and meta-analysis of univariate results. We simulated data (N = 1000) for three quantitative traits and one bi-allelic quantitative trait locus (QTL), and varied the number of traits associated with the QTL (explained variance 0.1%), minor allele frequency of the QTL, residual correlation between the traits, and the sign of the correlation induced by the QTL relative to the residual correlation. We compared the power of the methods using empirically fixed significance thresholds (α = 0.05). Our results showed that the multivariate methods implemented in PLINK, SNPTEST, MultiPhen and BIMBAM performed best for the majority of the tested scenarios, with a notable increase in power for scenarios with an opposite sign of genetic and residual correlation. All multivariate analyses resulted in a higher power than univariate analyses, even when only one of the traits was associated with the QTL. Hence, use of multivariate GWAS methods can be recommended, even when genetic correlations between traits are weak.
| S-EPMC3999149 | biostudies-literature
Project description:Simulation studies are computer experiments that involve creating data by pseudo-random sampling. A key strength of simulation studies is the ability to understand the behavior of statistical methods because some "truth" (usually some parameter/s of interest) is known from the process of generating the data. This allows us to consider properties of methods, such as bias. While widely used, simulation studies are often poorly designed, analyzed, and reported. This tutorial outlines the rationale for using simulation studies and offers guidance for design, execution, analysis, reporting, and presentation. In particular, this tutorial provides a structured approach for planning and reporting simulation studies, which involves defining aims, data-generating mechanisms, estimands, methods, and performance measures ("ADEMP"); coherent terminology for simulation studies; guidance on coding simulation studies; a critical discussion of key performance measures and their estimation; guidance on structuring tabular and graphical presentation of results; and new graphical presentations. With a view to describing recent practice, we review 100 articles taken from Volume 34 of Statistics in Medicine, which included at least one simulation study and identify areas for improvement.
| S-EPMC6492164 | biostudies-literature
Project description:BackgroundThe Interrupted Time Series (ITS) is a quasi-experimental design commonly used in public health to evaluate the impact of interventions or exposures. Multiple statistical methods are available to analyse data from ITS studies, but no empirical investigation has examined how the different methods compare when applied to real-world datasets.MethodsA random sample of 200 ITS studies identified in a previous methods review were included. Time series data from each of these studies was sought. Each dataset was re-analysed using six statistical methods. Point and confidence interval estimates for level and slope changes, standard errors, p-values and estimates of autocorrelation were compared between methods.ResultsFrom the 200 ITS studies, including 230 time series, 190 datasets were obtained. We found that the choice of statistical method can importantly affect the level and slope change point estimates, their standard errors, width of confidence intervals and p-values. Statistical significance (categorised at the 5% level) often differed across the pairwise comparisons of methods, ranging from 4 to 25% disagreement. Estimates of autocorrelation differed depending on the method used and the length of the series.ConclusionsThe choice of statistical method in ITS studies can lead to substantially different conclusions about the impact of the interruption. Pre-specification of the statistical method is encouraged, and naive conclusions based on statistical significance should be avoided.
| S-EPMC8235830 | biostudies-literature
Project description:A large number of fMRI studies have shown that the temporal dynamics of evoked BOLD responses can be highly heterogeneous. Failing to model heterogeneous responses in statistical analysis can lead to significant errors in signal detection and characterization and alter the neurobiological interpretation. However, to date it is not clear that, out of a large number of options, which methods are robust against variability in the temporal dynamics of BOLD responses in block-design studies. Here, we used rodent optogenetic fMRI data with heterogeneous BOLD responses and simulations guided by experimental data as a means to investigate different analysis methods' performance against heterogeneous BOLD responses. Evaluations are carried out within the general linear model (GLM) framework and consist of standard basis sets as well as independent component analysis (ICA). Analyses show that, in the presence of heterogeneous BOLD responses, conventionally used GLM with a canonical basis set leads to considerable errors in the detection and characterization of BOLD responses. Our results suggest that the 3rd and 4th order gamma basis sets, the 7th to 9th order finite impulse response (FIR) basis sets, the 5th to 9th order B-spline basis sets, and the 2nd to 5th order Fourier basis sets are optimal for good balance between detection and characterization, while the 1st order Fourier basis set (coherence analysis) used in our earlier studies show good detection capability. ICA has mostly good detection and characterization capabilities, but detects a large volume of spurious activation with the control fMRI data.
| S-EPMC5472444 | biostudies-literature
Project description:To address the growing concern of honey adulteration in Canada and globally, a quantitative NMR method was developed to analyze 424 honey samples collected across Canada as part of two surveys in 2018 and 2019 led by the Canadian Food Inspection Agency. Based on a robust and reproducible methodology, NMR data were recorded in triplicate on a 700 MHz NMR spectrometer equipped with a cryoprobe, and the data analysis led to the identification and quantification of 33 compounds characteristic of the chemical composition of honey. The high proportion of Canadian honey in the library provided a unique opportunity to apply multivariate statistical methods including PCA, PLS-DA, and SIMCA in order to differentiate Canadian samples from the rest of the world. Through satisfactory model validation, both PLS-DA as a discriminant modeling technique and SIMCA as a class modeling method proved to be reliable at differentiating Canadian honey from a diverse set of honeys with various countries of origins and floral types. The replacement method of optimization was successfully applied for variable selection, and trigonelline, proline, and ethanol at a lower extent were identified as potential chemical markers for the discrimination of Canadian and non-Canadian honeys.
| S-EPMC9959790 | biostudies-literature
Project description:BACKGROUND:In individually randomised trials we might expect interventions delivered in groups or by care providers to result in clustering of outcomes for participants treated in the same group or by the same care provider. In partially nested randomised controlled trials (pnRCTs) this clustering only occurs in one trial arm, commonly the intervention arm. It is important to measure and account for between-cluster variability in trial design and analysis. We compare analysis approaches for pnRCTs with continuous outcomes, investigating the impact on statistical inference of cluster sizes, coding of the non-clustered arm, intracluster correlation coefficient (ICCs), and differential variance between intervention and control arm, and provide recommendations for analysis. METHODS:We performed a simulation study assessing the performance of six analysis approaches for a two-arm pnRCT with a continuous outcome. These include: linear regression model; fully clustered mixed-effects model with singleton clusters in control arm; fully clustered mixed-effects model with one large cluster in control arm; fully clustered mixed-effects model with pseudo clusters in control arm; partially nested homoscedastic mixed effects model, and partially nested heteroscedastic mixed effects model. We varied the cluster size, number of clusters, ICC, and individual variance between the two trial arms. RESULTS:All models provided unbiased intervention effect estimates. In the partially nested mixed-effects models, methods for classifying the non-clustered control arm had negligible impact. Failure to account for even small ICCs resulted in inflated Type I error rates and over-coverage of confidence intervals. Fully clustered mixed effects models provided poor control of the Type I error rates and biased ICC estimates. The heteroscedastic partially nested mixed-effects model maintained relatively good control of Type I error rates, unbiased ICC estimation, and did not noticeably reduce power even with homoscedastic individual variances across arms. CONCLUSIONS:In general, we recommend the use of a heteroscedastic partially nested mixed-effects model, which models the clustering in only one arm, for continuous outcomes similar to those generated under the scenarios of our simulations study. However, with few clusters (3-6), small cluster sizes (5-10), and small ICC (?0.05) this model underestimates Type I error rates and there is no optimal model.
| S-EPMC6186141 | biostudies-other