Browse
Submit Data
Databases
API
Help

Dataset Information

20 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Richness estimation in microbiome data obtained from denoising pipelines.

ABSTRACT: The quantification of richness within a sample-either measured as the number of observed species or approximated by estimation-is a common first step in microbiome studies and is known to be highly dependent on sequencing depth, which itself is highly variable between samples. Rarefaction curves serve as a tool to investigate this dependency and it is often argued that after rarefying data-sub-sampling to an equal sequencing depth-richness estimates no longer depend on sequencing depth. However, the estimation of richness from data obtained by high throughput sequencing methods and processed by current bioinformatics pipelines may be subject to various sources of variation related to sequencing depth. Those that may confound inference based on richness estimates and cannot be solved by sub-sampling. We investigated how pipeline settings in DADA2 and deblur affect estimates of richness and showed that the use of rarefaction and sub-sampling is inappropriate when default pipeline settings are applied. Furthermore, we showed how independent sample-wise processing established spurious correlations between sequencing depth and richness estimations in data produced by DADA2 and how this problem can be solved by a pooled processing approach.

SUBMITTER: Kleine Bardenhorst S

PROVIDER: S-EPMC8762370 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

A comparison of denoising pipelines in high temporal resolution task-based functional magnetic resonance imaging data.

Project description:It has been known for decades that head motion/other artifacts affect the blood oxygen level-dependent signal. Recent recommendations predominantly focus on denoising resting state data, which may not apply to task data due to the different statistical relationships that exist between signal and noise sources. Several blind-source denoising strategies (FIX and AROMA) and more standard motion parameter (MP) regression (0, 12, or 24 parameters) analyses were therefore compared across four sets of event-related functional magnetic resonance imaging (erfMRI) and block-design (bdfMRI) datasets collected with multiband 32- (repetition time [TR] = 460 ms) or older 12-channel (TR = 2,000 ms) head coils. The amount of motion varied across coil designs and task types. Quality control plots indicated small to moderate relationships between head motion estimates and percent signal change in both signal and noise regions. Blind-source denoising strategies eliminated signal as well as noise relative to MP24 regression; however, the undesired effects on signal depended both on algorithm (FIX > AROMA) and design (bdfMRI > erfMRI). Moreover, in contrast to previous results, there were minimal differences between MP12/24 and MP0 pipelines in both erfMRI and bdfMRI designs. MP12/24 pipelines were detrimental for a task with both longer block length (30 ± 5 s) and higher correlations between head MPs and design matrix. In summary, current results suggest that there does not appear to be a single denoising approach that is appropriate for all fMRI designs. However, even nonaggressive blind-source denoising approaches appear to remove signal as well as noise from task-related data at individual subject and group levels.

| S-EPMC6865567 | biostudies-literature

mbDenoise: microbiome data denoising using zero-inflated probabilistic principal components analysis.

Project description:The analysis of microbiome data has several technical challenges. In particular, count matrices contain a large proportion of zeros, some of which are biological, whereas others are technical. Furthermore, the measurements suffer from unequal sequencing depth, overdispersion, and data redundancy. These nuisance factors introduce substantial noise. We propose an accurate and robust method, mbDenoise, for denoising microbiome data. Assuming a zero-inflated probabilistic PCA (ZIPPCA) model, mbDenoise uses variational approximation to learn the latent structure and recovers the true abundance levels using the posterior, borrowing information across samples and taxa. mbDenoise outperforms state-of-the-art methods to extract the signal for downstream analyses.

| S-EPMC9011970 | biostudies-literature

RICHEST--a web server for richness estimation in biological data.

Project description:UnlabelledRichness is defined as the number of distinct species or classes in a sample or population. Although richness estimation is an important practice, it requires mathematical and computational methods that are challenging to understand and implement. We have developed a web server, RICHness ESTimator (RICHEST), which implements three non-parametric statistical methods for richness estimation. Its user-friendly web interface allows users to analyze and compare their data conveniently over the web.AvailabilityA web server hosting RICHEST is accessible at http://richest.cgb.indiana.edu/cgi-bin/index.cgi and the software is freely available for local installations.

| S-EPMC2655047 | biostudies-literature

Compositional zero-inflated network estimation for microbiome data.

Project description:BackgroundThe estimation of microbial networks can provide important insight into the ecological relationships among the organisms that comprise the microbiome. However, there are a number of critical statistical challenges in the inference of such networks from high-throughput data. Since the abundances in each sample are constrained to have a fixed sum and there is incomplete overlap in microbial populations across subjects, the data are both compositional and zero-inflated.ResultsWe propose the COmpositional Zero-Inflated Network Estimation (COZINE) method for inference of microbial networks which addresses these critical aspects of the data while maintaining computational scalability. COZINE relies on the multivariate Hurdle model to infer a sparse set of conditional dependencies which reflect not only relationships among the continuous values, but also among binary indicators of presence or absence and between the binary and continuous representations of the data. Our simulation results show that the proposed method is better able to capture various types of microbial relationships than existing approaches. We demonstrate the utility of the method with an application to understanding the oral microbiome network in a cohort of leukemic patients.ConclusionsOur proposed method addresses important challenges in microbiome network estimation, and can be effectively applied to discover various types of dependence relationships in microbial communities. The procedure we have developed, which we refer to as COZINE, is available online at https://github.com/MinJinHa/COZINE .

| S-EPMC7768662 | biostudies-literature

Denoising inferred functional association networks obtained by gene fusion analysis.

Project description:BackgroundGene fusion detection - also known as the 'Rosetta Stone' method - involves the identification of fused composite genes in a set of reference genomes, which indicates potential interactions between its un-fused counterpart genes in query genomes. The precision of this method typically improves with an ever-increasing number of reference genomes.ResultsIn order to explore the usefulness and scope of this approach for protein interaction prediction and generate a high-quality, non-redundant set of interacting pairs of proteins across a wide taxonomic range, we have exhaustively performed gene fusion analysis for 184 genomes using an efficient variant of a previously developed protocol. By analyzing interaction graphs and applying a threshold that limits the maximum number of possible interactions within the largest graph components, we show that we can reduce the number of implausible interactions due to the detection of promiscuous domains. With this generally applicable approach, we generate a robust set of over 2 million distinct and testable interactions encompassing 696,894 proteins in 184 species or strains, most of which have never been the subject of high-throughput experimental proteomics. We investigate the cumulative effect of increasing numbers of genomes on the fidelity and quantity of predictions, and show that, for large numbers of genomes, predictions do not become saturated but continue to grow linearly, for the majority of the species. We also examine the percentage of component (and composite) proteins with relation to the number of genes and further validate the functional categories that are highly represented in this robust set of detected genome-wide interactions.ConclusionWe illustrate the phylogenetic and functional diversity of gene fusion events across genomes, and their usefulness for accurate prediction of protein interaction and function.

| S-EPMC2248599 | biostudies-literature

Limited sampling hampers "big data" estimation of species richness in a tropical biodiversity hotspot.

Project description:Macro-scale species richness studies often use museum specimens as their main source of information. However, such datasets are often strongly biased due to variation in sampling effort in space and time. These biases may strongly affect diversity estimates and may, thereby, obstruct solid inference on the underlying diversity drivers, as well as mislead conservation prioritization. In recent years, this has resulted in an increased focus on developing methods to correct for sampling bias. In this study, we use sample-size-correcting methods to examine patterns of tropical plant diversity in Ecuador, one of the most species-rich and climatically heterogeneous biodiversity hotspots. Species richness estimates were calculated based on 205,735 georeferenced specimens of 15,788 species using the Margalef diversity index, the Chao estimator, the second-order Jackknife and Bootstrapping resampling methods, and Hill numbers and rarefaction. Species richness was heavily correlated with sampling effort, and only rarefaction was able to remove this effect, and we recommend this method for estimation of species richness with "big data" collections.

| S-EPMC4328781 | biostudies-literature

Industrial pipelines data generator.

Project description:The construction of industrial projects involves fabricating and installing massive quantities of pipelines. The design data of pipelines is complex, usually unique for each project and not easily available to researchers and the public for confidentiality reasons. As a result, an industrial pipelines data generator able to realistically simulate pipelines structures will lessen the dependence on real-life data. This article describes an industrial pipelines data generator that was developed using topological and physical properties of pipelines from real industrial projects. This generator can simulate the properties (the type of component, length, diameter, running direction, and the connectivity relationships between components) of real industrial pipelines. Its application in construction engineering and management research, more specifically in the experimental analysis of an optimization algorithm, was described by the authors in previous work [1]. The data generator can be used to develop benchmark problem instances for optimization problems and for simulation studies of construction operations in industrial projects.

| S-EPMC7490719 | biostudies-literature

Evaluation of automated pipelines for tree and plot metric estimation from TLS data in tropical forest areas.

Project description:Background and aimsTerrestrial LiDAR scanning (TLS) data are of great interest in forest ecology and management because they provide detailed 3-D information on tree structure. Automated pipelines are increasingly used to process TLS data and extract various tree- and plot-level metrics. With these developments comes the risk of unknown reliability due to an absence of systematic output control. In the present study, we evaluated the estimation errors of various metrics, such as wood volume, at tree and plot levels for four automated pipelines.MethodsWe used TLS data collected from a 1-ha plot of tropical forest, from which 391 trees >10 cm in diameter were fully processed using human assistance to obtain control data for tree- and plot-level metrics.Key resultsOur results showed that fully automated pipelines led to median relative errors in the quantitative structural model (QSM) volume ranging from 39 to 115 % at the tree level and 10 to 134 % at the 1-ha plot level. For tree-level metrics, the median error for the crown-projected area ranged from 46 to 59 % and that for the crown-hull volume varied from 72 to 88 %. This result suggests that the tree isolation step is the weak link in automated pipeline methods. We further analysed how human assistance with automated pipelines can help reduce the error in the final QSM volume. At the tree scale, we found that isolating trees using human assistance reduced the error in wood volume by a factor of 10. At the 1-ha plot scale, locating trees with human assistance reduced the error by a factor of 3.ConclusionsOur results suggest that in complex tropical forests, fully automated pipelines may provide relatively unreliable metrics at the tree and plot levels, but limited human assistance inputs can significantly reduce errors.

| S-EPMC8557371 | biostudies-literature

Denoising PCR-amplified metagenome data.

Project description:PCR amplification and high-throughput sequencing theoretically enable the characterization of the finest-scale diversity in natural microbial and viral populations, but each of these methods introduces random errors that are difficult to distinguish from genuine biological diversity. Several approaches have been proposed to denoise these data but lack either speed or accuracy.We introduce a new denoising algorithm that we call DADA (Divisive Amplicon Denoising Algorithm). Without training data, DADA infers both the sample genotypes and error parameters that produced a metagenome data set. We demonstrate performance on control data sequenced on Roche's 454 platform, and compare the results to the most accurate denoising software currently available, AmpliconNoise.DADA is more accurate and over an order of magnitude faster than AmpliconNoise. It eliminates the need for training data to establish error parameters, fully utilizes sequence-abundance information, and enables inclusion of context-dependent PCR error rates. It should be readily extensible to other sequencing platforms such as Illumina.

| S-EPMC3563472 | biostudies-literature

Denoising of Aligned Genomic Data.

Project description:Noise in genomic sequencing data is known to have effects on various stages of genomic data analysis pipelines. Variant identification is an important step of many of these pipelines, and is increasingly being used in clinical settings to aid medical practices. We propose a denoising method, dubbed SAMDUDE, which operates on aligned genomic data in order to improve variant calling performance. Denoising human data with SAMDUDE resulted in improved variant identification in both individual chromosome as well as whole genome sequencing (WGS) data sets. In the WGS data set, denoising led to identification of almost 2,000 additional true variants, and elimination of over 1,500 erroneously identified variants. In contrast, we found that denoising with other state-of-the-art denoisers significantly worsens variant calling performance. SAMDUDE is written in Python and is freely available at https://github.com/ihwang/SAMDUDE .

| S-EPMC6803637 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data