Dataset Information

An evaluation of the accuracy and speed of metagenome analysis tools.

ABSTRACT: Metagenome studies are becoming increasingly widespread, yielding important insights into microbial communities covering diverse environments from terrestrial and aquatic ecosystems to human skin and gut. With the advent of high-throughput sequencing platforms, the use of large scale shotgun sequencing approaches is now commonplace. However, a thorough independent benchmark comparing state-of-the-art metagenome analysis tools is lacking. Here, we present a benchmark where the most widely used tools are tested on complex, realistic data sets. Our results clearly show that the most widely used tools are not necessarily the most accurate, that the most accurate tool is not necessarily the most time consuming, and that there is a high degree of variability between available tools. These findings are important as the conclusions of any metagenomics study are affected by errors in the predicted community composition and functional capacity. Data sets and results are freely available from http://www.ucbioinformatics.org/metabenchmark.html.

SUBMITTER: Lindgreen S

PROVIDER: S-EPMC4726098 | biostudies-literature | 2016 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An evaluation of the accuracy and speed of metagenome analysis tools.

Lindgreen Stinus S Adair Karen L KL Gardner Paul P PP

Scientific reports 20160118

Metagenome studies are becoming increasingly widespread, yielding important insights into microbial communities covering diverse environments from terrestrial and aquatic ecosystems to human skin and gut. With the advent of high-throughput sequencing platforms, the use of large scale shotgun sequencing approaches is now commonplace. However, a thorough independent benchmark comparing state-of-the-art metagenome analysis tools is lacking. Here, we present a benchmark where the most widely used to ...[more]

PMID: 26778510

Similar Datasets

Project description:BackgroundTyphoid fevers are infections caused by the bacteria Salmonella enterica serovar Typhi (Salmonella Typhi) and Paratyphi A, B and C (Salmonella Paratyphi). Approximately 17.8 million incident cases of typhoid fever occur annually, and incidence is highest in children. The accuracy of current diagnostic tests of typhoid fever is poorly understood. We aimed to determine the comparative accuracy of available tests for the pediatric population.MethodsWe first conducted a systematic literature review to identify studies that compared diagnostic tests for typhoid fever in children (aged ≤15 years) to blood culture results. We applied a Bayesian latent-class extension to a network meta-analysis model. We modelled known diagnostic properties of bone marrow culture and the relationship between bone marrow and blood culture as informative priors in a Bayesian framework. We tested sensitivities for the proportion of negative blood samples that were false as well as bone marrow sensitivity and specificity.ResultsWe found 510 comparisons from 196 studies and 57 specific to the pediatric population. IgM-based tests outperformed their IgG-based counterparts for ELISA and Typhidot tests. The lateral flow IgG test performed comparatively well with 92% sensitivity (72% to 98% across scenario analyses) and 94% specificity. The most sensitive test of those investigated for the South Asian pediatric population was the Reverse Passive Hemagglutination Assay with 99% sensitivity (98% - 100% across scenario analyses). Adding a Widal slide test to other typhoid diagnostics did not substantially improve diagnostic performance beyond the single test alone, however, a lateral flow-based IgG rapid test combined with the typhoid/paratyphoid (TPT) assay yielded improvements in sensitivity without substantial declines in specificity and was the best performing combination test in this setting.ConclusionIn the pediatric population, lateral-flow IgG, TPT and Reverse Passive Hemagglutination tests had high diagnostic accuracy compared to other diagnostics. Combinations of tests may provide a feasible option to increase diagnostic sensitivity. South Asia has the most informed set of data on typhoid diagnostic testing accuracy, and the evidence base in other important regions needs to be expanded.

Dataset Information

An evaluation of the accuracy and speed of metagenome analysis tools.

Publications

An evaluation of the accuracy and speed of metagenome analysis tools.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets