Dataset Information

Developing standards for the microbiome field.

ABSTRACT:

Background

Effective standardisation of methodologies to analyse the microbiome is essential to the entire microbiome community. Despite the microbiome field being established for over a decade, there are no accredited or certified reference materials available to the wider community. In this study, we describe the development of the first reference reagents produced by the National Institute for Biological Standards and Control (NIBSC) for microbiome analysis by next-generation sequencing. These can act as global working standards and will be evaluated as candidate World Health Organization International Reference Reagents.

Results

We developed the NIBSC DNA reference reagents Gut-Mix-RR and Gut-HiLo-RR and a four-measure framework for evaluation of bioinformatics tool and pipeline bias. Using these reagents and reporting system, we performed an independent evaluation of a variety of bioinformatics tools by analysing shotgun sequencing and 16S rRNA sequencing data generated from the Gut-Mix-RR and Gut-HiLo-RR. We demonstrate that key measures of microbiome health, such as diversity estimates, are largely inflated by the majority of bioinformatics tools. Across all tested tools, biases were present, with a clear trade-off occurring between sensitivity and the relative abundance of false positives in the final dataset. Using commercially available mock communities, we investigated how the composition of reference reagents may impact benchmarking studies. Reporting measures consistently changed when the same bioinformatics tools were used on different community compositions. This was influenced by both community complexity and taxonomy of species present. Both NIBSC reference reagents, which consisted of gut commensal species, proved to be the most challenging for the majority of bioinformatics tools tested. Going forward, we recommend the field uses site-specific reagents of a high complexity to ensure pipeline benchmarking is fit for purpose.

Conclusions

If a consensus of acceptable levels of error can be agreed on, widespread adoption of these reference reagents will standardise downstream gut microbiome analyses. We propose to do this through a large open-invite collaborative study for multiple laboratories in 2020. Video Abstract.

SUBMITTER: Amos GCA

PROVIDER: S-EPMC7320585 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing standards for the microbiome field.

Amos Gregory C A GCA Logan Alastair A Anwar Saba S Fritzsche Martin M Mate Ryan R Bleazard Thomas T Rijpkema Sjoerd S

Microbiome 20200626 1

<h4>Background</h4>Effective standardisation of methodologies to analyse the microbiome is essential to the entire microbiome community. Despite the microbiome field being established for over a decade, there are no accredited or certified reference materials available to the wider community. In this study, we describe the development of the first reference reagents produced by the National Institute for Biological Standards and Control (NIBSC) for microbiome analysis by next-generation sequenci ...[more]

PMID: 32591016

Similar Datasets

Project description:An inherent issue in high-throughput rRNA gene tag sequencing microbiome surveys is that they provide compositional data in relative abundances. This often leads to spurious correlations, making the interpretation of relationships to biogeochemical rates challenging. To overcome this issue, we quantitatively estimated the abundance of microorganisms by spiking in known amounts of internal DNA standards. Using a 3-year sample set of diverse microbial communities from the Western Antarctica Peninsula, we demonstrated that the internal standard method yielded community profiles and taxon cooccurrence patterns substantially different from those derived using relative abundances. We found that the method provided results consistent with the traditional CHEMTAX analysis of pigments and total bacterial counts by flow cytometry. Using the internal standard method, we also showed that chloroplast 16S rRNA gene data in microbial surveys can be used to estimate abundances of certain eukaryotic phototrophs such as cryptophytes and diatoms. In Phaeocystis, scatter in the 16S/18S rRNA gene ratio may be explained by physiological adaptation to environmental conditions. We conclude that the internal standard method, when applied to rRNA gene microbial community profiling, is quantitative and that its application will substantially improve our understanding of microbial ecosystems.IMPORTANCE High-throughput-sequencing-based marine microbiome profiling is rapidly expanding and changing how we study the oceans. Although powerful, the technique is not fully quantitative; it provides taxon counts only in relative abundances. In order to address this issue, we present a method to quantitatively estimate microbial abundances per unit volume of seawater filtered by spiking known amounts of internal DNA standards into each sample. We validated this method by comparing the calculated abundances to other independent estimates, including chemical markers (pigments) and total bacterial cell counts by flow cytometry. The internal standard approach allows us to quantitatively estimate and compare marine microbial community profiles, with important implications for linking environmental microbiomes to quantitative processes such as metabolic and biogeochemical rates.

Project description:BACKGROUND: There is a lack of effective and affordable technologies to address health needs in the developing world. One way to address problems of innovation and affordability is to design global health technologies to follow agreed-upon standards. This Debate article argues that we can better develop standards for global health technologies if we learn lessons from other industries. DISCUSSION: The article's Background section begins by explaining why standards are needed in global health. For example, if global health technologies can be modularized into independent interfacing parts, these parts can then interact via well-defined standards in a "plug and play" fashion. This can avoid development of mutually incompatible solutions by different organizations, speed the pace of innovation, unlock health systems from single providers and approaches, and lower barriers to entry. The Background then gives a brief primer on standards and discusses incentives for health standards. The article's Discussion section begins with brief relevant cases of standards development from other industries, including electricity, container shipping, CD standards, Universal Serial Bus (USB), and the Internet. It then explores lessons from these and other industries that suggest how to develop standards for global health technologies. The remainder of the Discussion considers intellectual property and regulatory issues and standards-based global health business models, and ends with a checklist of considerations for health standards development leaders. (The associated Additional file discusses observations from standards development for cell phones and semiconductors, as well as challenges in the standards development process itself.) Throughout the article, point-of-care diagnostics are used as an illustrative example. An initiative is already underway to explore standardized diagnostics platforms. SUMMARY: This Debate article aims to convince the reader that standards can benefit global health technologies if we learn lessons from other industries. The article draws from historical examples and the authors' experiences to suggest principles, challenges, and opportunities in developing these standards. If implemented well, standardized platforms can lower barriers to entry, improve affordability, and create a vibrant ecosystem of innovative new global health technologies.

Project description:IntroductionDespite widespread availability of clinical practice guidelines (CPGs), considerable gaps continue between the care that is recommended ('appropriate care') and the care provided. Problems with current CPGs are commonly cited as barriers to providing 'appropriate care'.Our study aims to develop and test an alternative method to keep CPGs accessible and up to date. This method aims to mitigate existing problems by using a single process to develop clinical standards (embodied in clinical indicators) collaboratively with researchers, healthcare professionals, patients and consumers. A transparent and inclusive online curated (purpose-designed, custom-built, wiki-type) system will use an ongoing and iterative documentation process to facilitate synthesis of up-to-date information and make available its provenance. All participants are required to declare conflicts of interest. This protocol describes three phases: engagement of relevant stakeholders; design of a process to develop clinical standards (embodied in indicators) for 'appropriate care' for common medical conditions; and evaluation of our processes, products and feasibility.Methods and analysisA modified e-Delphi process will be used to gain consensus on 'appropriate care' for a range of common medical conditions. Clinical standards and indicators will be developed through searches of national and international guidelines, and formulated with explicit criteria for inclusion, exclusion, time frame and setting. Healthcare professionals and consumers will review the indicators via the wiki-based modified e-Delphi process. Reviewers will declare conflicts of interest which will be recorded and managed according to an established protocol. The provenance of all indicators and suggestions included or excluded will be logged from indicator inception to finalisation. A mixed-methods formative evaluation of our research methodology will be undertaken.Ethics and disseminationHuman Research Ethics Committee approval has been received from the University of South Australia. We will submit the results of the study to relevant journals and offer national and international presentations.

Project description:BackgroundDispensed prescription medicine labels (prescription labels) are important information sources supporting safe and appropriate medicines use.ObjectiveTo develop and user test patient-centred prescription label formats.MethodsFive stages: developing 12 labels for four fictitious medicines of varying dosage forms; diagnostic user testing of labels (Round 1) with 40 consumers (each testing three labels); iterative label revision, and development of Round 2 labels (n = 7); user testing of labels (Round 2) with 20 consumers (each testing four labels); labelling recommendations. Evaluated labels stated the active ingredient and brand name, using various design features (eg upper case and bold). Dosing was expressed differently across labels: frequency of doses/day, approximate times of day (eg morning), explicit times (eg 7 to 9 AM), and/or explicit dosing interval. Participants' ability to find and understand medicines information and plan a dosing schedule were assessed.ResultsParticipants demonstrated satisfactory ability to find and understand the dosage for all label formats. Excluding active ingredient and dosing schedule, 14/19 labels (8/12 in Round 1; 6/7 in Round 2) met industry standard on performance. Participants' ability to correctly identify the active ingredient varied, with clear medicine name sign-posting enabling all participants evaluating these labels to find and understand the active ingredient. When planning a dosing schedule, doses were correctly spaced if the label stated a dosing interval, or frequency of doses/day. Two-thirds planned appropriate dosing schedules using a dosing table.ConclusionsEffective prescription label formatting and sign-posting of active ingredient improved communication of information on labels, potentially supporting safe medicines use.Patient and public involvementConsumers actively contributed to the development of dispensed prescription medicine labels. Feedback from consumers following the first round was incorporated in revisions of the labels for the next round. Patient and public involvement in this study was critical to the development of readable and understandable dispensed prescription medicine labels.

Project description:BACKGROUND:Microbial communities play a crucial role in our environment and may influence human health tremendously. Despite being the place where human interaction is most abundant we still know little about the urban microbiome. This is highlighted by the large amount of unclassified DNA reads found in urban metagenome samples. The only in silico approach that allows us to find unknown species, is the assembly and classification of draft genomes from a metagenomic dataset. In this study we (1) investigate the applicability of an assembly and binning approach for urban metagenome datasets, and (2) develop a new method for the generation of in silico gold standards to better understand the specific challenges of such datasets and provide a guide in the selection of available software. RESULTS:We applied combinations of three assembly (Megahit, SPAdes and MetaSPAdes) and three binning tools (MaxBin, MetaBAT and CONCOCT) to whole genome shotgun datasets from the CAMDA 2017 Challenge. Complex in silico gold standards with a simulated bacterial fraction were generated for representative samples of each surface type and city. Using these gold standards, we found the combination of SPAdes and MetaBAT to be optimal for urban metagenome datasets by providing the best trade-off between the number of high-quality genome draft bins (MIMAG standards) retrieved, the least amount of misassemblies and contamination. The assembled draft genomes included known species like Propionibacterium acnes but also novel species according to respective ANI values. CONCLUSIONS:In our work, we showed that, even for datasets with high diversity and low sequencing depth from urban environments, assembly and binning-based methods can provide high-quality genome drafts. Of vital importance to retrieve high-quality genome drafts is sequence depth but even more so a high proportion of the bacterial sequence fraction too achieve high coverage for bacterial genomes. In contrast to read-based methods relying on database knowledge, genome-centric methods as applied in this study can provide valuable information about unknown species and strains as well as functional contributions of single community members within a sample. Furthermore, we present a method for the generation of sample-specific highly complex in silico gold standards. REVIEWERS:This article was reviewed by Craig Herbold, Serghei Mangul and Yana Bromberg.

Dataset Information

Developing standards for the microbiome field.

Background

Results

Conclusions

Publications

Developing standards for the microbiome field.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets