Dataset Information

Benchmarking bacterial genome-wide association study methods using simulated genomes and phenotypes.

ABSTRACT: Genome-wide association studies (GWASs) have the potential to reveal the genetics of microbial phenotypes such as antibiotic resistance and virulence. Capitalizing on the growing wealth of bacterial sequence data, microbial GWAS methods aim to identify causal genetic variants while ignoring spurious associations. Bacteria reproduce clonally, leading to strong population structure and genome-wide linkage, making it challenging to separate true 'hits' (i.e. mutations that cause a phenotype) from non-causal linked mutations. GWAS methods attempt to correct for population structure in different ways, but their performance has not yet been systematically and comprehensively evaluated under a range of evolutionary scenarios. Here, we developed a bacterial GWAS simulator (BacGWASim) to generate bacterial genomes with varying rates of mutation, recombination and other evolutionary parameters, along with a subset of causal mutations underlying a phenotype of interest. We assessed the performance (recall and precision) of three widely used single-locus GWAS approaches (cluster-based, dimensionality-reduction and linear mixed models, implemented in plink, pyseer and gemma) and one relatively new multi-locus model implemented in pyseer, across a range of simulated sample sizes, recombination rates and causal mutation effect sizes. As expected, all methods performed better with larger sample sizes and effect sizes. The performance of clustering and dimensionality reduction approaches to correct for population structure were considerably variable according to the choice of parameters. Notably, the multi-locus elastic net (lasso) approach was consistently amongst the highest-performing methods, and had the highest power in detecting causal variants with both low and high effect sizes. Most methods reached the level of good performance (recall >0.75) for identifying causal mutations of strong effect size [log odds ratio (OR) ?2] with a sample size of 2000 genomes. However, only elastic nets reached the level of reasonable performance (recall=0.35) for detecting markers with weaker effects (log OR ~1) in smaller samples. Elastic nets also showed superior precision and recall in controlling for genome-wide linkage, relative to single-locus models. However, all methods performed relatively poorly on highly clonal (low-recombining) genomes, suggesting room for improvement in method development. These findings show the potential for multi-locus models to improve bacterial GWAS performance. BacGWASim code and simulated data are publicly available to enable further comparisons and benchmarking of new methods.

SUBMITTER: Saber MM

PROVIDER: S-EPMC7200059 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Benchmarking bacterial genome-wide association study methods using simulated genomes and phenotypes.

Saber Morteza M MM Shapiro B Jesse BJ

Microbial genomics 20200301 3

Genome-wide association studies (GWASs) have the potential to reveal the genetics of microbial phenotypes such as antibiotic resistance and virulence. Capitalizing on the growing wealth of bacterial sequence data, microbial GWAS methods aim to identify causal genetic variants while ignoring spurious associations. Bacteria reproduce clonally, leading to strong population structure and genome-wide linkage, making it challenging to separate true 'hits' (i.e. mutations that cause a phenotype) from n ...[more]

PMID: 32100713

Similar Datasets

Project description:Data-Dependent and Data-Independent Acquisition modes (DDA and DIA, respectively) are both widely used to acquire MS2 spectra in untargeted liquid chromatography tandem mass spectrometry (LC-MS/MS) metabolomics analyses. Despite their wide use, little work has been attempted to systematically compare their MS/MS spectral annotation performance in untargeted settings due to the lack of ground truth and the costs involved in running a large number of acquisitions. Here, we present a systematic in silico comparison of these two acquisition methods in untargeted metabolomics by extending our Virtual Metabolomics Mass Spectrometer (ViMMS) framework with a DIA module. Our results show that the performance of these methods varies with the average number of co-eluting ions as the most important factor. At low numbers, DIA outperforms DDA, but at higher numbers, DDA has an advantage as DIA can no longer deal with the large amount of overlapping ion chromatograms. Results from simulation were further validated on an actual mass spectrometer, demonstrating that using ViMMS we can draw conclusions from simulation that translate well into the real world. The versatility of the Virtual Metabolomics Mass Spectrometer (ViMMS) framework in simulating different parameters of both Data-Dependent and Data-Independent Acquisition (DDA and DIA) modes is a key advantage of this work. Researchers can easily explore and compare the performance of different acquisition methods within the ViMMS framework, without the need for expensive and time-consuming experiments with real experimental data. By identifying the strengths and limitations of each acquisition method, researchers can optimize their choice and obtain more accurate and robust results. Furthermore, the ability to simulate and validate results using the ViMMS framework can save significant time and resources, as it eliminates the need for numerous experiments. This work not only provides valuable insights into the performance of DDA and DIA, but it also opens the door for further advancements in LC-MS/MS data acquisition methods.

Project description:Numerous studies suggest genetic influences on sleepiness and circadian rhythms. The Sleep Heart Health Study collected questionnaire data on sleep habits and sleepiness from 2848 Framingham Heart Study Offspring Cohort participants. More than 700 participants were genotyped using the Affymetrix 100K SNP GeneChip, providing a unique opportunity to assess genetic linkage and association of these traits.Sleepiness (defined as the Epworth Sleepiness Scale score), usual bedtime and usual sleep duration were assessed by self-completion questionnaire. Standardized residual measures adjusted for age, sex and BMI were analyzed. Multipoint variance components linkage analysis was performed. Association of SNPs to sleep phenotypes was analyzed with both population-based and family-based association tests, with analysis limited to 70,987 autosomal SNPs with minor allele frequency > or =10%, call rate > or =80%, and no significant deviation from Hardy-Weinberg equilibrium (p > or = 0.001).Heritability of sleepiness was 0.29, bedtime 0.22, and sleep duration 0.17. Both genotype and sleep phenotype data were available for 749 subjects. Linkage analysis revealed five linkage peaks of LOD >2: four to usual bedtime, one to sleep duration. These peaks include several candidate sleep-related genes, including CSNK2A2, encoding a known component of the circadian molecular clock, and PROK2, encoding a putative transmitter of the behavioral circadian rhythm from the suprachiasmatic nucleus. Association tests identified an association of usual bedtime with a non-synonymous coding SNP in NPSR1 that has been shown to encode a gain of function mutation of the neuropeptide S receptor, whose endogenous ligand is a potent promoter of wakefulness. Each copy of the minor allele of this SNP was associated with a 15 minute later mean bedtime. The lowest p value was for association of sleepiness with a SNP located in an intron of PDE4D, which encodes a cAMP-specific phosphodiesterase widely expressed in human brain. Full association results are posted at http://www.ncbi.nlm.nih.gov/projects/gap/cgi-bin/study.cgi?id=phs000007 webcite.This analysis confirms prior reports of significant heritability of sleepiness, usual bedtime, and usual sleep duration. Several genetic loci with suggestive linkage to these traits are identified, including linkage peaks containing circadian clock-related genes. Association tests identify NPSR1 and PDE4D as possible mediators of bedtime and sleepiness.

Project description:Many antibacterial drugs have multiple mechanisms of resistance, which are often represented simultaneously by a mixture of resistance mutations (some more frequent than others) in a clinical population. This presents a challenge for Genome-Wide Association Studies (GWAS) methods, making it difficult to detect less prevalent resistance mechanisms purely through (weak) statistical associations. Homoplasy, or the occurrence of multiple independent mutations at the same site, is often observed with drug resistance mutations and can be a strong indicator of positive selection. However, traditional GWAS methods, such as those based on allele counting or linear regression, are not designed to take homoplasy into account. In this article, we present a new method, called ECAT (for Evolutionary Cluster-based Association Test), that extends traditional regression-based GWAS methods with the ability to take advantage of homoplasy. This is achieved through a preprocessing step which identifies hypervariable regions in the genome exhibiting statistically significant clusters of distinct evolutionary changes, to which association testing by a linear mixed model (LMM) is applied using GEMMA (a well-established LMM-based GWAS tool). Thus, the approach can be viewed as extending GEMMA from the usual site- or gene-level analysis to focusing on clustered regions of mutations. This approach was evaluated on a large collection of more than 600 clinical isolates of multidrug-resistant (MDR) Mycobacterium tuberculosis from Lima, Peru. We show that ECAT does a better job of detecting known resistance mutations for several antitubercular drugs (including less prevalent mutations with weaker associations), compared with (site- or gene-based) GEMMA, as representative of existing GWAS methods. The power of the multiphase approach in ECAT comes from focusing association testing on the hypervariable regions of the genome, which reduces complexity in the model and increases statistical power.

Dataset Information

Benchmarking bacterial genome-wide association study methods using simulated genomes and phenotypes.

Publications

Benchmarking bacterial genome-wide association study methods using simulated genomes and phenotypes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets