Dataset Information

Comparing somatic mutation-callers: beyond Venn diagrams.

ABSTRACT:

Background

Somatic mutation-calling based on DNA from matched tumor-normal patient samples is one of the key tasks carried by many cancer genome projects. One such large-scale project is The Cancer Genome Atlas (TCGA), which is now routinely compiling catalogs of somatic mutations from hundreds of paired tumor-normal DNA exome-sequence data. Nonetheless, mutation calling is still very challenging. TCGA benchmark studies revealed that even relatively recent mutation callers from major centers showed substantial discrepancies. Evaluation of the mutation callers or understanding the sources of discrepancies is not straightforward, since for most tumor studies, validation data based on independent whole-exome DNA sequencing is not available, only partial validation data for a selected (ascertained) subset of sites.

Results

To provide guidelines to comparing outputs from multiple callers, we have analyzed two sets of mutation-calling data from the TCGA benchmark studies and their partial validation data. Various aspects of the mutation-calling outputs were explored to characterize the discrepancies in detail. To assess the performances of multiple callers, we introduce four approaches utilizing the external sequence data to varying degrees, ranging from having independent DNA-seq pairs, RNA-seq for tumor samples only, the original exome-seq pairs only, or none of those.

Conclusions

Our analyses provide guidelines to visualizing and understanding the discrepancies among the outputs from multiple callers. Furthermore, applying the four evaluation approaches to the whole exome data, we illustrate the challenges and highlight the various circumstances that require extra caution in assessing the performances of multiple callers.

SUBMITTER: Kim SY

PROVIDER: S-EPMC3702398 | biostudies-literature | 2013 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparing somatic mutation-callers: beyond Venn diagrams.

Kim Su Yeon SY Speed Terence P TP

BMC bioinformatics 20130610

<h4>Background</h4>Somatic mutation-calling based on DNA from matched tumor-normal patient samples is one of the key tasks carried by many cancer genome projects. One such large-scale project is The Cancer Genome Atlas (TCGA), which is now routinely compiling catalogs of somatic mutations from hundreds of paired tumor-normal DNA exome-sequence data. Nonetheless, mutation calling is still very challenging. TCGA benchmark studies revealed that even relatively recent mutation callers from major cen ...[more]

PMID: 23758877

Similar Datasets

Project description:BackgroundMitigation of the spread of infection relies on targeted approaches aimed at preventing nonhousehold interactions. Contact tracing in the form of digital proximity tracing apps has been widely adopted in multiple countries due to its perceived added benefits of tracing speed and breadth in comparison to traditional manual contact tracing. Assessments of user responses to exposure notifications through a guided approach can provide insights into the effect of digital proximity tracing app use on managing the spread of SARS-CoV-2.ObjectiveThe aim of this study was to demonstrate the use of Venn diagrams to investigate the contributions of digital proximity tracing app exposure notifications and subsequent mitigative actions in curbing the spread of SARS-CoV-2 in Switzerland.MethodsWe assessed data from 4 survey waves (December 2020 to March 2021) from a nationwide panel study (COVID-19 Social Monitor) of Swiss residents who were (1) nonusers of the SwissCovid app, (2) users of the SwissCovid app, or (3) users of the SwissCovid app who received exposure notifications. A Venn diagram approach was applied to describe the overlap or nonoverlap of these subpopulations and to assess digital proximity tracing app use and its associated key performance indicators, including actions taken to prevent SARS-CoV-2 transmission.ResultsWe included 12,525 assessments from 2403 participants, of whom 50.9% (1222/2403) reported not using the SwissCovid digital proximity tracing app, 49.1% (1181/2403) reported using the SwissCovid digital proximity tracing app and 2.5% (29/1181) of the digital proximity tracing app users reported having received an exposure notification. Most digital proximity tracing app users (75.9%, 22/29) revealed taking at least one recommended action after receiving an exposure notification, such as seeking SARS-CoV-2 testing (17/29, 58.6%) or calling a federal information hotline (7/29, 24.1%). An assessment of key indicators of mitigative actions through a Venn diagram approach reveals that 30% of digital proximity tracing app users (95% CI 11.9%-54.3%) also tested positive for SARS-CoV-2 after having received exposure notifications, which is more than 3 times that of digital proximity tracing app users who did not receive exposure notifications (8%, 95% CI 5%-11.9%).ConclusionsResponses in the form of mitigative actions taken by 3 out of 4 individuals who received exposure notifications reveal a possible contribution of digital proximity tracing apps in mitigating the spread of SARS-CoV-2. The application of a Venn diagram approach demonstrates its value as a foundation for researchers and health authorities to assess population-level digital proximity tracing app effectiveness by providing an intuitive approach for calculating key performance indicators.

Project description:BackgroundDriven by high throughput next generation sequencing technologies and the pressing need to decipher cancer genomes, computational approaches for detecting somatic single nucleotide variants (sSNVs) have undergone dramatic improvements during the past 2 years. The recently developed tools typically compare a tumor sample directly with a matched normal sample at each variant locus in order to increase the accuracy of sSNV calling. These programs also address the detection of sSNVs at low allele frequencies, allowing for the study of tumor heterogeneity, cancer subclones, and mutation evolution in cancer development.MethodsWe used whole genome sequencing (Illumina Genome Analyzer IIx platform) of a melanoma sample and matched blood, whole exome sequencing (Illumina HiSeq 2000 platform) of 18 lung tumor-normal pairs and seven lung cancer cell lines to evaluate six tools for sSNV detection: EBCall, JointSNVMix, MuTect, SomaticSniper, Strelka, and VarScan 2, with a focus on MuTect and VarScan 2, two widely used publicly available software tools. Default/suggested parameters were used to run these tools. The missense sSNVs detected in these samples were validated through PCR and direct sequencing of genomic DNA from the samples. We also simulated 10 tumor-normal pairs to explore the ability of these programs to detect low allelic-frequency sSNVs.ResultsOut of the 237 sSNVs successfully validated in our cancer samples, VarScan 2 and MuTect detected the most of any tools (that is, 204 and 192, respectively). MuTect identified 11 more low-coverage validated sSNVs than VarScan 2, but missed 11 more sSNVs with alternate alleles in normal samples than VarScan 2. When examining the false calls of each tool using 169 invalidated sSNVs, we observed >63% false calls detected in the lung cancer cell lines had alternate alleles in normal samples. Additionally, from our simulation data, VarScan 2 identified more sSNVs than other tools, while MuTect characterized most low allelic-fraction sSNVs.ConclusionsOur study explored the typical false-positive and false-negative detections that arise from the use of sSNV-calling tools. Our results suggest that despite recent progress, these tools have significant room for improvement, especially in the discrimination of low coverage/allelic-frequency sSNVs and sSNVs with alternate alleles in normal samples.

Dataset Information

Comparing somatic mutation-callers: beyond Venn diagrams.

Background

Results

Conclusions

Publications

Comparing somatic mutation-callers: beyond Venn diagrams.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets