Dataset Information

Relative Model Fit Does Not Predict Topological Accuracy in Single-Gene Protein Phylogenetics.

ABSTRACT: It is regarded as best practice in phylogenetic reconstruction to perform relative model selection to determine an appropriate evolutionary model for the data. This procedure ranks a set of candidate models according to their goodness of fit to the data, commonly using an information theoretic criterion. Users then specify the best-ranking model for inference. Although it is often assumed that better-fitting models translate to increase accuracy, recent studies have shown that the specific model employed may not substantially affect inferences. We examine whether there is a systematic relationship between relative model fit and topological inference accuracy in protein phylogenetics, using simulations and real sequences. Simulations employed site-heterogeneous mechanistic codon models that are distinct from protein-level phylogenetic inference models, allowing us to investigate how protein models performs when they are misspecified to the data, as will be the case for any real sequence analysis. We broadly find that phylogenies inferred across models with vastly different fits to the data produce highly consistent topologies. We additionally find that all models infer similar proportions of false-positive splits, raising the possibility that all available models of protein evolution are similarly misspecified. Moreover, we find that the parameter-rich GTR (general time reversible) model, whose amino acid exchangeabilities are free parameters, performs similarly to models with fixed exchangeabilities, although the inference precision associated with GTR models was not examined. We conclude that, although relative model selection may not hinder phylogenetic analysis on protein data, it may not offer specific predictable improvements and is not a reliable proxy for accuracy.

SUBMITTER: Spielman SJ

PROVIDER: S-EPMC7306691 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Relative Model Fit Does Not Predict Topological Accuracy in Single-Gene Protein Phylogenetics.

Spielman Stephanie J SJ

Molecular biology and evolution 20200701 7

It is regarded as best practice in phylogenetic reconstruction to perform relative model selection to determine an appropriate evolutionary model for the data. This procedure ranks a set of candidate models according to their goodness of fit to the data, commonly using an information theoretic criterion. Users then specify the best-ranking model for inference. Although it is often assumed that better-fitting models translate to increase accuracy, recent studies have shown that the specific model ...[more]

PMID: 32191313

Similar Datasets

Project description:Meningiomas, the most common adult brain tumors, recur in up to half of cases. This requires timely intervention and therefore accurate risk assessment of recurrence is essential. Our current practice relies heavily on histological grade and extent of surgical excision to predict meningioma recurrence. However, prediction accuracy can be as poor as 50% for low or intermediate grade tumors which constitute the majority of cases. Moreover, attempts to find molecular markers to predict their recurrence have been impeded by low or heterogenous genetic signal. We therefore sought to apply systems-biology approaches to transcriptomic data to better predict meningioma recurrence. We apply gene co-expression networks to a cohort of 252 adult patients from the publicly available genetic repository Gene Expression Omnibus. Resultant gene clusters ("modules") were represented by the first principle component of their expression, and their ability to predict recurrence assessed with a logistic regression model. External validation was done using two independent samples: one merged microarray-based cohort with a total of 108 patients and one RNA-seq-based cohort with 145 patients, using the same modules. We used the bioinformatics database Enrichr to examine the gene ontology associations and driver transcription factors of each module. Using gene co-expression analysis, we were able predict tumor recurrence with high accuracy using a single module which mapped to cell cycle-related processes (AUC of 0.81?±?0.09 and 0.77?±?0.10 in external validation using microarray and RNA-seq data, respectively). This module remained predictive when controlling for WHO grade in all cohorts, and was associated with several cancer-associated transcription factors which may serve as novel therapeutic targets for patients with this disease. With the easy accessibility of gene panels in healthcare diagnostics, our results offer a basis for routine molecular testing in meningioma management and propose potential therapeutic targets for future research.

Project description:Colorectal cancer (CRC) has high incidence and is associated with high case fatality. In France, the 5-year survival, pooled across all cancer stages at diagnosis, ranges from 57% in men to 60% in women. About one third of patients diagnosed with CRC will develop a metachronous recurrence during the following years. It is of paramount importance to accurately identify factors associated with the increased risk of progression and death, in order to develop effective follow-up and treatment strategies. However, to accurately assess the role of patients’ specific characteristics in the progression of cancer several methodological challenges need to be overcome. One difficulty, common to prognostic studies of cancer, concerns the need to separate the effects of prognostic factors on different clinical endpoints, such as disease recurrence vs recurrence-free death. Another difficulty, encountered in prognostic studies, is that the cause of death is not available or not accurately coded. Yet, some patients are likely to die of causes not related to the disease of primary interest, especially in cancers with longer survival and in those that affect older subjects. Until recently, the existing statistical methodology was not able to simultaneously, deal with both difficulties, i.e. to account for (i) possibly different effects of prognostic factors on death vs recurrence, and (ii) unknown causes of death. However, this challenge has been addressed by the recent development of the Markov relative survival model (MRS) , which extends the Markov multi-state model to incorporate relative survival modelling. Simulations demonstrate that MRS is able to accurately estimate different effects of prognostic factors on the risk of each of several events, including separate effects on disease-specific vs other causes of death. To date, the MRS had not been applied in clinical or epidemiological studies. The aim of this study was to assess the potential advantages of the new multi-state relative survival model (MRS), proposed by Huszti et al. (2012), in a prognostic cancer study. To this end, we compared the MRS results with those obtained with two more conventional analyses, based on Cox’s proportional hazards model, and the multi-state Markov model proposed by Alioum and Commenges (2001). The three models were applied to explore the impact of prognostic factors on cancer-specific mortality and recurrence, in a large population-based French registry of colorectal cancer, with up to 25 years of follow-up.

Dataset Information

Relative Model Fit Does Not Predict Topological Accuracy in Single-Gene Protein Phylogenetics.

Publications

Relative Model Fit Does Not Predict Topological Accuracy in Single-Gene Protein Phylogenetics.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets