Developing and evaluating polygenic risk prediction models for stratified disease prevention.
Ontology highlight
ABSTRACT:
SUBMITTER: Chatterjee N
PROVIDER: S-EPMC6021129 | biostudies-literature | 2016 Jul
REPOSITORIES: biostudies-literature
Publications
Developing and evaluating polygenic risk prediction models for stratified disease prevention.
Chatterjee Nilanjan N Shi Jianxin J García-Closas Montserrat M
Nature reviews. Genetics 20160503 7
Knowledge of genetics and its implications for human health is rapidly evolving in accordance with recent events, such as discoveries of large numbers of disease susceptibility loci from genome-wide association studies, the US Supreme Court ruling of the non-patentability of human genes, and the development of a regulatory framework for commercial genetic tests. In anticipation of the increasing relevance of genetic testing for the assessment of disease risks, this Review provides a summary of t ...[more]
Similar Datasets
Project description:Panel current status data arise frequently in biomedical studies when the occurrence of a particular clinical condition is only examined at several prescheduled visit times. Existing methods for analyzing current status data have largely focused on regression modeling based on commonly used survival models such as the proportional hazards model and the accelerated failure time model. However, these procedures have the limitations of being difficult to implement and performing sub-optimally in relatively small sample sizes. The performance of these procedures is also unclear under model misspecification. In addition, no methods currently exist to evaluate the prediction performance of estimated risk models with panel current status data. In this paper, we propose a simple estimator under a general class of nonparametric transformation (NPT) models by fitting a logistic regression working model and demonstrate that our proposed estimator is consistent for the NPT model parameter up to a scale multiplier. Furthermore, we propose nonparametric estimators for evaluating the prediction performance of the risk score derived from model fitting, which is valid regardless of the adequacy of the fitted model. Extensive simulation results suggest that our proposed estimators perform well in finite samples and the regression parameter estimators outperform existing estimators under various scenarios. We illustrate the proposed procedures using data from the Framingham Offspring Study.
| S-EPMC8168594 | biostudies-literature
Project description:Genetic data consists of a wide range of marker types, including common, low-frequency, and rare variants. Multiple genetic markers and their interactions play central roles in the heritability of complex disease. In this study, we propose an algorithm that uses a stratified variable selection design by genetic architectures and interaction effects, achieved by a dataset-adaptive W-test. The polygenic sets in all strata were integrated to form a classification rule. The algorithm was applied to the Critical Assessment of Genome Interpretation 4 bipolar challenge sequencing data. The prediction accuracy was 60% using genetic markers on an independent test set. We found that epistasis among common genetic variants contributed most substantially to prediction precision. However, the sample size was not large enough to draw conclusions for the lack of predictability of low-frequency variants and their epistasis.
| S-EPMC5561515 | biostudies-literature
Project description:We propose and study two criteria to assess the usefulness of models that predict risk of disease incidence for screening and prevention, or the usefulness of prognostic models for management following disease diagnosis. The first criterion, the proportion of cases followed?PCF?(q), is the proportion of individuals who will develop disease who are included in the proportion?q?of individuals in the population at highest risk. The second criterion is the proportion needed to follow-up,?PNF?(p), namely the proportion of the general population at highest risk that one needs to follow in order that a proportion?p?of those destined to become cases will be followed.?PCF?(q)?assesses the effectiveness of a program that follows?100q% of the population at highest risk.?PNF?(p)?assess the feasibility of covering?100p% of cases by indicating how much of the population at highest risk must be followed. We show the relationship of those two criteria to the Lorenz curve and its inverse, and present distribution theory for estimates of?PCF?and?PNF. We develop new methods, based on influence functions, for inference for a single risk model, and also for comparing the?PCFs and?PNFs of two risk models, both of which were evaluated in the same validation data.
| S-EPMC3135785 | biostudies-literature
Project description:BackgroundRisk prediction models incorporating single nucleotide polymorphisms (SNPs) could lead to individualized prevention of colorectal cancer (CRC). However, the added value of incorporating SNPs into models with only traditional risk factors is still not clear. Hence, our primary aim was to summarize literature on risk prediction models including genetic variants for CRC, while our secondary aim was to evaluate the improvement of discriminatory accuracy when adding SNPs to a prediction model with only traditional risk factors.MethodsWe conducted a systematic review on prediction models incorporating multiple SNPs for CRC risk prediction. We tested whether a significant trend in the increase of Area Under Curve (AUC) according to the number of SNPs could be observed, and estimated the correlation between AUC improvement and number of SNPs. We estimated pooled AUC improvement for SNP-enhanced models compared with non-SNP-enhanced models using random effects meta-analysis, and conducted meta-regression to investigate the association of specific factors with AUC improvement.ResultsWe included 33 studies, 78.79% using genetic risk scores to combine genetic data. We found no significant trend in AUC improvement according to the number of SNPs (p for trend = 0.774), and no correlation between the number of SNPs and AUC improvement (p = 0.695). Pooled AUC improvement was 0.040 (95% CI: 0.035, 0.045), and the number of cases in the study and the AUC of the starting model were inversely associated with AUC improvement obtained when adding SNPs to a prediction model. In addition, models constructed in Asian individuals achieved better AUC improvement with the incorporation of SNPs compared with those developed among individuals of European ancestry.ConclusionsThough not conclusive, our results provide insights on factors influencing discriminatory accuracy of SNP-enhanced models. Genetic variants might be useful to inform stratified CRC screening in the future, but further research is needed.
| S-EPMC8760647 | biostudies-literature
Project description:MOTIVATION:Polygenic risk score (PRS) methods based on genome-wide association studies (GWAS) have a potential for predicting the risk of developing complex diseases and are expected to become more accurate with larger training datasets and innovative statistical methods. The area under the ROC curve (AUC) is often used to evaluate the performance of PRSs, which requires individual genotypic and phenotypic data in an independent GWAS validation dataset. We are motivated to develop methods for approximating AUC of PRSs based on the summary level data of the validation dataset, which will greatly facilitate the development of PRS models for complex diseases. RESULTS:We develop statistical methods and an R package SummaryAUC for approximating the AUC and its variance of a PRS when only the summary level data of the validation dataset are available. SummaryAUC can be applied to PRSs with SNPs either genotyped or imputed in the validation dataset. We examined the performance of SummaryAUC using a large-scale GWAS of schizophrenia. SummaryAUC provides accurate approximations to AUCs and their variances. The bias of AUC is typically <0.5% in most analyses. SummaryAUC cannot be applied to PRSs that use all SNPs in the genome because it is computationally prohibitive. AVAILABILITY AND IMPLEMENTATION:https://github.com/lsncibb/SummaryAUC. SUPPLEMENTARY INFORMATION:Supplementary data are available at Bioinformatics online.
| S-EPMC6931355 | biostudies-literature
Project description:The identification of subjects at high risk for Alzheimer's disease is important for prognosis and early intervention. We investigated the polygenic architecture of Alzheimer's disease and the accuracy of Alzheimer's disease prediction models, including and excluding the polygenic component in the model. This study used genotype data from the powerful dataset comprising 17 008 cases and 37 154 controls obtained from the International Genomics of Alzheimer's Project (IGAP). Polygenic score analysis tested whether the alleles identified to associate with disease in one sample set were significantly enriched in the cases relative to the controls in an independent sample. The disease prediction accuracy was investigated in a subset of the IGAP data, a sample of 3049 cases and 1554 controls (for whom APOE genotype data were available) by means of sensitivity, specificity, area under the receiver operating characteristic curve (AUC) and positive and negative predictive values. We observed significant evidence for a polygenic component enriched in Alzheimer's disease (P = 4.9 × 10(-26)). This enrichment remained significant after APOE and other genome-wide associated regions were excluded (P = 3.4 × 10(-19)). The best prediction accuracy AUC = 78.2% (95% confidence interval 77-80%) was achieved by a logistic regression model with APOE, the polygenic score, sex and age as predictors. In conclusion, Alzheimer's disease has a significant polygenic component, which has predictive utility for Alzheimer's disease risk and could be a valuable research tool complementing experimental designs, including preventative clinical trials, stem cell selection and high/low risk clinical studies. In modelling a range of sample disease prevalences, we found that polygenic scores almost doubles case prediction from chance with increased prediction at polygenic extremes.
| S-EPMC5006219 | biostudies-literature
Project description:Objective:Genome-wide association studies (GWAS) have identified over 30 susceptibility loci associated with Alzheimer's disease (AD). Using AD GWAS data from the International Genomics of Alzheimer's Project (IGAP), Polygenic Risk Score (PRS) was successfully applied to predict life time risk of AD development. A recently introduced Polygenic Hazard Score (PHS) is able to quantify individuals with age-specific genetic risk for AD. The aim of this study was to quantify the age-specific genetic risk for AD with PRS and compare the results generated by PRS with those from PHS. Methods:Quantification of individual differences in age-specific genetic risk for AD identified by the PRS, was performed with Cox Regression on 9903 (2626 cases and 7277 controls) individuals from the Genetic and Environmental Risk in Alzheimer's Disease consortium (GERAD). Polygenic Hazard Scores were generated for the same individuals. The age-specific genetic risk for AD identified by the PRS was compared with that generated by the PHS. This was repeated using varying SNPs P-value thresholds for disease association. Results:Polygenic Risk Score significantly predicted the risk associated with age at AD onset when SNPs were preselected for association to AD at P ? 0.001. The strongest effect (B = 0.28, SE = 0.04, P = 2.5 × 10-12) was observed for PRS based upon genome-wide significant SNPs (P ? 5 × 10-8). The strength of association was weaker with less stringent SNP selection thresholds. Interpretation:Both PRS and PHS can be used to predict an age-specific risk for developing AD. The PHS approach uses SNP effect sizes derived with the Cox Proportional Hazard Regression model. When SNPs were selected based upon AD GWAS case/control P ? 10-3, we found no advantage of using SNP effects sizes calculated with the Cox Proportional Hazard Regression model in our study. When SNPs are selected for association with AD risk at P > 10-3, the age-specific risk prediction results are not significant for either PRS or PHS. However PHS could be more advantageous than PRS of age specific AD risk predictions when SNPs are prioritized for association with AD age at onset (i.e., powerful Cox Regression GWAS study).
| S-EPMC6414493 | biostudies-literature
Project description:PurposeTo develop and evaluate the performance of a polygenic risk score (PRS) constructed in a Korean male population to predict clinically significant prostate cancer (csPCa).Materials and methodsTotal 2,702 PCa samples and 7,485 controls were used to discover csPCa susceptible single nucleotide polymorphisms (SNPs). Males with biopsy-proven or post-radical prostatectomy Gleason score 7 or higher were included for analysis. After genotype imputation for quality control, logistic regression models were applied to test association and calculate effect size. Extracted candidate SNPs were further tested to compare predictive performance according to number of SNPs included in the PRS. The best-fit model was validated in an independent cohort of 311 cases and 822 controls.ResultsOf the 83 candidate SNPs with significant PCa association reported in previous literature, rs72725879 located in PRNCR1 showed the highest significance for PCa risk (odds ratio, 0.597; 95% confidence interval [CI], 0.555-0.641; p=4.3×10-45). Thirty-two SNPs within 26 distinct loci were further selected for PRS construction. Best performance was found with the top 29 SNPs, with AUC found to be 0.700 (95% CI, 0.667-0.734). Males with very-high PRS (above the 95th percentile) had a 4.92-fold increased risk for csPCa.ConclusionsEthnic-specific PRS was developed and validated in Korean males to predict csPCa susceptibility using the largest csPCa sample size in Asia. PRS can be a potential biomarker to predict individual risk. Future multi-ethnic trials are required to further validate our results.
| S-EPMC8756152 | biostudies-literature
Project description:The availability of data from electronic health records facilitates the development and evaluation of risk-prediction models, but estimation of prediction accuracy could be limited by outcome misclassification, which can arise if events are not captured. We evaluate the robustness of prediction accuracy summaries, obtained from receiver operating characteristic curves and risk-reclassification methods, if events are not captured (i.e., "false negatives"). We derive estimators for sensitivity and specificity if misclassification is independent of marker values. In simulation studies, we quantify the potential for bias in prediction accuracy summaries if misclassification depends on marker values. We compare the accuracy of alternative prognostic models for 30-day all-cause hospital readmission among 4548 patients discharged from the University of Pennsylvania Health System with a primary diagnosis of heart failure. Simulation studies indicate that if misclassification depends on marker values, then the estimated accuracy improvement is also biased, but the direction of the bias depends on the direction of the association between markers and the probability of misclassification. In our application, 29% of the 1143 readmitted patients were readmitted to a hospital elsewhere in Pennsylvania, which reduced prediction accuracy. Outcome misclassification can result in erroneous conclusions regarding the accuracy of risk-prediction models.
| S-EPMC4859766 | biostudies-literature
Project description:BackgroundMany measures of prediction accuracy have been developed. However, the most popular ones in typical medical outcome prediction settings require additional investigation of calibration.MethodsWe show how rescaling the Brier score produces a measure that combines discrimination and calibration in one value and improves interpretability by adjusting for a benchmark model. We have called this measure the index of prediction accuracy (IPA). The IPA permits a common interpretation across binary, time to event, and competing risk outcomes. We illustrate this measure using example datasets.ResultsThe IPA is simple to compute, and example code is provided. The values of the IPA appear very interpretable.ConclusionsIPA should be a prominent measure reported in studies of medical prediction model performance. However, IPA is only a measure of average performance and, by default, does not measure the utility of a medical decision.
| S-EPMC6460739 | biostudies-literature