Developing and evaluating polygenic risk prediction models for stratified disease prevention.
Ontology highlight
ABSTRACT:
SUBMITTER: Chatterjee N
PROVIDER: S-EPMC6021129 | biostudies-literature | 2016 Jul
REPOSITORIES: biostudies-literature
Publications
Developing and evaluating polygenic risk prediction models for stratified disease prevention.
Chatterjee Nilanjan N Shi Jianxin J García-Closas Montserrat M
Nature reviews. Genetics 20160503 7
Knowledge of genetics and its implications for human health is rapidly evolving in accordance with recent events, such as discoveries of large numbers of disease susceptibility loci from genome-wide association studies, the US Supreme Court ruling of the non-patentability of human genes, and the development of a regulatory framework for commercial genetic tests. In anticipation of the increasing relevance of genetic testing for the assessment of disease risks, this Review provides a summary of t ...[more]
Similar Datasets
Project description:Panel current status data arise frequently in biomedical studies when the occurrence of a particular clinical condition is only examined at several prescheduled visit times. Existing methods for analyzing current status data have largely focused on regression modeling based on commonly used survival models such as the proportional hazards model and the accelerated failure time model. However, these procedures have the limitations of being difficult to implement and performing sub-optimally in relatively small sample sizes. The performance of these procedures is also unclear under model misspecification. In addition, no methods currently exist to evaluate the prediction performance of estimated risk models with panel current status data. In this paper, we propose a simple estimator under a general class of nonparametric transformation (NPT) models by fitting a logistic regression working model and demonstrate that our proposed estimator is consistent for the NPT model parameter up to a scale multiplier. Furthermore, we propose nonparametric estimators for evaluating the prediction performance of the risk score derived from model fitting, which is valid regardless of the adequacy of the fitted model. Extensive simulation results suggest that our proposed estimators perform well in finite samples and the regression parameter estimators outperform existing estimators under various scenarios. We illustrate the proposed procedures using data from the Framingham Offspring Study.
| S-EPMC8168594 | biostudies-literature
Project description:Background and objectivesAlzheimer disease (AD) has a polygenic architecture, for which genome-wide association studies (GWAS) have helped elucidate sequence variants (SVs) influencing susceptibility. Polygenic risk score (PRS) approaches show promise for generating summary measures of inherited risk for clinical AD based on the effects of APOE and other GWAS hits. However, existing PRS approaches, based on traditional regression models, explain only modest variation in AD dementia risk and AD-related endophenotypes. We hypothesized that machine learning (ML) models of polygenic risk (ML-PRS) could outperform standard regression-based PRS methods and therefore have the potential for greater clinical utility.MethodsWe analyzed combined data from the Mayo Clinic Study of Aging (n = 1,791) and the Alzheimer's Disease Neuroimaging Initiative (n = 864). An AD PRS was computed for each participant using the top common SVs obtained from a large AD dementia GWAS. In parallel, ML models were trained using those SV genotypes, with amyloid PET burden as the primary outcome. Secondary outcomes included amyloid PET positivity and clinical diagnosis (cognitively unimpaired vs impaired). We compared performance between ML-PRS and standard PRS across 100 training sessions with different data splits. In each session, data were split into 80% training and 20% testing, and then five-fold cross-validation was used within the training set to ensure the best model was produced for testing. We also applied permutation importance techniques to assess which genetic factors contributed most to outcome prediction.ResultsML-PRS models outperformed the AD PRS (r2 = 0.28 vs r2 = 0.24 in test set) in explaining variation in amyloid PET burden. Among ML approaches, methods accounting for nonlinear genetic influences were superior to linear methods. ML-PRS models were also more accurate when predicting amyloid PET positivity (area under the curve [AUC] = 0.80 vs AUC = 0.63) and the presence of cognitive impairment (AUC = 0.75 vs AUC = 0.54) compared with the standard PRS.DiscussionWe found that ML-PRS approaches improved upon standard PRS for prediction of AD endophenotypes, partly related to improved accounting for nonlinear effects of genetic susceptibility alleles. Further adaptations of the ML-PRS framework could help to close the gap of remaining unexplained heritability for AD and therefore facilitate more accurate presymptomatic and early-stage risk stratification for clinical decision-making.
| S-EPMC10798228 | biostudies-literature
Project description:Genetic data consists of a wide range of marker types, including common, low-frequency, and rare variants. Multiple genetic markers and their interactions play central roles in the heritability of complex disease. In this study, we propose an algorithm that uses a stratified variable selection design by genetic architectures and interaction effects, achieved by a dataset-adaptive W-test. The polygenic sets in all strata were integrated to form a classification rule. The algorithm was applied to the Critical Assessment of Genome Interpretation 4 bipolar challenge sequencing data. The prediction accuracy was 60% using genetic markers on an independent test set. We found that epistasis among common genetic variants contributed most substantially to prediction precision. However, the sample size was not large enough to draw conclusions for the lack of predictability of low-frequency variants and their epistasis.
| S-EPMC5561515 | biostudies-literature
Project description:Polygenic risk score (PRS) is useful for capturing an individual's genetic susceptibility. However, previous studies have not fully exploited the potential of the risk factor PRS (RFPRS) for disease prediction. We explored the potential of integrating disease-related RFPRSs with disease PRS to enhance disease prediction performance. We constructed 112 RFPRSs and analyzed the association of RFPRSs with diseases to identify disease-related RFPRSs in 700 diseases, using the UK Biobank dataset. We uncovered 6157 statistically significant associations between 247 diseases and 109 RFPRSs. We estimated the disease PRSs of 70 diseases that exhibited statistically significant heritability, to generate RFDiseasemetaPRS-a combined PRS integrating RFPRSs and disease PRS-and compare the prediction performance metrics between RFDiseasemetaPRS and disease PRS. RFDiseasemetaPRS showed better performance for Nagelkerke's pseudo-R2, odds ratio (OR) per 1 SD, net reclassification improvement (NRI) values and difference of R2 considered by variance of R2 in 31 out of 70 diseases. Additionally, we assessed risk classification between two models by examining OR between the top 10% and remaining 90% individuals for the 31 diseases; RFDiseasemetaPRS exhibited better R2, NRI and OR than disease PRS. These findings highlight the importance of utilizing RFDiseasemetaPRS, which can provide personalized healthcare and tailored prevention strategies.
| S-EPMC10864389 | biostudies-literature
Project description:We propose and study two criteria to assess the usefulness of models that predict risk of disease incidence for screening and prevention, or the usefulness of prognostic models for management following disease diagnosis. The first criterion, the proportion of cases followed?PCF?(q), is the proportion of individuals who will develop disease who are included in the proportion?q?of individuals in the population at highest risk. The second criterion is the proportion needed to follow-up,?PNF?(p), namely the proportion of the general population at highest risk that one needs to follow in order that a proportion?p?of those destined to become cases will be followed.?PCF?(q)?assesses the effectiveness of a program that follows?100q% of the population at highest risk.?PNF?(p)?assess the feasibility of covering?100p% of cases by indicating how much of the population at highest risk must be followed. We show the relationship of those two criteria to the Lorenz curve and its inverse, and present distribution theory for estimates of?PCF?and?PNF. We develop new methods, based on influence functions, for inference for a single risk model, and also for comparing the?PCFs and?PNFs of two risk models, both of which were evaluated in the same validation data.
| S-EPMC3135785 | biostudies-literature
Project description:BackgroundRisk prediction models incorporating single nucleotide polymorphisms (SNPs) could lead to individualized prevention of colorectal cancer (CRC). However, the added value of incorporating SNPs into models with only traditional risk factors is still not clear. Hence, our primary aim was to summarize literature on risk prediction models including genetic variants for CRC, while our secondary aim was to evaluate the improvement of discriminatory accuracy when adding SNPs to a prediction model with only traditional risk factors.MethodsWe conducted a systematic review on prediction models incorporating multiple SNPs for CRC risk prediction. We tested whether a significant trend in the increase of Area Under Curve (AUC) according to the number of SNPs could be observed, and estimated the correlation between AUC improvement and number of SNPs. We estimated pooled AUC improvement for SNP-enhanced models compared with non-SNP-enhanced models using random effects meta-analysis, and conducted meta-regression to investigate the association of specific factors with AUC improvement.ResultsWe included 33 studies, 78.79% using genetic risk scores to combine genetic data. We found no significant trend in AUC improvement according to the number of SNPs (p for trend = 0.774), and no correlation between the number of SNPs and AUC improvement (p = 0.695). Pooled AUC improvement was 0.040 (95% CI: 0.035, 0.045), and the number of cases in the study and the AUC of the starting model were inversely associated with AUC improvement obtained when adding SNPs to a prediction model. In addition, models constructed in Asian individuals achieved better AUC improvement with the incorporation of SNPs compared with those developed among individuals of European ancestry.ConclusionsThough not conclusive, our results provide insights on factors influencing discriminatory accuracy of SNP-enhanced models. Genetic variants might be useful to inform stratified CRC screening in the future, but further research is needed.
| S-EPMC8760647 | biostudies-literature
Project description:MOTIVATION:Polygenic risk score (PRS) methods based on genome-wide association studies (GWAS) have a potential for predicting the risk of developing complex diseases and are expected to become more accurate with larger training datasets and innovative statistical methods. The area under the ROC curve (AUC) is often used to evaluate the performance of PRSs, which requires individual genotypic and phenotypic data in an independent GWAS validation dataset. We are motivated to develop methods for approximating AUC of PRSs based on the summary level data of the validation dataset, which will greatly facilitate the development of PRS models for complex diseases. RESULTS:We develop statistical methods and an R package SummaryAUC for approximating the AUC and its variance of a PRS when only the summary level data of the validation dataset are available. SummaryAUC can be applied to PRSs with SNPs either genotyped or imputed in the validation dataset. We examined the performance of SummaryAUC using a large-scale GWAS of schizophrenia. SummaryAUC provides accurate approximations to AUCs and their variances. The bias of AUC is typically <0.5% in most analyses. SummaryAUC cannot be applied to PRSs that use all SNPs in the genome because it is computationally prohibitive. AVAILABILITY AND IMPLEMENTATION:https://github.com/lsncibb/SummaryAUC. SUPPLEMENTARY INFORMATION:Supplementary data are available at Bioinformatics online.
| S-EPMC6931355 | biostudies-literature
Project description:The identification of subjects at high risk for Alzheimer's disease is important for prognosis and early intervention. We investigated the polygenic architecture of Alzheimer's disease and the accuracy of Alzheimer's disease prediction models, including and excluding the polygenic component in the model. This study used genotype data from the powerful dataset comprising 17 008 cases and 37 154 controls obtained from the International Genomics of Alzheimer's Project (IGAP). Polygenic score analysis tested whether the alleles identified to associate with disease in one sample set were significantly enriched in the cases relative to the controls in an independent sample. The disease prediction accuracy was investigated in a subset of the IGAP data, a sample of 3049 cases and 1554 controls (for whom APOE genotype data were available) by means of sensitivity, specificity, area under the receiver operating characteristic curve (AUC) and positive and negative predictive values. We observed significant evidence for a polygenic component enriched in Alzheimer's disease (P = 4.9 × 10(-26)). This enrichment remained significant after APOE and other genome-wide associated regions were excluded (P = 3.4 × 10(-19)). The best prediction accuracy AUC = 78.2% (95% confidence interval 77-80%) was achieved by a logistic regression model with APOE, the polygenic score, sex and age as predictors. In conclusion, Alzheimer's disease has a significant polygenic component, which has predictive utility for Alzheimer's disease risk and could be a valuable research tool complementing experimental designs, including preventative clinical trials, stem cell selection and high/low risk clinical studies. In modelling a range of sample disease prevalences, we found that polygenic scores almost doubles case prediction from chance with increased prediction at polygenic extremes.
| S-EPMC5006219 | biostudies-literature
Project description:Objective:Genome-wide association studies (GWAS) have identified over 30 susceptibility loci associated with Alzheimer's disease (AD). Using AD GWAS data from the International Genomics of Alzheimer's Project (IGAP), Polygenic Risk Score (PRS) was successfully applied to predict life time risk of AD development. A recently introduced Polygenic Hazard Score (PHS) is able to quantify individuals with age-specific genetic risk for AD. The aim of this study was to quantify the age-specific genetic risk for AD with PRS and compare the results generated by PRS with those from PHS. Methods:Quantification of individual differences in age-specific genetic risk for AD identified by the PRS, was performed with Cox Regression on 9903 (2626 cases and 7277 controls) individuals from the Genetic and Environmental Risk in Alzheimer's Disease consortium (GERAD). Polygenic Hazard Scores were generated for the same individuals. The age-specific genetic risk for AD identified by the PRS was compared with that generated by the PHS. This was repeated using varying SNPs P-value thresholds for disease association. Results:Polygenic Risk Score significantly predicted the risk associated with age at AD onset when SNPs were preselected for association to AD at P ? 0.001. The strongest effect (B = 0.28, SE = 0.04, P = 2.5 × 10-12) was observed for PRS based upon genome-wide significant SNPs (P ? 5 × 10-8). The strength of association was weaker with less stringent SNP selection thresholds. Interpretation:Both PRS and PHS can be used to predict an age-specific risk for developing AD. The PHS approach uses SNP effect sizes derived with the Cox Proportional Hazard Regression model. When SNPs were selected based upon AD GWAS case/control P ? 10-3, we found no advantage of using SNP effects sizes calculated with the Cox Proportional Hazard Regression model in our study. When SNPs are selected for association with AD risk at P > 10-3, the age-specific risk prediction results are not significant for either PRS or PHS. However PHS could be more advantageous than PRS of age specific AD risk predictions when SNPs are prioritized for association with AD age at onset (i.e., powerful Cox Regression GWAS study).
| S-EPMC6414493 | biostudies-literature
Project description:PurposeTo develop and evaluate the performance of a polygenic risk score (PRS) constructed in a Korean male population to predict clinically significant prostate cancer (csPCa).Materials and methodsTotal 2,702 PCa samples and 7,485 controls were used to discover csPCa susceptible single nucleotide polymorphisms (SNPs). Males with biopsy-proven or post-radical prostatectomy Gleason score 7 or higher were included for analysis. After genotype imputation for quality control, logistic regression models were applied to test association and calculate effect size. Extracted candidate SNPs were further tested to compare predictive performance according to number of SNPs included in the PRS. The best-fit model was validated in an independent cohort of 311 cases and 822 controls.ResultsOf the 83 candidate SNPs with significant PCa association reported in previous literature, rs72725879 located in PRNCR1 showed the highest significance for PCa risk (odds ratio, 0.597; 95% confidence interval [CI], 0.555-0.641; p=4.3×10-45). Thirty-two SNPs within 26 distinct loci were further selected for PRS construction. Best performance was found with the top 29 SNPs, with AUC found to be 0.700 (95% CI, 0.667-0.734). Males with very-high PRS (above the 95th percentile) had a 4.92-fold increased risk for csPCa.ConclusionsEthnic-specific PRS was developed and validated in Korean males to predict csPCa susceptibility using the largest csPCa sample size in Asia. PRS can be a potential biomarker to predict individual risk. Future multi-ethnic trials are required to further validate our results.
| S-EPMC8756152 | biostudies-literature