Quantifying the Predictive Accuracy of a Polygenic Risk Score for Predicting Incident Cancer Cases : Application to the CARTaGENE Cohort.
Ontology highlight
ABSTRACT:
SUBMITTER: Duhaze J
PROVIDER: S-EPMC7193029 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
Quantifying the Predictive Accuracy of a Polygenic Risk Score for Predicting Incident Cancer Cases : Application to the CARTaGENE Cohort.
Duhazé Julianne J Jantzen Rodolphe R Payette Yves Y De Malliard Thibault T Labbé Catherine C Noisel Nolwenn N Broët Philippe P
Frontiers in genetics 20200424
With the increasing use of polygenic risk scores (PRS) there is a need for adapted methods to evaluate the predictivity of these tools. In this work, we propose a new pseudo-<i>R</i> <sup>2</sup> criterion to evaluate PRS predictive accuracy for time-to-event data. This new criterion is related to the score statistic derived under a two-component mixture model. It evaluates the effect of the PRS on both the propensity to experience the event and on the dynamic of the event among the susceptible ...[more]
Similar Datasets
Project description:ImportancePolygenic risk scores comprising millions of single-nucleotide polymorphisms (SNPs) could be useful for population-wide coronary heart disease (CHD) screening.ObjectiveTo determine whether a polygenic risk score improves prediction of CHD compared with a guideline-recommended clinical risk equation.Design, setting, and participantsA retrospective cohort study of the predictive accuracy of a previously validated polygenic risk score was assessed among 4847 adults of white European ancestry, aged 45 through 79 years, participating in the Atherosclerosis Risk in Communities (ARIC) study and 2390 participating in the Multi-Ethnic Study of Atherosclerosis (MESA) from 1996 through December 31, 2015, the final day of follow-up. The performance of the polygenic risk score was compared with that of the 2013 American College of Cardiology and American Heart Association pooled cohort equations.ExposuresGenetic risk was computed for each participant by summing the product of the weights and allele dosage across 6 630 149 SNPs. Weights were based on an international genome-wide association study.Main outcomes and measuresPrediction of 10-year first CHD events (including myocardial infarctions, fatal coronary events, silent infarctions, revascularization procedures, or resuscitated cardiac arrest) assessed using measures of model discrimination, calibration, and net reclassification improvement (NRI).ResultsThe study population included 4847 adults from the ARIC study (mean [SD] age, 62.9 [5.6] years; 56.4% women) and 2390 adults from the MESA cohort (mean [SD] age, 61.8 [9.6] years; 52.2% women). Incident CHD events occurred in 696 participants (14.4%) and 227 participants (9.5%), respectively, over median follow-up of 15.5 years (interquartile range [IQR], 6.3 years) and 14.2 (IQR, 2.5 years) years. The polygenic risk score was significantly associated with 10-year CHD incidence in ARIC with hazard ratios per SD increment of 1.24 (95% CI, 1.15 to 1.34) and in MESA, 1.38 (95% CI, 1.21 to 1.58). Addition of the polygenic risk score to the pooled cohort equations did not significantly increase the C statistic in either cohort (ARIC, change in C statistic, -0.001; 95% CI, -0.009 to 0.006; MESA, 0.021; 95% CI, -0.0004 to 0.043). At the 10-year risk threshold of 7.5%, the addition of the polygenic risk score to the pooled cohort equations did not provide significant improvement in reclassification in either ARIC (NRI, 0.018, 95% CI, -0.012 to 0.036) or MESA (NRI, 0.001, 95% CI, -0.038 to 0.076). The polygenic risk score did not significantly improve calibration in either cohort.Conclusions and relevanceIn this analysis of 2 cohorts of US adults, the polygenic risk score was associated with incident coronary heart disease events but did not significantly improve discrimination, calibration, or risk reclassification compared with conventional predictors. These findings suggest that a polygenic risk score may not enhance risk prediction in a general, white middle-aged population.
| S-EPMC7042849 | biostudies-literature
Project description:Polygenic scores link the genotypes of ancient individuals to their phenotypes, which are often unobservable, offering a tantalizing opportunity to reconstruct complex trait evolution. In practice, however, interpretation of ancient polygenic scores is subject to numerous assumptions. For one, the genome-wide association (GWA) studies from which polygenic scores are derived, can only estimate effect sizes for loci segregating in contemporary populations. Therefore, a GWA study may not correctly identify all loci relevant to trait variation in the ancient population. In addition, the frequencies of trait-associated loci may have changed in the intervening years. Here, we devise a theoretical framework to quantify the effect of this allelic turnover on the statistical properties of polygenic scores as functions of population genetic dynamics, trait architecture, power to detect significant loci, and the age of the ancient sample. We model the allele frequencies of loci underlying trait variation using the Wright-Fisher diffusion, and employ the spectral representation of its transition density to find analytical expressions for several error metrics, including the expected sample correlation between the polygenic scores of ancient individuals and their true phenotypes, referred to as polygenic score accuracy. Our theory also applies to a two-population scenario and demonstrates that allelic turnover alone may explain a substantial percentage of the reduced accuracy observed in cross-population predictions, akin to those performed in human genetics. Finally, we use simulations to explore the effects of recent directional selection, a bias-inducing process, on the statistics of interest. We find that even in the presence of bias, weak selection induces minimal deviations from our neutral expectations for the decay of polygenic score accuracy. By quantifying the limitations of polygenic scores in an explicit evolutionary context, our work lays the foundation for the development of more sophisticated statistical procedures to analyze both temporally and geographically resolved polygenic scores.
| S-EPMC9116686 | biostudies-literature
Project description:Background and aimsDespite interest in the use of polygenic risk scores (PRS) for predicting coronary heart disease (CHD) risk, the clinical utility of PRS compared to conventional risk factors has not been demonstrated. We compared the performance of PRS with that of high-sensitivity C-reactive protein (hsCRP) in two well-established cohorts.MethodsThe study population included individuals of European ancestry free of baseline CHD from ARIC (N = 13,113) and the Framingham Offspring Study (FHS) (N = 2,696). The primary predictors included a validated PRS consisting of >6.6 million single nucleotide polymorphisms and hsCRP. The outcome was incident CHD, defined as non-fatal or fatal myocardial infarction. We compared the performance of both predictors after adjusting for the Pooled Cohort Equations in multivariable-adjusted Cox regression models. We assessed discrimination and reclassification using c-statistics and net reclassification improvement.ResultsIncident CHD occurred in 565 ARIC and 153 FHS participants. In multivariable-adjusted models, both PRS and hsCRP were associated with incident CHD (p < 0.05 in both cohorts). In models incorporating both predictors, strengths of association were similar. For instance, in ARIC, the hazard ratio per SD increment was 1.38 (95% CI, 1.27-1.50, p = 2.94 × 10-14) for PRS and 1.41 (1.30-1.55, p = 3.10 × 10-15) for hsCRP. Neither predictor significantly increased model discrimination or net reclassification when compared with models containing the Pooled Cohort Equations alone.ConclusionsIn two independent cohorts, PRS performed similarly to hsCRP for the prediction of CHD risk. These findings suggest PRS does not have unique clinical utility beyond this widely-available, inexpensive measure of risk in unselected middle-aged populations.
| S-EPMC10529589 | biostudies-literature
Project description:Background and purposePolygenic risk scores (PRSs) can be used to predict ischemic stroke (IS). However, further validation of PRS performance is required in independent populations, particularly older adults in whom the majority of strokes occur.MethodsWe predicted risk of incident IS events in a population of 12 792 healthy older individuals enrolled in the ASPREE trial (Aspirin in Reducing Events in the Elderly). The PRS was calculated using 3.6 million genetic variants. Participants had no previous history of cardiovascular events, dementia, or persistent physical disability at enrollment. The primary outcome was IS over 5 years, with stroke subtypes as secondary outcomes. A multivariable model including conventional risk factors was applied and reevaluated after adding PRS. Area under the curve and net reclassification were evaluated.ResultsAt baseline, mean population age was 75 years. In total, 173 incident IS events occurred over a median follow-up of 4.7 years. When PRS was added to the multivariable model as a continuous variable, it was independently associated with IS (hazard ratio, 1.41 [95% CI, 1.20–1.65] per SD of the PRS; P<0.001). The PRS alone was a better discriminator for IS events than most conventional risk factors. PRS as a categorical variable was a significant predictor in the highest tertile (hazard ratio, 1.74; P=0.004) compared with the lowest. The area under the curve of the conventional model was 66.6% (95% CI, 62.2–71.1) and after inclusion of the PRS, improved to 68.5 ([95% CI, 64.0–73.0] P=0.095). In subgroup analysis, the continuous PRS remained an independent predictor for large vessel and cardioembolic stroke subtypes but not for small vessel stroke. Reclassification was improved, as the continuous net reclassification index after adding PRS to the conventional model was 0.25 (95% CI, 0.17–0.43).ConclusionsPRS predicts incident IS in a healthy older population but only moderately improves prediction over conventional risk factors.RegistrationURL: https://www.clinicaltrials.gov; Unique identifier: NCT01038583.
| S-EPMC8384668 | biostudies-literature
Project description:ImportanceThe incremental value of polygenic risk scores in addition to well-established risk prediction models for coronary artery disease (CAD) is uncertain.ObjectiveTo examine whether a polygenic risk score for CAD improves risk prediction beyond pooled cohort equations.Design, setting, and participantsObservational study of UK Biobank participants enrolled from 2006 to 2010. A case-control sample of 15 947 prevalent CAD cases and equal number of age and sex frequency-matched controls was used to optimize the predictive performance of a polygenic risk score for CAD based on summary statistics from published genome-wide association studies. A separate cohort of 352 660 individuals (with follow-up to 2017) was used to evaluate the predictive accuracy of the polygenic risk score, pooled cohort equations, and both combined for incident CAD.ExposuresPolygenic risk score for CAD, pooled cohort equations, and both combined.Main outcomes and measuresCAD (myocardial infarction and its related sequelae). Discrimination, calibration, and reclassification using a risk threshold of 7.5% were assessed.ResultsIn the cohort of 352 660 participants (mean age, 55.9 years; 205 297 women [58.2%]) used to evaluate the predictive accuracy of the examined models, there were 6272 incident CAD events over a median of 8 years of follow-up. CAD discrimination for polygenic risk score, pooled cohort equations, and both combined resulted in C statistics of 0.61 (95% CI, 0.60 to 0.62), 0.76 (95% CI, 0.75 to 0.77), and 0.78 (95% CI, 0.77 to 0.79), respectively. The change in C statistic between the latter 2 models was 0.02 (95% CI, 0.01 to 0.03). Calibration of the models showed overestimation of risk by pooled cohort equations, which was corrected after recalibration. Using a risk threshold of 7.5%, addition of the polygenic risk score to pooled cohort equations resulted in a net reclassification improvement of 4.4% (95% CI, 3.5% to 5.3%) for cases and -0.4% (95% CI, -0.5% to -0.4%) for noncases (overall net reclassification improvement, 4.0% [95% CI, 3.1% to 4.9%]).Conclusions and relevanceThe addition of a polygenic risk score for CAD to pooled cohort equations was associated with a statistically significant, yet modest, improvement in the predictive accuracy for incident CAD and improved risk stratification for only a small proportion of individuals. The use of genetic information over the pooled cohort equations model warrants further investigation before clinical implementation.
| S-EPMC7042853 | biostudies-literature
Project description:BACKGROUND:The extent of weight loss among patients undergoing bariatric surgery is highly variable. Herein, we tested the contribution of genetic background to such interindividual variability after biliopancreatic diversion with duodenal switch. METHODS:Percentage of excess body weight loss (%EBWL) was monitored in 865 patients over a period of 48 months after bariatric surgery, and two polygenic risk scores were constructed with 186 and 11 (PRS186 and PRS11) single nucleotide polymorphisms previously associated with body mass index (BMI). RESULTS:The accuracy of the %EBWL logistic prediction model - including initial BMI, age, sex, and surgery modality, and assessed as the area under the receiver operating characteristics (ROC) curve adjusted for optimism (AUCadj = 0.867) - significantly increased after the inclusion of PRS186 (?AUCadj = 0.021; 95% CI of the difference [95% CIdiff] = 0.005-0.038) but not PRS11 (?AUCadj= 0.008; 95% CIdiff= -0.003-0.019). The overall fit of the longitudinal linear mixed model for %EBWL showed a significant increase after addition of PRS186 (-2 log-likelihood = 12.3; P = 0.002) and PRS11 (-2 log-likelihood = 9.9; P = 0.007). A significant interaction with postsurgery time was found for PRS186 (? = -0.003; P = 0.008) and PRS11 (? = -0.008; P = 0.03). The inclusion of PRS186 and PRS11 in the model improved the cost-effectiveness of bariatric surgery by reducing the percentage of false negatives from 20.4% to 10.9% and 10.2%, respectively. CONCLUSION:These results revealed that genetic background has a significant impact on weight loss after biliopancreatic diversion with duodenal switch. Likewise, the improvement in weight loss prediction after addition of polygenic risk scores is cost-effective, suggesting that genetic testing could potentially be used in the presurgical assessment of patients with severe obesity. FUNDING:Heart and Stroke Foundation of Canada (G-17-0016627) and Canada Research Chair in Genomics Applied to Nutrition and Metabolic Health (no. 950-231-580).
| S-EPMC6171810 | biostudies-other
Project description:Polygenic scores have recently been used to summarise genetic effects among an ensemble of markers that do not individually achieve significance in a large-scale association study. Markers are selected using an initial training sample and used to construct a score in an independent replication sample by forming the weighted sum of associated alleles within each subject. Association between a trait and this composite score implies that a genetic signal is present among the selected markers, and the score can then be used for prediction of individual trait values. This approach has been used to obtain evidence of a genetic effect when no single markers are significant, to establish a common genetic basis for related disorders, and to construct risk prediction models. In some cases, however, the desired association or prediction has not been achieved. Here, the power and predictive accuracy of a polygenic score are derived from a quantitative genetics model as a function of the sizes of the two samples, explained genetic variance, selection thresholds for including a marker in the score, and methods for weighting effect sizes in the score. Expressions are derived for quantitative and discrete traits, the latter allowing for case/control sampling. A novel approach to estimating the variance explained by a marker panel is also proposed. It is shown that published studies with significant association of polygenic scores have been well powered, whereas those with negative results can be explained by low sample size. It is also shown that useful levels of prediction may only be approached when predictors are estimated from very large samples, up to an order of magnitude greater than currently available. Therefore, polygenic scores currently have more utility for association testing than predicting complex traits, but prediction will become more feasible as sample sizes continue to grow.
| S-EPMC3605113 | biostudies-literature
Project description:Genetic factors increase the risk of depression, but the extent to which this can be offset by modifiable lifestyle factors is unknown. We investigated whether a combination of healthy lifestyles is associated with lower risk of depression regardless of genetic risk. Data were obtained from the UK Biobank and consisted of 339,767 participants (37-73 years old) without depression between 2006 and 2010. Genetic risk was categorized as low, intermediate, or high according to polygenic risk score for depression. A combination of healthy lifestyles factors-including no current smoking, regular physical activity, a healthy diet, moderate alcohol intake and a body mass index <30 kg/m2-was categorized into favorable, intermediate, and unfavorable lifestyles. The risk of depression was 22% higher among those at high genetic risk compared with those at low genetic risk (HR = 1.22, 95% CI: 1.14-1.30). Participants with high genetic risk and unfavorable lifestyle had a more than two-fold risk of incident depression compared with low genetic risk and favorable lifestyle (HR = 2.18, 95% CI: 1.84-2.58). There was no significant interaction between genetic risk and lifestyle factors (P for interaction = 0.69). Among participants at high genetic risk, a favorable lifestyle was associated with nearly 50% lower relative risk of depression than an unfavorable lifestyle (HR = 0.51, 95% CI: 0.43-0.60). We concluded that genetic and lifestyle factors were independently associated with risk of incident depression. Adherence to healthy lifestyles may lower the risk of depression regardless of genetic risk.
| S-EPMC8007584 | biostudies-literature
Project description:BackgroundThe value of polygenic risk scores (PRSs) towards improving guideline-recommended clinical risk models for coronary artery disease (CAD) prediction is controversial. Here we examine whether an integrated polygenic risk score improves the prediction of CAD beyond pooled cohort equations. METHODS: An observation study of 291,305 unrelated White British UK Biobank participants enrolled from 2006 to 2010 was conducted. A case-control sample of 9499 prevalent CAD cases and an equal number of randomly selected controls was used for tuning and integrating of the polygenic risk scores. A separate cohort of 272,307 individuals (with follow-up to 2020) was used to examine the risk prediction performance of pooled cohort equations, integrated polygenic risk score, and PRS-enhanced pooled cohort equation for incident CAD cases. The performance of each model was analyzed by discrimination and risk reclassification using a 7.5% threshold.ResultsIn the cohort of 272,307 individuals (mean age, 56.7 years) used to analyze predictive accuracy, there were 7036 incident CAD cases over a 12-year follow-up period. Model discrimination was tested for integrated polygenic risk score, pooled cohort equation, and PRS-enhanced pooled cohort equation with reported C-statistics of 0.640 (95% CI, 0.634-0.646), 0.718 (95% CI, 0.713-0.723), and 0.753 (95% CI, 0.748-0.758), respectively. Risk reclassification for the addition of the integrated polygenic risk score to the pooled cohort equation at a 7.5% risk threshold resulted in a net reclassification improvement of 0.117 (95% CI, 0.102 to 0.129) for cases and - 0.023 (95% CI, - 0.025 to - 0.022) for noncases [overall: 0.093 (95% CI, 0.08 to 0.104)]. For incident CAD cases, this represented 14.2% correctly reclassified to the higher-risk category and 2.6% incorrectly reclassified to the lower-risk category.ConclusionsAddition of the integrated polygenic risk score for CAD to the pooled cohort questions improves the predictive accuracy for incident CAD and clinical risk classification in the White British from the UK Biobank. These findings suggest that an integrated polygenic risk score may enhance CAD risk prediction and screening in the White British population.
| S-EPMC9639312 | biostudies-literature
Project description:Polygenic risk scores (PRS) are an emerging tool to predict the clinical phenotypes and outcomes of individuals. Validation and transferability of existing PRS across independent datasets and diverse ancestries are limited, which hinders the practical utility and exacerbates health disparities. We propose PRSmix, a framework that evaluates and leverages the PRS corpus of a target trait to improve prediction accuracy, and PRSmix+, which incorporates genetically correlated traits to better capture the human genetic architecture. We applied PRSmix to 47 and 32 diseases/traits in European and South Asian ancestries, respectively. PRSmix demonstrated a mean prediction accuracy improvement of 1.20-fold (95% CI: [1.10; 1.3]; P-value = 9.17 × 10-5) and 1.19-fold (95% CI: [1.11; 1.27]; P-value = 1.92 × 10-6), and PRSmix+ improved the prediction accuracy by 1.72-fold (95% CI: [1.40; 2.04]; P-value = 7.58 × 10-6) and 1.42-fold (95% CI: [1.25; 1.59]; P-value = 8.01 × 10-7) in European and South Asian ancestries, respectively. Compared to the previously established cross-trait-combination method with scores from pre-defined correlated traits, we demonstrated that our method can improve prediction accuracy for coronary artery disease up to 3.27-fold (95% CI: [2.1; 4.44]; P-value after FDR correction = 2.6 × 10-4). Our method provides a comprehensive framework to benchmark and leverage the combined power of PRS for maximal performance in a desired target population.
| S-EPMC9980241 | biostudies-literature