An independent and external validation of QRISK2 cardiovascular disease risk score: a prospective open cohort study.
Ontology highlight
ABSTRACT: Objective
To evaluate the performance of the QRISK2 score for predicting 10-year cardiovascular disease in an independent UK cohort of patients from general practice records and to compare it with the NICE version of the Framingham equation and QRISK1.Design
Prospective cohort study to validate a cardiovascular risk score.Setting
365 practices from United Kingdom contributing to The Health Improvement Network (THIN) database.Participants
1.58 million patients registered with a general practice between 1 January 1993 and 20 June 2008, aged 35-74 years (9.4 million person years) with 71 465 cardiovascular events.Main outcome measures
First diagnosis of cardiovascular disease (myocardial infarction, angina, coronary heart disease, stroke, and transient ischaemic stroke) recorded in general practice records.Results
QRISK2 offered improved prediction of a patient's 10-year risk of cardiovascular disease over the NICE version of the Framingham equation. Discrimination and calibration statistics were better with QRISK2. QRISK2 explained 33% of the variation in men and 40% for women, compared with 29% and 34% respectively for the NICE Framingham and 32% and 38% respectively for QRISK1. The incidence rate of cardiovascular events (per 1000 person years) among men in the high risk group was 27.8 (95% CI 27.4 to 28.2) with QRISK2, 21.9 (21.6 to 22.2) with NICE Framingham, and 24.8 (22.8 to 26.9) with QRISK1. Similarly, the incidence rate of cardiovascular events (per 1000 person years) among women in the high risk group was 24.3 (23.8 to 24.9) with QRISK2, 20.6 (20.1 to 21.0) with NICE Framingham, and 21.8 (18.9 to 24.6) with QRISK1.Conclusions
QRISK2 is more accurate in identifying a high risk population for cardiovascular disease in the United Kingdom than the NICE version of the Framingham equation. Differences in performance between QRISK2 and QRISK1 were marginal.
SUBMITTER: Collins GS
PROVIDER: S-EPMC2869403 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Objectives To develop and validate updated QRISK3 prediction algorithms to estimate the 10 year risk of cardiovascular disease in women and men accounting for potential new risk factors.Design Prospective open cohort study.Setting General practices in England providing data for the QResearch database.Participants 1309 QResearch general practices in England: 981 practices were used to develop the scores and a separate set of 328 practices were used to validate the scores. 7.89 million patients aged 25-84 years were in the derivation cohort and 2.67 million patients in the validation cohort. Patients were free of cardiovascular disease and not prescribed statins at baseline.Methods Cox proportional hazards models in the derivation cohort to derive separate risk equations in men and women for evaluation at 10 years. Risk factors considered included those already in QRISK2 (age, ethnicity, deprivation, systolic blood pressure, body mass index, total cholesterol: high density lipoprotein cholesterol ratio, smoking, family history of coronary heart disease in a first degree relative aged less than 60 years, type 1 diabetes, type 2 diabetes, treated hypertension, rheumatoid arthritis, atrial fibrillation, chronic kidney disease (stage 4 or 5)) and new risk factors (chronic kidney disease (stage 3, 4, or 5), a measure of systolic blood pressure variability (standard deviation of repeated measures), migraine, corticosteroids, systemic lupus erythematosus (SLE), atypical antipsychotics, severe mental illness, and HIV/AIDs). We also considered erectile dysfunction diagnosis or treatment in men. Measures of calibration and discrimination were determined in the validation cohort for men and women separately and for individual subgroups by age group, ethnicity, and baseline disease status.Main outcome measures Incident cardiovascular disease recorded on any of the following three linked data sources: general practice, mortality, or hospital admission records.Results 363?565 incident cases of cardiovascular disease were identified in the derivation cohort during follow-up arising from 50.8 million person years of observation. All new risk factors considered met the model inclusion criteria except for HIV/AIDS, which was not statistically significant. The models had good calibration and high levels of explained variation and discrimination. In women, the algorithm explained 59.6% of the variation in time to diagnosis of cardiovascular disease (R2, with higher values indicating more variation), and the D statistic was 2.48 and Harrell's C statistic was 0.88 (both measures of discrimination, with higher values indicating better discrimination). The corresponding values for men were 54.8%, 2.26, and 0.86. Overall performance of the updated QRISK3 algorithms was similar to the QRISK2 algorithms.Conclusion Updated QRISK3 risk prediction models were developed and validated. The inclusion of additional clinical variables in QRISK3 (chronic kidney disease, a measure of systolic blood pressure variability (standard deviation of repeated measures), migraine, corticosteroids, SLE, atypical antipsychotics, severe mental illness, and erectile dysfunction) can help enable doctors to identify those at most risk of heart disease and stroke.
| S-EPMC5441081 | biostudies-other
Project description:A risk score was recently derived to predict mortality in adult patients with Gram-negative bloodstream infection (BSI). The aim of this study was to provide external validation of the BSI mortality risk score (BSIMRS) in a population-based cohort. All residents of Olmsted County, Minnesota, with Escherichia coli and Pseudomonas aeruginosa BSI from 1 January 1998 to 31 December 2007 were identified. Logistic regression was used to examine the association between BSIMRS and mortality. Area under receiver operating characteristic curve (AUC) was calculated to quantify the discriminative ability of the BSIMRS to predict a variety of short-term and long-term outcomes. Overall, 424 unique Olmsted County residents with first episodes of E. coli and P. aeruginosa BSI were included in the study. Median age was 68 (range 0-99) years, 280 (66%) were women, 61 (14%) had cancer and 9 (2%) had liver cirrhosis. The BSIMRS was associated with 28-day mortality (p <0.001) with an AUC of 0.86. There was an almost 56% increase in 28-day mortality for each point increase in BSIMRS (OR 1.56, 95% CI 1.40-1.78). A BSIMRS ? 5 had a sensitivity of 74% and a specificity of 87% to predict 28-day mortality with a negative predictive value of 97%. The BSIMRS had AUC of 0.85, 0.85 and 0.81 for 7-, 14- and 365-day mortality, respectively. BSIMRS stratified mortality with high discrimination in a population-based cohort that included patients of all age groups who had a relatively low prevalence of cancer and liver cirrhosis.
| S-EPMC4254722 | biostudies-literature
Project description:Prediction of lifetime cardiovascular disease (CVD) risk is recommended in many clinical guidelines, but lifetime risk models are rarely externally validated. The aim of this study was to externally validate the QRiskLifetime incident CVD risk prediction tool. Independent external validation of QRiskLifetime using Clinical Practice Research Datalink data, examining discrimination and calibration in the whole population and stratified by age, and reclassification compared to QRISK3. Since lifetime CVD risk is unobservable, performance was evaluated at 10-years' follow-up, and lifetime performance inferred in terms of performance for in the different age-groups from which lifetime predictions are derived. One million, two hundreds sixty thousand and three hundreds twenty nine women and 1,223,265 men were included in the analysis. Discrimination was excellent in the whole population (Harrell's-C = 0.844 in women, 0.808 in men), but moderate to poor stratified by age-group (Harrell's C in people aged 30-44 0.714 for both men and women, in people aged 75-84 0.578 in women and 0.556 in men). Ten-year CVD risk was under-predicted in the whole population, and in all age-groups except women aged 45-64, with worse under-prediction in older age-groups. Compared to those at highest QRISK3 estimated 10-year risk, those with highest lifetime risk were younger (mean age: women 50.5 vs. 71.3 years; men 46.3 vs. 63.8 years) and had lower systolic blood pressure and prevalence of treated hypertension, but had more family history of premature CVD, and were more commonly minority ethnic. Over 10-years, the estimated number needed to treat (NNT) with a statin to prevent one CVD event in people with QRISK3 ≥ 10% was 34 in women and 37 in men, compared to 99 and 100 for those at highest lifetime risk. QRiskLifetime underpredicts 10-year CVD risk in nearly all age-groups, so is likely to also underpredict lifetime risk. Treatment based on lifetime risk has considerably lower medium-term benefit than treatment based on 10-year risk.
| S-EPMC10105395 | biostudies-literature
Project description:No cardiovascular risk score has included Latin American patients in its development. The ACC/AHA ASCVD risk score has not been validated in Latin America; consequently, its predictive capacity in the population of the region is unknown. The aim of this study is to evaluate the discrimination capacity and calibration of the ACC/AHA ASCVD score to predict the 10-year risk of a cardiovascular event in a primary prevention cohort followed in a Colombian hospital. A retrospective cohort study was conducted in primary prevention patients belonging to an intermediate/high-risk and low-risk cohort without established atherosclerotic disease. Cardiovascular risk was calculated at inclusion. The calibration was analyzed by comparing observed and expected events in the different risk categories. A discrimination analysis was made using the area under the ROC curve and C statistic. A total of 918 patients were included-202 from the intermediate/high-risk and 716 from the low-risk cohort. The median cardiovascular risk was 3.6% (IQR 1.7-8.5%). At the 10-year follow-up, 40 events (4,4%) occurred. The area under the ROC curve was 0.782 (95% CI 0.71-0.85). The Hosmer-Lemeshow test did not show differences between expected and observed events. The ACC/AHA ASCVD score is calibrated and has good discrimination capacity in predicting 10-year risk of cardiovascular events in a Colombian population.
| S-EPMC10105759 | biostudies-literature
Project description:PurposeTo assess the association between a score appraising adherence to the PaleoDiet and the risk of cardiovascular disease (CVD) in a Mediterranean cohort.MethodsWe included 18,210 participants from the Seguimiento Universidad de Navarra (SUN) cohort study. The PaleoDiet score comprised six food groups promoted within this diet (fruit, nuts, vegetables, eggs, meat and fish) and five food groups whose consumption is discouraged (cereals and grains, dairy products, legumes, culinary ingredients, and processed/ultra-processed foods). CVD was defined as acute myocardial infarction with or without ST elevation, non-fatal stroke and cardiovascular death. Cox proportional hazards models adjusted for potential confounders were fitted to assess the association between the PaleoDiet score and CVD risk, and the PaleoDiet and MedDiet indices to explore differences between both diets.ResultsDuring 12.2 years of follow-up, 165 incident CVD cases were confirmed. A significant inverse association was found between the PaleoDiet score and CVD (HR Q5 vs. Q1: 0.45, 95% CI 0.27-0.76, P for trend = 0.007). A weaker association that became non-significant was observed when the item for low consumption of ultra-processed foods was removed from the score. Joint analysis of PaleoDiet and MedDiet Trichopoulou scores suggested that the inverse association between PaleoDiet and CVD was mainly present when adherence to the MedDiet was also high (HR for high adherence vs low adherence to both diet scores: 0.22, 95% CI 0.08-0.64).ConclusionsOur findings suggest that the PaleoDiet may have cardiovascular benefits in participants from a Mediterranean country. Avoidance of ultra-processed foods seems to play a key role in this inverse association.
| S-EPMC8854325 | biostudies-literature
Project description:Cirrhosis poses an increased risk of postoperative mortality, yet it remains challenging to accurately risk stratify patients in clinical practice. The VOCAL-Penn cirrhosis surgical risk score was recently developed and internally validated in the national Veterans Affairs health system; however, to date this score has not been evaluated in independent cohorts. The goal of this study was to compare the predictive performance of the VOCAL-Penn to the Mayo risk, Model for End-Stage Liver Disease (MELD), and MELD-sodium (MELD-Na) scores in 2 large health systems. We performed a retrospective cohort study of patients with cirrhosis undergoing surgical procedures of interest at the Beth Israel Deaconess Medical Center or University of Pennsylvania Health System from January 1, 2008, to October 1, 2015. The outcomes of interest were 30-day and 90-day postoperative mortality. Concordance statistics (C-statistics), calibration curves, Brier scores, and the index of prediction accuracy (IPA) were compared for each predictive model. A total of 855 surgical procedures were identified. The VOCAL-Penn score had the numerically highest C-statistic for 90-day postoperative mortality (eg, 0.82 versus 0.79 Mayo versus 0.78 MELD-Na versus 0.79 MELD), although differences were not statistically significant. Calibrations were excellent for the VOCAL-Penn, MELD, and MELD-Na; however, the Mayo score consistently overestimated risk. The VOCAL-Penn had the lowest Brier score and highest IPA at both time points, suggesting superior overall predictive model performance. In subgroup analyses of patients with higher MELD scores, the VOCAL-Penn had significantly higher C-statistics compared with the MELD and MELD-Na. The VOCAL-Penn score (www.vocalpennscore.com) has excellent discrimination and calibration for postoperative mortality among diverse patients with cirrhosis. Overall performance is superior to the Mayo, MELD, and MELD-Na scores. In contrast to the MELD/MELD-Na, the VOCAL-Penn retains excellent discrimination among patients with higher MELD scores.
| S-EPMC8283779 | biostudies-literature
Project description:Platelets are key mediators of atherothrombosis; yet, limited tools exist to identify individuals with a hyperreactive platelet phenotype. Here we derive and validate a Platelet Reactivity ExpreSsion Score (PRESS) integrating platelet aggregation responses and RNA sequencing in multiple cohorts. PRESS performs well in identifying a hyperreactive phenotype in patients with cardiovascular disease (AUC [cross-validation] 0.81, 95% CI 0.68 to 0.94), with similar discrimination in an independent cohort of healthy participants (AUC [validation] 0.77, 95% CI 0.75 to 0.79); accuracy 80%, sensitivity 71%, and specificity 86%. Next, we validate PRESS in multiple cohorts of patients with platelet RNASeq available. Following multivariable adjustment, PRESS was significantly higher in MI (β=1.8, p=0.02), and individuals with a score above the median more frequently develop a future cardiovascular event (adjusted HR 1.90, CI 1.07 to 3.36), p=0.027). Altogether, we provide strong evidence that PRESS is a robust prognostic marker, which could have an essential role in facilitating a personalized approach to cardiovascular risk management.
2024-06-30 | GSE232027 | GEO
Project description:BackgroundTo investigate the performance of the 2013 American College of Cardiology/American Heart Association Pooled Cohort Equations (PCE) in a large, prospective, community-based cohort in Korea and to compare it with that of the Framingham Global Cardiovascular Disease Risk Score (FRS-CVD) and the Korean Risk Prediction Model (KRPM).MethodsIn the Korean Genome and Epidemiology Study (KOGES)-Ansan and Ansung study, we evaluated calibration and discrimination of the PCE for non-Hispanic whites (PCE-WH) and for African Americans (PCE-AA) and compared their predictive abilities with the FRS-CVD and the KRPM.ResultsThe present study included 7,932 individuals (3,778 men and 4,154 women). The PCE-WH and PCE-AA moderately overestimated the risk of atherosclerotic cardiovascular disease (ASCVD) for men (6% and 13%, respectively) but underestimated the risk for women (-49% and -25%, respectively). The FRS-CVD overestimated ASCVD risk for men (91%) but provided a good risk prediction for women (3%). The KRPM underestimated ASCVD risk for men (-31%) and women (-31%). All the risk prediction models showed good discrimination in both men (C-statistic 0.730 to 0.735) and women (C-statistic 0.726 to 0.732). Recalibration of the PCE using data from the KOGES-Ansan and Ansung study substantially improved the predictive accuracy in men.ConclusionIn the KOGES-Ansan and Ansung study, the PCE overestimated ASCVD risk for men and underestimated the risk for women. The PCE-WH and the FRS-CVD provided an accurate prediction of ASCVD in men and women, respectively.
| S-EPMC7332332 | biostudies-literature
Project description:BackgroundClinical prediction rules (CPRs) should be externally validated by independent researchers. Although there are many cardiovascular CPRs, most have not been externally validated. It is not known why some CPRs are externally validated by independent researchers and others are not.MethodsWe analyzed cardiovascular risk CPRs included in a systematic review. Independent external validations were identified by forward citation searches of derivation studies. Time between the publication of a cardiovascular CPR and the first independent external validation was calculated. We assessed Kaplan-Meier estimates of the probability to have an independent external validation. Using univariable Cox regression, we explored whether characteristics of derivation (design, location, sample size, number of predictors, presentation format, validation in derivation), reporting (participants, predictors, outcomes, performance measure, information for risk calculation), and publication (journal impact factor) are associated with time to the first independent external validation.ResultsOf 125 cardiovascular risk CPRs, 29 had an independent external validation. The median follow-up was 118 months (95% CI, 99-130). The 25th percentile of event time was 122 months (95% CI, 91-299). Cardiovascular risk CPRs from the USA were 4.15 times (95% CI, 1.89-9.13) more likely to have an independent external validation. Increasing the sample size of derivation by ten times was associated with a 2.32-fold (95% CI, 1.37-3.91) increase in the probability of having an independent external validation. CPRs presented with an internal validation tend to get an independent external validation sooner (HR = 1.73, 95% CI, 0.77-3.93). CPRs reporting all the information necessary for calculating individual risk were 2.65 (95% CI, 1.01-6.96) times more likely to have an independent external validation. Publishing a cardiovascular risk CPR in a journal that has one unit higher impact factor was associated with a 6% (95% CI, 3-9) higher likelihood of an independent external validation.ConclusionsThe probability for cardiovascular risk CPRs to get an independent external validation was low even many years after their derivations. Authors of new cardiovascular risk CPRs should consider using adequate sample size, conducting an internal validation, and reporting all the information needed for risk calculation as these features were associated with an independent external validation.
| S-EPMC6460844 | biostudies-literature
Project description:BackgroundThe Sepsis-3 criteria introduced the system that uses the Sequential Organ-Failure Assessment (SOFA) score to define sepsis. The cardiovascular SOFA (CV SOFA) scoring system needs modification due to the change in guideline-recommended vasopressors. In this study, we aimed to develop and to validate the modified CV SOFA score.MethodsWe developed, internally validated, and externally validated the modified CV SOFA score using the suspected infection cohort, sepsis cohort, and septic shock cohort. The primary outcome was 28-day mortality. The modified CV SOFA score system was constructed with consideration of the recently recommended use of the vasopressor norepinephrine with or without lactate level. The predictive validity of the modified SOFA score was evaluated by the discrimination for the primary outcome. Discrimination was assessed using the area under the receiver operating characteristics curve (AUC). Calibration was assessed using the calibration curve. We compared the prognostic performance of the original CV/total SOFA score and the modified CV/total SOFA score to detect mortality in patients with suspected infection, sepsis, or septic shock.ResultsWe identified 7,393 patients in the suspected cohort, 4038 patients in the sepsis cohort, and 3,107 patients in the septic shock cohort in seven Korean emergency departments (EDs). The 28-day mortality rates were 7.9%, 21.4%, and 20.5%, respectively, in the suspected infection, sepsis, and septic shock cohorts. The model performance is higher when vasopressor and lactate were used in combination than the vasopressor only used model. The modified CV/total SOFA score was well-developed and internally and externally validated in terms of discrimination and calibration. Predictive validity of the modified CV SOFA was significantly higher than that of the original CV SOFA in the development set (0.682 vs 0.624, p < 0.001), test set (0.716 vs 0.638), and all other cohorts (0.648 vs 0.557, 0.674 vs 0.589). Calibration was modest. In the suspected infection cohort, the modified model classified more patients to sepsis (66.0 vs 62.5%) and identified more patients at risk of septic mortality than the SOFA score (92.6 vs 89.5%).ConclusionsAmong ED patients with suspected infection, sepsis, and septic shock, the newly-developed modified CV/total SOFA score had higher predictive validity and identified more patients at risk of septic mortality.
| S-EPMC9394016 | biostudies-literature