Improvement in Cardiovascular Risk Prediction with Electronic Health Records.
Ontology highlight
ABSTRACT:
SUBMITTER: Pike MM
PROVIDER: S-EPMC4874910 | biostudies-literature | 2016 Jun
REPOSITORIES: biostudies-literature
Publications
Improvement in Cardiovascular Risk Prediction with Electronic Health Records.
Pike Mindy M MM Decker Paul A PA Larson Nicholas B NB St Sauver Jennifer L JL Takahashi Paul Y PY Roger Véronique L VL Rocca Walter A WA Miller Virginia M VM Olson Janet E JE Pathak Jyotishman J Bielinski Suzette J SJ
Journal of cardiovascular translational research 20160309 3
The aim of this study was to compare the QRISKII, an electronic health data-based risk score, to the Framingham Risk Score (FRS) and atherosclerotic cardiovascular disease (ASCVD) score. Risk estimates were calculated for a cohort of 8783 patients, and the patients were followed up from November 29, 2012, through June 1, 2015, for a cardiovascular disease (CVD) event. During follow-up, 246 men and 247 women had a CVD event. Cohen's kappa statistic for the comparison of the QRISKII and FRS was 0. ...[more]
Similar Datasets
Project description:Background Risk assessment is the cornerstone for atherosclerotic cardiovascular disease ( ASCVD ) treatment decisions. The Pooled Cohort Equations ( PCE ) have not been validated in disaggregated Asian or Hispanic populations, who have heterogeneous cardiovascular risk and outcomes. Methods and Results We used electronic health record data from adults aged 40 to 79 years from a community-based, outpatient healthcare system in northern California between January 1, 2006 and December 31, 2015, without ASCVD and not on statins. We examined the calibration and discrimination of the PCE and recalibrated the equations for disaggregated race/ethnic subgroups. The cohort included 231 622 adults with a mean age of 53.1 (SD 9.7) years and 54.3% women. There were 56 130 Asian (Chinese, Asian Indian, Filipino, Japanese, Vietnamese, and other Asian) and 19 760 Hispanic (Mexican, Puerto Rican, and other Hispanic) patients. There were 2703 events (332 and 189 in Asian and Hispanic patients, respectively) during an average of 3.9 (SD 1.5) years of follow-up. The PCE overestimated risk for NHW s, African Americans, Asians, and Hispanics by 20% to 60%. The extent of overestimation of ASCVD risk varied by disaggregated racial/ethnic subgroups, with a predicted-to-observed ratio of ASCVD events ranging from 1.1 for Puerto Rican patients to 1.9 for Chinese patients. The PCE had adequate discrimination, although it varied significantly by race/ethnic subgroups (C-indices 0.66-0.83). Recalibration of the PCE did not significantly improve its performance. Conclusions Using electronic health record data from a large, real-world population, we found that the PCE generally overestimated ASCVD risk, with marked heterogeneity by disaggregated Asian and Hispanic subgroups.
| S-EPMC6662141 | biostudies-literature
Project description:The availability of data from electronic health records facilitates the development and evaluation of risk-prediction models, but estimation of prediction accuracy could be limited by outcome misclassification, which can arise if events are not captured. We evaluate the robustness of prediction accuracy summaries, obtained from receiver operating characteristic curves and risk-reclassification methods, if events are not captured (i.e., "false negatives"). We derive estimators for sensitivity and specificity if misclassification is independent of marker values. In simulation studies, we quantify the potential for bias in prediction accuracy summaries if misclassification depends on marker values. We compare the accuracy of alternative prognostic models for 30-day all-cause hospital readmission among 4548 patients discharged from the University of Pennsylvania Health System with a primary diagnosis of heart failure. Simulation studies indicate that if misclassification depends on marker values, then the estimated accuracy improvement is also biased, but the direction of the bias depends on the direction of the association between markers and the probability of misclassification. In our application, 29% of the 1143 readmitted patients were readmitted to a hospital elsewhere in Pennsylvania, which reduced prediction accuracy. Outcome misclassification can result in erroneous conclusions regarding the accuracy of risk-prediction models.
| S-EPMC4859766 | biostudies-literature
Project description:Electronic health records are a large and cost-effective data source for developing risk-prediction models. However, for screen-detected diseases, standard risk models (such as Kaplan-Meier or Cox models) do not account for key issues encountered with electronic health record data: left-censoring of pre-existing (prevalent) disease, interval-censoring of incident disease, and ambiguity of whether disease is prevalent or incident when definitive disease ascertainment is not conducted at baseline. Furthermore, researchers might conduct novel screening tests only on a complex two-phase subsample. We propose a family of weighted mixture models that account for left/interval-censoring and complex sampling via inverse-probability weighting in order to estimate current and future absolute risk: we propose a weakly-parametric model for general use and a semiparametric model for checking goodness of fit of the weakly-parametric model. We demonstrate asymptotic properties analytically and by simulation. We used electronic health records to assemble a cohort of 33,295 human papillomavirus (HPV) positive women undergoing cervical cancer screening at Kaiser Permanente Northern California (KPNC) that underlie current screening guidelines. The next guidelines would focus on HPV typing tests, but reporting 14 HPV types is too complex for clinical use. National Cancer Institute along with KPNC conducted a HPV typing test on a complex subsample of 9258 women in the cohort. We used our model to estimate the risk due to each type and grouped the 14 types (the 3-year risk ranges 21.9-1.5) into 4 risk-bands to simplify reporting to clinicians and guidelines. These risk-bands could be adopted by future HPV typing tests and future screening guidelines.
| S-EPMC6586434 | biostudies-other
Project description:Accurate prediction of suicide risk among children and adolescents within an actionable time frame is an important but challenging task. Very few studies have comprehensively considered the clinical risk factors available to produce quantifiable risk scores for estimation of short- and long-term suicide risk for pediatric population. In this paper, we built machine learning models for predicting suicidal behavior among children and adolescents based on their longitudinal clinical records, and determining short- and long-term risk factors. This retrospective study used deidentified structured electronic health records (EHR) from the Connecticut Children's Medical Center covering the period from 1 October 2011 to 30 September 2016. Clinical records of 41,721 young patients (10-18 years old) were included for analysis. Candidate predictors included demographics, diagnosis, laboratory tests, and medications. Different prediction windows ranging from 0 to 365 days were adopted. For each prediction window, candidate predictors were first screened by univariate statistical tests, and then a predictive model was built via a sequential forward feature selection procedure. We grouped the selected predictors and estimated their contributions to risk prediction at different prediction window lengths. The developed predictive models predicted suicidal behavior across all prediction windows with AUCs varying from 0.81 to 0.86. For all prediction windows, the models detected 53-62% of suicide-positive subjects with 90% specificity. The models performed better with shorter prediction windows and predictor importance varied across prediction windows, illustrating short- and long-term risks. Our findings demonstrated that routinely collected EHRs can be used to create accurate predictive models for suicide risk among children and adolescents.
| S-EPMC7693189 | biostudies-literature
Project description:Use of the electronic health record (EHR) is expected to increase rapidly in the near future, yet little research exists on whether analyzing internal EHR data using flexible, adaptive statistical methods could improve clinical risk prediction. Extensive implementation of EHR in the Veterans Health Administration provides an opportunity for exploration.To compare the performance of various approaches for predicting risk of cerebrovascular and cardiovascular (CCV) death, using traditional risk predictors versus more comprehensive EHR data.Retrospective cohort study. We identified all Veterans Health Administration patients without recent CCV events treated at 12 facilities from 2003 to 2007, and predicted risk using the Framingham risk score, logistic regression, generalized additive modeling, and gradient tree boosting.The outcome was CCV-related death within 5 years. We assessed each method's predictive performance with the area under the receiver operating characteristic curve (AUC), the Hosmer-Lemeshow goodness-of-fit test, plots of estimated risk, and reclassification tables, using cross-validation to penalize overfitting.Regression methods outperformed the Framingham risk score, even with the same predictors (AUC increased from 71% to 73% and calibration also improved). Even better performance was attained in models using additional EHR-derived predictor variables (AUC increased to 78% and net reclassification improvement was as large as 0.29). Nonparametric regression further improved calibration and discrimination compared with logistic regression.Despite the EHR lacking some risk factors and its imperfect data quality, health care systems may be able to substantially improve risk prediction for their patients by using internally developed EHR-derived models and flexible statistical methodology.
| S-EPMC4081533 | biostudies-literature
Project description:BackgroundPrevention of diabetes and coronary heart disease (CHD) is possible but identification of at-risk patients for targeting interventions is a challenge in primary care.MethodsWe analyzed electronic health record (EHR) data for 122,715 patients from 12 primary care practices. We defined patients with risk factor clustering using metabolic syndrome (MetS) characteristics defined by NCEP-ATPIII criteria; if missing, we used surrogate characteristics, and validated this approach by directly measuring risk factors in a subset of 154 patients. For subjects with at least 3 of 5 MetS criteria measured at baseline (2003-2004), we defined 3 categories: No MetS (0 criteria); At-risk-for MetS (1-2 criteria); and MetS (>or= 3 criteria). We examined new diabetes and CHD incidence, and resource utilization over the subsequent 3-year period (2005-2007) using age-sex-adjusted regression models to compare outcomes by MetS category.ResultsAfter excluding patients with diabetes/CHD at baseline, 78,293 patients were eligible for analysis. EHR-defined MetS had 73% sensitivity and 91% specificity for directly measured MetS. Diabetes incidence was 1.4% in No MetS; 4.0% in At-risk-for MetS; and 11.0% in MetS (p < 0.0001 for trend; adjusted OR MetS vs No MetS = 6.86 [6.06-7.76]); CHD incidence was 3.2%, 5.3%, and 6.4% respectively (p < 0.0001 for trend; adjusted OR = 1.42 [1.25-1.62]). Costs and resource utilization increased across categories (p < 0.0001 for trends). Results were similar analyzing individuals with all five criteria not missing, or defining MetS as >or= 2 criteria present.ConclusionRisk factor clustering in EHR data identifies primary care patients at increased risk for new diabetes, CHD and higher resource utilization.
| S-EPMC2753330 | biostudies-literature
Project description:ObjectivePostpartum hemorrhage (PPH) remains a leading cause of preventable maternal mortality in the United States. We sought to develop a novel risk assessment tool and compare its accuracy to tools used in current practice.Materials and methodsWe used a PPH digital phenotype that we developed and validated previously to identify 6639 PPH deliveries from our delivery cohort (N = 70 948). Using a vast array of known and potential risk factors extracted from electronic medical records available prior to delivery, we trained a gradient boosting model in a subset of our cohort. In a held-out test sample, we compared performance of our model with 3 clinical risk-assessment tools and 1 previously published model.ResultsOur 24-feature model achieved an area under the receiver-operating characteristic curve (AUROC) of 0.71 (95% confidence interval [CI], 0.69-0.72), higher than all other tools (research-based AUROC, 0.67 [95% CI, 0.66-0.69]; clinical AUROCs, 0.55 [95% CI, 0.54-0.56] to 0.61 [95% CI, 0.59-0.62]). Five features were novel, including red blood cell indices and infection markers measured upon admission. Additionally, we identified inflection points for vital signs and labs where risk rose substantially. Most notably, patients with median intrapartum systolic blood pressure above 132 mm Hg had an 11% (95% CI, 8%-13%) median increase in relative risk for PPH.ConclusionsWe developed a novel approach for predicting PPH and identified clinical feature thresholds that can guide intrapartum monitoring for PPH risk. These results suggest that our model is an excellent candidate for prospective evaluation and could ultimately reduce PPH morbidity and mortality through early detection and prevention.
| S-EPMC8757294 | biostudies-literature
Project description:OBJECTIVE:Electronic health records (EHRs) are an increasingly common data source for clinical risk prediction, presenting both unique analytic opportunities and challenges. We sought to evaluate the current state of EHR based risk prediction modeling through a systematic review of clinical prediction studies using EHR data. METHODS:We searched PubMed for articles that reported on the use of an EHR to develop a risk prediction model from 2009 to 2014. Articles were extracted by two reviewers, and we abstracted information on study design, use of EHR data, model building, and performance from each publication and supplementary documentation. RESULTS:We identified 107 articles from 15 different countries. Studies were generally very large (median sample size?=?26 100) and utilized a diverse array of predictors. Most used validation techniques (n?=?94 of 107) and reported model coefficients for reproducibility (n?=?83). However, studies did not fully leverage the breadth of EHR data, as they uncommonly used longitudinal information (n?=?37) and employed relatively few predictor variables (median?=?27 variables). Less than half of the studies were multicenter (n?=?50) and only 26 performed validation across sites. Many studies did not fully address biases of EHR data such as missing data or loss to follow-up. Average c-statistics for different outcomes were: mortality (0.84), clinical prediction (0.83), hospitalization (0.71), and service utilization (0.71). CONCLUSIONS:EHR data present both opportunities and challenges for clinical risk prediction. There is room for improvement in designing such studies.
| S-EPMC5201180 | biostudies-literature
Project description:BackgroundUsing novel data mining methods such as natural language processing (NLP) on electronic health records (EHRs) for screening and detecting individuals at risk for psychosis.MethodThe study included all patients receiving a first index diagnosis of nonorganic and nonpsychotic mental disorder within the South London and Maudsley (SLaM) NHS Foundation Trust between January 1, 2008, and July 28, 2018. Least Absolute Shrinkage and Selection Operator (LASSO)-regularized Cox regression was used to refine and externally validate a refined version of a five-item individualized, transdiagnostic, clinically based risk calculator previously developed (Harrell's C = 0.79) and piloted for implementation. The refined version included 14 additional NLP-predictors: tearfulness, poor appetite, weight loss, insomnia, cannabis, cocaine, guilt, irritability, delusions, hopelessness, disturbed sleep, poor insight, agitation, and paranoia.ResultsA total of 92 151 patients with a first index diagnosis of nonorganic and nonpsychotic mental disorder within the SLaM Trust were included in the derivation (n = 28 297) or external validation (n = 63 854) data sets. Mean age was 33.6 years, 50.7% were women, and 67.0% were of white race/ethnicity. Mean follow-up was 1590 days. The overall 6-year risk of psychosis in secondary mental health care was 3.4 (95% CI, 3.3-3.6). External validation indicated strong performance on unseen data (Harrell's C 0.85, 95% CI 0.84-0.86), an increase of 0.06 from the original model.ConclusionsUsing NLP on EHRs can considerably enhance the prognostic accuracy of psychosis risk calculators. This can help identify patients at risk of psychosis who require assessment and specialized care, facilitating earlier detection and potentially improving patient outcomes.
| S-EPMC7965059 | biostudies-literature
Project description:BackgroundCardiovascular disease (CVD) is the leading cause of death in the United States (US). Better cardiovascular health (CVH) is associated with CVD prevention. Predicting future CVH levels may help providers better manage patients' CVH. We hypothesized that CVH measures can be predicted based on previous measurements from longitudinal electronic health record (EHR) data.MethodsThe Guideline Advantage (TGA) dataset was used and contained EHR data from 70 outpatient clinics across the United States (US). We studied predictions of 5 CVH submetrics: smoking status (SMK), body mass index (BMI), blood pressure (BP), hemoglobin A1c (A1C), and low-density lipoprotein (LDL). We applied embedding techniques and long short-term memory (LSTM) networks - to predict future CVH category levels from all the previous CVH measurements of 216,445 unique patients for each CVH submetric.ResultsThe LSTM model performance was evaluated by the area under the receiver operator curve (AUROC): the micro-average AUROC was 0.99 for SMK prediction; 0.97 for BMI; 0.84 for BP; 0.91 for A1C; and 0.93 for LDL prediction. Model performance was not improved by using all 5 submetric measures compared with using single submetric measures.ConclusionsWe suggest that future CVH levels can be predicted using previous CVH measurements for each submetric, which has implications for population cardiovascular health management. Predicting patients' future CVH levels might directly increase patient CVH health and thus quality of life, while also indirectly decreasing the burden and cost for clinical health system caused by CVD and cancers.
| S-EPMC7789405 | biostudies-literature