Dataset Information

Exploring the frontier of electronic health record surveillance: the case of postoperative complications.

ABSTRACT: The aim of this study was to build electronic algorithms using a combination of structured data and natural language processing (NLP) of text notes for potential safety surveillance of 9 postoperative complications.Postoperative complications from 6 medical centers in the Southeastern United States were obtained from the Veterans Affairs Surgical Quality Improvement Program (VASQIP) registry. Development and test datasets were constructed using stratification by facility and date of procedure for patients with and without complications. Algorithms were developed from VASQIP outcome definitions using NLP-coded concepts, regular expressions, and structured data. The VASQIP nurse reviewer served as the reference standard for evaluating sensitivity and specificity. The algorithms were designed in the development and evaluated in the test dataset.Sensitivity and specificity in the test set were 85% and 92% for acute renal failure, 80% and 93% for sepsis, 56% and 94% for deep vein thrombosis, 80% and 97% for pulmonary embolism, 88% and 89% for acute myocardial infarction, 88% and 92% for cardiac arrest, 80% and 90% for pneumonia, 95% and 80% for urinary tract infection, and 77% and 63% for wound infection, respectively. A third of the complications occurred outside of the hospital setting.Computer algorithms on data extracted from the electronic health record produced respectable sensitivity and specificity across a large sample of patients seen in 6 different medical centers. This study demonstrates the utility of combining NLP with structured data for mining the information contained within the electronic health record.

SUBMITTER: FitzHenry F

PROVIDER: S-EPMC3658153 | biostudies-literature | 2013 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Exploring the frontier of electronic health record surveillance: the case of postoperative complications.

FitzHenry Fern F Murff Harvey J HJ Matheny Michael E ME Gentry Nancy N Fielstein Elliot M EM Brown Steven H SH Reeves Ruth M RM Aronsky Dominik D Elkin Peter L PL Messina Vincent P VP Speroff Theodore T

Medical care 20130601 6

<h4>Background</h4>The aim of this study was to build electronic algorithms using a combination of structured data and natural language processing (NLP) of text notes for potential safety surveillance of 9 postoperative complications.<h4>Methods</h4>Postoperative complications from 6 medical centers in the Southeastern United States were obtained from the Veterans Affairs Surgical Quality Improvement Program (VASQIP) registry. Development and test datasets were constructed using stratification b ...[more]

PMID: 23673394

Similar Datasets

Project description:BackgroundAccurate, pragmatic risk stratification for postoperative delirium (POD) is necessary to target preventative resources toward high-risk patients. Machine learning (ML) offers a novel approach to leveraging electronic health record (EHR) data for POD prediction. We sought to develop and internally validate a ML-derived POD risk prediction model using preoperative risk features, and to compare its performance to models developed with traditional logistic regression.MethodsThis was a retrospective analysis of preoperative EHR data from 24,885 adults undergoing a procedure requiring anesthesia care, recovering in the main post-anesthesia care unit, and staying in the hospital at least overnight between December 2016 and December 2019 at either of two hospitals in a tertiary care health system. One hundred fifteen preoperative risk features including demographics, comorbidities, nursing assessments, surgery type, and other preoperative EHR data were used to predict postoperative delirium (POD), defined as any instance of Nursing Delirium Screening Scale ≥2 or positive Confusion Assessment Method for the Intensive Care Unit within the first 7 postoperative days. Two ML models (Neural Network and XGBoost), two traditional logistic regression models ("clinician-guided" and "ML hybrid"), and a previously described delirium risk stratification tool (AWOL-S) were evaluated using the area under the receiver operating characteristic curve (AUC-ROC), sensitivity, specificity, positive likelihood ratio, and positive predictive value. Model calibration was assessed with a calibration curve. Patients with no POD assessments charted or at least 20% of input variables missing were excluded.ResultsPOD incidence was 5.3%. The AUC-ROC for Neural Net was 0.841 [95% CI 0. 816-0.863] and for XGBoost was 0.851 [95% CI 0.827-0.874], which was significantly better than the clinician-guided (AUC-ROC 0.763 [0.734-0.793], p < 0.001) and ML hybrid (AUC-ROC 0.824 [0.800-0.849], p < 0.001) regression models and AWOL-S (AUC-ROC 0.762 [95% CI 0.713-0.812], p < 0.001). Neural Net, XGBoost, and ML hybrid models demonstrated excellent calibration, while calibration of the clinician-guided and AWOL-S models was moderate; they tended to overestimate delirium risk in those already at highest risk.ConclusionUsing pragmatically collected EHR data, two ML models predicted POD in a broad perioperative population with high discrimination. Optimal application of the models would provide automated, real-time delirium risk stratification to improve perioperative management of surgical patients at risk for POD.

Project description:Accurate, real-time case identification is needed to target interventions to improve quality and outcomes for hospitalized patients with heart failure. Problem lists may be useful for case identification but are often inaccurate or incomplete. Machine-learning approaches may improve accuracy of identification but can be limited by complexity of implementation.To develop algorithms that use readily available clinical data to identify patients with heart failure while in the hospital.We performed a retrospective study of hospitalizations at an academic medical center. Hospitalizations for patients 18 years or older who were admitted after January 1, 2013, and discharged before February 28, 2015, were included. From a random 75% sample of hospitalizations, we developed 5 algorithms for heart failure identification using electronic health record data: (1) heart failure on problem list; (2) presence of at least 1 of 3 characteristics: heart failure on problem list, inpatient loop diuretic, or brain natriuretic peptide level of 500 pg/mL or higher; (3) logistic regression of 30 clinically relevant structured data elements; (4) machine-learning approach using unstructured notes; and (5) machine-learning approach using structured and unstructured data.Heart failure diagnosis based on discharge diagnosis and physician review of sampled medical records.A total of 47?119 hospitalizations were included in this study (mean [SD] age, 60.9 [18.15] years; 23 952 female [50.8%], 5258 black/African American [11.2%], and 3667 Hispanic/Latino [7.8%] patients). Of these hospitalizations, 6549 (13.9%) had a discharge diagnosis of heart failure. Inclusion of heart failure on the problem list (algorithm 1) had a sensitivity of 0.40 and a positive predictive value (PPV) of 0.96 for heart failure identification. Algorithm 2 improved sensitivity to 0.77 at the expense of a PPV of 0.64. Algorithms 3, 4, and 5 had areas under the receiver operating characteristic curves of 0.953, 0.969, and 0.974, respectively. With a PPV of 0.9, these algorithms had associated sensitivities of 0.68, 0.77, and 0.83, respectively.The problem list is insufficient for real-time identification of hospitalized patients with heart failure. The high predictive accuracy of machine learning using free text demonstrates that support of such analytics in future electronic health record systems can improve cohort identification.

Project description:Background and significanceIntravascular (IV) catheters are the most invasive medical device in healthcare. Localized priority-setting related to IV catheter quality surveillance is a key objective of recent healthcare reform in Australia. We sought to determine the plausibility of using electronic health record (EHR) data for catheter surveillance by mapping currently available data across state-wide platforms. This work has identified barriers and facilitators to a state-wide EHR surveillance initiative.Materials and methodsData variables were generated and mapped from routinely used EHR sources across Queensland, Australia through a systematic search of gray literature and expert consultation with clinical information specialists. EHR systems were eligible for inclusion if they collected data related to IV catheter insertion, care, or outcomes of hospitalized patients. Generated variables were mapped against international recommendations for IV catheter surveillance, with data linkage and data export capacity narratively summarized.ResultsWe identified five EHR systems, namely, iEMR, MetaVision ICU®, Multiprac, RiskMan, and the Nephrology Registry. Systems were used across jurisdictions and hospital wards. Data linkage was not evident across systems. Extraction processes for catheter data were not standardized, lacking clear and reliable extraction techniques. In combination, EHR systems collected 43/50 international variables recommended for catheter surveillance, however, individual systems collected a median of 24/50 (IQR 22, 30) variables. We did not identify integrated clinical analytic systems (incorporating machine learning) to support clinical decision making or for risk stratification (e.g., catheter-related infection).ConclusionCurrent data linkage across EHR systems limits the development of an IV catheter quality surveillance system to provide timely data related to catheter complications and harm. To facilitate reliable and timely surveillance of catheter outcomes using clinical informatics, substantial work is needed to overcome existing barriers and transform health surveillance.

Dataset Information

Exploring the frontier of electronic health record surveillance: the case of postoperative complications.

Publications

Exploring the frontier of electronic health record surveillance: the case of postoperative complications.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets