Dataset Information

Identifying Opioid Use Disorder in the Emergency Department: Multi-System Electronic Health Record-Based Computable Phenotype Derivation and Validation Study.

ABSTRACT: BACKGROUND:Deploying accurate computable phenotypes in pragmatic trials requires a trade-off between precise and clinically sensical variable selection. In particular, evaluating the medical encounter to assess a pattern leading to clinically significant impairment or distress indicative of disease is a difficult modeling challenge for the emergency department. OBJECTIVE:This study aimed to derive and validate an electronic health record-based computable phenotype to identify emergency department patients with opioid use disorder using physician chart review as a reference standard. METHODS:A two-algorithm computable phenotype was developed and evaluated using structured clinical data across 13 emergency departments in two large health care systems. Algorithm 1 combined clinician and billing codes. Algorithm 2 used chief complaint structured data suggestive of opioid use disorder. To evaluate the algorithms in both internal and external validation phases, two emergency medicine physicians, with a third acting as adjudicator, reviewed a pragmatic sample of 231 charts: 125 internal validation (75 positive and 50 negative), 106 external validation (56 positive and 50 negative). RESULTS:Cohen kappa, measuring agreement between reviewers, for the internal and external validation cohorts was 0.95 and 0.93, respectively. In the internal validation phase, Algorithm 1 had a positive predictive value (PPV) of 0.96 (95% CI 0.863-0.995) and a negative predictive value (NPV) of 0.98 (95% CI 0.893-0.999), and Algorithm 2 had a PPV of 0.8 (95% CI 0.593-0.932) and an NPV of 1.0 (one-sided 97.5% CI 0.863-1). In the external validation phase, the phenotype had a PPV of 0.95 (95% CI 0.851-0.989) and an NPV of 0.92 (95% CI 0.807-0.978). CONCLUSIONS:This phenotype detected emergency department patients with opioid use disorder with high predictive values and reliability. Its algorithms were transportable across health care systems and have potential value for both clinical and research purposes.

SUBMITTER: Chartash D

PROVIDER: S-EPMC6913746 | biostudies-literature | 2019 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Identifying Opioid Use Disorder in the Emergency Department: Multi-System Electronic Health Record-Based Computable Phenotype Derivation and Validation Study.

Chartash David D Paek Hyung H Dziura James D JD Ross Bill K BK Nogee Daniel P DP Boccio Eric E Hines Cory C Schott Aaron M AM Jeffery Molly M MM Patel Mehul D MD Platts-Mills Timothy F TF Ahmed Osama O Brandt Cynthia C Couturier Katherine K Melnick Edward E

JMIR medical informatics 20191031 4

<h4>Background</h4>Deploying accurate computable phenotypes in pragmatic trials requires a trade-off between precise and clinically sensical variable selection. In particular, evaluating the medical encounter to assess a pattern leading to clinically significant impairment or distress indicative of disease is a difficult modeling challenge for the emergency department.<h4>Objective</h4>This study aimed to derive and validate an electronic health record-based computable phenotype to identify emer ...[more]

PMID: 31674913

Similar Datasets

Project description:BackgroundAsthma exacerbation leading to emergency department (ED) visit is prevalent, an indicator of poor control of asthma, and is a potentially preventable clinical outcome.ObjectiveWe propose to utilize multiple data elements available in electronic medical records (EMRs) and claims database to create separate algorithms with high validity for clinical and research purposes to identify asthma exacerbation-related ED visit among the general population.MethodsWe performed a retrospective study with inclusion criteria of patients aged 4 to 40 years, a visit to Geisinger ED from January 1, 2006, to October 28, 2013, with asthma on their problem list. Different electronic data elements including chief complaints, vitals, season, smoking, medication use, and discharge diagnoses were obtained to create the algorithm. A stratified random sample was generated to select the charts for review. Chart review was performed to classify patients with asthma-related ED visit, that is, the gold standard. Two reviewers performed the chart review and validation was done on a small subset.ResultsThere were 966 eligible ED visits in the EMR sample and 731 in the claims sample. Agreement between reviewers was 95.45% and kappa statistic was 0.91. Mean age of the EMR sample was 22 years, and mostly white (93%). Multiple models conventionally used in studies were evaluated and the final model chosen included principal diagnosis, bronchodilator, and steroid use for both algorithms, chief complaints for EMR, and secondary diagnosis for claims. Area under the curve was 0.93 (95% confidence interval: 0.91-0.94) and 0.94 (0.93-0.96), respectively, for EMR and claims data, with positive predictive value of?>?94%. The algorithms are visually presented using nomograms.ConclusionWe were able to develop two separate algorithms for EMR and claims to identify asthma exacerbation-related ED visit with excellent diagnostic ability and varying discrimination threshold for clinical and research purposes.

Project description:BackgroundWith higher adoption of electronic health records at health-care centers, electronic search algorithms (computable phenotype) for identifying acute decompensated heart failure (ADHF) among hospitalized patients can be an invaluable tool to enhance data abstraction accuracy and efficacy in order to improve clinical research accrual and patient centered outcomes. We aimed to derive and validate a computable phenotype for ADHF in hospitalized patients.MethodsWe screened 256, 443 eligible (age?>?18?years and with prior research authorization) individuals who were admitted to Mayo Clinic Hospital in Rochester, MN, from January 1, 2006, through December 31, 2014. Using a randomly selected derivation cohort of 938 patients, several iterations of a free-text electronic search were developed and refined. The computable phenotype was subsequently validated in an independent cohort 100 patients. The sensitivity and specificity of the computable phenotype were compared to the gold standard (expert review of charts) and International Classification of Diseases-9 (ICD-9) codes for Acute Heart Failure.ResultsIn the derivation cohort, the computable phenotype achieved a sensitivity of 97.5%, and specificity of 100%, whereas ICD-9 codes for Acute Heart Failure achieved a sensitivity of 47.5% and specificity of 96.7%. When all Heart Failure codes (ICD-9) were used, sensitivity and specificity were 97.5 and 86.6%, respectively. In the validation cohort, the sensitivity and specificity of the computable phenotype were 100 and 98.5%. The sensitivity and specificity for the ICD-9 codes (Acute Heart Failure) were 42 and 98.5%. Upon use of all Heart Failure codes (ICD-9), sensitivity and specificity were 96.8 and 91.3%.ConclusionsOur results suggest that using computable phenotype to ascertain ADHF from the clinical notes contained within the electronic medical record are feasible and reliable. Our computable phenotype outperformed ICD-9 codes for the detection of ADHF.

Project description:Background. While often first treated in the emergency department (ED), identification of sepsis is difficult. Electronic medical record (EMR) clinical decision tools offer a novel strategy for identifying patients with sepsis. The objective of this study was to test the accuracy of an EMR-based, automated sepsis identification system. Methods. We tested an EMR-based sepsis identification tool at a major academic, urban ED with 64,000 annual visits. The EMR system collected vital sign and laboratory test information on all ED patients, triggering a "sepsis alert" for those with ?2 SIRS (systemic inflammatory response syndrome) criteria (fever, tachycardia, tachypnea, leukocytosis) plus ?1 major organ dysfunction (SBP ? 90 mm Hg, lactic acid ?2.0 mg/dL). We confirmed the presence of sepsis through manual review of physician, nursing, and laboratory records. We also reviewed a random selection of ED cases that did not trigger a sepsis alert. We evaluated the diagnostic accuracy of the sepsis identification tool. Results. From January 1 through March 31, 2012, there were 795 automated sepsis alerts. We randomly selected 300 cases without a sepsis alert from the same period. The true prevalence of sepsis was 355/795 (44.7%) among alerts and 0/300 (0%) among non-alerts. The positive predictive value of the sepsis alert was 44.7% (95% CI [41.2-48.2%]). Pneumonia and respiratory infections (38%) and urinary tract infection (32.7%) were the most common infections among the 355 patients with true sepsis (true positives). Among false-positive sepsis alerts, the most common medical conditions were gastrointestinal (26.1%), traumatic (25.7%), and cardiovascular (20.0%) conditions. Rates of hospital admission were: true-positive sepsis alert 91.0%, false-positive alert 83.0%, no sepsis alert 5.7%. Conclusions. This ED EMR-based automated sepsis identification system was able to detect cases with sepsis. Automated EMR-based detection may provide a viable strategy for identifying sepsis in the ED.

Project description:BackgroundPostoperative delirium is an important problem for surgical inpatients and was the target of a multidisciplinary quality improvement project at our institution. We developed and tested a semiautomated delirium risk stratification instrument, Age, WORLD backwards, Orientation, iLlness severity, Surgery-specific risk (AWOL-S), in 3 independent cohorts from our tertiary care hospital and describe its performance characteristics and impact on clinical care.MethodsThe risk stratification instrument was derived with elective surgical patients who were admitted at least overnight and received at least 1 postoperative delirium screen (Nursing Delirium Screening Scale [NuDESC] or Confusion Assessment Method for the Intensive Care Unit [CAM-ICU]) and preoperative cognitive screening tests (orientation to place and ability to spell WORLD backward). Using data pragmatically collected between December 7, 2016, and June 15, 2017, we derived a logistic regression model predicting probability of delirium in the first 7 postoperative hospital days. A priori predictors included age, cognitive screening, illness severity or American Society of Anesthesiologists physical status, and surgical delirium risk. We applied model odds ratios to 2 subsequent cohorts ("validation" and "sustained performance") and assessed performance using area under the receiver operator characteristic curves (AUC-ROC). A post hoc sensitivity analysis assessed performance in emergency and preadmitted patients. Finally, we retrospectively evaluated the use of benzodiazepines and anticholinergic medications in patients who screened at high risk for delirium.ResultsThe logistic regression model used to derive odds ratios for the risk prediction tool included 2091 patients. Model AUC-ROC was 0.71 (0.67-0.75), compared with 0.65 (0.58-0.72) in the validation (n = 908) and 0.75 (0.71-0.78) in the sustained performance (n = 3168) cohorts. Sensitivity was approximately 75% in the derivation and sustained performance cohorts; specificity was approximately 59%. The AUC-ROC for emergency and preadmitted patients was 0.71 (0.67-0.75; n = 1301). After AWOL-S was implemented clinically, patients at high risk for delirium (n = 3630) had 21% (3%-36%) lower relative risk of receiving an anticholinergic medication perioperatively after controlling for secular trends.ConclusionsThe AWOL-S delirium risk stratification tool has moderate accuracy for delirium prediction in a cohort of elective surgical patients, and performance is largely unchanged in emergent/preadmitted surgical patients. Using AWOL-S risk stratification as a part of a multidisciplinary delirium reduction intervention was associated with significantly lower rates of perioperative anticholinergic but not benzodiazepine, medications in those at high risk for delirium. AWOL-S offers a feasible starting point for electronic medical record-based postoperative delirium risk stratification and may serve as a useful paradigm for other institutions.

Dataset Information

Identifying Opioid Use Disorder in the Emergency Department: Multi-System Electronic Health Record-Based Computable Phenotype Derivation and Validation Study.

Publications

Identifying Opioid Use Disorder in the Emergency Department: Multi-System Electronic Health Record-Based Computable Phenotype Derivation and Validation Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets