Dataset Information

Prediction of Acute Respiratory Failure Requiring Advanced Respiratory Support in Advance of Interventions and Treatment: A Multivariable Prediction Model From Electronic Medical Record Data.

ABSTRACT:

Background

Acute respiratory failure occurs frequently in hospitalized patients and often begins outside the ICU, associated with increased length of stay, cost, and mortality. Delays in decompensation recognition are associated with worse outcomes.

Objectives

The objective of this study is to predict acute respiratory failure requiring any advanced respiratory support (including noninvasive ventilation). With the advent of the coronavirus disease pandemic, concern regarding acute respiratory failure has increased.

Derivation cohort

All admission encounters from January 2014 to June 2017 from three hospitals in the Emory Healthcare network (82,699).

Validation cohort

External validation cohort: all admission encounters from January 2014 to June 2017 from a fourth hospital in the Emory Healthcare network (40,143). Temporal validation cohort: all admission encounters from February to April 2020 from four hospitals in the Emory Healthcare network coronavirus disease tested (2,564) and coronavirus disease positive (389).

Prediction model

All admission encounters had vital signs, laboratory, and demographic data extracted. Exclusion criteria included invasive mechanical ventilation started within the operating room or advanced respiratory support within the first 8 hours of admission. Encounters were discretized into hour intervals from 8 hours after admission to discharge or advanced respiratory support initiation and binary labeled for advanced respiratory support. Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment, our eXtreme Gradient Boosting-based algorithm, was compared against Modified Early Warning Score.

Results

Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment had significantly better discrimination than Modified Early Warning Score (area under the receiver operating characteristic curve 0.85 vs 0.57 [test], 0.84 vs 0.61 [external validation]). Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment maintained a positive predictive value (0.31-0.21) similar to that of Modified Early Warning Score greater than 4 (0.29-0.25) while identifying 6.62 (validation) to 9.58 (test) times more true positives. Furthermore, Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment performed more effectively in temporal validation (area under the receiver operating characteristic curve 0.86 [coronavirus disease tested], 0.93 [coronavirus disease positive]), while achieving identifying 4.25-4.51× more true positives.

Conclusions

Prediction of Acute Respiratory Failure requiring advanced respiratory support in Advance of Interventions and Treatment is more effective than Modified Early Warning Score in predicting respiratory failure requiring advanced respiratory support at external validation and in coronavirus disease 2019 patients. Silent prospective validation necessary before local deployment.

SUBMITTER: Wong AI

PROVIDER: S-EPMC8162520 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe electronic medical record (EMR) contains a rich source of information that could be harnessed for epidemic surveillance. We asked if structured EMR data could be coupled with computerized processing of free-text clinical entries to enhance detection of acute respiratory infections (ARI).MethodologyA manual review of EMR records related to 15,377 outpatient visits uncovered 280 reference cases of ARI. We used logistic regression with backward elimination to determine which among candidate structured EMR parameters (diagnostic codes, vital signs and orders for tests, imaging and medications) contributed to the detection of those reference cases. We also developed a computerized free-text search to identify clinical notes documenting at least two non-negated ARI symptoms. We then used heuristics to build case-detection algorithms that best combined the retained structured EMR parameters with the results of the text analysis.Principal findingsAn adjusted grouping of diagnostic codes identified reference ARI patients with a sensitivity of 79%, a specificity of 96% and a positive predictive value (PPV) of 32%. Of the 21 additional structured clinical parameters considered, two contributed significantly to ARI detection: new prescriptions for cough remedies and elevations in body temperature to at least 38°C. Together with the diagnostic codes, these parameters increased detection sensitivity to 87%, but specificity and PPV declined to 95% and 25%, respectively. Adding text analysis increased sensitivity to 99%, but PPV dropped further to 14%. Algorithms that required satisfying both a query of structured EMR parameters as well as text analysis disclosed PPVs of 52-68% and retained sensitivities of 69-73%.ConclusionStructured EMR parameters and free-text analyses can be combined into algorithms that can detect ARI cases with new levels of sensitivity or precision. These results highlight potential paths by which repurposed EMR information could facilitate the discovery of epidemics before they cause mass casualties.

Project description:Background Only 50% of eligible atrial fibrillation ( AF ) patients receive anticoagulation ( AC ). Feasibility and effectiveness of electronic medical record (EMR)-based interventions to profile and raise provider AC percentage is poorly understood. The SUPPORT-AF (Supporting Use of AC Through Provider Profiling of Oral AC Therapy for AF) study aims to improve rates of adherence to AC guidelines by developing and delivering supportive tools based on the EMR to providers treating patients with AF. Methods and Results We emailed cardiologists and community-based primary care providers affiliated with our institution reports of their AC percentage relative to peers. We also sent an electronic medical record-based message to these providers the day before an appointment with an atrial fibrillation patient who was eligible but not receiving AC . The electronic medical record message asked the provider to discuss AC with the patient if he or she deemed it appropriate. To assess feasibility, we tracked provider review of our correspondence. We also tracked the change in AC for intervention providers relative to alternate primary care providers not receiving our intervention. We identified 3786, 1054, and 566 patients cared for by 49 cardiology providers, 90 community-based primary care providers, and 88 control providers, respectively. At baseline, the percentage of AC was 71.3%, 63.5%, and 58.3% for these 3 respective groups. Intervention providers reviewed our e-mails and electronic medical record messages 45% and 96% of the time, respectively. For providers responding, patient refusal was the most common reason for patients not being on AC (21%) followed by high bleeding risk (19%). At follow-up 10 weeks later, change in AC was no different for either cardiology or community-based primary care providers relative to controls (0.2% lower and 0.01% higher, respectively). Conclusions Our intervention profiling AC was feasible, but not sufficient to increase AC in our population.