Dataset Information

The CCEDRRN COVID-19 Mortality Score to predict death among nonpalliative patients with COVID-19 presenting to emergency departments: a derivation and validation study.

ABSTRACT:

Background

Predicting mortality from COVID-19 using information available when patients present to the emergency department can inform goals-of-care decisions and assist with ethical allocation of critical care resources. The study objective was to develop and validate a clinical score to predict emergency department and in-hospital mortality among consecutive nonpalliative patients with COVID-19; in this study, we define palliative patients as those who do not want resuscitative measures, such as intubation, intensive care unit care or cardiopulmonary resuscitation.

Methods

This derivation and validation study used observational cohort data recruited from 46 hospitals in 8 Canadian provinces participating in the Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN). We included adult (age ≥ 18 yr) nonpalliative patients with confirmed COVID-19 who presented to the emergency department of a participating site between Mar. 1, 2020, and Jan. 31, 2021. We randomly assigned hospitals to derivation or validation, and prespecified clinical variables as candidate predictors. We used logistic regression to develop the score in a derivation cohort and examined its performance in predicting emergency department and in-hospital mortality in a validation cohort.

Results

Of 8761 eligible patients, 618 (7.0%) died. The CCEDRRN COVID-19 Mortality Score included age, sex, type of residence, arrival mode, chest pain, severe liver disease, respiratory rate and level of respiratory support. The area under the curve was 0.92 (95% confidence interval [CI] 0.90-0.93) in derivation and 0.92 (95% CI 0.90-0.93) in validation. The score had excellent calibration. These results suggest that scores of 6 or less would categorize patients as being at low risk for in-hospital death, with a negative predictive value of 99.9%. Patients in the low-risk group had an in-hospital mortality rate of 0.1%. Patients with a score of 15 or higher had an observed mortality rate of 81.0%.

Interpretation

The CCEDRRN COVID-19 Mortality Score is a simple score that can be used for level-of-care discussions with patients and in situations of critical care resource constraints to accurately predict death using variables available on emergency department arrival. The score was derived and validated mostly in unvaccinated patients, and before variants of concern were circulating widely and newer treatment regimens implemented in Canada.

Study registration

ClinicalTrials.gov, no. NCT04702945.

SUBMITTER: Hohl CM

PROVIDER: S-EPMC9259439 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesTo develop and validate a clinical risk score that can accurately quantify the probability of SARS-CoV-2 infection in patients presenting to an emergency department without the need for laboratory testing.DesignCohort study of participants in the Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN) registry. Regression models were fitted to predict a positive SARS-CoV-2 test result using clinical and demographic predictors, as well as an indicator of local SARS-CoV-2 incidence.Setting32 emergency departments in eight Canadian provinces.Participants27 665 consecutively enrolled patients who were tested for SARS-CoV-2 in participating emergency departments between 1 March and 30 October 2020.Main outcome measuresPositive SARS-CoV-2 nucleic acid test result within 14 days of an index emergency department encounter for suspected COVID-19 disease.ResultsWe derived a 10-item CCEDRRN COVID-19 Infection Score using data from 21 743 patients. This score included variables from history and physical examination and an indicator of local disease incidence. The score had a c-statistic of 0.838 with excellent calibration. We externally validated the rule in 5295 patients. The score maintained excellent discrimination and calibration and had superior performance compared with another previously published risk score. Score cut-offs were identified that can rule-in or rule-out SARS-CoV-2 infection without the need for nucleic acid testing with 97.4% sensitivity (95% CI 96.4 to 98.3) and 95.9% specificity (95% CI 95.5 to 96.0).ConclusionsThe CCEDRRN COVID-19 Infection Score uses clinical characteristics and publicly available indicators of disease incidence to quantify a patient's probability of SARS-CoV-2 infection. The score can identify patients at sufficiently high risk of SARS-CoV-2 infection to warrant isolation and empirical therapy prior to test confirmation while also identifying patients at sufficiently low risk of infection that they may not need testing.Trial registration numberNCT04702945.

Project description:BackgroundCOVID-19 mortality risk stratification tools could improve care, inform accurate and rapid triage decisions, and guide family discussions regarding goals of care. A minority of COVID-19 prognostic tools have been tested in external cohorts. Our objective was to compare machine learning algorithms and develop a tool for predicting subsequent clinical outcomes in COVID-19. MethodsWe conducted a retrospective cohort study that included hospitalized patients with COVID-19 from March 2020 to March 2021. 712 consecutive patients from University of Washington (UW) and 345 patients from Tongji Hospital in China were included. We applied three different machine learning algorithms to clinical and laboratory data collected within the initial 24 hours of hospital admission to determine the risk of in-hospital mortality, transfer to the intensive care unit (ICU), shock requiring vasopressors, and receipt of renal replacement therapy (RRT). Mortality risk models were derived, internally validated in UW and externally validated in Tongji Hospital. The risk models for ICU transfer, shock and RRT were derived and internally validated in the UW dataset. ResultsAmong the UW dataset, 122 patients died (17%) during hospitalization and the mean days to hospital mortality was 15.7 +/- 21.5 (mean +/- SD). Elastic net logistic regression resulted in a C-statistic for in-hospital mortality of 0.72 (95% CI, 0.64 to 0.81) in the internal validation and 0.85 (95% CI, 0.81 to 0.89) in the external validation set. Age, platelet count, and white blood cell count were the most important predictors of mortality. In the sub-group of patients > 50 years of age, the mortality prediction model continued to perform with a C-statistic of 0.82 (95% CI:0.76,0.87). Mortality prediction models also performed well for shock and RRT in the UW dataset but functioned with lower accuracy for ICU transfer. ConclusionsWe trained, internally and externally validated a prediction model using data collected within 24 hours of hospital admission to predict in-hospital mortality on average two weeks prior to death. We also developed models to predict RRT and shock with high accuracy. These models could be used to improve triage decisions, resource allocation, and support clinical trial enrichment.

Project description:AbstractAs severe acute respiratory syndrome coronavirus 2 continues to spread, easy-to-use risk models that predict hospital mortality can assist in clinical decision making and triage. We aimed to develop a risk score model for in-hospital mortality in patients hospitalized with 2019 novel coronavirus (COVID-19) that was robust across hospitals and used clinical factors that are readily available and measured standardly across hospitals.In this retrospective observational study, we developed a risk score model using data collected by trained abstractors for patients in 20 diverse hospitals across the state of Michigan (Mi-COVID19) who were discharged between March 5, 2020 and August 14, 2020. Patients who tested positive for severe acute respiratory syndrome coronavirus 2 during hospitalization or were discharged with an ICD-10 code for COVID-19 (U07.1) were included. We employed an iterative forward selection approach to consider the inclusion of 145 potential risk factors available at hospital presentation. Model performance was externally validated with patients from 19 hospitals in the Mi-COVID19 registry not used in model development. We shared the model in an easy-to-use online application that allows the user to predict in-hospital mortality risk for a patient if they have any subset of the variables in the final model.Two thousand one hundred and ninety-three patients in the Mi-COVID19 registry met our inclusion criteria. The derivation and validation sets ultimately included 1690 and 398 patients, respectively, with mortality rates of 19.6% and 18.6%, respectively. The average age of participants in the study after exclusions was 64 years old, and the participants were 48% female, 49% Black, and 87% non-Hispanic. Our final model includes the patient's age, first recorded respiratory rate, first recorded pulse oximetry, highest creatinine level on day of presentation, and hospital's COVID-19 mortality rate. No other factors showed sufficient incremental model improvement to warrant inclusion. The area under the receiver operating characteristics curve for the derivation and validation sets were .796 (95% confidence interval, .767-.826) and .829 (95% confidence interval, .782-.876) respectively.We conclude that the risk of in-hospital mortality in COVID-19 patients can be reliably estimated using a few factors, which are standardly measured and available to physicians very early in a hospital encounter.

Project description:BackgroundTreatment for coronavirus disease 2019 (COVID-19) evolved between pandemic waves. Our objective was to compare treatments, acute care utilization, and outcomes of COVID-19 patients presenting to emergency departments (ED) across pandemic waves.MethodsThis observational study enrolled consecutive eligible COVID-19 patients presenting to 46 EDs participating in the Canadian COVID-19 ED Rapid Response Network (CCEDRRN) between March 1 and December 31, 2020. We collected data by retrospective chart review. Our primary outcome was in-hospital mortality. Secondary outcomes included treatments, hospital and ICU admissions, ED revisits and readmissions. Logistic regression modeling assessed the impact of pandemic wave on outcomes.ResultsWe enrolled 9,967 patients in 8 provinces, 3,336 from the first and 6,631 from the second wave. Patients in the second wave were younger, fewer met criteria for severe COVID-19, and more were discharged from the ED. Adjusted for patient characteristics and disease severity, steroid use increased (odds ratio [OR] 7.4; 95% confidence interval [CI] 6.2-8.9), and invasive mechanical ventilation decreased (OR 0.5; 95% CI 0.4-0.7) in the second wave compared to the first. After adjusting for differences in patient characteristics and disease severity, the odds of hospitalization (OR 0.7; 95% CI 0.6-0.8) and critical care admission (OR 0.7; 95% CI 0.6-0.9) decreased, while mortality remained unchanged (OR 0.7; 95% CI 0.5-1.1).InterpretationIn patients presenting to cute care facilities, we observed rapid uptake of evidence-based therapies and less use of experimental therapies in the second wave. We observed increased rates of ED discharges and lower hospital and critical care resource use over time. Substantial reductions in mechanical ventilation were not associated with increasing mortality. Advances in treatment strategies created health system efficiencies without compromising patient outcomes.Trial registrationClinicaltrials.gov, NCT04702945.

Project description:BackgroundSurgical delay may result in unintended harm to patients needing cardiac surgery, who are at risk for death if their condition is left untreated. Our objective was to derive and internally validate a clinical risk score to predict death among patients awaiting major cardiac surgery.MethodsWe used the CorHealth Ontario Registry and linked ICES health administrative databases with information on all Ontario residents to identify patients aged 18 years or more who were referred for isolated coronary artery bypass grafting (CABG), valvular procedures, combined CABG-valvular procedures or thoracic aorta procedures between Oct. 1, 2008, and Sept. 30, 2019. We used a hybrid modelling approach with the random forest method for initial variable selection, followed by backward stepwise logistic regression modelling for clinical interpretability and parsimony. We internally validated the logistic regression model, termed the CardiOttawa Waitlist Mortality Score, using 200 bootstraps.ResultsOf the 112 266 patients referred for cardiac surgery, 269 (0.2%) died while awaiting surgery (118/72 366 [0.2%] isolated CABG, 81/24 461 [0.3%] valvular procedures, 63/12 046 [0.5%] combined CABG-valvular procedures and 7/3393 [0.2%] thoracic aorta procedures). Age, sex, surgery type, left main stenosis, Canadian Cardiovascular Society classification, left ventricular ejection fraction, heart failure, atrial fibrillation, dialysis, psychosis and operative priority were predictors of waitlist mortality. The model discriminated (C-statistic 0.76 [optimism-corrected 0.73]). It calibrated well in the overall cohort (Hosmer-Lemeshow p = 0.2) and across surgery types.InterpretationThe CardiOttawa Waitlist Mortality Score is a simple clinical risk model that predicts the likelihood of death while awaiting cardiac surgery. It has the potential to provide data-driven decision support for managing access to cardiac care and preserve system capacity during the COVID-19 pandemic, the recovery period and beyond.