Dataset Information

External validation of a clinical risk score to predict hospital admission and in-hospital mortality in COVID-19 patients.

ABSTRACT:

Background

Identification of patients with novel coronavirus disease 2019 (COVID-19) requiring hospital admission or at high-risk of in-hospital mortality is essential to guide patient triage and to provide timely treatment for higher risk hospitalized patients.

Methods

A retrospective multi-centre (8 hospital) cohort at Beaumont Health, Michigan, USA, reporting on COVID-19 patients diagnosed between 1 March and 1 April 2020 was used for score validation. The COVID-19 Risk of Complications Score was automatically computed by the EHR. Multivariate logistic regression models were built to predict hospital admission and in-hospital mortality using individual variables constituting the score. Validation was performed using both discrimination and calibration.

Results

Compared to Green scores, Yellow Scores (OR: 5.72) and Red Scores (OR: 19.1) had significantly higher odds of admission (both p < .0001). Similarly, Yellow Scores (OR: 4.73) and Red Scores (OR: 13.3) had significantly higher odds of in-hospital mortality than Green Scores (both p < .0001). The cross-validated C-Statistics for the external validation cohort showed good discrimination for both hospital admission (C = 0.79 (95% CI: 0.77-0.81)) and in-hospital mortality (C = 0.75 (95% CI: 0.71-0.78)).

Conclusions

The COVID-19 Risk of Complications Score predicts the need for hospital admission and in-hospital mortality patients with COVID-19. Key points: Can an electronic health record generated risk score predict the risk of hospital admission and in-hospital mortality in patients diagnosed with coronavirus disease 2019 (COVID-19)? In both validation cohorts of 2,025 and 1,290 COVID-19, the cross-validated C-Statistics showed good discrimination for both hospital admission (C = 0.79 (95% CI: 0.77-0.81)) and in-hospital mortality (C = 0.75 (95% CI: 0.71-0.78)), respectively. The COVID-19 Risk of Complications Score may help predict the need for hospital admission if a patient contracts SARS-CoV-2 infection and in-hospital mortality for a hospitalized patient with COVID-19.

SUBMITTER: Halalau A

PROVIDER: S-EPMC7877986 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundEarly identification of patients with coronavirus disease 2019 (COVID-19) who are at high risk of mortality is of vital importance for appropriate clinical decision making and delivering optimal treatment. We aimed to develop and validate a clinical risk score for predicting mortality at the time of admission of patients hospitalized with COVID-19.MethodsCollaborating with the Korea Centers for Disease Control and Prevention (KCDC), we established a prospective consecutive cohort of 5,628 patients with confirmed COVID-19 infection who were admitted to 120 hospitals in Korea between January 20, 2020, and April 30, 2020. The cohort was randomly divided using a 7:3 ratio into a development (n = 3,940) and validation (n = 1,688) set. Clinical information and complete blood count (CBC) detected at admission were investigated using Least Absolute Shrinkage and Selection Operator (LASSO) and logistic regression to construct a predictive risk score (COVID-Mortality Score). The discriminative power of the risk model was assessed by calculating the area under the curve (AUC) of the receiver operating characteristic curves.ResultsThe incidence of mortality was 4.3% in both the development and validation set. A COVID-Mortality Score consisting of age, sex, body mass index, combined comorbidity, clinical symptoms, and CBC was developed. AUCs of the scoring system were 0.96 (95% confidence interval [CI], 0.85-0.91) and 0.97 (95% CI, 0.84-0.93) in the development and validation set, respectively. If the model was optimized for > 90% sensitivity, accuracies were 81.0% and 80.2% with sensitivities of 91.7% and 86.1% in the development and validation set, respectively. The optimized scoring system has been applied to the public online risk calculator (https://www.diseaseriskscore.com).ConclusionThis clinically developed and validated COVID-Mortality Score, using clinical data available at the time of admission, will aid clinicians in predicting in-hospital mortality.

Project description:AbstractAs severe acute respiratory syndrome coronavirus 2 continues to spread, easy-to-use risk models that predict hospital mortality can assist in clinical decision making and triage. We aimed to develop a risk score model for in-hospital mortality in patients hospitalized with 2019 novel coronavirus (COVID-19) that was robust across hospitals and used clinical factors that are readily available and measured standardly across hospitals.In this retrospective observational study, we developed a risk score model using data collected by trained abstractors for patients in 20 diverse hospitals across the state of Michigan (Mi-COVID19) who were discharged between March 5, 2020 and August 14, 2020. Patients who tested positive for severe acute respiratory syndrome coronavirus 2 during hospitalization or were discharged with an ICD-10 code for COVID-19 (U07.1) were included. We employed an iterative forward selection approach to consider the inclusion of 145 potential risk factors available at hospital presentation. Model performance was externally validated with patients from 19 hospitals in the Mi-COVID19 registry not used in model development. We shared the model in an easy-to-use online application that allows the user to predict in-hospital mortality risk for a patient if they have any subset of the variables in the final model.Two thousand one hundred and ninety-three patients in the Mi-COVID19 registry met our inclusion criteria. The derivation and validation sets ultimately included 1690 and 398 patients, respectively, with mortality rates of 19.6% and 18.6%, respectively. The average age of participants in the study after exclusions was 64 years old, and the participants were 48% female, 49% Black, and 87% non-Hispanic. Our final model includes the patient's age, first recorded respiratory rate, first recorded pulse oximetry, highest creatinine level on day of presentation, and hospital's COVID-19 mortality rate. No other factors showed sufficient incremental model improvement to warrant inclusion. The area under the receiver operating characteristics curve for the derivation and validation sets were .796 (95% confidence interval, .767-.826) and .829 (95% confidence interval, .782-.876) respectively.We conclude that the risk of in-hospital mortality in COVID-19 patients can be reliably estimated using a few factors, which are standardly measured and available to physicians very early in a hospital encounter.

Project description:BackgroundAcute kidney injury has been described as a common complication in patients hospitalized with COVID-19, which may lead to the need for kidney replacement therapy (KRT) in its most severe forms. Our group developed and validated the MMCD score in Brazilian COVID-19 patients to predict KRT, which showed excellent performance using data from 2020. This study aimed to validate the MMCD score in a large cohort of patients hospitalized with COVID-19 in a different pandemic phase and assess its performance to predict in-hospital mortality.MethodsThis study is part of the "Brazilian COVID-19 Registry", a retrospective observational cohort of consecutive patients hospitalized for laboratory-confirmed COVID-19 in 25 Brazilian hospitals between March 2021 and August 2022. The primary outcome was KRT during hospitalization and the secondary was in-hospital mortality. We also searched literature for other prediction models for KRT, to assess the results in our database. Performance was assessed using area under the receiving operator characteristic curve (AUROC) and the Brier score.ResultsA total of 9422 patients were included, 53.8% were men, with a median age of 59 (IQR 48-70) years old. The incidence of KRT was 8.8% and in-hospital mortality was 18.1%. The MMCD score had excellent discrimination and overall performance to predict KRT (AUROC: 0.916 [95% CI 0.909-0.924]; Brier score = 0.057). Despite the excellent discrimination and overall performance (AUROC: 0.922 [95% CI 0.914-0.929]; Brier score = 0.100), the calibration was not satisfactory concerning in-hospital mortality. A random forest model was applied in the database, with inferior performance to predict KRT requirement (AUROC: 0.71 [95% CI 0.69-0.73]).ConclusionThe MMCD score is not appropriate for in-hospital mortality but demonstrates an excellent predictive ability to predict KRT in COVID-19 patients. The instrument is low cost, objective, fast and accurate, and can contribute to supporting clinical decisions in the efficient allocation of assistance resources in patients with COVID-19.