Dataset Information

Multicenter validation of Early Warning Scores for detection of clinical deterioration in COVID-19 hospitalized patients.

ABSTRACT:

Objective

Investigate the predictive value of NEWS2, NEWS-C, and COVID-19 Severity Index for predicting intensive care unit (ICU) transfer in the next 24h.

Design

Retrospective multicenter study.

Setting

Two third-level hospitals in Argentina.

Patients

All adult patients with confirmed COVID-19, admitted on general wards, excluding patients with non-intubated orders.

Interventions

Patients were divided between those who were admitted to ICU and non-admitted. We calculated the three scores for each day of hospitalization.

Variables

We evaluate the calibration and discrimination of the three scores for the outcome ICU admission within 24, 48h, and at hospital admission.

Results

We evaluate 13,768 days of hospitalizations on general medical wards of 1318 patients. Among these, 126 (9.5%) were transferred to ICU. The AUROC of NEWS2 was 0.73 (95%CI 0.68-0.78) 24h before ICU admission, and 0.52 (95%CI 0.47-0.57) at hospital admission. The AUROC of NEWS-C was 0.73 (95%CI 0.68-0.78) and 0.52 (95%CI 0.47-0.57) respectively, and the AUROC of COVID-19 Severity Index was 0.80 (95%CI 0.77-0.84) and 0.61 (95%CI 0.58-0.66) respectively. COVID-19 Severity Index presented better calibration than NEWS2 and NEWS-C.

Conclusion

COVID-19 Severity index has better calibration and discrimination than NEWS2 and NEWS-C to predict ICU transfer during hospitalization.

SUBMITTER: Huespe IA

PROVIDER: S-EPMC9579896 | biostudies-literature | 2022 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multicenter validation of Early Warning Scores for detection of clinical deterioration in COVID-19 hospitalized patients.

Huespe I A IA Bisso I C IC Roman E S ES Prado E E Gemelli N N Sinner J J Heras M L ML Risk M R MR

Medicina intensiva 20221019 1

<h4>Objective</h4>Investigate the predictive value of NEWS2, NEWS-C, and COVID-19 Severity Index for predicting intensive care unit (ICU) transfer in the next 24h.<h4>Design</h4>Retrospective multicenter study.<h4>Setting</h4>Two third-level hospitals in Argentina.<h4>Patients</h4>All adult patients with confirmed COVID-19, admitted on general wards, excluding patients with non-intubated orders.<h4>Interventions</h4>Patients were divided between those who were admitted to ICU and non-admitted. W ...[more]

PMID: 36272911

Similar Datasets

Project description:Background: Early Warning Scores (EWS), including the National Early Warning Score 2 (NEWS2) and Modified NEWS (NEWS-C), have been recommended for triage decision in patients with COVID-19. However, the effectiveness of these EWS in COVID-19 has not been fully validated. The study aimed to investigate the predictive value of EWS to detect clinical deterioration in patients with COVID-19. Methods: Between February 7, 2020 and February 17, 2020, patients confirmed with COVID-19 were screened for this study. The outcomes were early deterioration of respiratory function (EDRF) and need for intensive respiratory support (IRS) during the treatment process. The EDRF was defined as changes in the respiratory component of the sequential organ failure assessment (SOFA) score at day 3 (ΔSOFAresp = SOFA resp at day 3-SOFAresp on admission), in which the positive value reflects clinical deterioration. The IRS was defined as the use of high flow nasal cannula oxygen therapy, noninvasive or invasive mechanical ventilation. The performances of EWS including NEWS, NEWS 2, NEWS-C, Modified Early Warning Scores (MEWS), Hamilton Early Warning Scores (HEWS), and quick sepsis-related organ failure assessment (qSOFA) for predicting EDRF and IRS were compared using the area under the receiver operating characteristic curve (AUROC). Results: A total of 116 patients were included in this study. Of them, 27 patients (23.3%) developed EDRF and 24 patients (20.7%) required IRS. Among these EWS, NEWS-C was the most accurate scoring system for predicting EDRF [AUROC 0.79 (95% CI, 0.69-0.89)] and IRS [AUROC 0.89 (95% CI, 0.82-0.96)], while NEWS 2 had the lowest accuracy in predicting EDRF [AUROC 0.59 (95% CI, 0.46-0.720)] and IRS [AUROC 0.69 (95% CI, 0.57-0.81)]. A NEWS-C ≥ 9 had a sensitivity of 59.3% and a specificity of 85.4% for predicting EDRF. For predicting IRS, a NEWS-C ≥ 9 had a sensitivity of 75% and a specificity of 88%. Conclusions: The NEWS-C was the most accurate scoring system among common EWS to identify patients with COVID-19 at risk for EDRF and need for IRS. The NEWS-C could be recommended as an early triage tool for patients with COVID-19.

Project description:BackgroundThe emergence of new SARS-CoV-2 variants with significant immune-evasiveness, the relaxation of measures for reducing the number of infections, the waning of immune protection (particularly in high-risk population groups), and the low uptake of new vaccine boosters, forecast new waves of hospitalizations and admission to intensive care units. There is an urgent need for easily implementable and clinically effective Early Warning Scores (EWSs) that can predict the risk of complications within the next 24-48 hr. Although EWSs have been used in the evaluation of COVID-19 patients, there are several clinical limitations to their use. Moreover, no models have been tested on geographically distinct populations or population groups with varying levels of immune protection.MethodsWe developed and validated COVID-19 Early Warning Score (COEWS), an EWS that is automatically calculated solely from laboratory parameters that are widely available and affordable. We benchmarked COEWS against the widely used NEWS2. We also evaluated the predictive performance of vaccinated and unvaccinated patients.ResultsThe variables of the COEWS predictive model were selected based on their predictive coefficients and on the wide availability of these laboratory variables. The final model included complete blood count, blood glucose, and oxygen saturation features. To make COEWS more actionable in real clinical situations, we transformed the predictive coefficients of the COEWS model into individual scores for each selected feature. The global score serves as an easy-to-calculate measure indicating the risk of a patient developing the combined outcome of mechanical ventilation or death within the next 48 hr.The discrimination in the external validation cohort was 0.743 (95% confidence interval [CI]: 0.703-0.784) for the COEWS score performed with coefficients and 0.700 (95% CI: 0.654-0.745) for the COEWS performed with scores. The area under the receiver operating characteristic curve (AUROC) was similar in vaccinated and unvaccinated patients. Additionally, we observed that the AUROC of the NEWS2 was 0.677 (95% CI: 0.601-0.752) in vaccinated patients and 0.648 (95% CI: 0.608-0.689) in unvaccinated patients.ConclusionsThe COEWS score predicts death or MV within the next 48 hr based on routine and widely available laboratory measurements. The extensive external validation, its high performance, its ease of use, and its positive benchmark in comparison with the widely used NEWS2 position COEWS as a new reference tool for assisting clinical decisions and improving patient care in the upcoming pandemic waves.FundingUniversity of Vienna.

Project description:BackgroundThe National Early Warning Score-2 (NEWS-2) is used to detect patient deterioration in UK hospitals but fails to take account of the detailed granularity or temporal trends in clinical observations. We used data-driven methods to develop dynamic early warning scores (DEWS) to address these deficiencies, and tested their accuracy in patients with respiratory disease for predicting (1) death or intensive care unit admission, occurring within 24 h (D/ICU), and (2) clinically significant deterioration requiring urgent intervention, occurring within 4 h (CSD).MethodsClinical observations data were extracted from electronic records for 31,590 respiratory in-patient episodes from April 2015 to December 2020 at a large acute NHS Trust. The timing of D/ICU was extracted for all episodes. 1100 in-patient episodes were annotated manually to record the timing of CSD, defined as a specific event requiring a change in treatment. Time series features were entered into logistic regression models to derive DEWS for each of the clinical outcomes. Area under the receiver operating characteristic curve (AUROC) was the primary measure of model accuracy.ResultsAUROC (95% confidence interval) for predicting D/ICU was 0.857 (0.852-0.862) for NEWS-2 and 0.906 (0.899-0.914) for DEWS in the validation data. AUROC for predicting CSD was 0.829 (0.817-0.842) for NEWS-2 and 0.877 (0.862-0.892) for DEWS. NEWS-2 ≥ 5 had sensitivity of 88.2% and specificity of 54.2% for predicting CSD, while DEWS ≥ 0.021 had higher sensitivity of 93.6% and approximately the same specificity of 54.3% for the same outcome. Using these cut-offs, 315 out of 347 (90.8%) CSD events were detected by both NEWS-2 and DEWS, at the time of the event or within the previous 4 h; 12 (3.5%) were detected by DEWS but not by NEWS-2, while 4 (1.2%) were detected by NEWS-2 but not by DEWS; 16 (4.6%) were not detected by either scoring system.ConclusionWe have developed DEWS that display greater accuracy than NEWS-2 for predicting clinical deterioration events in patients with respiratory disease. Prospective validation studies are required to assess whether DEWS can be used to reduce missed deteriorations and false alarms in real-life clinical settings.

Project description:BackgroundEarly warning scores are designed to identify hospitalized patients who are at high risk of clinical deterioration. Although many general scores have been developed for the medical-surgical wards, specific scores have also been developed for obstetric patients due to differences in normal vital sign ranges and potential complications in this unique population. The comparative performance of general and obstetric early warning scores for predicting deterioration and infection on the maternal wards is not known.MethodsThis was an observational cohort study at the University of Chicago that included patients hospitalized on obstetric wards from November 2008 to December 2018. Obstetric scores (modified early obstetric warning system (MEOWS), maternal early warning criteria (MEWC), and maternal early warning trigger (MEWT)), paper-based general scores (Modified Early Warning Score (MEWS) and National Early Warning Score (NEWS), and a general score developed using machine learning (electronic Cardiac Arrest Risk Triage (eCART) score) were compared using the area under the receiver operating characteristic score (AUC) for predicting ward to intensive care unit (ICU) transfer and/or death and new infection.ResultsA total of 19,611 patients were included, with 43 (0.2%) experiencing deterioration (ICU transfer and/or death) and 88 (0.4%) experiencing an infection. eCART had the highest discrimination for deterioration (p < 0.05 for all comparisons), with an AUC of 0.86, followed by MEOWS (0.74), NEWS (0.72), MEWC (0.71), MEWS (0.70), and MEWT (0.65). MEWC, MEWT, and MEOWS had higher accuracy than MEWS and NEWS but lower accuracy than eCART at specific cut-off thresholds. For predicting infection, eCART (AUC 0.77) had the highest discrimination.ConclusionsWithin the limitations of our retrospective study, eCART had the highest accuracy for predicting deterioration and infection in our ante- and postpartum patient population. Maternal early warning scores were more accurate than MEWS and NEWS. While institutional choice of an early warning system is complex, our results have important implications for the risk stratification of maternal ward patients, especially since the low prevalence of events means that small improvements in accuracy can lead to large decreases in false alarms.

Dataset Information

Multicenter validation of Early Warning Scores for detection of clinical deterioration in COVID-19 hospitalized patients.

Objective

Design

Setting

Patients

Interventions

Variables

Results

Conclusion

Publications

Multicenter validation of Early Warning Scores for detection of clinical deterioration in COVID-19 hospitalized patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets