Dataset Information

Performance Analysis of the National Early Warning Score and Modified Early Warning Score in the Adaptive COVID-19 Treatment Trial Cohort.

ABSTRACT: We sought to validate prognostic scores in coronavirus disease 2019 including National Early Warning Score, Modified Early Warning Score, and age-based modifications, and define their performance characteristics.

Design

We analyzed prospectively collected data from the Adaptive COVID-19 Treatment Trial. National Early Warning Score was collected daily during the trial, Modified Early Warning Score was calculated, and age applied to both scores. We assessed prognostic value for the end points of recovery, mechanical ventilation, and death for score at enrollment, average, and slope of score over the first 48 hours.

Setting

A multisite international inpatient trial.

Patients

A total of 1,062 adult nonpregnant inpatients with severe coronavirus disease 2019 pneumonia.

Interventions

Adaptive COVID-19 Treatment Trial 1 randomized participants to receive remdesivir or placebo. The prognostic value of predictive scores was evaluated in both groups separately to assess for differential performance in the setting of remdesivir treatment.

Measurements and main results

For mortality, baseline National Early Warning Score and Modified Early Warning Score were weakly to moderately prognostic (c-index, 0.60-0.68), and improved with addition of age (c-index, 0.66-0.74). For recovery, baseline National Early Warning Score and Modified Early Warning Score demonstrated somewhat better prognostic ability (c-index, 0.65-0.69); however, National Early Warning Score+age and Modified Early Warning Score+age further improved performance (c-index, 0.68-0.71). For deterioration, baseline National Early Warning Score and Modified Early Warning Score were weakly to moderately prognostic (c-index, 0.59-0.69) and improved with addition of age (c-index, 0.63-0.70). All prognostic performance improvements due to addition of age were significant (p < 0.05).

Conclusions

In the Adaptive COVID-19 Treatment Trial 1 cohort, National Early Warning Score and Modified Early Warning Score demonstrated moderate prognostic performance in patients with severe coronavirus disease 2019, with improvement in predictive ability for National Early Warning Score+age and Modified Early Warning Score+age. Area under receiver operating curve for National Early Warning Score and Modified Early Warning Score improved in patients receiving remdesivir versus placebo early in the pandemic for recovery and mortality. Although these scores are simple and readily obtainable in myriad settings, in our data set, they were insufficiently predictive to completely replace clinical judgment in coronavirus disease 2019 and may serve best as an adjunct to triage, disposition, and resourcing decisions.

SUBMITTER: Colombo CJ

PROVIDER: S-EPMC8280088 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundModified Early Warning Score (MEWS) and National Early Warning Score (NEWS) are widely used in predicting the mortality and intensive care unit (ICU) admission of critically ill patients. This study was conducted to evaluate and compare the prognostic value of NEWS and MEWS for predicting ICU readmission, mortality, and related outcomes in critically ill patients at the time of ICU discharge.MethodsThis multicenter, prospective, observational study was conducted over a year, from April 2019 to March 2020, in the general ICUs of two university-affiliated hospitals in Northwest Iran. MEWS and NEWS were compared based on the patients' outcomes (including mortality, ICU readmission, time to readmission, discharge type, mechanical ventilation (MV), MV duration, and multiple organ failure after readmission) using the univariable and multivariable binary logistic regression. The receiver operating characteristic (ROC) curve was used to determine the outcome predictability of MEWS and NEWS.ResultsA total of 410 ICU patients were enrolled in this study. According to multivariable logistic regression analysis, both MEWS and NEWS were predictors of ICU readmission, time to readmission, MV status after readmission, MV duration, and multiple organ failure after readmission. The area under the ROC curve (AUC) for predicting mortality was 0.91 (95% CI = 0.88-0.94, P < 0.0001) for the NEWS and 0.88 (95% CI = 0.84-0.91, P < 0.0001) for the MEWS. There was no significant difference between the AUC of the NEWS and the MEWS for predicting mortality (P = 0.082). However, for ICU readmission (0.84 vs. 0.71), time to readmission (0.82 vs. 0.67), MV after readmission (0.83 vs. 0.72), MV duration (0.81 vs. 0.67), and multiple organ failure (0.833 vs. 0.710), the AUCs of MEWS were significantly greater (P < 0.001).ConclusionNational Early Warning Score and MEWS values of >4 demonstrated high sensitivity and specificity in identifying the risk of mortality for the patients' discharge from ICU. However, we found that the MEWS showed superiority over the NEWS score in predicting other outcomes. Eventually, MEWS could be considered an efficient prediction score for morbidity and mortality of critically ill patients.

Project description:BackgroundThere is a need for validated clinical risk scores to identify patients at risk of severe disease and to guide decision-making during the covid-19 pandemic. The National Early Warning Score 2 (NEWS2) is widely used in emergency medicine, but so far, no studies have evaluated its use in patients with covid-19. We aimed to study the performance of NEWS2 and compare commonly used clinical risk stratification tools at admission to predict risk of severe disease and in-hospital mortality in patients with covid-19.MethodsThis was a prospective cohort study in a public non-university general hospital in the Oslo area, Norway, including a cohort of all 66 patients hospitalised with confirmed SARS-CoV-2 infection from the start of the pandemic; 13 who died during hospital stay and 53 who were discharged alive. Data were collected consecutively from March 9th to April 27th 2020. The main outcome was the ability of the NEWS2 score and other clinical risk scores at emergency department admission to predict severe disease and in-hospital mortality in covid-19 patients. We calculated sensitivity and specificity with 95% confidence intervals (CIs) for NEWS2 scores ≥5 and ≥ 6, quick Sequential Organ Failure Assessment (qSOFA) score ≥ 2, ≥2 Systemic Inflammatory Response Syndrome (SIRS) criteria, and CRB-65 score ≥ 2. Areas under the curve (AUCs) for the clinical risk scores were compared using DeLong's test.ResultsIn total, 66 patients (mean age 67.9 years) were included. Of these, 23% developed severe disease. In-hospital mortality was 20%. Tachypnoea, hypoxemia and confusion at admission were more common in patients developing severe disease. A NEWS2 score ≥ 6 at admission predicted severe disease with 80.0% sensitivity and 84.3% specificity (Area Under the Curve (AUC) 0.822, 95% CI 0.690-0.953). NEWS2 was superior to qSOFA score ≥ 2 (AUC 0.624, 95% CI 0.446-0.810, p < 0.05) and other clinical risk scores for this purpose.ConclusionNEWS2 score at hospital admission predicted severe disease and in-hospital mortality, and was superior to other widely used clinical risk scores in patients with covid-19.

Project description:BackgroundThe National Early Warning Score (NEWS2) is currently recommended in the UK for the risk stratification of COVID-19 patients, but little is known about its ability to detect severe cases. We aimed to evaluate NEWS2 for the prediction of severe COVID-19 outcome and identify and validate a set of blood and physiological parameters routinely collected at hospital admission to improve upon the use of NEWS2 alone for medium-term risk stratification.MethodsTraining cohorts comprised 1276 patients admitted to King's College Hospital National Health Service (NHS) Foundation Trust with COVID-19 disease from 1 March to 30 April 2020. External validation cohorts included 6237 patients from five UK NHS Trusts (Guy's and St Thomas' Hospitals, University Hospitals Southampton, University Hospitals Bristol and Weston NHS Foundation Trust, University College London Hospitals, University Hospitals Birmingham), one hospital in Norway (Oslo University Hospital), and two hospitals in Wuhan, China (Wuhan Sixth Hospital and Taikang Tongji Hospital). The outcome was severe COVID-19 disease (transfer to intensive care unit (ICU) or death) at 14 days after hospital admission. Age, physiological measures, blood biomarkers, sex, ethnicity, and comorbidities (hypertension, diabetes, cardiovascular, respiratory and kidney diseases) measured at hospital admission were considered in the models.ResultsA baseline model of 'NEWS2 + age' had poor-to-moderate discrimination for severe COVID-19 infection at 14 days (area under receiver operating characteristic curve (AUC) in training cohort = 0.700, 95% confidence interval (CI) 0.680, 0.722; Brier score = 0.192, 95% CI 0.186, 0.197). A supplemented model adding eight routinely collected blood and physiological parameters (supplemental oxygen flow rate, urea, age, oxygen saturation, C-reactive protein, estimated glomerular filtration rate, neutrophil count, neutrophil/lymphocyte ratio) improved discrimination (AUC = 0.735; 95% CI 0.715, 0.757), and these improvements were replicated across seven UK and non-UK sites. However, there was evidence of miscalibration with the model tending to underestimate risks in most sites.ConclusionsNEWS2 score had poor-to-moderate discrimination for medium-term COVID-19 outcome which raises questions about its use as a screening tool at hospital admission. Risk stratification was improved by including readily available blood and physiological parameters measured at hospital admission, but there was evidence of miscalibration in external sites. This highlights the need for a better understanding of the use of early warning scores for COVID.