Dataset Information

Measuring the modified early warning score and the Rothman index: advantages of utilizing the electronic medical record in an early warning system.

ABSTRACT: Early detection of an impending cardiac or pulmonary arrest is an important focus for hospitals trying to improve quality of care. Unfortunately, all current early warning systems suffer from high false-alarm rates. Most systems are based on the Modified Early Warning Score (MEWS); 4 of its 5 inputs are vital signs. The purpose of this study was to compare the accuracy of MEWS against the Rothman Index (RI), a patient acuity score based upon summation of excess risk functions that utilize additional data from the electronic medical record (EMR). MEWS and RI scores were computed retrospectively for 32,472 patient visits. Nursing assessments, a category of EMR inputs only used by the RI, showed sharp differences 24 hours before death. Receiver operating characteristic curves for 24-hour mortality demonstrated superior RI performance with c-statistics, 0.82 and 0.93, respectively. At the point where MEWS triggers an alarm, we identified the RI point corresponding to equal sensitivity and found the positive likelihood ratio (LR+) for MEWS was 7.8, and for the RI was 16.9 with false alarms reduced by 53%. At the RI point corresponding to equal LR+, the sensitivity for MEWS was 49% and 77% for RI, capturing 54% more of those patients who will die within 24 hours.

SUBMITTER: Finlay GD

PROVIDER: S-EPMC4321057 | biostudies-literature | 2014 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring the modified early warning score and the Rothman index: advantages of utilizing the electronic medical record in an early warning system.

Finlay G Duncan GD Rothman Michael J MJ Smith Robert A RA

Journal of hospital medicine 20131219 2

Early detection of an impending cardiac or pulmonary arrest is an important focus for hospitals trying to improve quality of care. Unfortunately, all current early warning systems suffer from high false-alarm rates. Most systems are based on the Modified Early Warning Score (MEWS); 4 of its 5 inputs are vital signs. The purpose of this study was to compare the accuracy of MEWS against the Rothman Index (RI), a patient acuity score based upon summation of excess risk functions that utilize additi ...[more]

PMID: 24357519

Similar Datasets

Project description:We sought to validate prognostic scores in coronavirus disease 2019 including National Early Warning Score, Modified Early Warning Score, and age-based modifications, and define their performance characteristics.DesignWe analyzed prospectively collected data from the Adaptive COVID-19 Treatment Trial. National Early Warning Score was collected daily during the trial, Modified Early Warning Score was calculated, and age applied to both scores. We assessed prognostic value for the end points of recovery, mechanical ventilation, and death for score at enrollment, average, and slope of score over the first 48 hours.SettingA multisite international inpatient trial.PatientsA total of 1,062 adult nonpregnant inpatients with severe coronavirus disease 2019 pneumonia.InterventionsAdaptive COVID-19 Treatment Trial 1 randomized participants to receive remdesivir or placebo. The prognostic value of predictive scores was evaluated in both groups separately to assess for differential performance in the setting of remdesivir treatment.Measurements and main resultsFor mortality, baseline National Early Warning Score and Modified Early Warning Score were weakly to moderately prognostic (c-index, 0.60-0.68), and improved with addition of age (c-index, 0.66-0.74). For recovery, baseline National Early Warning Score and Modified Early Warning Score demonstrated somewhat better prognostic ability (c-index, 0.65-0.69); however, National Early Warning Score+age and Modified Early Warning Score+age further improved performance (c-index, 0.68-0.71). For deterioration, baseline National Early Warning Score and Modified Early Warning Score were weakly to moderately prognostic (c-index, 0.59-0.69) and improved with addition of age (c-index, 0.63-0.70). All prognostic performance improvements due to addition of age were significant (p < 0.05).ConclusionsIn the Adaptive COVID-19 Treatment Trial 1 cohort, National Early Warning Score and Modified Early Warning Score demonstrated moderate prognostic performance in patients with severe coronavirus disease 2019, with improvement in predictive ability for National Early Warning Score+age and Modified Early Warning Score+age. Area under receiver operating curve for National Early Warning Score and Modified Early Warning Score improved in patients receiving remdesivir versus placebo early in the pandemic for recovery and mortality. Although these scores are simple and readily obtainable in myriad settings, in our data set, they were insufficiently predictive to completely replace clinical judgment in coronavirus disease 2019 and may serve best as an adjunct to triage, disposition, and resourcing decisions.

Project description:ObjectivesTo determine whether a statistically derived, trend-based, deterioration index is superior to other early warning scores at predicting adverse events and whether it can be integrated into an electronic medical record to enable real-time alerts.DesignForty-three variables and their trends from cases and controls were used to develop a logistic model and deterioration index to predict patient deterioration greater than or equal to 1 hour prior to an adverse event.SettingTwo large Australian teaching hospitals.PatientsCases were considered as patients who suffered adverse events (unexpected death, unplanned ICU transfer, urgent surgery, and rapid-response alert) between August 1, 2016, and April 1, 2019.InterventionsThe logistic model and deterioration index were tested on historical data and then integrated into an electronic medical record for a 6-month prospective "silent" validation.Measurements and main resultsData were acquired from 258,732 admissions. There were 8,002 adverse events. The addition of vital sign and laboratory trend values to the logistic model increased the area under the curve from 0.84 to 0.89 and the sensitivity to predict an adverse event 1-48 hours prior from 0.35 to 0.41. A 48-hour simulation showed that the logistic model had a higher area under the curve than the Modified Early Warning Score and National Early Warning Score (0.87 vs 0.74 vs 0.71). During the silently run prospective trial, the sensitivity of the deterioration index to detect adverse event any time prior to the adverse event was 0.474, 0.369 1 hour prior, and 0.327 4 hours prior, with a specificity of 0.972.ConclusionsA deterioration prediction model was developed using patient demographics, ward-based observations, laboratory values, and their trends. The model's outputs were converted to a deterioration index that was successfully integrated into a live hospital electronic medical record. The sensitivity and specificity of the tool to detect inpatient deterioration were superior to traditional early warning scores.

Project description:BackgroundModified Early Warning Score (MEWS) and National Early Warning Score (NEWS) are widely used in predicting the mortality and intensive care unit (ICU) admission of critically ill patients. This study was conducted to evaluate and compare the prognostic value of NEWS and MEWS for predicting ICU readmission, mortality, and related outcomes in critically ill patients at the time of ICU discharge.MethodsThis multicenter, prospective, observational study was conducted over a year, from April 2019 to March 2020, in the general ICUs of two university-affiliated hospitals in Northwest Iran. MEWS and NEWS were compared based on the patients' outcomes (including mortality, ICU readmission, time to readmission, discharge type, mechanical ventilation (MV), MV duration, and multiple organ failure after readmission) using the univariable and multivariable binary logistic regression. The receiver operating characteristic (ROC) curve was used to determine the outcome predictability of MEWS and NEWS.ResultsA total of 410 ICU patients were enrolled in this study. According to multivariable logistic regression analysis, both MEWS and NEWS were predictors of ICU readmission, time to readmission, MV status after readmission, MV duration, and multiple organ failure after readmission. The area under the ROC curve (AUC) for predicting mortality was 0.91 (95% CI = 0.88-0.94, P < 0.0001) for the NEWS and 0.88 (95% CI = 0.84-0.91, P < 0.0001) for the MEWS. There was no significant difference between the AUC of the NEWS and the MEWS for predicting mortality (P = 0.082). However, for ICU readmission (0.84 vs. 0.71), time to readmission (0.82 vs. 0.67), MV after readmission (0.83 vs. 0.72), MV duration (0.81 vs. 0.67), and multiple organ failure (0.833 vs. 0.710), the AUCs of MEWS were significantly greater (P < 0.001).ConclusionNational Early Warning Score and MEWS values of >4 demonstrated high sensitivity and specificity in identifying the risk of mortality for the patients' discharge from ICU. However, we found that the MEWS showed superiority over the NEWS score in predicting other outcomes. Eventually, MEWS could be considered an efficient prediction score for morbidity and mortality of critically ill patients.

Project description:Objectives1) To explore the adequacy of: vital signs' recordings (respiratory and heart rate, oxygen saturation, systolic blood pressure (BP), temperature, level of consciousness and urine output) in the first 8 post-operative hours; responses to clinical deterioration. 2) To identify factors associated with death on the ward between transfer from the theatre recovery suite and the seventh day after operation.DesignRetrospective review of records of 11 patients who died plus four controls for each case.ParticipantsWe reviewed clinical records of 55 patients who met inclusion criteria (general anaesthetic, age >13, complete records) from six surgical wards in a teaching hospital between 1 May and 31 July 2009.MethodsIn the absence of guidelines for routine post-operative vital signs' monitoring, nurses' standard practice graphical plots of recordings were recoded into MEWS formats (0?=?normal, 1-3 upper or lower limit) and their responses to clinical deterioration were interpreted using MEWS reporting algorithms.ResultsNo patients' records contained recordings for all seven parameters displayed on the MEWS. There was no evidence of response to: 22/36 (61.1%) abnormal vital signs for patients who died that would have triggered an escalated MEWS reporting algorithm; 81/87 (93.1%) for controls. Death was associated with age, ?61 years (OR 14.2, 3.0-68.0); ?2 pre-existing co-morbidities (OR 75.3, 3.7-1527.4); high/low systolic BP on admission (OR 7.2, 1.5-34.2); tachycardia (?111-129 bpm) (OR 6.6, 1.4-30.0) and low systolic BP (?81-100 mmHg), as defined by the MEWS (OR 8.0, 1.9-33.1).ConclusionsGuidelines for post-operative vital signs' monitoring and reporting need to be established. The MEWS provides a useful scoring system for interpreting clinical deterioration and guiding intervention. Exploration of the ability of the Cape Town MEWS chart plus reporting algorithm to expedite recognition of signs of clinical and physiological deterioration and securing more skilled assistance is essential.

Project description:BackgroundThe rapid deterioration observed in the condition of some hospitalized patients can be attributed to either disease progression or imperfect triage and level of care assignment after their admission. An early warning system (EWS) to identify patients at high risk of subsequent intrahospital death can be an effective tool for ensuring patient safety and quality of care and reducing avoidable harm and costs.ObjectiveThe aim of this study was to prospectively validate a real-time EWS designed to predict patients at high risk of inpatient mortality during their hospital episodes.MethodsData were collected from the system-wide electronic medical record (EMR) of two acute Berkshire Health System hospitals, comprising 54,246 inpatient admissions from January 1, 2015, to September 30, 2017, of which 2.30% (1248/54,246) resulted in intrahospital deaths. Multiple machine learning methods (linear and nonlinear) were explored and compared. The tree-based random forest method was selected to develop the predictive application for the intrahospital mortality assessment. After constructing the model, we prospectively validated the algorithms as a real-time inpatient EWS for mortality.ResultsThe EWS algorithm scored patients' daily and long-term risk of inpatient mortality probability after admission and stratified them into distinct risk groups. In the prospective validation, the EWS prospectively attained a c-statistic of 0.884, where 99 encounters were captured in the highest risk group, 69% (68/99) of whom died during the episodes. It accurately predicted the possibility of death for the top 13.3% (34/255) of the patients at least 40.8 hours before death. Important clinical utilization features, together with coded diagnoses, vital signs, and laboratory test results were recognized as impactful predictors in the final EWS.ConclusionsIn this study, we prospectively demonstrated the capability of the newly-designed EWS to monitor and alert clinicians about patients at high risk of in-hospital death in real time, thereby providing opportunities for timely interventions. This real-time EWS is able to assist clinical decision making and enable more actionable and effective individualized care for patients' better health outcomes in target medical facilities.

Dataset Information

Measuring the modified early warning score and the Rothman index: advantages of utilizing the electronic medical record in an early warning system.

Publications

Measuring the modified early warning score and the Rothman index: advantages of utilizing the electronic medical record in an early warning system.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets