Dataset Information

Modification and Validation of a Complaint-Oriented Emergency Department Triage System: A Multicenter Observational Study.

ABSTRACT:

Purpose

The objective of this study was to modify and validate an emergency department (ED) triage system with improved prediction performance on hospital outcomes by modifying the Korean Triage and Acuity Scale (KTAS).

Materials and methods

We performed a retrospective observational study at three academic universities in South Korea. The KTAS code, determined by the chief complaint and the selected modifier of a patient, was used to derive the Modified KTAS (MKTAS). We calculated the area under the receiver operating characteristics curve (AUC) and the test characteristics to evaluate the performance of MKTAS to predict hospital mortality, critical outcome, and admission.

Results

A total of 272402 and 128831 ED visits were used for the derivation and validation of MKTAS, respectively. Compared to KTAS, MKTAS had significantly higher AUC values for the prediction of hospital mortality [MKTAS 0.826 (0.818-0.835) vs. KTAS 0.794 (0.784-0.803)], critical outcome [MKTAS 0.836 (0.830-0.841) vs. 0.798 (0.792-0.804)], and admission [MKTAS 0.725 (0.723-0.728) vs. KTAS 0.685 (0.682-0.688)]. The sensitivity for predicting hospital mortality and critical outcome, as well as the specificity for predicting admission, were significantly improved.

Conclusion

MKTAS was derived by modifying the KTAS, and then validated. Compared with KTAS, MKTAS showed better discriminating ability to predict hospital outcomes. Continuous efforts to evaluate and modify widely used triage systems are required to improve their performance.

SUBMITTER: Choi DH

PROVIDER: S-EPMC8612858 | biostudies-literature | 2021 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Modification and Validation of a Complaint-Oriented Emergency Department Triage System: A Multicenter Observational Study.

Choi Dong Hyun DH Hong Won Pyo WP Song Kyoung Jun KJ Kim Tae Han TH Shin Sang Do SD Hong Ki Jeong KJ Park Jeong Ho JH Jeong Joo J

Yonsei medical journal 20211201 12

<h4>Purpose</h4>The objective of this study was to modify and validate an emergency department (ED) triage system with improved prediction performance on hospital outcomes by modifying the Korean Triage and Acuity Scale (KTAS).<h4>Materials and methods</h4>We performed a retrospective observational study at three academic universities in South Korea. The KTAS code, determined by the chief complaint and the selected modifier of a patient, was used to derive the Modified KTAS (MKTAS). We calculate ...[more]

PMID: 34816645

Similar Datasets

Project description:BackgroundA substantial proportion of attendances to ophthalmic emergency departments are for non-urgent presentations. We developed and evaluated a machine learning system (DemDx Ophthalmology Triage System: DOTS) to optimise triage, with the aim of reducing inappropriate emergency attendances and streamlining case referral when necessary.MethodsDOTS was built using retrospective tabular data from 11,315 attendances between July 1st, 2021, to June 15th, 2022 at Moorfields Eye Hospital Emergency Department (MEH) in London, UK. Demographic and clinical features were used as inputs and a triage recommendation was given ("see immediately", "see within a week", or "see electively"). DOTS was validated temporally and compared with triage nurses' performance (1269 attendances at MEH) and validated externally (761 attendances at the Federal University of Minas Gerais - UFMG, Brazil). It was also tested for biases and robustness to variations in disease incidences. All attendances from patients aged at least 18 years with at least one confirmed diagnosis were included in the study.FindingsFor identifying ophthalmic emergency attendances, on temporal validation, DOTS had a sensitivity of 94.5% [95% CI 92.3-96.1] and a specificity of 42.4% [38.8-46.1]. For comparison within the same dataset, triage nurses had a sensitivity of 96.4% [94.5-97.7] and a specificity of 25.1% [22.0-28.5]. On external validation at UFMG, DOTS had a sensitivity of 95.2% [92.5-97.0] and a specificity of 32.2% [27.4-37.0]. In simulated scenarios with varying disease incidences, the sensitivity was ≥92.2% and the specificity was ≥36.8%. No differences in sensitivity were found in subgroups of index of multiple deprivation, but the specificity was higher for Q2 when compared to Q4 (Q4 is less deprived than Q2).InterpretationAt MEH, DOTS had similar sensitivity to triage nurses in determining attendance priority; however, with a specificity of 17.3% higher, DOTS resulted in lower rates of patients triaged to be seen immediately at emergency. DOTS showed consistent performance in temporal and external validation, in social-demographic subgroups and was robust to varying relative disease incidences. Further trials are necessary to validate these findings. This system will be prospectively evaluated, considering human-computer interaction, in a clinical trial.FundingThe Artificial Intelligence in Health and Care Award (AI_AWARD01671) of the NHS AI Lab under National Institute for Health and Care Research (NIHR) and the Accelerated Access Collaborative (AAC).

Project description:ImportanceThe management of patients with syncope in the emergency department (ED) is challenging because no robust risk tool available has been recommended for clinical use.ObjectiveTo validate the Canadian Syncope Risk Score (CSRS) in a new cohort of patients with syncope to determine its ability to predict 30-day serious outcomes not evident during index ED evaluation.Design, setting, and participantsThis prospective multicenter cohort study conducted at 9 EDs across Canada included patients 16 years and older who presented to EDs within 24 hours of syncope. Patients were enrolled from March 2014 to April 2018.Main outcomes and measuresBaseline characteristics, CSRS predictors, and 30-day adjudicated serious outcomes, including arrhythmic (arrhythmias, interventions for arrhythmia, or unknown cause of death) and nonarrhythmic (myocardial infarction, structural heart disease, pulmonary embolism, or hemorrhage) serious outcomes, were collected. Calibration and discrimination characteristics for CSRS validation were calculated.ResultsA total of 3819 patients were included (mean [SD] age 53.9 [22.8] years; 2088 [54.7%] female), of whom 139 (3.6%) experienced 30-day serious outcomes, including 13 patients (0.3%) who died. In the validation cohort, there were no differences between the predicted and observed risk, the calibration slope was 1.0, and the area under the receiver operating characteristic curve was 0.91 (95% CI, 0.88-0.93). The empirical probability of a 30-day serious outcome during validation was 3.64% (95% CI, 3.09%-4.28%) compared with the model-predicted probability of 3.17% (95% CI, 2.66%-3.77%; P = .26). The proportion of patients with 30-day serious outcomes increased from 3 of 1631 (0.3%) in the very-low-risk group to 40 of 78 (51.3%) in the very-high-risk group (Cochran-Armitage trend test P < .001). There was a similar significant increase in the serious outcome subtypes with increasing CSRS risk category. None of the very-low-risk and low-risk patients died or experienced ventricular arrhythmia. At a threshold score of -1 (2145 of 3819 patients), the CSRS sensitivity and specificity were 97.8% (95% CI, 93.8%-99.6%) and 44.3% (95% CI, 42.7%-45.9%), respectively.Conclusions and relevanceThe CSRS was successfully validated and its use is recommended to guide ED management of patients when serious causes are not identified during index ED evaluation. Very-low-risk and low-risk patients can generally be discharged, while brief hospitalization can be considered for high-risk patients. We believe CSRS implementation has the potential to improve patient safety and health care efficiency.

Project description:BackgroundEmergency department (ED) crowding is a serious problem worldwide causing decreased quality of care. It is reasonable to assume that the negative effects of crowding are at least partially due to high staff workload, but previous crowding metrics based on high workload have not been generalisable to Swedish EDs and have not been associated with increased mortality, in contrast to, e.g., occupancy rate. We recently derived and validated the modified Skåne Emergency Department Assessment of Patient Load model (mSEAL) that measures crowding based on staff workload in Swedish EDs, but its ability to identify situations with increased mortality is unclear. In this study, we aimed to investigate the association between ED crowding measured by mSEAL model, or occupancy rate, and mortality.MethodsAll ED patients from 2017-01-01 to 2017-06-30 from two regional healthcare systems (Skåne and Östergötland Counties with a combined population of approximately 1.8 million) in Sweden were included. Exposure was ED- and hour-adjusted mSEAL or occupancy rate. Primary outcome was mortality within 7 days of ED arrival, with one-day and 30-day mortality as secondary outcomes. We used Cox regression hazard ratio (HR) adjusted for age, sex, arrival by ambulance, hospital admission and chief complaint.ResultsWe included a total of 122,893 patients with 168,900 visits to the six participating EDs. Arriving at an hour with a mSEAL score above the 95th percentile for that ED and hour of day was associated with an non-significant HR for death at 7 days of 1.04 (95% CI 0.96-1.13). For one- and 30-day mortality the HR was non-significant at 1.03 (95% CI 0.9-1.18) and 1.03 (95% CI 0.97-1.09). Similarly, occupancy rate above the 95th percentile with a HR of 1.04 (95% CI 0.9-1.19), 1.03 (95%CI 0.95-1.13) and 1.04 (95% CI 0.98-1.11) for one-, 7- and 30-day mortality, respectively.ConclusionIn this multicenter study in Sweden, ED crowding measured by mSEAL or occupancy rate was not associated with a significant increase in short-term mortality.

Dataset Information

Modification and Validation of a Complaint-Oriented Emergency Department Triage System: A Multicenter Observational Study.

Purpose

Materials and methods

Results

Conclusion

Publications

Modification and Validation of a Complaint-Oriented Emergency Department Triage System: A Multicenter Observational Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets