Dataset Information

Validation of the Interagency Integrated Triage Tool in a resource-limited, urban emergency department in Papua New Guinea: a pilot study.

ABSTRACT:

Background

The Interagency Integrated Triage Tool (IITT) is a three-tier triage system designed for resource-limited emergency care (EC) settings. This study sought to assess the validity and reliability of a pilot version of the tool in an urban emergency department (ED) in Papua New Guinea.

Methods

A pragmatic observational study was conducted at Gerehu General Hospital in Port Moresby, commencing eight weeks after IITT implementation. All ED patients presenting within the subsequent two-month period were included. Triage assessments were performed by a variety of ED clinicians, including community health workers, nurses and doctors. The primary outcome was sensitivity for the detection of time-critical illness, defined by ten pre-specified diagnoses. The association between triage category and ED outcomes was examined using Cramer's V correlation coefficient. Reliability was assessed by inter-rater agreement between a local and an experienced, external triage officer.

Findings

Among 4512 presentations during the study period, 58 (1.3%) were classified as category one (emergency), 967 (21.6%) as category two (priority) and 3478 (77.1%) as category three (non-urgent). The tool's sensitivity for detecting the pre-specified set of time-sensitive conditions was 70.8% (95%CI 58.2-81.4%), with negative predictive values of 97.3% (95%CI 96.7 - 97.8%) for admission/transfer and 99.9% (95%CI 99.7 - 100.0%) for death. The admission/transfer rate was 44.8% (26/58) among emergency patients, 22.9% (223/976) among priority patients and 2.7% (94/3478) among non-urgent patients (Cramer's V=0.351, p=0.00). Four of 58 (6.9%) emergency patients, 19/976 (2.0%) priority patients and 3/3478 (0.1%) non-urgent patients died in the ED (Cramer's V=0.14, p=0.00). The under-triage rate was 2.7% (94/3477) and the over-triage rate 48.2% (28/58), both within pre-specified limits of acceptability. On average, it took staff 3 minutes 34 seconds (SD 1:06) to determine and document a triage category. Among 70 observed assessments, weighted κ was 0.84 (excellent agreement).

Interpretation

The pilot version of the IITT demonstrated acceptable performance characteristics, and validation in other EC settings is warranted.

Funding

This project was funded through a Friendship Grant from the Australian Government Department of Foreign Affairs and Trade and an International Development Fund Grant from the Australasian College for Emergency Medicine Foundation.

SUBMITTER: Mitchell R

PROVIDER: S-EPMC8358156 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundTriage implementation in resource-limited emergency departments (EDs) has traditionally relied on intensive in-person training. This study sought to evaluate the impact of a novel digital-based learning strategy focused on the Interagency Integrated Triage Tool, a three-tier triage instrument recommended by the World Health Organization.MethodsA mixed methods study utilising pre-post intervention methods was conducted in two EDs in Papua New Guinea. The primary outcome was the mean change in knowledge before and after completion of a voluntary, multimodal training program, primarily delivered through a digital learning platform accessible via smartphone. Secondary outcomes included the change in confidence to perform selected clinical tasks, and acceptability of the learning methods.FindingsAmong 136 eligible ED staff, 91 (66.9%) completed the digital learning program. The mean knowledge score on the post-training exam was 87.5% (SD 10.4), a mean increase of 12.9% (95% CI 10.7-15.1%, p < 0.0001) from the pre-training exam. There were statistically significant improvements in confidence for 13 of 15 clinical tasks, including undertaking a triage assessment and identifying an unwell patient.In an evaluation survey, 100% of 30 respondents agreed or strongly agreed the online learning platform was easy to access, use and navigate, and that the digital teaching methods were appropriate for their learning needs. In qualitative feedback, respondents reported that limited internet access and a lack of dedicated training time were barriers to participation.InterpretationThe use of digital learning to support triage implementation in resource-limited EDs is feasible and effective when accompanied by in-person mentoring. Adequate internet access is an essential pre-requisite.FundingDevelopment of the Kumul Helt Skul learning platform was undertaken as part of the Clinical Support Program (Phase II), facilitated by Johnstaff International Development on behalf of the Australian Government Department of Foreign Affairs and Trade through the PNG-Australia Partnership. RM is supported by a National Health and Medical Research Council Postgraduate Scholarship and a Monash Graduate Excellence Scholarship, while PC is supported by a Medical Research Future Fund Practitioner Fellowship. Funders had no role in study design, results analysis or manuscript preparation.

Project description:Study objectiveTriage quickly identifies critically ill patients, facilitating timely interventions. Many emergency departments (EDs) use emergency severity index (ESI) or abnormal vital sign triggers to guide triage. However, both use fixed thresholds, and false activations are costly. Prior approaches using machinelearning have relied on information that is often unavailable during the triage process. We examined whether deep-learning approaches could identify critically ill patients only using data immediately available at triage.MethodsWe conducted a retrospective, cross-sectional study at an urban tertiary care center, from January 1, 2012-January 1, 2020. De-identified triage information included structured (age, sex, initial vital signs) and textual (chief complaint) data, with critical illness (mortality or ICU admission within 24 hours) as the outcome. Four progressively complex deep-learning models were trained and applied to triage information from all patients. We compared the accuracy of the models against ESI as the standard diagnostic test, using area under the receiver-operator curve (AUC).ResultsA total of 445,925 patients were included, with 60,901 (13.7%) critically ill. Vital sign thresholds identified critically ill patients with AUC 0.521 (95% confidence interval [CI] = 0.519-0.522), and ESI <3 demonstrated AUC 0.672 (95% CI = 0.671-0.674), logistic regression classified patients with AUC 0.803 (95% CI = 0.802-0.804), 2-layer neural network with structured data with AUC 0.811 (95% CI = 0.807-0.815), gradient tree boosting with AUC 0.820 (95% CI = 0.818-0.821), and the neural network model with textual data with AUC 0.851 (95% CI = 0.849-0.852). All successive increases in AUC were statistically significant.ConclusionDeep-learning techniques represent a promising method of augmenting triage, even with limited information. Further research is needed to determine if improved predictions yield clinical and operational benefits.

Project description:BackgroundThe number of older adults with a high risk of frailty and severe illness continues to increase. Moreover, physiological change and multiple comorbidities are challenging to triage in geriatrics. Therefore, we aimed to evaluate variables to predict 28-day mortality and develop a screening tool to predict mortality and lifesaving intervention among geriatric patients in the emergency department (ED).MethodsThis study was a retrospective, single-center, observational study at the ED of Ramathibodi Hospital, Bangkok. Patients aged ≥ 65 years who visited the ED between January 2018 and December 2019 were enrolled. In the development cohort, univariable logistic regression was used to identify predictors of 28-day mortality in older patients. A predictive model for mortality and the need for lifesaving intervention was developed by multivariable logistic regression. In addition, the score was validated with internal validation and compared between development and validation set by chi-square.ResultsWe enrolled 1393 patients. In the development cohort, among these 1002 patients, 103 (10.3%) of whom died within 28 days. Malignancy, shock index (SI), systolic blood pressure (SBP) < 100 mmHg, and altered mentation were independent risk factors of 28-day mortality. We developed new screening tools named the S-TRIAGE score, which has the respiratory rate (< 11, > 22 breaths/min), the ratio of pulse oximetric saturation to the fraction of inspired oxygen (< 420, 420-450), SI (> 1, 0.6-0.99), SBP < 100 mmHg, body temperature (< 36, > 37.5 °C), and mental change. The area under a receiver operating characteristic (ROC) curve of the S-TRIAGE score in the validation cohort was 0.826 [95% confidence interval (95%CI) 0.773-0.879] in predicting mortality and lifesaving intervention, and the clinical score classified patients into five groups.ConclusionThis study showed malignancy, hypotension, increased SI, and mental status change were predictive factors for 28-day mortality in older adults in the ED. The screening tool risk score for geriatrics used in this study is potentially a good predictor of mortality and lifesaving intervention in high-risk older patients in the ED.