Dataset Information

Validity and effectiveness of paediatric early warning systems and track and trigger tools for identifying and reducing clinical deterioration in hospitalised children: a systematic review.

ABSTRACT:

Objective

To assess (1) how well validated existing paediatric track and trigger tools (PTTT) are for predicting adverse outcomes in hospitalised children, and (2) how effective broader paediatric early warning systems are at reducing adverse outcomes in hospitalised children.

Design

Systematic review.

Data sources

British Nursing Index, Cumulative Index of Nursing and Allied Health Literature, Cochrane Central Register of Controlled Trials, Database of Abstracts of Reviews of Effectiveness, EMBASE, Health Management Information Centre, Medline, Medline in Process, Scopus and Web of Knowledge searched through May 2018.

Eligibility criteria

We included (1) papers reporting on the development or validation of a PTTT or (2) the implementation of a broader early warning system in paediatric units (age 0-18 years), where adverse outcome metrics were reported. Several study designs were considered.

Data extraction and synthesis

Data extraction was conducted by two independent reviewers using template forms. Studies were quality assessed using a modified Downs and Black rating scale.

Results

36 validation studies and 30 effectiveness studies were included, with 27 unique PTTT identified. Validation studies were largely retrospective case-control studies or chart reviews, while effectiveness studies were predominantly uncontrolled before-after studies. Metrics of adverse outcomes varied considerably. Some PTTT demonstrated good diagnostic accuracy in retrospective case-control studies (primarily for predicting paediatric intensive care unit transfers), but positive predictive value was consistently low, suggesting potential for alarm fatigue. A small number of effectiveness studies reported significant decreases in mortality, arrests or code calls, but were limited by methodological concerns. Overall, there was limited evidence of paediatric early warning system interventions leading to reductions in deterioration.

Conclusion

There are several fundamental methodological limitations in the PTTT literature, and the predominance of single-site studies carried out in specialist centres greatly limits generalisability. With limited evidence of effectiveness, calls to make PTTT mandatory across all paediatric units are not supported by the evidence base.

Prospero registration number

CRD42015015326.

SUBMITTER: Trubey R

PROVIDER: S-EPMC6502038 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validity and effectiveness of paediatric early warning systems and track and trigger tools for identifying and reducing clinical deterioration in hospitalised children: a systematic review.

Trubey Rob R Huang Chao C Lugg-Widger Fiona V FV Hood Kerenza K Allen Davina D Edwards Dawn D Lacy David D Lloyd Amy A Mann Mala M Mason Brendan B Oliver Alison A Roland Damian D Sefton Gerri G Skone Richard R Thomas-Jones Emma E Tume Lyvonne N LN Powell Colin C

BMJ open 20190505 5

<h4>Objective</h4>To assess (1) how well validated existing paediatric track and trigger tools (PTTT) are for predicting adverse outcomes in hospitalised children, and (2) how effective broader paediatric early warning systems are at reducing adverse outcomes in hospitalised children.<h4>Design</h4>Systematic review.<h4>Data sources</h4>British Nursing Index, Cumulative Index of Nursing and Allied Health Literature, Cochrane Central Register of Controlled Trials, Database of Abstracts of Reviews ...[more]

PMID: 31061010

Similar Datasets

Project description:BackgroundEarly warning tools have been widely implemented without evidence to guide (a) recognition and (b) response team expertise optimisation. With growing databases from MET-calls and digital hospitals, we now have access to guiding information. The Queensland Adult-Deterioration-Detection-System (Q-ADDS) is widely used and requires validation.AimCompare the accuracy of Q-ADDS to National Early Warning Score (NEWS), Between-the-Flags (BTF) and the electronic Cardiac Arrest Risk Triage Score (eCART)).MethodsData from the Chicago University hospital database were used. Clinical deterioration was defined as unplanned admission to ICU or death. Currently used NEWS, BTF and eCART trigger thresholds were compared with a clinically endorsed Q-ADDS variant.ResultsOf 224,912 admissions, 11,706 (5%) experienced clinical deterioration. Q-ADDS (AUC 0.71) and NEWS (AUC 0.72) had similar predictive accuracy, BTF (AUC 0.64) had the lowest, and eCART (AUC 0.76) the highest. Early warning alert (advising ward MO review) had similar NPV (99.2-99.3%), for all the four tools however sensitivity varied (%: Q-ADDS = 47/NEWS = 49/BTF = 66/eCART = 40), as did alerting rate (% vitals sets: Q-ADDS = 1.4/NEWS = 3.5/BTF = 4.1/eCART = 3.4). MET alert (advising MET/critical-care review) had similar NPV for all the four tools (99.1-99.2%), however sensitivity varied (%: Q-ADDS = 14/NEWS = 24/BTF = 19/eCART = 29), as did MET alerting rate (%: Q-ADDS = 1.4/NEWS = 3.5/BTF = 4.1/eCART = 3.4). High-severity alert (advising advanced ward review, Q-ADDS only): NPV = 99.1%, sensitivity = 26%, alerting rate = 3.5%.ConclusionThe accuracy of Q-ADDS is comparable to NEWS, and higher than BTF, with eCART being the most accurate. Q-ADDS provides an additional high-severity ward alert, and generated significantly fewer MET alerts. Impacts of increased ward awareness and fewer MET alerts on actual MET call numbers and patient outcomes requires further evaluation.

Project description:IntroductionHospitalised paediatric oncology patients are at risk to develop acute complications. Early identification of clinical deterioration enabling adequate escalation of care remains challenging. Various Paediatric Early Warning Systems (PEWSs) have been evaluated, also in paediatric oncology patients but mostly in retrospective or case-control study designs. This study protocol encompasses the first prospective cohort with the aim of evaluating the predictive performance of a modified Bedside PEWS score for non-elective paediatric intensive care unit (PICU) admission or cardiopulmonary resuscitation in hospitalised paediatric oncology patients.Methods and analysisA prospective cohort study will be conducted at the 80-bed Dutch paediatric oncology hospital, where all national paediatric oncology care has been centralised, directly connected to a shared 22-bed PICU. All patients between 1 February 2019 and 1 February 2021 admitted to the inpatient nursing wards, aged 0-18 years, with an International Classification of Diseases for Oncology (ICD-O) diagnosis of paediatric malignancy will be eligible. A Cox proportional hazard regression model will be used to estimate the association between the modified Bedside PEWS and time to non-elective PICU transfer or cardiopulmonary arrest. Predictive performance (discrimination and calibration) will be assessed internally using resampling validation. To account for multiple occurrences of the event of interest within each patient, the unit of study is a single uninterrupted ward admission (a clinical episode).Ethics and disseminationThe study protocol has been approved by the institutional ethical review board of our hospital (MEC protocol number 16-572/C). We adapted our enrolment procedure to General Data Protection Regulation compliance. Results will be disseminated at scientific conferences, regional educational sessions and publication in peer-reviewed journals.Trial registration numberNetherlands Trial Registry (NL8957).

Project description:AimWe conducted a systematic review and meta-analysis to answer the question: Does the implementation of Paediatric Early Warning Systems (PEWS) in the hospital setting reduce mortality, cardiopulmonary arrests, unplanned codes and critical deterioration events among children, as compared to usual care without PEWS?MethodsWe conducted a comprehensive search using Medline, EMBASE, Cochrane Central Register of Controlled Trials, Cumulative Index to Nursing and Allied Health Literature and Web of Science. We included studies published between January 2006 and April 2022 on children <18 years old performed in inpatient units and emergency departments, and compared patient populations with PEWS to those without PEWS. We excluded studies without a comparator, case control studies, systematic reviews, and studies published in non-English languages. We employed a random effects meta-analysis and synthesised the risk and rate ratios from individual studies. We used the Scottish Intercollegiate Guidelines Network (SIGN) to appraise the risk of bias.ResultsAmong 911 articles screened, 15 were included for descriptive analysis. Fourteen of the 15 studies were pre- versus post-implementation studies and one was a multi-centre cluster randomised controlled trial (RCT). Among 10 studies (580,604 hospital admissions) analysed for mortality, we found an increased risk (pooled RR 1.18, 95% CI 1.01-1.38, p = 0.036) in the group without PEWS compared to the group with PEWS. The sensitivity analysis performed without the RCT (436,065 hospital admissions) showed a non-significant relationship (pooled RR 1.17, 95% CI 0.98-1.40, p = 0.087). Among four studies (168,544 hospital admissions) analysed for unplanned code events, there was an increased risk in the group without PEWS (pooled RR 1.73, 95%CI 1.01-2.96, p = 0.046) There were no differences in the rate of cardiopulmonary arrests or critical deterioration events between groups. Our findings were limited by potential confounders and imprecision among included studies.ConclusionsHealthcare systems that implemented PEWS were associated with reduced mortality and code rates. We recognise that these gains vary depending on resource availability and efferent response systems.PROSPERO registration: CRD42021269579.

Project description:BACKGROUND:Changes to physiological parameters precede deterioration of ill patients. Early warning and track and trigger systems (TTS) use routine physiological measurements with pre-specified thresholds to identify deteriorating patients and trigger appropriate and timely escalation of care. Patients presenting to the emergency department (ED) are undiagnosed, undifferentiated and of varying acuity, yet the effectiveness and cost-effectiveness of using early warning systems and TTS in this setting is unclear. We aimed to systematically review the evidence on the use, development/validation, clinical effectiveness and cost-effectiveness of physiologically based early warning systems and TTS for the detection of deterioration in adult patients presenting to EDs. METHODS:We searched for any study design in scientific databases and grey literature resources up to March 2016. Two reviewers independently screened results and conducted quality assessment. One reviewer extracted data with independent verification of 50% by a second reviewer. Only information available in English was included. Due to the heterogeneity of reporting across studies, results were synthesised narratively and in evidence tables. RESULTS:We identified 6397 citations of which 47 studies and 1 clinical trial registration were included. Although early warning systems are increasingly used in EDs, compliance varies. One non-randomised controlled trial found that using an early warning system in the ED may lead to a change in patient management but may not reduce adverse events; however, this is uncertain, considering the very low quality of evidence. Twenty-eight different early warning systems were developed/validated in 36 studies. There is relatively good evidence on the predictive ability of certain early warning systems on mortality and ICU/hospital admission. No health economic data were identified. CONCLUSIONS:Early warning systems seem to predict adverse outcomes in adult patients of varying acuity presenting to the ED but there is a lack of high quality comparative studies to examine the effect of using early warning systems on patient outcomes. Such studies should include health economics assessments.

Project description:BackgroundPaediatric Early Warning Systems (PEWSs) improve identification of deterioration, however, their sustainability has not been studied. Sustainability is critical to maximise impact of interventions like PEWS, particularly in low-resource settings. This study establishes the reliability and validity of a Spanish-language Clinical Sustainability Assessment Tool (CSAT) to assess clinical capacity to sustain interventions in resource-limited hospitals.MethodsParticipants included PEWS implementation leadership teams of 29 paediatric cancer centres in Latin America involved in a collaborative to implement PEWS. The CSAT, a sustainability assessment tool validated in high-resource settings, was translated into Spanish and distributed to participants as an anonymous electronic survey. Psychometric, confirmatory factor analysis (CFA), and multivariate analyses were preformed to assess reliability, structure and initial validity. Focus groups were conducted after participants reviewed CSAT reports to assess their interpretation and utility.ResultsThe CSAT survey achieved an 80% response rate (n=169) with a mean score of 4.4 (of 5; 3.8-4.8 among centres). The CSAT had good reliability with an average internal consistency of 0.77 (95% CI 0.71 to 0.81); and CFAs supported the seven-domain structure. CSAT results were associated with respondents' perceptions of the evidence for PEWS, its implementation and use in their centre, and their assessment of the hospital culture and implementation climate. The mean CSAT score was higher among respondents at centres with longer time using PEWS (p<0.001). Focus group participants noted the CSAT report helped assess their centre's clinical capacity to sustain PEWS and provided constructive feedback for improvement.ConclusionsWe present information supporting the reliability and validity of the CSAT tool, the first Spanish-language instrument to assess clinical capacity to sustain evidence-based interventions in hospitals of variable resource levels. This assessment demonstrates a high capacity to sustain PEWS in these resource-limited centres with improvement over time from PEWS implementation.

Dataset Information

Validity and effectiveness of paediatric early warning systems and track and trigger tools for identifying and reducing clinical deterioration in hospitalised children: a systematic review.

Objective

Design

Data sources

Eligibility criteria

Data extraction and synthesis

Results

Conclusion

Prospero registration number

Publications

Validity and effectiveness of paediatric early warning systems and track and trigger tools for identifying and reducing clinical deterioration in hospitalised children: a systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets