Dataset Information

Evaluation of the effects of implementing an electronic early warning score system: protocol for a stepped wedge study.

ABSTRACT:

Background

An Early Warning Score is a clinical risk score based upon vital signs intended to aid recognition of patients in need of urgent medical attention. The use of an escalation of care policy based upon an Early Warning Score is mandated as the standard of practice in British hospitals. Electronic systems for recording vital sign observations and Early Warning Score calculation offer theoretical benefits over paper-based systems. However, the evidence for their clinical benefit is limited. Previous studies have shown inconsistent results. The majority have employed a "before and after" study design, which may be strongly confounded by simultaneously occurring events. This study aims to examine how the implementation of an electronic early warning score system, System for Notification and Documentation (SEND), affects the recognition of clinical deterioration occurring in hospitalised adult patients.

Methods

This study is a non-randomised stepped wedge evaluation carried out across the four hospitals of the Oxford University Hospitals NHS Trust, comparing charting on paper and charting using SEND. We assume that more frequent monitoring of acutely ill patients is associated with better recognition of patient deterioration. The primary outcome measure is the time between a patient's first observations set with an Early Warning Score above the alerting threshold and their subsequent set of observations. Secondary outcome measures are in-hospital mortality, cardiac arrest and Intensive Care admission rates, hospital length of stay and system usability measured using the System Usability Scale. We will also measure Intensive Care length of stay, Intensive Care mortality, Acute Physiology and Chronic Health Evaluation (APACHE) II acute physiology score on admission, to examine whether the introduction of SEND has any effect on Intensive Care-related outcomes.

Discussion

The development of this protocol has been informed by guidance from the Agency for Healthcare Research and Quality (AHRQ) Health Information Technology Evaluation Toolkit and Delone and McLeans's Model of Information System Success. Our chosen trial design, a stepped wedge study, is well suited to the study of a phased roll out. The choice of primary endpoint is challenging. We have selected the time from the first triggering observation set to the subsequent observation set. This has the benefit of being easy to measure on both paper and electronic charting and having a straightforward interpretation. We have collected qualitative measures of system quality via a user questionnaire and organisational descriptors to help readers understand the context in which SEND has been implemented.

SUBMITTER: Bonnici T

PROVIDER: S-EPMC4748571 | biostudies-literature | 2016 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluation of the effects of implementing an electronic early warning score system: protocol for a stepped wedge study.

Bonnici Timothy T Gerry Stephen S Wong David D Knight Julia J Watkinson Peter P

BMC medical informatics and decision making 20160209

<h4>Background</h4>An Early Warning Score is a clinical risk score based upon vital signs intended to aid recognition of patients in need of urgent medical attention. The use of an escalation of care policy based upon an Early Warning Score is mandated as the standard of practice in British hospitals. Electronic systems for recording vital sign observations and Early Warning Score calculation offer theoretical benefits over paper-based systems. However, the evidence for their clinical benefit is ...[more]

PMID: 26860362

Similar Datasets

Project description:INTRODUCTION:Safety-netting in primary care is the best practice in cancer diagnosis, ensuring that patients are followed up until symptoms are explained or have resolved. Currently, clinicians use haphazard manual solutions. The ubiquitous use of electronic health records provides an opportunity to standardise safety-netting practices.A new electronic safety-netting toolkit has been introduced to provide systematic ways to track and follow up patients. We will evaluate the effectiveness of this toolkit, which is embedded in a major primary care clinical system in England:Egerton Medical Information System(EMIS)-Web. METHODS AND ANALYSIS:We will conduct a stepped-wedge cluster RCT in 60 general practices within the RCGP Research and Surveillance Centre (RSC) network. Groups of 10 practices will be randomised into the active phase at 2-monthly intervals over 12 months. All practices will be activated for at least 2 months. The primary outcome is the primary care interval measured as days between the first recorded symptom of cancer (within the year prior to diagnosis) and the subsequent referral to secondary care. Other outcomes include referrals rates and rates of direct access cancer investigation.Analysis of the clustered stepped-wedge design will model associations using a fixed effect for intervention condition of the cluster at each time step, a fixed effect for time and other covariates, and then include a random effect for practice and for patient to account for correlation between observations from the same centre and from the same participant. ETHICS AND DISSEMINATION:Ethical approval has been obtained from the North West-Greater Manchester West National Health Service Research Ethics Committee (REC Reference 19/NW/0692). Results will be disseminated in peer-reviewed journals and conferences, and sent to participating practices. They will be published on the University of Oxford Nuffield Department of Primary Care and RCGP RSC websites. TRIAL REGISTRATION NUMBER:ISRCTN15913081; Pre-results.

Project description:IntroductionEarly sepsis treatment in the emergency department (ED) is crucial to improve patient survival. Despite international promulgation, the uptake of the Surviving Sepsis Campaign (SSC) Hour-1 Bundle (lactate measurement, blood culture, broad-spectrum antibiotics, 30 mL/kg crystalloid for hypotension/lactate ≥4 mmol/L and vasopressors for hypotension during/after fluid resuscitation within 1 hour of sepsis recognition) is low across healthcare settings. Delays in sepsis recognition and a lack of high-quality evidence hinder its implementation. We propose a novel sepsis care model (National Early Warning Score, NEWS-1 care), in which the SSC Hour-1 Bundle is triggered objectively by a high NEWS-2 (≥5). This study aims to determine the feasibility of a full-scale type 1 hybrid effectiveness-implementation trial on the NEWS-1 care in multiple EDs.Methods and analysisWe will conduct a pilot type 1 hybrid trial and prospectively recruit 200 patients from 4 public EDs in Hong Kong cluster randomised in a stepped wedge design over 10 months. All study sites will start with an initial period of standard care and switch in random order at 2-month intervals to the NEWS-1 care unidirectionally. The implementation evaluation will employ mixed methods guided by the Reach, Effectiveness, Adoption, Implementation and Maintenance framework, which includes qualitative and quantitative data from focus group interviews, staff survey and clinical record reviews. We will analyse the 14 feasibility outcomes as progression criteria to a full-scale trial, including trial acceptability to patients and staff, patient and staff recruitment rates, accuracy of sepsis screening, protocol adherence, accessibility to follow-up data, safety and preliminary clinical impacts of the NEWS1 care, using descriptive statistics.Ethics and disseminationThe institutional review boards of all study sites approved this study. This study will establish the feasibility of a full-scale hybrid trial. We will disseminate the findings through peer-reviewed publications, conference presentations and educational activities.Trial registration numberNCT05731349.

Project description:BACKGROUND:Previous research indicates that people with osteoarthritis (OA) are not receiving the recommended and optimal treatment. Based on international treatment recommendations for hip and knee OA and previous research, the SAMBA model for integrated OA care in Norwegian primary health care has been developed. The model includes physiotherapist (PT) led patient OA education sessions and an exercise programme lasting 8-12 weeks. This study aims to assess the effectiveness, feasibility, and costs of a tailored strategy to implement the SAMBA model. METHODS/DESIGN:A cluster randomized controlled trial with stepped wedge design including an effect, process, and cost evaluation will be conducted in six municipalities (clusters) in Norway. The municipalities will be randomized for time of crossover from current usual care to the implementation of the SAMBA model by a tailored strategy. The tailored strategy includes interactive workshops for general practitioners (GPs) and PTs in primary care covering the SAMBA model for integrated OA care, educational material, educational outreach visits, feedback, and reminder material. Outcomes will be measured at the patient, GP, and PT levels using self-report, semi-structured interviews, and register based data. The primary outcome measure is patient-reported quality of care (OsteoArthritis Quality Indicator questionnaire) at 6-month follow-up. Secondary outcomes include referrals to PT, imaging, and referrals to the orthopaedic surgeon as well as participants' treatment satisfaction, symptoms, physical activity level, body weight, and self-reported and measured lower limb function. The actual exposure to the tailor made implementation strategy and user experiences will be measured in a process evaluation. In the economic evaluation, the difference in costs of usual OA care and the SAMBA model for integrated OA care will be compared with the difference in health outcomes and reported by the incremental cost-effectiveness ratio (ICER). DISCUSSION:The results from the present study will add to the current knowledge on tailored strategies, which aims to improve the uptake of evidence-based OA care recommendations and improve the quality of OA care in primary health care. The new knowledge can be used in national and international initiatives designed to improve the quality of OA care. TRIAL REGISTRATION:ClinicalTrials.gov NCT02333656.

Project description:INTRODUCTION:Prevention of overweight and obesity in childhood is a priority because of associated acute and chronic conditions in childhood and later in life, which place significant burden on health systems. Evidence suggests prevention should engage a range of actions and actors and target multiple levels. The Whole of Systems Trial Of Prevention Strategies for childhood obesity (WHO STOPS) will evaluate the outcomes of a novel systems-based intervention that aims to engage whole communities in a locally led multifaceted response. This paper describes the planned economic evaluation of WHO STOPS and examines the methodological challenges for economic evaluation of a complex systems-based intervention. METHODS AND ANALYSIS:Economic evaluation alongside a stepped-wedge cluster randomised controlled trial in regional and rural communities in Victoria, Australia. Cost-effectiveness and cost-utility analyses will provide estimates of the incremental cost (in $A) per body mass index unit saved and quality adjusted life year gained. A Markov cohort model will be employed to estimate healthcare cost savings and benefits over the life course of children. The dollar value of community resources harnessed for the community-led response will be estimated. Probabilistic uncertainty analyses will be undertaken to test sensitivity of results to plausible variations in all trial-based and modelled variables. WHO STOPS will also be assessed against other implementation considerations (such as sustainability and acceptability to communities and other stakeholders). ETHICS AND DISSEMINATION:The trial is registered by the Australian New Zealand Clinical Trials Registry (ACTRN12616000980437). Full ethics clearances have been received for all methods described below: Deakin University's Human Research Ethics Committee 2014-279, Deakin University's Human Ethics Advisory Group-Health (HEAG-H) HEAG-H 194_2014, HEAG-H 17 2015, HEAG-H 155_2014, HEAG-H 197_2016, HEAG-H 118_2017, the Victorian Department of Education and Training 2015_002622 and the Catholic Archdiocese of Ballarat. Trial findings (including economic evaluation) will be published in peer-reviewed journals and presented at international conferences. Collected data and analyses will be made available in accordance with journal policies and study ethics approvals. Results will be presented to relevant government authorities with an interest in cost-effectiveness of these types of interventions. TRIAL REGISTRATION NUMBER:ACTRN12616000980437; Pre-results.

Project description:BackgroundStructured distress management, comprised a 2-stage screening and referral model, can direct supportive care resources toward individuals who are most likely to benefit. This structured approach has yet to be trialed in Australian community-based services such as Cancer Council New South Wales (NSW) and Victoria Cancer Information and Support (CIS) 13 11 20 lines who care for a large community of cancer patients and caregivers.ObjectiveThe aim of this study was to evaluate the effectiveness of structured screening and referral in (1) increasing the proportion of distressed CIS callers who accept supportive care referrals and (2) reducing distress levels at 6-month follow-up.MethodsIn this stepped-wedge trial, Cancer Council NSW and Victoria CIS consultants are randomized to deliver structured care during inbound 13 11 20 calls in accordance with 3 intervention periods. Eligible callers are patients or caregivers who score 4 or more on the Distress Thermometer; NSW or Victorian residents; aged 18 years or older; and English proficient. Study data are collected via computer-assisted telephone interviews (CATIs) at 3- and 6-month follow-up and CIS record audit. CATIs include demographic and service use items and the General Health Questionnaire (GHQ-28) to assess distress. An economic analysis of the structured care model will be completed.ResultsThe structured care model was developed by guideline review and identification of service characteristics to guide mapping decisions; place-card methodology; and clinical vignettes with think-aloud methodology to confirm referral appropriateness. The model includes an additional screening tool (Patient Health Questionnaire-4) and a referral model with 16-20 CIS services. Descriptive statistics will be used to assess referral uptake rates. Differences between GHQ-28 scores for structured and usual care callers will be tested using a generalized linear mixed model with fixed effects for intervention and each time period. The trial will recruit 1512 callers. The sample size will provide the study with approximately 80% power to detect a difference of 0.3 SD in the mean score of the GHQ-28 at an alpha level of .05 and assuming an intra-cluster correlation of .04. A random sample of recorded calls will be reviewed to assess intervention fidelity and contamination. To date, 1835 distressed callers have been invited to participate with 60.71% (1114/1835) enrolled in the study. A total of 692 participants have completed 6-month CATIs. Recruitment is anticipated to end in late 2019.ConclusionsThis trial is among the first to rigorously test the outcomes of a community-based structured approach to distress management. The model is evidence-informed, practice-ready, and trialed in a real-world setting. The study outcomes will advance the understanding of distress management internationally for both patients and caregivers.Trial registrationAustralian New Zealand Clinical Trial Registry ACTRN12617000352303; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372105&isReview=true (Archived by WebCite on http://www.webcitation.org/78AW0Ba09).International registered report identifier (irrid)DERR1-10.2196/12473.

Dataset Information

Evaluation of the effects of implementing an electronic early warning score system: protocol for a stepped wedge study.

Background

Methods

Discussion

Publications

Evaluation of the effects of implementing an electronic early warning score system: protocol for a stepped wedge study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets