Dataset Information

Developing outcome, process and balancing measures for an emergency department longitudinal patient monitoring system using a modified Delphi.

ABSTRACT:

Background

Early warning score systems have been widely recommended for use to detect clinical deterioration in patients. The Irish National Emergency Medicine Programme has developed and piloted an emergency department specific early warning score system. The objective of this study was to develop a consensus among frontline healthcare staff, quality and safety staff and health systems researchers regarding evaluation measures for an early warning score system in the Emergency Department.

Methods

Participatory action research including a modified Delphi consensus building technique with frontline hospital staff, quality and safety staff, health systems researchers, local and national emergency medicine stakeholders was the method employed in this study. In Stage One, a workshop was held with the participatory action research team including frontline hospital staff, quality and safety staff and health systems researchers to gather suggestions regarding the evaluation measures. In Stage Two, an electronic modified-Delphi study was undertaken with a panel consisting of the workshop participants, key local and national emergency medicine stakeholders. Descriptive statistics were used to summarise the characteristics of the panellists who completed the questionnaires in each round. The mean Likert rating, standard deviation and 95% bias-corrected bootstrapped confidence interval for each variable was calculated. Bonferroni corrections were applied to take account of multiple testing. Data were analysed using Stata 14.0 SE.

Results

Using the Institute for Healthcare Improvement framework, 12 process, outcome and balancing metrics for measuring the effectiveness of an ED-specific early warning score system were developed.

Conclusion

There are currently no published measures for evaluating the effectiveness of an ED early warning score system. It was possible in this study to develop a suite of evaluation measures using a modified Delphi consensus approach. Using the collective expertise of frontline hospital staff, quality and safety staff and health systems researchers to develop and categorise the initial set of potential measures was an innovative and unique element of this study.

SUBMITTER: Ward ME

PROVIDER: S-EPMC6332627 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing outcome, process and balancing measures for an emergency department longitudinal patient monitoring system using a modified Delphi.

Ward Marie E ME Wakai Abel A McDowell Ronald R Boland Fiona F Coughlan Eoin E Hamza Moayed M Browne John J O'Sullivan Ronan R Geary Una U McDaid Fiona F Ní Shé Éidín É Drummond Frances J FJ Deasy Conor C McAuliffe Eilish E

BMC emergency medicine 20190114 1

<h4>Background</h4>Early warning score systems have been widely recommended for use to detect clinical deterioration in patients. The Irish National Emergency Medicine Programme has developed and piloted an emergency department specific early warning score system. The objective of this study was to develop a consensus among frontline healthcare staff, quality and safety staff and health systems researchers regarding evaluation measures for an early warning score system in the Emergency Departmen ...[more]

PMID: 30642263

Similar Datasets

Project description:BackgroundOlder adults are at high risk of developing delirium in the emergency department (ED); however, it is under-recognized in routine clinical care. Lack of detection and treatment is associated with poor outcomes, such as mortality. Performance measures (PMs) are needed to identify variations in quality care to help guide improvement strategies. The purpose of this study is to gain consensus on a set of quality statements and PMs that can be used to evaluate delirium care quality for older ED patients.MethodsA 3-round modified e-Delphi study was conducted with ED clinical experts. In each round, participants rated quality statements according to the concepts of importance and actionability, then their associated PMs according to the concept of necessity (1-9 Likert scales), with the ability to comment on each. Consensus and stability were evaluated using a priori criteria using descriptive statistics. Qualitative data was examined to identify themes within and across quality statements and PMs, which went through a participant validation exercise in the final round.ResultsTwenty-two experts participated, 95.5% were from west or central Canada. From 10 quality statements and 24 PMs, consensus was achieved for six quality statements and 22 PMs. Qualitative data supported justification for including three quality statements and one PM that achieved consensus slightly below a priori criteria. Three overarching themes emerged from the qualitative data related to quality statement actionability. Nine quality statements, nine structure PMs, and 14 process PMs are included in the final set, addressing four areas of delirium care: screening, diagnosis, risk reduction and management.ConclusionResults provide a set of quality statements and PMs that are important, actionable, and necessary to a diverse group of clinical experts. To our knowledge, this is the first known study to develop a de novo set of guideline-based quality statements and PMs to evaluate the quality of delirium care older adults receive in the ED setting.

Project description:BackgroundSocial distancing policies work in different ways and at different levels. In addition, various forms of monitoring systems have been implemented in different countries. However, there is an almost complete lack of specific monitoring system in Republic of Korea to effectively monitor social distancing measures compliance and outcome. This study aims to develop a monitoring system for social distancing measures compliance and outcome in Korea to evaluate and improve the implemented policy.MethodsA draft monitoring system was developed after reviewing Korea's social distancing measures (central and local government briefings) and checking available data about social distancing behavior. The modified Delphi process was used to evaluate the draft of the social distancing monitoring system. In total, 27 experts participated in the evaluation. The round 1 evaluation includes (1) commenting on the composition of the monitoring fields (open response), (2) monitoring indicators for each monitoring field (10-point Likert scale), and (3) commenting on the source of data used to develop the monitoring system (open response). In the round 2 evaluation, 55 indicators, excepting open responses, were re-evaluated.ResultsThe response rate for the Delphi survey was 100% in both the first and second rounds. Of the 55 indicators, 1 indicator, which did not satisfy the quantitative criteria, was excluded. According to the experts' open response comments, 15 indicators were excluded, as these indicators overlapped with other indicators or had little relevance to social distancing. Instead, 23 new indicators were added. Finally, 62 indicators were included with 12 available data sources. The monitoring system domain was divided into 'social distancing measures state, social distancing measures compliance, social distancing outcome'.ConclusionsThis study is significant in that it is the first in Korea to develop a comprehensive monitoring system for checking if social distancing measures are being followed well, and is applicable to estimates utilizing data that are immediately available for each indicator. Furthermore, the developed monitoring system could be a reference for other countries that require the development of such systems to monitor social distancing.

Project description:BackgroundEmergency department (ED) crowding leads to prolonged emergency department length of stay (ED-LOS) and adverse patient outcomes. No uniform definition of ED crowding exists. Several scores have been developed to quantify ED crowding; the best known is the Emergency Department Work Index (EDWIN). Research on the EDWIN is often applied to limited settings and conducted over a short period of time.ObjectivesTo explore whether the EDWIN as a measure can track occupancy at a Dutch ED over the course of one year and to identify fluctuations in ED occupancy per hour, day, and month. Secondary objective is to investigate the discriminatory value of the EDWIN in detecting crowding, as compared with the occupancy rate and prolonged ED-LOS.MethodsA retrospective cohort study of all ED visits during the period from September 2010 to August 2011 was performed in one hospital in the Netherlands. The EDWIN incorporates the number of patients per triage level, physicians, treatment beds and admitted patients to quantify ED crowding. The EDWIN was adjusted to emergency care in the Netherlands: modified EDWIN (mEDWIN). ED crowding was defined as the 75th percentile of mEDWIN per hour, which was ≥0.28.ResultsIn total, 28,220 ED visits were included in the analysis. The median mEDWIN per hour was 0.15 (Interquartile range (IQR) 0.05-0.28); median mEDWIN per patient was 0.25 (IQR 0.15-0.39). The EDWIN was higher on Wednesday (0.16) than on other days (0.14-0.16, p<0.001), and a peak in both mEDWIN (0.30-0.33) and ED crowding (52.9-63.4%) was found between 13:00-18:00 h. A comparison of the mEDWIN with the occupancy rate revealed an area under the curve (AUC) of 0.86 (95%CI 0.85-0.87). The AUC of mEDWIN compared with a prolonged ED-LOS (≥4 hours) was 0.50 (95%CI 0.40-0.60).ConclusionThe mEDWIN was applicable at a Dutch ED. The mEDWIN was able to identify fluctuations in ED occupancy. In addition, the mEDWIN had high discriminatory power for identification of a busy ED, when compared with the occupancy rate.

Project description:IntroductionOntario ambulances are restricted from patient transportation to sub-acute levels of care when these facilities may be more suitable than emergency departments for non-emergent conditions. There is no known patient classification specifically constructed to inform ED diversion protocols and guidance for sub-acute centre transportation for primary care-like patient conditions.ObjectiveTo construct a novel patient classification of potentially preventable emergency department visits following transport by ambulance, and analyse patient-level characteristic associations with this classification based in Ontario secondary data.Methods and analysisThe Primary Care-like Ambulance transports following Response for 911-Emergencies (PriCARE) patient classification will be constructed using a two-phase RAND/UCLA modified Delphi design. All experts included are physicians with relevant experience in emergency and/or primary care in Ontario. The first phase of the study will determine consensus of the expert committee on which ED interventions performed on patients with non-emergent acuities could be conducted in sub-acute healthcare centres. The second phase will assess consensus of which patient, hospital and acuity factors are most appropriate to be incorporated into a PriCARE classification. We will also investigate secondary outcomes on consensus of which ED interventions could be transferred to a paramedic context given an expanded scope of practice and patient-level characteristics of PriCARE classified individuals.Ethics and disseminationThis study received a research ethics board exemption waiver from the Hamilton Integrated Research Ethics Board; review reference 2020-11451-GRA. Results will be submitted for publication in a peer-reviewed journal and presented at relevant conferences. The results will be shared with Ontario paramedic services and governing institutions. This study will be used to inform patient classification protocols and clinical decision tools for ambulances to transport to sub-acute healthcare centres.Trial registration numberISRCTN22901977.

Project description:BackgroundMost patients transported by Ontario paramedics to the emergency department have non-emergent conditions and may be more appropriately served by subacute community-based care centres. We sought to determine consensus on a set of patient characteristics that could be useful to classify retrospective emergency department visits that had a high probability of being primary care-like and potentially redirectable to a subacute care centre by paramedics.MethodsWe conducted a modified Delphi study to assess expert consensus on characteristics of patients transported by paramedics to the emergency department from August to October 2021. An expert Delphi committee was constructed of emergency and family physicians in Ontario using purposive sampling. Experts rated whether each characteristic was useful to be included in a classification to identify potentially redirectable visits retrospectively, as well as characteristic details (e.g., upper and lower bounds). Consensus was considered 75% agreement.ResultsSixteen experts participated in the study; the experts were mostly male (75%) and evenly divided between emergency and family medicine. After 2 rounds, consensus was achieved on 8 of 9 characteristics (89%). Four characteristics were determined as useful to classify potentially redirectable emergency department visits: age (81%), triage acuity (100%), specialist consult in the emergency department (94%) and emergency department visit outcome (81%). Specifications of each characteristic were refined as follows: young and middle-aged adults with a non-emergent triage acuity, did not receive a specialist physician consult in the emergency department and discharged from the emergency department.InterpretationStrong consensus was achieved to specify a classification system for potentially redirectable emergency department visits. These results will be combined with knowledge of which subacute care centres could conduct the main physician interventions to retrospectively identify emergency department visits that could have been suitable for paramedic redirection for further research.Study registrationID ISRCTN22901977.

Project description:BackgroundType 1 diabetes (T1D) management is complex and associated with significant psychosocial burden. Continuous glucose monitors (CGM) can improve disease management and outcomes and introduce new or exacerbate existing psychosocial concerns. Patient-reported outcome measures (PROMs) can be used to capture this information, but there is no consensus on which PROMs should be used in pediatric CGM research.ObjectiveHere we describe the process to (1) identify PROMs that could be used to assess the impact of CGMs on pediatric patients with T1D, (2) implement a modified electronic Delphi (e-Delphi) methodology to arrive at an expert consensus on which PROMs are most suitable for clinical and research applications, and (3) establish a periodicity table for the administration of PROMs over time in a real-world evidence study.MethodsTo identify appropriate PROMs for pediatric patients and families with T1D and CGMs, we conducted an asynchronous, e-Delphi process with a multidisciplinary group of experts from around the country. We identified candidate instruments through a literature review. The 3-round e-Delphi process was conducted via a study website, email, and web-based forms. Participants provided opinions on the usefulness of instruments, age validation, feasibility, time, and frequency of administration.ResultsIn total, 16 experts participated in the e-Delphi process; 4 of whom consistently participated in all 3 rounds. We identified 62 candidate instruments, which were narrowed down to 12 final PROMs across 5 domains: diabetes distress and burden (n=4), autonomy (n=2), quality of life (n=1), psychosocial (n=3), and technology acceptance (n=2). A quarterly administration schedule was developed to reduce burden on participants.ConclusionsPROMs can provide critical insights into the psychosocial well-being of patients. The specific measures identified in the paper are particularly well suited for pediatric patients with T1D using CGMs. Clinical implementation could help health care providers, patients, and families to engage in more comprehensive disease management.

Dataset Information

Developing outcome, process and balancing measures for an emergency department longitudinal patient monitoring system using a modified Delphi.

Background

Methods

Results

Conclusion

Publications

Developing outcome, process and balancing measures for an emergency department longitudinal patient monitoring system using a modified Delphi.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets