Dataset Information

Involving end-users in the design of an audit and feedback intervention in the emergency department setting - a mixed methods study.

ABSTRACT:

Background

Long length of stays (LOS) in emergency departments (ED) negatively affect quality of care. Ordering of inappropriate diagnostic tests contributes to long LOS and reduces quality of care. One strategy to change practice patterns is to use performance feedback dashboards for physicians. While this strategy has proven to be successful in multiple settings, the most effective ways to deliver such interventions remain unknown. Involving end-users in the process is likely important for a successful design and implementation of a performance dashboard within a specific workplace culture. This mixed methods study aimed to develop design requirements for an ED performance dashboard and to understand the role of culture and social networks in the adoption process.

Methods

We performed 13 semi-structured interviews with attending physicians in different roles within a single public ED in the U.S. to get an in-depth understanding of physicians' needs and concerns. Principles of human-centered design were used to translate these interviews into design requirements and to iteratively develop a front-end performance feedback dashboard. Pre- and post- surveys were used to evaluate the effect of the dashboard on physicians' motivation and to measure their perception of the usefulness of the dashboard. Data on the ED culture and underlying social network were collected. Outcomes were compared between physicians involved in the human-centered design process, those with exposure to the design process through the ED social network, and those with limited exposure.

Results

Key design requirements obtained from the interviews were ease of access, drilldown functionality, customization, and a visual data display including monthly time-trends and blinded peer-comparisons. Identified barriers included concerns about unintended consequences and the veracity of underlying data. The surveys revealed that the ED culture and social network are associated with reported usefulness of the dashboard. Additionally, physicians' motivation was differentially affected by the dashboard based on their position in the social network.

Conclusions

This study demonstrates the feasibility of designing a performance feedback dashboard using a human-centered design approach in the ED setting. Additionally, we show preliminary evidence that the culture and underlying social network are of key importance for successful adoption of a dashboard.

SUBMITTER: van Deen WK

PROVIDER: S-EPMC6489283 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Involving end-users in the design of an audit and feedback intervention in the emergency department setting - a mixed methods study.

van Deen Welmoed K WK Cho Edward S ES Pustolski Kathryn K Wixon Dennis D Lamb Shona S Valente Thomas W TW Menchine Michael M

BMC health services research 20190429 1

<h4>Background</h4>Long length of stays (LOS) in emergency departments (ED) negatively affect quality of care. Ordering of inappropriate diagnostic tests contributes to long LOS and reduces quality of care. One strategy to change practice patterns is to use performance feedback dashboards for physicians. While this strategy has proven to be successful in multiple settings, the most effective ways to deliver such interventions remain unknown. Involving end-users in the process is likely important ...[more]

PMID: 31035992

Similar Datasets

Project description:IntroductionThe goal of this study was to characterize current practices in the transition of care between the emergency department and primary care setting, with an emphasis on the use of the electronic medical record (EMR).MethodsUsing literature review and modified Delphi technique, we created and tested a pilot survey to evaluate for face and content validity. The final survey was then administered face-to-face at eight different clinical sites across the country. A total of 52 emergency physicians (EP) and 49 primary care physicians (PCP) were surveyed and analyzed. We performed quantitative analysis using chi-square test. Two independent coders performed a qualitative analysis, classifying answers by pre-defined themes (inter-rater reliability > 80%). Participants' answers could cross several pre-defined themes within a given question.ResultsEPs were more likely to prefer telephone communication compared with PCPs (30/52 [57.7%] vs. 3/49 [6.1%] P < 0.0001), whereas PCPs were more likely to prefer using the EMR for discharge communication compared with EPs (33/49 [67.4%] vs. 13/52 [25%] p < 0.0001). EPs were more likely to report not needing to communicate with a PCP when a patient had a benign condition (23/52 [44.2%] vs. 2/49 [4.1%] p < 0.0001), but were more likely to communicate if the patient required urgent follow-up prior to discharge from the ED (33/52 [63.5%] vs. 20/49 [40.8%] p = 0.029). When discussing barriers to effective communication, 51/98 (52%) stated communication logistics, followed by 49/98 (50%) who reported setting/environmental constraints and 32/98 (32%) who stated EMR access was a significant barrier.ConclusionSignificant differences exist between EPs and PCPs in the transition of care process. EPs preferred telephone contact synchronous to the encounter whereas PCPs preferred using the EMR asynchronous to the encounter. Providers believe EP-to-PCP contact is important for improving patient care, but report varied expectations and multiple barriers to effective communication. This study highlights the need to optimize technology for an effective transition of care from the ED to the outpatient setting.

Project description:INTRODUCTION:Emergency department (ED) visits for epilepsy are common, costly, often clinically unnecessary and typically lead to little benefit for epilepsy management. An 'Alternative Care Pathway' (ACP) for epilepsy, which diverts people with epilepsy (PWE) away from ED when '999' is called and leads to care elsewhere, might generate savings and facilitate improved ambulatory care. It is unknown though what features it should incorporate to make it acceptable to persons from this particularly vulnerable target population. It also needs to be National Health Service (NHS) feasible. This project seeks to identify the optimal ACP configuration. METHODS AND ANALYSIS:Mixed-methods project comprising three-linked stages. In Stage 1, NHS bodies will be surveyed on ACPs they are considering and semi-structured interviews with PWE and their carers will explore attributes of care important to them and their concerns and expectations regarding ACPs. In Stage 2, Discrete Choice Experiments (DCE) will be completed with PWE and carers to identify the relative importance placed on different care attributes under common seizure scenarios and the trade-offs people are willing to make. The uptake of different ACP configurations will be estimated. In Stage 3, two Knowledge Exchange workshops using a nominal group technique will be run. NHS managers, health professionals, commissioners and patient and carer representatives will discuss DCE results and form a consensus on which ACP configuration best meets users' needs and is NHS feasible. ETHICS AND DISSEMINATION:Ethical approval: NRES Committee (19/WM/0012) and King's College London ethics Committee (LRS-18/19-10353). Primary output will be identification of optimal ACP configuration which should be prioritised for implementation and evaluation. A pro-active dissemination strategy will make those considering developing or supporting an epilepsy ACP aware of the project and opportunities to take part in it. It will also ensure they are informed of its findings. PROJECT REGISTRATION NUMBER:Researchregistry4723.

Project description:BackgroundEmergency department utilization and crowding is increasing, putting additional pressure on emergency medicine (EM) residency programs to train efficient residents who can meet these demands. Specific practices associated with resident efficiency have yet to be identified. The objective of this study was to identify practices associated with enhanced efficiency in EM residents.MethodsA mixed-methods study design was utilized to identify behaviors associated with resident efficiency. In Stage 1, eight EM faculty provided 61 efficiency behaviors during semistructured interviews, which were prioritized into eight behaviors by independent ranking. A total of 31 behaviors were tested, including additions from previous literature and the study team. In Stage 2, two 4-hour observations during separate shifts of 27 EM residents were performed to record minute-by-minute timing and frequency of each behavior. In Stage 3, the association between resident efficiency and each of the behaviors was estimated using multivariable regression models adjusted for training year and clustered on resident. The primary efficiency outcome was 6-month average relative value units/hour. A sensitivity analysis was performed using patients/hour.ResultsSeven practices were positively associated with efficiency: average patient load, taking initial patient history with nurse present (number/hour, number/new patient), running the board (number/hour), conversations with other care team members (number/hour, % time), dictation use (number/hour, % time), smartphone text communication (number/hour, % time), and nonwork tasks (number/hour). Three practices were negatively associated with efficiency: visits to patient room (number/patient), conversations with attending physicians (% time), and reviewing electronic medical record (number/hour).ConclusionSeveral discrete behaviors were found to be associated with enhanced resident efficiency. These results can be utilized by EM residency programs to improve resident education and inform evaluations by providing specific, evidence-based practices for residents to develop and improve upon throughout training.

Project description:BackgroundPersonal health records (PHRs) can be useful in the emergency department, as they provide patient information in an accurate and timely manner and enable it to be used actively. This has an effect on patients' health outcomes and patient experience. Despite the importance of PHRs in emergencies, there are only a few studies related to PHRs in emergencies that evaluate patient experience.ObjectiveThis study aims to introduce the novel mobile PHR (mPHR) platform to emergency environments and assess user experience.MethodsThe study was conducted from October 2019 to November 2019. In total, 1000 patients or carers in the emergency departments of 3 hospitals were provided an application-based service called FirstER, which was developed to collect and utilize medical information for patients in the emergency department. This study was performed as a mixed methods study. After using FirstER, we investigated its usability and conducted a survey on the experience of obtaining medical information with a legacy system and with FirstER. Additionally, we interviewed 24 patients to gain insight into their experiences regarding medical information using FirstER. For the quantitative analysis, the survey results were analyzed using descriptive statistics (mean and standard deviation). For the qualitative analysis, we determined the keywords and their frequencies from each survey question and interview question.ResultsIn total, 1000 participants, consisting of both patients and carers, were recruited in this study. Their mean age was 41.4 (SD 13.3) years. We ascertained participants' satisfaction with FirstER and their mPHR needs through a survey and an in-depth interview. With the current system, participants were not well aware of their health conditions and medical information, and they were passive in the use of their medical information and treatment. However, they wanted their medical information for several reasons, such as information sharing and managing their health conditions. FirstER provided participants with their needed information and an easy way to access it. The mean System Usability Scale (SUS) value was 67.1 (SD 13.8), which was considered very near to acceptable.ConclusionsThis study is the first to implement mPHRs in the emergency department of large tertiary hospitals in the Republic of Korea. FirstER was found to enhance user experience in emergencies, as it provided necessary medical information and proper user experience. Moreover, the average SUS was 67.1, which means that participants found FirstER to be very near to acceptable. This is very encouraging in that FirstER was developed within a very short time, and it was a pilot study.Trial registrationClinicaltrials.gov NCT04180618; https://clinicaltrials.gov/ct2/show/NCT04180618.

Dataset Information

Involving end-users in the design of an audit and feedback intervention in the emergency department setting - a mixed methods study.

Background

Methods

Results

Conclusions

Publications

Involving end-users in the design of an audit and feedback intervention in the emergency department setting - a mixed methods study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets