Influence of user-centered clinical decision support on pediatric blood product ordering errors.
Ontology highlight
ABSTRACT: Background
Children are at increased risk from transfusion-related medical errors. Clinical decision support (CDS) can enhance pediatric providers' decision-making regarding transfusion practices including indications, volume, rate, and special processing instructions. Our objective was to use CDS in a pediatric health system to reduce:blood product-related safety events from ordering errors;special processing ordering errors for patients with T-cell dysfunction, sickle cell disease (SCD), or thalassemia;transfusions administered faster than 5 mL/kg/h.Materials and methods
In this single-center before and after quality improvement study, we evaluated how user-centered design of pediatric blood product orders influenced pediatric transfusion practices and outcomes. Safety events were identified through active and passive surveillance. Other clinically relevant outcomes were identified through electronic health record queries.Results
Blood product-related safety events from ordering errors did not change significantly from the baseline period (6 events, 0.4 per month, from 1/1/2018-3/27/2019) to the intervention period (1 event, 0.1 per month, from 3/28/2019-12/31/2019; rate ratio: 0.27 [0.01-2.25]). Packed red blood cell (PRBC) and platelet orders for patients with T-cell dysfunction that did not specify irradiation decreased significantly from 488/12,359 (3.9%) to 204/6,711 (3.0%, risk ratio: 0.77 [0.66-0.90]). PRBC orders for patients with SCD or thalassemia that did not specify phenotypically similar units fell from 386/2,876 (13.4%) to 57/1,755 (3.2%, risk ratio: 0.24 [0.18-0.32]). Transfusions administered faster than 5 mL/kg/h decreased from 4,112/14,641 (28.1%) to 2,125/9,263 (22.9%, risk ratio: 0.82 [0.78-0.85]).Discussion
User-centered design of CDS for pediatric blood product orders significantly reduced special processing ordering errors and inappropriate transfusion rates. Larger studies are needed to evaluate the impact on safety events.
SUBMITTER: Orenstein EW
PROVIDER: S-EPMC9918378 | biostudies-literature | 2023 Jan
REPOSITORIES: biostudies-literature
Publications
Influence of user-centered clinical decision support on pediatric blood product ordering errors.
Orenstein Evan W EW Rollins Margo M Jones Jennifer J Kandaswamy Swaminathan S Boudreaux Jeanne J Carter Alexis B AB Josephson Cassandra D CD
Blood transfusion = Trasfusione del sangue 20220510 1
<h4>Background</h4>Children are at increased risk from transfusion-related medical errors. Clinical decision support (CDS) can enhance pediatric providers' decision-making regarding transfusion practices including indications, volume, rate, and special processing instructions. Our objective was to use CDS in a pediatric health system to reduce:blood product-related safety events from ordering errors;special processing ordering errors for patients with T-cell dysfunction, sickle cell disease (SCD ...[more]
Similar Datasets
Project description:BackgroundMedical errors in blood product orders and administration are common, especially for pediatric patients. A failure modes and effects analysis in our health care system indicated high risk from the electronic blood ordering process.ObjectivesThere are two objectives of this study as follows:(1) To describe differences in the design of the original blood product orders and order sets in the system (original design), new orders and order sets designed by expert committee (DEC), and a third-version developed through user-centered design (UCD).(2) To compare the number and type of ordering errors, task completion rates, time on task, and user preferences between the original design and that developed via UCD.MethodsA multidisciplinary expert committee proposed adjustments to existing blood product order sets resulting in the DEC order set. When that order set was tested with front-line users, persistent failure modes were detected, so orders and order sets were redesigned again via formative usability testing. Front-line users in their native clinical workspaces were observed ordering blood in realistic simulated scenarios using a think-aloud protocol. Iterative adjustments were made between participants. In summative testing, participants were randomized to use the original design or UCD for five simulated scenarios. We evaluated differences in ordering errors, time on task, and users' design preference with two-sample t-tests.ResultsFormative usability testing with 27 providers from seven specialties led to 18 changes made to the DEC to produce the UCD. In summative testing, error-free task completion for the original design was 36%, which increased to 66% in UCD (30%, 95% confidence interval [CI]: 3.9-57%; p = 0.03). Time on task did not vary significantly.ConclusionUCD led to substantially different blood product orders and order sets than DEC. Users made fewer errors when ordering blood products for pediatric patients in simulated scenarios when using the UCD orders and order sets compared with the original design.
| S-EPMC6930842 | biostudies-literature
Project description:BackgroundThe number of trained specialists world-wide is insufficient to serve all children with pediatric rheumatologic disorders, even in the countries with robust medical resources. We evaluated the potential of diagnostic decision support software (DDSS) to alleviate this shortage by assessing the ability of such software to improve the diagnostic accuracy of non-specialists.MethodsUsing vignettes of actual clinical cases, clinician testers generated a differential diagnosis before and after using diagnostic decision support software. The evaluation used the SimulConsult® DDSS tool, based on Bayesian pattern matching with temporal onset of each finding in each disease. The tool covered 5405 diseases (averaging 22 findings per disease). Rheumatology content in the database was developed using both primary references and textbooks. The frequency, timing, age of onset and age of disappearance of findings, as well as their incidence, treatability, and heritability were taken into account in order to guide diagnostic decision making. These capabilities allowed key information such as pertinent negatives and evolution over time to be used in the computations. Efficacy was measured by comparing whether the correct condition was included in the differential diagnosis generated by clinicians before using the software ("unaided"), versus after use of the DDSS ("aided").ResultsThe 26 clinicians demonstrated a significant reduction in diagnostic errors following introduction of the software, from 28% errors while unaided to 15% using decision support (p < 0.0001). Improvement was greatest for emergency medicine physicians (p = 0.013) and clinicians in practice for less than 10 years (p = 0.012). This error reduction occurred despite the fact that testers employed an "open book" approach to generate their initial lists of potential diagnoses, spending an average of 8.6 min using printed and electronic sources of medical information before using the diagnostic software.ConclusionsThese findings suggest that decision support can reduce diagnostic errors and improve use of relevant information by generalists. Such assistance could potentially help relieve the shortage of experts in pediatric rheumatology and similarly underserved specialties by improving generalists' ability to evaluate and diagnose patients presenting with musculoskeletal complaints.Trial registrationClinicalTrials.gov ID: NCT02205086.
| S-EPMC5155385 | biostudies-literature
Project description:BACKGROUND:A pharmacogenomic clinical decision support tool (PGx-CDS) for thiopurine medications can help physicians incorporate pharmacogenomic results into prescribing decisions by providing up-to-date, real-time decision support. However, the PGx-CDS user interface may introduce errors and promote alert fatigue. The objective of this study was to develop and evaluate a prototype of a PGx-CDS user interface for thiopurine medications with user-centered design methods. METHODS:This study had two phases: In phase I, we conducted qualitative interviews to assess providers' information needs. Interview transcripts were analyzed through a combination of inductive and deductive qualitative analysis to develop design requirements for a PGx-CDS user interface. Using these requirements, we developed a user interface prototype and evaluated its usability (phase II). RESULTS:In total, 14 providers participated: 10 were interviewed in phase I, and seven providers completed usability testing in phase II (3 providers participated in both phases). Most (90%) participants were interested in PGx-CDS systems to help improve medication efficacy and patient safety. Interviews yielded 11 themes sorted into two main categories: 1) health care providers' views on PGx-CDS and 2) important design features for PGx-CDS. We organized these findings into guidance for PGx-CDS content and display. Usability testing of the PGx-CDS prototype showed high provider satisfaction. CONCLUSION:This is one of the first studies to utilize a user-centered design approach to develop and assess a PGx-CDS interface prototype for Thiopurine Methyltransferase (TPMT). This study provides guidance for the development of a PGx-CDS, and particularly for biomarkers such as TPMT.
| S-EPMC6798472 | biostudies-literature
Project description:BACKGROUND:Emergency departments (EDs) frequently care for individuals with opioid use disorder (OUD). Buprenorphine (BUP) is an effective treatment option for patients with OUD that can safely be initiated in the ED. At present, BUP is rarely initiated as a part of routine ED care. Clinical decision support (CDS) could accelerate adoption of ED-initiated BUP into routine emergency care. OBJECTIVE:This study aimed to design and formatively evaluate a user-centered decision support tool for ED initiation of BUP for patients with OUD. METHODS:User-centered design with iterative prototype development was used. Initial observations and interviews identified workflows and information needs. The design team and key stakeholders reviewed prototype designs to ensure accuracy. A total of 5 prototypes were evaluated and iteratively refined based on input from 26 attending and resident physicians. RESULTS:Early feedback identified concerns with the initial CDS design: an alert with several screens. The timing of the alert led to quick dismissal without using the tool. User feedback on subsequent iterations informed the development of a flexible tool to support clinicians with varied levels of experience with the intervention by providing both one-click options for direct activation of care pathways and user-activated support for critical decision points. The final design resolved challenging navigation issues through targeted placement, color, and design of the decision support modules and care pathways. In final testing, users expressed that the tool could be easily learned without training and was reasonable for use during routine emergency care. CONCLUSIONS:A user-centered design process helped designers to better understand users' needs for a Web-based clinical decision tool to support ED initiation of BUP for OUD. The process identified varying needs across user experience and familiarity with the protocol, leading to a flexible design supporting both direct care pathways and user-initiated decision support.
| S-EPMC6414819 | biostudies-literature
Project description:PLAIN ENGLISH SUMMARY:For the elderly to get the care and services they need, they may need to make the difficult decision about staying in their home or moving to another home. Many other people may be involved in their care too (friends, family and healthcare providers), and can support them in making the decision. We asked informal caregivers of elderly people to help us develop a decision guide to support them and their loved ones in making this decision. This guide will be used by health providers in home care who are trained to help people make decisions. The guide is in French and English. To design and test this decision guide we involved elderly people, their caregivers and health administrators. We first asked them what they needed for making the decision, and then designed a first version of the guide. Then we asked them to look at it and give feedback, which was used to make the final version. We then used scientific criteria to check its content and the language used. The final decision guide was acceptable to the caregivers, their elderly loved ones, and the health administrators. The guide is currently being evaluated in a large research project with home care teams in the province of Quebec. ABSTRACT:Background As they grow older, many elderly people are faced with the difficult and preference-sensitive decision about staying in their home or moving to a residence better adapted to their evolving care needs. We aimed to develop an English and French decision aid (DA) for elderly people facing this decision, and to involve end-users in all phases of the development process. Methods A three-cycle design with involvement of end-users in Quebec. End-users were elderly people (n?=?4) caregivers of the elderly (n?=?5), health administrators involved in home-care service delivery or policy (n?=?6) and an interprofessional research team (n?=?19). Cycle 1: Decisional needs assessment and development of the first prototype based on existing tools and input from end-users; overview of reviews examining the impact of location of care on elderly people's health outcomes. Cycle 2: Usability testing with end-users, adaptation of prototype. Cycle 3: Refinement of the prototype with a linguist, graphic designer and end-users. The final prototype underwent readability testing and an International Patient Decision Aids (IPDAS) criteria compatibility assessment to verify minimal requirements for decision aids and was tested for usability by the elderly. ResultsCycle 1: We used the Ottawa Personal Decision Guide to design a first prototype. As the overview of reviews did not find definitive evidence regarding optimal locations of care for elderly people, we were not able to add evidence-based advantages and disadvantages to the guide. Cycle 2: Overall, the caregivers and health administrators who evaluated the prototype (n?=?10) were positive. In response to their suggestions, we deleted some elements (overview of pros, cons, and consequences of the options) that were necessary to qualify the tool as a DA and renamed it a "decision guide". Cycle 3: We developed French and English versions of the guide, readable at a primary school level. The elderly judged the guide as acceptable. Conclusion We developed a decision guide to support elderly people and their caregivers in decision making about location of care. This paper is one of few to report on a fully collaborative approach to decision guide development that involves end-users at every stage (caregivers and health administrators early on, the frail elderly in the final stages). The guide is currently being evaluated in a cluster randomized trial. Trial registration: NCT02244359.
| S-EPMC5611600 | biostudies-literature
Project description:IntroductionMany parents who choose hypospadias repair for their sons experience decisional conflict (DC) and decisional regret (DR). We previously found that parental decision-making about hypospadias surgery is a complex process characterized by cyclic information-seeking to alleviate anxiety and confusion.ObjectiveThe objective of this study was to engage parents of hypospadias patients and pediatric providers in the co-design of a decision aid (DA) prototype to facilitate shared decision-making about hypospadias surgery and address DC and DR.MethodsFrom August 2018 to January 2019, we conducted three co-design workshops with parents of hypospadias patients, pediatric urology and general pediatric providers to discuss their recommendations for a DA prototype. Activities were audio recorded and professionally transcribed. Transcripts and worksheets were analyzed by six coders using qualitative analysis to identify key aspects of a hypospadias DA desired by stakeholders. We conducted a collaborative design and prototyping session to establish key features and requirements, created a content map visualizing this work, and then developed a DA prototype.ResultsParent participants included 6 mothers and 4 fathers: 8 Caucasian, 2 African-American; median age 31 years. Providers included pediatric urology (n = 7) and general pediatric providers (n = 10): median age 47.5 years, 83.3% Caucasian, 58.3% male, 58.3% MD's and 41.7% nurse practitioners. Participants created user-friendly, interactive DA prototypes with "24/7" availability that had three key functions: 1) provide accurate, customizable, educational content, 2) connect parents with each other, and 3) engage them in a decision-making activity. The prototype consisted of five modules (Extended Summary Figure). "Hypospadias Basics" includes epidemiology and a hypospadias severity scale. "Surgery Basics" includes goals, illustrated steps, and pros/cons of surgery. "Testimonials" includes videos of parents and adolescents discussing their experiences. "Help me Decide" includes a decisional conflict scale and a decision-making activity (i.e. values clarification method). "Frequently Asked Questions" covers general hypospadias information, perioperative expectations and a review of postoperative care.DiscussionTo our knowledge, this is the first DA prototype developed for a pediatric urology condition using a human-centered design approach to engage many key stakeholders in the development process. One limitation of this study is the small population sampled, which limits generalizability and means that our findings may not reflect the views of all parents or pediatric providers involved in hypospadias decision-making.ConclusionsWe created a parent-centered hypospadias DA prototype that provides decision support in an online, interactive format. Future directions include further testing with usability experts, providers and parents.
| S-EPMC7686073 | biostudies-literature
Project description:ObjectivesAdoption of emergency department (ED) initiation of buprenorphine (BUP) for opioid use disorder (OUD) into routine emergency care has been slow, partly due to clinicians' unfamiliarity with this practice and perceptions that it is complicated and time-consuming. To address these barriers and guide emergency clinicians through the process of BUP initiation, we implemented a user-centered computerized clinical decision support system (CDS). This study was conducted to assess the feasibility of implementation and to evaluate the preliminary efficacy of the intervention to increase the rate of ED-initiated BUP.MethodsAn interrupted time series study was conducted in an urban, academic ED from April 2018 to February 2019 (preimplementation phase), March 2019 to August 2019 (implementation phase), and September 2019 to December 2019 (maintenance phase) to study the effect of the intervention on adult ED patients identified by a validated electronic health record (EHR)-based computable phenotype consisting of structured data consistent with potential cases of OUD who would benefit from BUP treatment. The intervention offers flexible CDS for identification of OUD, assessment of opioid withdrawal, and motivation of readiness to start treatment and automates EHR activities related to ED initiation of BUP (including documentation, orders, prescribing, and referral). The primary outcome was the rate of ED-initiated BUP. Secondary outcomes were launch of the intervention, prescription for naloxone at ED discharge, and referral for ongoing addiction treatment.ResultsOf the 141,041 unique patients presenting to the ED over the preimplementation and implementation phases (i.e., the phases used in primary analysis), 906 (574 preimplementation and 332 implementation) met OUD phenotype and inclusion criteria. The rate of BUP initiation increased from 3.5% (20/574) in the preimplementation phase to 6.6% (22/332) in the implementation phase (p = 0.03). After the temporal trend of the number of physician's with X-waiver training and other covariates were adjusted for, the relative risk of BUP initiation rate was 2.73 (95% confidence interval [CI] = 0.62 to 12.0, p = 0.18). Similarly, the number of unique attendings who initiated BUP increased modestly 7/53 (13.0%) to 13/57 (22.8%, p = 0.10) after offering just-in-time training during the implementation period. The rate of naloxone prescribed at discharge also increased (6.5% preimplementation and 11.5% implementation; p < 0.01). The intervention received a system usability scale score of 82.0 (95% CI = 76.7 to 87.2).ConclusionImplementation of user-centered CDS at a single ED was feasible, acceptable, and associated with increased rates of ED-initiated BUP and naloxone prescribing in patients with OUD and a doubling of the number of unique physicians adopting the practice. We have implemented this intervention across several health systems in an ongoing trial to assess its effectiveness, scalability, and generalizability.
| S-EPMC7496559 | biostudies-literature
Project description:BackgroundShared decision-making (SDM) is optimal in the context of periviable delivery, where the decision to pursue life-support measures or palliation is both preference sensitive and value laden. We sought to develop a decision support tool (DST) prototype to facilitate SDM by utilizing a user-centered design research approach.MethodsWe convened four patient and provider advisory boards with women and their partners who had experienced a surviving or non-surviving periviable delivery, pregnant women who had not experienced a prior preterm birth, and obstetric providers. Each 2-h session involved design research activities to generate ideas and facilitate sharing of values, goals, and attitudes. Participant feedback shaped the design of three prototypes (a tablet application, family story videos, and a virtual reality experience) to be tested in a final session.ResultsNinety-five individuals (48 mothers/partners; 47 providers) from two hospitals participated. Most participants agreed that the prototypes should include factual, unbiased outcomes and probabilities. Mothers and support partners also desired comprehensive explanations of delivery and care options, while providers wanted a tool to ease communication, help elicit values, and share patient experiences. Participants ultimately favored the tablet application and suggested that it include family testimonial videos.ConclusionOur results suggest that a DST that combines unbiased information and understandable outcomes with family testimonials would be meaningful for periviable SDM. User-centered design was found to be a useful method for creating a DST prototype that may lead to improved effectiveness, usability, uptake, and dissemination in the future, by leveraging the expertise of a wide range of stakeholders.
| S-EPMC6686668 | biostudies-literature
Project description:BackgroundDespite the unprecedented performance of deep learning algorithms in clinical domains, full reviews of algorithmic predictions by human experts remain mandatory. Under these circumstances, artificial intelligence (AI) models are primarily designed as clinical decision support systems (CDSSs). However, from the perspective of clinical practitioners, the lack of clinical interpretability and user-centered interfaces hinders the adoption of these AI systems in practice.ObjectiveThis study aims to develop an AI-based CDSS for assisting polysomnographic technicians in reviewing AI-predicted sleep staging results. This study proposed and evaluated a CDSS that provides clinically sound explanations for AI predictions in a user-centered manner.MethodsOur study is based on a user-centered design framework for developing explanations in a CDSS that identifies why explanations are needed, what information should be contained in explanations, and how explanations can be provided in the CDSS. We conducted user interviews, user observation sessions, and an iterative design process to identify three key aspects for designing explanations in the CDSS. After constructing the CDSS, the tool was evaluated to investigate how the CDSS explanations helped technicians. We measured the accuracy of sleep staging and interrater reliability with macro-F1 and Cohen κ scores to assess quantitative improvements after our tool was adopted. We assessed qualitative improvements through participant interviews that established how participants perceived and used the tool.ResultsThe user study revealed that technicians desire explanations that are relevant to key electroencephalogram (EEG) patterns for sleep staging when assessing the correctness of AI predictions. Here, technicians wanted explanations that could be used to evaluate whether the AI models properly locate and use these patterns during prediction. On the basis of this, information that is closely related to sleep EEG patterns was formulated for the AI models. In the iterative design phase, we developed a different visualization strategy for each pattern based on how technicians interpreted the EEG recordings with these patterns during their workflows. Our evaluation study on 9 polysomnographic technicians quantitatively and qualitatively investigated the helpfulness of the tool. For technicians with <5 years of work experience, their quantitative sleep staging performance improved significantly from 56.75 to 60.59 with a P value of .05. Qualitatively, participants reported that the information provided effectively supported them, and they could develop notable adoption strategies for the tool.ConclusionsOur findings indicate that formulating clinical explanations for automated predictions using the information in the AI with a user-centered design process is an effective strategy for developing a CDSS for sleep staging.
| S-EPMC8811694 | biostudies-literature
Project description:BackgroundCurrent guidelines recommend less aggressive target hemoglobin A1c (HbA1c) levels based on older age and lower life expectancy for older adults with diabetes. The effectiveness of electronic health record (EHR) clinical decision support (CDS) in promoting guideline adherence is undermined by alert fatigue and poor workflow integration. Integrating behavioral economics (BE) and CDS tools is a novel approach to improving adherence to guidelines while minimizing clinician burden.MethodsWe will apply a systematic, user-centered design approach to incorporate BE "nudges" into a CDS module and will perform user testing in two "vanguard" sites. To accomplish this, we will conduct (1) semi-structured interviews with key informants (n = 8), (2) a 2-h, design-thinking workshop to derive and refine initial module ideas, and (3) semi-structured group interviews at each site with clinic leaders and clinicians to elicit feedback on three proposed nudge module components (navigator section, inbasket refill protocol, medication preference list). Detailed field notes will be summarized by module idea and usability theme for rapid iteration. Frequency of firing and user action taken will be assessed in the first month of implementation via EHR reporting to confirm that module components and related reporting are working as expected as well as assess utilization. To assess the utilization and feasibility of the new tools and generate estimates of clinician compliance with the Choosing Wisely guideline for diabetes management in older adults, a 6-month, single-arm pilot study of the BE-EHR module will be conducted in six outpatient primary care clinics.DiscussionWe hypothesize that a low burden, user-centered approach to design will yield a BE-driven, CDS module with relatively high utilization by clinicians. The resulting module will establish a platform for exploring the ability of BE concepts embedded within the EHR to affect guideline adherence for other use cases.
| S-EPMC6381676 | biostudies-literature