Dataset Information

Protocol for pragmatic randomised trial: integrating electronic health record-based behavioural economic ‘nudges’ into the electronic health record to reduce preoperative testing for patients undergoing cataract surgery

ABSTRACT:

Introduction

Robust randomised trial data have shown that routine preoperative (pre-op) testing for cataract surgery patients is inappropriate. While guidelines have discouraged testing since 2002, cataract pre-op testing rates have remained unchanged since the 1990s. Given the challenges of reducing low-value care despite strong consensus around the evidence, innovative approaches are needed to promote high-value care. This trial evaluates the impact of an interdisciplinary electronic health record (EHR) intervention that is informed by behavioural economic theory.

Methods and analysis

This pragmatic randomised trial is being conducted at UCLA Health between June 2021 and June 2022 with a 12-month follow-up period. We are randomising all UCLA Health physicians who perform pre-op visits during the study period to one of the three nudge arms or usual care. These three nudge alerts address (1) patient harm, (2) increased out-of-pocket costs for patients and (3) psychological harm to the patients related to pre-op testing. The nudges are triggered when a physician starts to order a pre-op test. We hypothesise that receipt of a nudge will be associated with reduced pre-op testing. The primary outcome will be the change in the percentage of patients undergoing pre-op testing at 12 months. Secondary outcomes will include the percentage of patients undergoing specific categories of pre-op tests (labs, EKGs, chest X-rays (CXRs)), the efficacy of each nudge, same-day surgery cancellations and cost savings.

Ethics and dissemination

The study protocol was approved by the institutional review board of the University of California, Los Angeles as well as a nominated Data Safety Monitoring Board. If successful, we will have created a tool that can be disseminated rapidly to EHR vendors across the nation to reduce inappropriate testing for the most common low-risk surgical procedures in the country.

Trial registration number

ClinicalTrials.gov identifier: NCT04104256.

SUBMITTER: Ahmadi A

PROVIDER: S-EPMC8572383 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo demonstrate that electronic health record (EHR) data can be used in an automated approach to evaluate cataract surgery outcomes.DesignRetrospective analysis.SubjectsResident and faculty surgeons.MethodsElectronic health record data were collected from cataract surgeries performed at the Johns Hopkins Wilmer Eye Institute, and cases were categorized into resident or attending as primary surgeon. Preoperative and postoperative visual acuity (VA) and unplanned return to operating room were extracted from the EHR.Main outcome measuresPostoperative VA and reoperation rate within 90 days.ResultsThis study analyzed 14 537 cataract surgery cases over 32 months. Data were extracted from the EHR using an automated approach to assess surgical outcomes for resident and attending surgeons. Of 337 resident surgeries with both preoperative and postoperative VA data, 248 cases (74%) had better postoperative VA, and 170 cases (51%) had more than 2 lines improvement. There was no statistical difference in the proportion of cases with better postoperative VA or more than 2 lines improvement between resident and attending cases. Attending surgeons had a statistically greater proportion of cases with postoperative VA better than 20/40, but this finding has to be considered in the context that, on average, resident cases started out with poorer baseline VA.A multivariable regression model of VA outcomes vs. resident/attending status that controlled for preoperative VA, patient age, American Society of Anesthesiologists (ASA) score, and estimated income found that resident status, preoperative VA, patient age, ASA score, and estimated income were all significant predictors of VA. The rate of unplanned return to the operating room within 90 days of cataract surgery was not statistically different between resident (1.8%) and attending (1.2%) surgeons.ConclusionsThis study demonstrates that EHR data can be used to evaluate and monitor surgical outcomes in an ongoing way. Analysis of EHR-extracted cataract outcome data showed that preoperative VA, ASA classification, and attending/resident status were important in predicting postoperative VA outcomes. These findings suggest that the utilization of EHR data could enable continuous assessment of surgical outcomes and inform interventions to improve resident training. Financial Disclosure(s): Proprietary or commercial disclosure may be found after the references.

Project description:BackgroundAccurate, pragmatic risk stratification for postoperative delirium (POD) is necessary to target preventative resources toward high-risk patients. Machine learning (ML) offers a novel approach to leveraging electronic health record (EHR) data for POD prediction. We sought to develop and internally validate a ML-derived POD risk prediction model using preoperative risk features, and to compare its performance to models developed with traditional logistic regression.MethodsThis was a retrospective analysis of preoperative EHR data from 24,885 adults undergoing a procedure requiring anesthesia care, recovering in the main post-anesthesia care unit, and staying in the hospital at least overnight between December 2016 and December 2019 at either of two hospitals in a tertiary care health system. One hundred fifteen preoperative risk features including demographics, comorbidities, nursing assessments, surgery type, and other preoperative EHR data were used to predict postoperative delirium (POD), defined as any instance of Nursing Delirium Screening Scale ≥2 or positive Confusion Assessment Method for the Intensive Care Unit within the first 7 postoperative days. Two ML models (Neural Network and XGBoost), two traditional logistic regression models ("clinician-guided" and "ML hybrid"), and a previously described delirium risk stratification tool (AWOL-S) were evaluated using the area under the receiver operating characteristic curve (AUC-ROC), sensitivity, specificity, positive likelihood ratio, and positive predictive value. Model calibration was assessed with a calibration curve. Patients with no POD assessments charted or at least 20% of input variables missing were excluded.ResultsPOD incidence was 5.3%. The AUC-ROC for Neural Net was 0.841 [95% CI 0. 816-0.863] and for XGBoost was 0.851 [95% CI 0.827-0.874], which was significantly better than the clinician-guided (AUC-ROC 0.763 [0.734-0.793], p < 0.001) and ML hybrid (AUC-ROC 0.824 [0.800-0.849], p < 0.001) regression models and AWOL-S (AUC-ROC 0.762 [95% CI 0.713-0.812], p < 0.001). Neural Net, XGBoost, and ML hybrid models demonstrated excellent calibration, while calibration of the clinician-guided and AWOL-S models was moderate; they tended to overestimate delirium risk in those already at highest risk.ConclusionUsing pragmatically collected EHR data, two ML models predicted POD in a broad perioperative population with high discrimination. Optimal application of the models would provide automated, real-time delirium risk stratification to improve perioperative management of surgical patients at risk for POD.

Project description:BackgroundSome researchers argue that the successful implementation of patient decision aids (PDAs) into clinical workflows depends on their integration into electronic health records (EHRs). Anecdotally, we know that EHR integration is a complex and time-consuming task; yet, the process has not been examined in detail. As part of an implementation project, we examined the work involved in integrating an encounter PDA for symptomatic uterine fibroids into Epic EHR systems.ObjectiveThis study aims to identify the steps and time required to integrate a PDA into the Epic EHR system and examine facilitators and barriers to the integration effort.MethodsWe conducted a case study at 5 academic medical centers in the United States. A clinical champion at each institution liaised with their Epic EHR team to initiate the integration of the uterine fibroid Option Grid PDAs into clinician-facing menus. We scheduled regular meetings with the Epic software analysts and an expert Epic technologist to discuss how best to integrate the tools into Epic for use by clinicians with patients. The meetings were then recorded and transcribed. Two researchers independently coded the transcripts and field notes before categorizing the codes and conducting a thematic analysis to identify the facilitators and barriers to EHR integration. The steps were reviewed and edited by an Epic technologist to ensure their accuracy.ResultsIntegrating the uterine fibroid Option Grid PDA into clinician-facing menus required an 18-month timeline and a 6-step process, as follows: task priority negotiation with Epic software teams, security risk assessment, technical review, Epic configuration; troubleshooting, and launch. The key facilitators of the process were the clinical champions who advocated for integration at the institutional level and the presence of an experienced technologist who guided Epic software analysts during the build. Another facilitator was the use of an emerging industry standard app platform (Health Level 7 Substitutable Medical Applications and Reusable Technologies on Fast Healthcare Interoperability Resources) as a means of integrating the Option Grid into existing systems. This standard platform enabled clinicians to access the tools by using single sign-on credentials and prevented protected health information from leaving the EHR. Key barriers were the lack of control over the Option Grid product developed by EBSCO (Elton B Stephens Company) Health; the periodic Epic upgrades that can result in a pause on new software configurations; and the unforeseen software problems with Option Grid (ie, inability to print the PDA), which delayed the launch of the PDA.ConclusionsThe integration of PDAs into the Epic EHR system requires a 6-step process and an 18-month timeline. The process required support and prioritization from a clinical champion, guidance from an experienced technologist, and a willing EHR software developer team.

Project description:BackgroundThe rapid expansion in the use of electronic health records (EHR) has increased the number of medical errors originating in health information systems (HIS). The sociotechnical approach helps in understanding risks in the development, implementation, and use of EHR and health information technology (HIT) while accounting for complex interactions of technology within the health care system.ObjectiveThis study addresses two important questions: (1) "which of the common EHR error types are associated with perceived high- and extreme-risk severity ratings among EHR users?", and (2) "which variables are associated with high- and extreme-risk severity ratings?"MethodsThis study was a quantitative, non-experimental, descriptive study of EHR users. We conducted a cross-sectional web-based questionnaire study at the largest hospital district in Finland. Statistical tests included the reliability of the summative scales tested with Cronbach's alpha. Logistic regression served to assess the association of the independent variables to each of the eight risk factors examined.ResultsA total of 2864 eligible respondents provided the final data. Almost half of the respondents reported a high level of risk related to the error type "extended EHR unavailability". The lowest overall risk level was associated with "selecting incorrectly from a list of items". In multivariate analyses, profession and clinical unit proved to be the strongest predictors for high perceived risk. Physicians perceived risk levels to be the highest ( P<.001 in six of eight error types), while emergency departments, operating rooms, and procedure units were associated with higher perceived risk levels ( P<.001 in four of eight error types). Previous participation in eLearning courses on EHR-use was associated with lower risk for some of the risk factors.ConclusionsBased on a large number of Finnish EHR users in hospitals, this study indicates that HIT safety hazards should be taken very seriously, particularly in operating rooms, procedure units, emergency departments, and intensive care units/critical care units. Health care organizations should use proactive and systematic assessments of EHR risks before harmful events occur. An EHR training program should be compulsory for all EHR users in order to address EHR safety concerns resulting from the failure to use HIT appropriately.

Project description:Electronic health record (EHR) use can enhance or undermine the ability of providers to deliver effective, humanistic patient-centered care. Given patient-centered care has been found to positively impact patient health outcomes, it is critical to provide formal education on patient-centered EHR communication skills. Unfortunately, despite increasing worldwide EHR adoption, few institutions educate trainees on EHR communication best practices.The goal of this research was to develop and deliver mandatory patient-centered EHR training to all incoming housestaff at the University of Chicago.We developed a brief patient-centered EHR use curriculum highlighting best practices based on a literature search. Training was embedded into required EHR onboarding for all incoming housestaff (interns, residents, and fellows) at the University of Chicago in 2015 and was delivered by institutional Clinical Applications Trainers. An 11-item posttraining survey consisting of ten 5-point Likert scale questions and 1 open-ended question was administered. Responses at the high end of the scale were grouped to dichotomize data.All 158 of the incoming 2015 postgraduate trainees participated in training and completed surveys (158/158, 100.0%). Just over half (86/158, 54.4%) were interns and the remaining were residents and fellows (72/158, 45.6%). One-fifth of respondents (32/158, 20.2%) were primary care trainees (defined as internal medicine, pediatric, and medicine-pediatric trainees), and the remaining 79.7% (126/158) were surgical or specialty trainees. Self-perceived pre- versus posttraining knowledge of barriers, best practices, and ability to implement patient-centered EHR skills significantly increased (3.1 vs 3.9, P<.001 for all). Most felt training was effective (90.5%), should be required (86.7%), and would change future practice as a result (70.9%). The only significant difference between intern and resident/fellow responses was prior knowledge of patient-centered EHR use barriers; interns endorsed higher prior knowledge than resident peers (3.27 vs 2.94 respectively, P=.03). Response comparison of specialty or surgical trainees (n=126) to primary care trainees (n=32) showed no significant differences in prior knowledge of barriers (3.09 vs 3.22, P=.50), of best practices (3.08 vs 2.94, P=.37), or prior ability to implement best practices (3.11 vs 2.84, P=.15). Primary care trainees had larger increases posttraining than surgical/specialty peers in knowledge of barriers (0.8 vs 0.7, P=.62), best practices (1.1 vs 0.8, P=.08), and ability to implement best practices (1.1 vs 0.7, P=.07), although none reached statistical significance. Primary care trainees also rated training as more effective (4.34 vs 4.09, P=.03) and felt training should be required (4.34 vs 4.09, P=.10) and would change their future practice as a result (4.13 vs 3.73, P=.02).Embedding EHR communication skills training into required institutional EHR training is a novel and effective way to teach key EHR skills to trainees. Such training may help ground trainees in best practices and contribute to cultivating an institutional culture of humanistic, patient-centered EHR use.