Dataset Information

The effect of automated audit and feedback on data completeness in the electronic health record of the general physician: protocol for a cluster randomized controlled trial.

ABSTRACT:

Background

The electronic health record (EHR) of the general physician (GP) is an important tool that can be used to assess and improve the quality of healthcare. However, there are some problems when (re) using the data gathered in the EHR for quality assessments. One problem is the lack of data completeness in the EHR. Audit and feedback (A&F) is a well-known quality intervention that can improve the quality of healthcare. We hypothesize that an automated A&F intervention can be adapted to improve the data completeness of the EHR of the GP, more specifically, the number of correctly registered diagnoses of type 2 diabetes and chronic kidney disease.

Methods

This study is a pragmatic cluster randomized controlled trial with an intervention at the level of GP practice. The intervention consists of an audit and extended electronically delivered feedback with multiple components that will be delivered 4 times electronically to general practices over 12 months. The data will be analyzed on an aggregated level (per GP practice). The primary outcome is the percentage of correctly registered diagnoses of type 2 diabetes. The key secondary outcome is the registration of chronic kidney disease. Exploratory secondary outcomes are the registration of heart failure, biometric data and lifestyle habits, and the evolution of 4 different EHR-extractable quality indicators.

Discussion

This cluster randomized controlled trial intends to primarily improve the registration of type 2 diabetes in the EHR of the GP and to secondarily improve the registration of chronic kidney disease. In addition, the registration of heart failure, lifestyle parameters, and biometric data in the EHR of the GP are explored together with 4 EHR-extractable quality indicators. By doing so, this study aims to improve the data completeness of the EHR, paving the way for future quality assessments.

Trial registration

ClinicalTrials.gov NCT04388228 . Registered on May 14, 2020.

SUBMITTER: Van den Bulck S

PROVIDER: S-EPMC8097814 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Electronic health record (EHR) access and audit logs record behaviors of providers as they navigate the EHR. These data can be used to better understand provider responses to EHR-based clinical decision support (CDS), shedding light on whether and why CDS is effective. OBJECTIVE:This study aimed to determine the feasibility of using EHR access and audit logs to track primary care physicians' (PCPs') opening of and response to noninterruptive alerts delivered to EHR InBaskets. METHODS:We conducted a descriptive study to assess the use of EHR log data to track provider behavior. We analyzed data recorded following opening of 799 noninterruptive alerts sent to 75 PCPs' InBaskets through a prior randomized controlled trial. Three types of alerts highlighted new medication concerns for older patients' posthospital discharge: information only (n=593), medication recommendations (n=37), and test recommendations (n=169). We sought log data to identify the person opening the alert and the timing and type of PCPs' follow-up EHR actions (immediate vs by the end of the following day). We performed multivariate analyses examining associations between alert type, patient characteristics, provider characteristics, and contextual factors and likelihood of immediate or subsequent PCP action (general, medication-specific, or laboratory-specific actions). We describe challenges and strategies for log data use. RESULTS:We successfully identified the required data in EHR access and audit logs. More than three-quarters of alerts (78.5%, 627/799) were opened by the PCP to whom they were directed, allowing us to assess immediate PCP action; of these, 208 alerts were followed by immediate action. Expanding on our analyses to include alerts opened by staff or covering physicians, we found that an additional 330 of the 799 alerts demonstrated PCP action by the end of the following day. The remaining 261 alerts showed no PCP action. Compared to information-only alerts, the odds ratio (OR) of immediate action was 4.03 (95% CI 1.67-9.72) for medication-recommendation and 2.14 (95% CI 1.38-3.32) for test-recommendation alerts. Compared to information-only alerts, ORs of medication-specific action by end of the following day were significantly greater for medication recommendations (5.59; 95% CI 2.42-12.94) and test recommendations (1.71; 95% CI 1.09-2.68). We found a similar pattern for OR of laboratory-specific action. We encountered 2 main challenges: (1) Capturing a historical snapshot of EHR status (number of InBasket messages at time of alert delivery) required incorporation of data generated many months prior with longitudinal follow-up. (2) Accurately interpreting data elements required iterative work by a physician/data manager team taking action within the EHR and then examining audit logs to identify corresponding documentation. CONCLUSIONS:EHR log data could inform future efforts and provide valuable information during development and refinement of CDS interventions. To address challenges, use of these data should be planned before implementing an EHR-based study.

Project description:Audit and feedback is often used as a strategy to improve quality of care, however, its effects are variable and often marginal. In order to learn how to design and deliver effective feedback, we need to understand their mechanisms of action. This theory-informed study will investigate how electronic audit and feedback affects improvement intentions (i.e. information-intention gap), and whether an action implementation toolbox with suggested actions and materials helps translating those intentions into action (i.e. intention-behaviour gap). The study will be executed in Dutch intensive care units (ICUs) and will be focused on pain management.We will conduct a laboratory experiment with individual ICU professionals to assess the impact of feedback on their intentions to improve practice. Next, we will conduct a cluster randomised controlled trial with ICUs allocated to feedback without or feedback with action implementation toolbox group. Participants will not be told explicitly what aspect of the intervention is randomised; they will only be aware that there are two variations of providing feedback. ICUs are eligible for participation if they submit indicator data to the Dutch National Intensive Care Evaluation (NICE) quality registry and agree to allocate a quality improvement team that spends 4 h per month on the intervention. All participating ICUs will receive access to an online quality dashboard that provides two functionalities: gaining insight into clinical performance on pain management indicators and developing action plans. ICUs with access to the toolbox can develop their action plans guided by a list of potential barriers in the care process, associated suggested actions, and supporting materials to facilitate implementation of the actions. The primary outcome measure for the laboratory experiment is the proportion of improvement intentions set by participants that are consistent with recommendations based on peer comparisons; for the randomised trial it is the proportion of patient shifts during which pain has been adequately managed. We will also conduct a process evaluation to understand how the intervention is implemented and used in clinical practice, and how implementation and use affect the intervention's impact.The results of this study will inform care providers and managers in ICU and other clinical settings how to use indicator-based performance feedback in conjunction with an action implementation toolbox to improve quality of care. Within the ICU context, this study will produce concrete and directly applicable knowledge with respect to what is or is not effective for improving pain management, and under which circumstances. The results will further guide future research that aims to understand the mechanisms behind audit and feedback and contribute to identifying the active ingredients of successful interventions.ClinicalTrials.gov NCT02922101 . Registered 26 September 2016.

Project description:BACKGROUND:Antibiotic prescribing in dentistry accounts for 9% of total antibiotic prescriptions in Scottish primary care. The Scottish Dental Clinical Effectiveness Programme (SDCEP) published guidance in April 2008 (2nd edition, August 2011) for Drug Prescribing in Dentistry, which aims to assist dentists to make evidence-based antibiotic prescribing decisions. However, wide variation in prescribing persists and the overall use of antibiotics is increasing. METHODS:RAPiD is a 12-month partial factorial cluster randomised trial conducted in NHS General Dental Practices across Scotland. Its aim is to compare the effectiveness of individualised audit and feedback (A&F) strategies for the translation into practice of SDCEP recommendations on antibiotic prescribing. The trial uses routinely collected electronic healthcare data in five aspects of its design in order to: identify the study population; apply eligibility criteria; carry out stratified randomisation; generate the trial intervention; analyse trial outcomes. Eligibility was determined on contract status and a minimum level of recent NHS treatment provision. All eligible dental practices in Scotland were simultaneously randomised at baseline either to current audit practice or to an intervention group. Randomisation was stratified by single-handed/multi-handed practices. General dental practitioners (GDPs) working at intervention practices will receive individualised graphical representations of their antibiotic prescribing rate from the previous 14 months at baseline and an update at six months. GDPs could not be blinded to their practice allocation. Intervention practices were further randomised using a factorial design to receive feedback with or without: a health board comparator; a supplementary text-based intervention; additional feedback at nine months. The primary outcome is the total antibiotic prescribing rate per 100 courses of treatment over the year following delivery of the baseline intervention. A concurrent qualitative process evaluation will apply theory-based approaches using the Consolidated Framework for Implementation Research to explore the acceptability of the interventions and the Theoretical Domains Framework to identify barriers and enablers to evidence-based antibiotic prescribing behaviour by GDPs. DISCUSSION:RAPiD will provide a robust evaluation of A&F in dentistry in Scotland. It also demonstrates that linked administrative datasets have the potential to be used efficiently and effectively across all stages of an randomised controlled trial. TRIAL REGISTRATION:Current Controlled Trials ISRCTN49204710.

Project description:BACKGROUND:Dentists prescribe approximately 10% of antibiotics dispensed in UK community pharmacies. Despite clear clinical guidance, dentists often prescribe antibiotics inappropriately. This cluster-randomised controlled trial used routinely collected National Health Service (NHS) dental prescribing and treatment claim data to compare the impact of individualised audit and feedback (A&F) interventions on dentists' antibiotic prescribing rates. METHODS AND FINDINGS:All 795 antibiotic prescribing NHS general dental practices in Scotland were included. Practices were randomised to the control (practices = 163; dentists = 567) or A&F intervention group (practices = 632; dentists = 1,999). A&F intervention practices were allocated to one of two A&F groups: (1) individualised graphical A&F comprising a line graph plotting an individual dentist's monthly antibiotic prescribing rate (practices = 316; dentists = 1,001); or (2) individualised graphical A&F plus a written behaviour change message synthesising and reiterating national guidance recommendations for dental antibiotic prescribing (practices = 316; dentists = 998). Intervention practices were also simultaneously randomised to receive A&F: (i) with or without a health board comparator comprising the addition of a line to the graphical A&F plotting the monthly antibiotic prescribing rate of all dentists in the health board; and (ii) delivered at 0 and 6 mo or at 0, 6, and 9 mo, giving a total of eight intervention groups. The primary outcome, measured by the trial statistician who was blinded to allocation, was the total number of antibiotic items dispensed per 100 NHS treatment claims over the 12 mo post-delivery of the baseline A&F. Primary outcome data was available for 152 control practices (dentists = 438) and 609 intervention practices (dentists = 1,550). At baseline, the number of antibiotic items prescribed per 100 NHS treatment claims was 8.3 in the control group and 8.5 in the intervention group. At follow-up, antibiotic prescribing had decreased by 0.4 antibiotic items per 100 NHS treatment claims in control practices and by 1.0 in intervention practices. This represents a significant reduction (-5.7%; 95% CI -10.2% to -1.1%; p = 0.01) in dentists' prescribing rate in the intervention group relative to the control group. Intervention subgroup analyses found a 6.1% reduction in the antibiotic prescribing rate of dentists who had received the written behaviour change message relative to dentists who had not (95% CI -10.4% to -1.9%; p = 0.01). There was no significant between-group difference in the prescribing rate of dentists who received a health board comparator relative to those who did not (-4.3%; 95% CI -8.6% to 0.1%; p = 0.06), nor between dentists who received A&F at 0 and 6 mo relative to those who received A&F at 0, 6, and 9 mo (0.02%; 95% CI -4.2% to 4.2%; p = 0.99). The key limitations relate to the use of routinely collected datasets which did not allow evaluation of any effects on inappropriate prescribing. CONCLUSIONS:A&F derived from routinely collected datasets led to a significant reduction in the antibiotic prescribing rate of dentists. TRIAL REGISTRATION:Current Controlled Trials ISRCTN49204710.

Project description:Financial incentives and audit plus feedback on performance are two strategies commonly used by governments to motivate general practitioners (GP) to undertake specific healthcare activities. However, in recent years, governments have reduced or removed incentive payments without evidence of the potential impact on GP behaviour and patient outcomes. This trial (known as ACCEPt-able) aims to determine whether preventive care activities in general practice are sustained when financial incentives and/or external audit plus feedback on preventive care activities are removed. The activity investigated is annual chlamydia testing for 16- to 29-year-old adults, a key preventive health strategy within this age group.ACCEPt-able builds on a large cluster randomised controlled trial (RCT) that evaluated a 3-year chlamydia testing intervention in general practice. GPs were provided with a support package to facilitate annual chlamydia testing of all sexually active 16- to 29-year-old patients. This package included financial incentive payments to the GP for each chlamydia test conducted and external audit plus feedback on each GP's chlamydia testing rates. ACCEPt-able is a factorial cluster RCT in which general practices are randomised to one of four groups: (i) removal of audit plus feedback-continue to receive financial incentive payments for each chlamydia test; (ii) removal of financial incentive payments-continue to receive audit plus feedback; (iii) removal of financial incentive payments and audit plus feedback; and (iv) continue financial incentive payments and audit plus feedback. The primary outcome is chlamydia testing rate measured as the proportion of sexually active 16- to 29-year-olds who have a GP consultation within a 12-month period and at least one chlamydia test.This will be the first RCT to examine the impact of removal of financial incentive payments and audit plus feedback on the chlamydia testing behaviour of GPs. This trial is particularly timely and will increase our understanding about the impact of financial incentives and audit plus feedback on GP behaviour when governments are looking for opportunities to control healthcare budgets and maximise clinical outcomes for money spent. The results of this trial will have implications for supporting preventive health measures beyond the content area of chlamydia.The trial has been registered on the Australian and New Zealand Clinical Trials Registry ( ACTRN12614000595617 ).

Project description:BackgroundMuch research worldwide is focussed on cost containment and better adherence to guidelines in healthcare. The research focussing on professional behaviour is often performed in a well-controlled research setting. In this study a large-scale implementation of a peer review strategy was tested on both test ordering and prescribing behaviour in primary care in the normal quality improvement setting.MethodsWe planned a cluster-RCT in existing local quality improvement collaboratives (LQICs) in primary care. The study ran from January 2008 to January 2011. LQICs were randomly assigned to one of two trial arms, with each arm receiving the same intervention of audit and feedback combined with peer review. Both arms were offered five different clinical topics and acted as blind controls for the other arm. The differences in test ordering rates and prescribing rates between both arms were analysed in an intention-to-treat pre-post analysis and a per-protocol analysis.ResultsTwenty-one LQIC groups, including 197 GPs working in 88 practices, entered the trial. The intention-to-treat analysis did not show a difference in the changes in test ordering or prescribing performance between intervention and control groups. The per-protocol analysis showed positive results for half of the clinical topics. The increase in total tests ordered was 3% in the intervention arm and 15% in the control arm. For prescribing the increase in prescriptions was 20% in the intervention arm and 66% in the control group. It was observed that the groups with the highest baseline test ordering and prescription volumes showed the largest improvements.ConclusionsOur study shows that the results from earlier work could not be confirmed by our attempt to implement the strategy in the field. We did not see a decrease in the volumes of tests ordered or of the drugs prescribed but were able to show a lesser increase instead. Implementing the peer review with audit and feedback proved to be not feasible in primary care in the Netherlands.Trial registrationThis trial was registered at the Dutch trial register under number ISRCTN40008171 on August 7th 2007.

Project description:ImportanceThe use of electronic health records (EHRs) is directly associated with physician burnout. An underlying factor associated with burnout may be EHR-related fatigue owing to insufficient user-centered interface design and suboptimal usability.ObjectiveTo examine the association between EHR use and fatigue, as measured by pupillometry, and efficiency, as measured by mouse clicks, time, and number of EHR screens, among intensive care unit (ICU) physicians completing a simulation activity in a prominent EHR.Design, setting, and participantsA cross-sectional, simulation-based EHR usability assessment of a leading EHR system was conducted from March 20 to April 5, 2018, among 25 ICU physicians and physician trainees at a southeastern US academic medical center. Participants completed 4 simulation patient cases in the EHR that involved information retrieval and task execution while wearing eye-tracking glasses. Fatigue was quantified through continuous eye pupil data; EHR efficiency was characterized through task completion time, mouse clicks, and EHR screen visits. Data were analyzed from June 1, 2018, to August 31, 2019.Main outcomes and measuresPrimary outcomes were physician fatigue, measured by pupillometry (with lower scores indicating greater fatigue), and EHR efficiency, measured by task completion times, number of mouse clicks, and number of screens visited during EHR simulation.ResultsThe 25 ICU physicians (13 women; mean [SD] age, 32.1 [6.1] years) who completed a simulation exercise involving 4 patient cases (mean [SD] completion time, 34:43 [11:41] minutes) recorded a total of 14 hours and 27 minutes of EHR activity. All physician participants experienced physiological fatigue at least once during the exercise, and 20 of 25 participants (80%) experienced physiological fatigue within the first 22 minutes of EHR use. Physicians who experienced EHR-related fatigue in 1 patient case were less efficient in the subsequent patient case, as demonstrated by longer task completion times (r?=?-0.521; P?=?.007), higher numbers of mouse clicks (r?=?-0.562; P?=?.003), and more EHR screen visits (r?=?-0.486; P?=?.01).Conclusions and relevanceThis study reports high rates of fatigue among ICU physicians during short periods of EHR simulation, which were negatively associated with EHR efficiency and included a carryover association across patient cases. More research is needed to investigate the underlying causes of EHR-associated fatigue, to support user-centered EHR design, and to inform safe EHR use policies and guidelines.

Project description:Background. While often first treated in the emergency department (ED), identification of sepsis is difficult. Electronic medical record (EMR) clinical decision tools offer a novel strategy for identifying patients with sepsis. The objective of this study was to test the accuracy of an EMR-based, automated sepsis identification system. Methods. We tested an EMR-based sepsis identification tool at a major academic, urban ED with 64,000 annual visits. The EMR system collected vital sign and laboratory test information on all ED patients, triggering a "sepsis alert" for those with ?2 SIRS (systemic inflammatory response syndrome) criteria (fever, tachycardia, tachypnea, leukocytosis) plus ?1 major organ dysfunction (SBP ? 90 mm Hg, lactic acid ?2.0 mg/dL). We confirmed the presence of sepsis through manual review of physician, nursing, and laboratory records. We also reviewed a random selection of ED cases that did not trigger a sepsis alert. We evaluated the diagnostic accuracy of the sepsis identification tool. Results. From January 1 through March 31, 2012, there were 795 automated sepsis alerts. We randomly selected 300 cases without a sepsis alert from the same period. The true prevalence of sepsis was 355/795 (44.7%) among alerts and 0/300 (0%) among non-alerts. The positive predictive value of the sepsis alert was 44.7% (95% CI [41.2-48.2%]). Pneumonia and respiratory infections (38%) and urinary tract infection (32.7%) were the most common infections among the 355 patients with true sepsis (true positives). Among false-positive sepsis alerts, the most common medical conditions were gastrointestinal (26.1%), traumatic (25.7%), and cardiovascular (20.0%) conditions. Rates of hospital admission were: true-positive sepsis alert 91.0%, false-positive alert 83.0%, no sepsis alert 5.7%. Conclusions. This ED EMR-based automated sepsis identification system was able to detect cases with sepsis. Automated EMR-based detection may provide a viable strategy for identifying sepsis in the ED.