Dataset Information

Promoting de-implementation of inappropriate antimicrobial use in cardiac device procedures by expanding audit and feedback: protocol for hybrid III type effectiveness/implementation quasi-experimental study.

ABSTRACT:

Background

Despite a strong evidence base and clinical guidelines specifically recommending against prolonged post-procedural antimicrobial use, studies indicate that the practice is common following cardiac device procedures. Formative evaluations conducted by the study team suggest that inappropriate antimicrobial use may be driven by information silos that drive provider belief that antimicrobials are not harmful, in part due to lack of complete feedback about all types of clinical outcomes. De-implementation is recognized as an important area of research that can lead to reductions in unnecessary, wasteful, or harmful practices, such as excess antimicrobial use following cardiac device procedures; however, investigations into strategies that lead to successful de-implementation are limited. The overarching hypothesis to be tested in this trial is that a bundle of implementation strategies that includes audit and feedback about direct patient harms caused by inappropriate prescribing can lead to successful de-implementation of guideline-discordant care.

Methods

We propose a hybrid type III effectiveness-implementation stepped-wedge intervention trial at three high-volume, high-complexity VA medical centers. The main study intervention (an informatics-based, real-time audit-and-feedback tool) was developed based on learning/unlearning theory and formative evaluations and guided by the integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) Framework. Elements of the bundled and multifaceted implementation strategy to promote appropriate prescribing will include audit-and-feedback reports that include information about antibiotic harms, stakeholder engagement, patient and provider education, identification of local champions, and blended facilitation. The primary study outcome is adoption of evidence-based practice (de-implementation of inappropriate antimicrobial use). Clinical outcomes (cardiac device infections, acute kidney injuries and Clostridioides difficile infections) are secondary. Qualitative interviews will assess relevant implementation outcomes (acceptability, adoption, fidelity, feasibility).

Discussion

De-implementation theory suggests that factors that may have a particularly strong influence on de-implementation include strength of the underlying evidence, the complexity of the intervention, and patient and provider anxiety and fear about changing an established practice. This study will assess whether a multifaceted intervention mapped to identified de-implementation barriers leads to measurable improvements in provision of guideline-concordant antimicrobial use. Findings will improve understanding about factors that impact successful or unsuccessful de-implementation of harmful or wasteful healthcare practices.

Trial registration

ClinicalTrials.gov NCT05020418.

SUBMITTER: Branch-Elliman W

PROVIDER: S-EPMC8800400 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThere is a significant variation among individual primary care providers in prescribing of potentially problematic, low-value medicines which cause avoidable patient harm. Audit and feedback is generally effective at improving prescribing. However, progress has been hindered by research waste, leading to unanswered questions about how to include audit and feedback for specific problems and circumstances. Trials of different ways of providing audit and feedback in implementation laboratories have been proposed as a way of improving population healthcare while generating robust evidence on feedback effects. However, there is limited experience in their design and delivery.AimTo explore priorities, feasibility, and ethical challenges of establishing a primary care prescribing audit and feedback implementation laboratory.Design and settingTwo-stage Delphi consensus process involving primary care pharmacy leads, audit and feedback researchers, and patient and public.MethodParticipants initially scored statements relating to priorities, feasibility, and ethical considerations for an implementation laboratory. These covered current feedback practice, priority topics for feedback, usefulness of feedback in improving prescribing and different types of prescribing data, acceptability and desirability of different organization levels of randomization, options for trial consent, different methods of delivering feedback, and interest in finding out how effective different ways of presenting feedback would be. After receiving collated results, participants then scored the items again. The consensus was defined using the GRADE criteria. The results were analyzed by group and overall score.ResultsFourteen participants reached consensus for 38 out of 55 statements. Addressing antibiotic and opioid prescribing emerged as the highest priorities for action. The panel supported statements around addressing high-priority prescribing issues, taking an "opt-out" approach to practice consent if waiving consent was not permitted, and randomizing at lower rather than higher organizational levels. Participants supported patient-level prescribing data and further research evaluating most of the different feedback methods we presented them with.ConclusionsThere is a good level of support for evaluating a wide range of potential enhancements to improve the effects of feedback on prescribing. The successful design and delivery of a primary care audit and feedback implementation laboratory depend on identifying shared priorities and addressing practical and ethical considerations.

Project description:Catheter-associated urinary tract infection (CAUTI) is one of the most common hospital-acquired infections. However, many cases treated as hospital-acquired CAUTI are actually asymptomatic bacteriuria (ABU). Evidence-based guidelines recommend that providers neither screen for nor treat ABU in most catheterized patients, but there is a significant gap between these guidelines and clinical practice. Our objectives are (1) to evaluate the effectiveness of an audit and feedback intervention for increasing guideline-concordant care concerning catheter-associated ABU and (2) to measure improvements in healthcare providers' knowledge of and attitudes toward the practice guidelines associated with the intervention.The study uses a controlled pre/post design to test an intervention using audit and feedback of healthcare providers to improve their compliance with ABU guidelines. The intervention and the control sites are two VA hospitals. For objective 1 we will review medical records to measure the clinical outcomes of inappropriate screening for and treatment of catheter-associated ABU. For objective 2 we will survey providers' knowledge and attitudes. Three phases of our protocol are proposed: the first 12-month phase will involve observation of the baseline incidence of inappropriate screening for and treatment of ABU at both sites. This surveillance for clinical outcomes will continue at both sites throughout the study. Phase 2 consists of 12 months of individualized audit and feedback at the intervention site and guidelines distribution at both sites. The third phase, also over 12 months, will provide unit-level feedback at the intervention site to assess sustainability. Healthcare providers at the intervention site during phase 2 and at both sites during phase 3 will complete pre/post surveys of awareness and familiarity (knowledge), as well as of acceptance and outcome expectancy (attitudes) regarding the relevant practice guidelines.Our proposal to bring clinical practice in line with published guidelines has significant potential to decrease overdiagnosis of CAUTI and associated inappropriate antibiotic use. Our study will also provide information about how to maximize effectiveness of audit and feedback to achieve guideline adherence in the inpatient setting.NCT01052545.

Project description:Background To address low state physical education (PE) quantity and quality law implementation in elementary schools, the New York City Department of Education (NYCDOE) delivered a multilevel intervention (PE Works; 2015-2019), which included a district-led audit of school PE-law implementation, feedback, and coaching with principals. Using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) implementation science framework, we assessed the primary multilevel drivers of success for this approach in increasing adherence to PE quantity and quality law. Methods We conducted in-depth, semi-structured interviews with district-level personnel (n=17), elementary school administrators (n=18), and PE teachers (n=6) in 2020-21. Results Interview results suggested several key RE-AIM drivers of successful PE law implementation. Reach: Ensure higher-need schools receive the necessary initial support to improve PE and later focus on lower-need schools. Effectiveness: Provide support tailored to school needs, not penalties, to improve PE. Adoption: Increase the priority of PE at both district and school levels (e.g., audit and feedback, themselves, appear to elevate PE’s priority). Streamline data collection and feedback reports; collecting/reporting too much information is burdensome and leads to lack of focus. Involve qualified (i.e., skilled in both school administration and PE programming/pedagogy) district-level personnel to work collaboratively with schools. Implementation: Build strong, trusting district-school relationships. Maintenance: Provide ongoing district-level support to schools and involve parents to advocate for quality PE. Conclusions PE audits, feedback, and coaching (PEAFC) can guide schools in establishing long-term plans for successfully implementing PE-related law. Future research should examine the impact of PEAFC elsewhere (e.g., secondary schools, other districts). Supplementary Information The online version contains supplementary material available at 10.1186/s12966-023-01479-1.

Project description:BackgroundIn this pilot trial, we evaluated whether audit-and-feedback was a feasible strategy to improve antimicrobial prescribing in emergency departments (EDs).MethodsWe evaluated an audit-and-feedback intervention using a quasi-experimental interrupted time-series design at 2 intervention and 2 matched-control EDs; there was a 12-month baseline, 1-month implementation, and 11-month intervention period. At intervention sites, clinicians received (1) a single, one-on-one education about antimicrobial prescribing for common infections and (2) individualized feedback on total and condition-specific (uncomplicated acute respiratory infection [ARI]) antimicrobial use with peer-to-peer comparisons at baseline and every quarter. The primary outcome was the total antimicrobial-prescribing rate for all visits and was assessed using generalized linear models. In an exploratory analysis, we measured antimicrobial use for uncomplicated ARI visits and manually reviewed charts to assess guideline-concordant management for 6 common infections.ResultsIn the baseline and intervention periods, intervention sites had 28 016 and 23 164 visits compared to 33 077 and 28 835 at control sites. We enrolled 27 of 31 (87.1%) eligible clinicians; they acknowledged receipt of 33.3% of feedback e-mails. Intervention sites compared with control sites had no absolute reduction in their total antimicrobial rate (incidence rate ratio = 0.99; 95% confidence interval, 0.98-1.01). At intervention sites, antimicrobial use for uncomplicated ARIs decreased (68.6% to 42.4%; P < .01) and guideline-concordant management improved (52.1% to 72.5%; P < .01); these improvements were not seen at control sites.ConclusionsAt intervention sites, total antimicrobial use did not decrease, but an exploratory analysis showed reduced antimicrobial prescribing for viral ARIs. Future studies should identify additional targets for condition-specific feedback while exploring ways to make electronic feedback more acceptable.

Project description:BackgroundAudit and feedback (A&F) is a widely used implementation strategy. Understanding mechanisms of action of A&F increases the likelihood that the strategy will lead to implementation of an evidence-based practice. We therefore sought to understand one hospital's experience selecting and implementing an A&F intervention, to determine the implementation strategies that were used by staff and to specify the mechanism of action of those implementation strategies using causal pathway models, with the ultimate goal of improving acute stroke treatment practices.MethodsWe selected an A&F strategy in a hospital, initially based on implementation determinants and staff consideration of their performance on acute stroke treatment measures. After 7 months of A&F, we conducted semi-structured interviews of hospital providers and administrative staff to understand how it contributed to implementing guideline-concordant acute stroke treatment (medication named tissue plasminogen activator). We coded the interviews to identify the implementation strategies that staff used following A&F and to assess their mechanisms of action.ResultsWe identified five implementation strategies that staff used following the feedback intervention. These included (1) creating folders containing the acute stroke treatment protocol for the emergency department, (2) educating providers about the protocol for acute stroke, (3) obtaining computed tomography imaging of stroke patients immediately upon emergency department arrival, (4) increasing access to acute stroke medical treatment in the emergency department, and (5) providing additional staff support for implementation of the protocol in the emergency department. We identified enablement, training, and environmental restructuring as mechanisms of action through which the implementation strategies acted to improve guideline-concordant and timely acute stroke treatment.ConclusionsA&F of a hospital's acute stroke treatment practices generated additional implementation strategies that acted through various mechanisms of action. Future studies should focus on how initial implementation strategies can be amplified through internal mechanisms.

Project description:BackgroundUsing patient audio recordings of medical visits to provide clinicians with feedback on their attention to patient life context in care planning can improve health care delivery and outcomes, and reduce costs. However, such an initiative can raise concerns across stakeholders about surveillance, intrusiveness and merit. This study examined the perspectives of patients, physicians and other clinical staff, and facility leaders over 3 years at six sites during the implementation of a patient-collected audio quality improvement program designed to improve patient-centered care in a non-threatening manner and with minimal effort required of patients and clinicians.MethodsPatients were invited during the first and third year to complete exit surveys when they returned their audio recorders following visits, and clinicians to complete surveys annually. Clinicians were invited to participate in focus groups in the first and third years. Facility leaders were interviewed individually during the last 6 months of the study.ResultsThere were a total of 12 focus groups with 89 participants, and 30 leadership interviews. Two hundred fourteen clinicians and 800 patients completed surveys. In a qualitative analysis of focus group data employing NVivo, clinicians initially expressed concerns that the program could be disruptive and/or burdensome, but these diminished with program exposure and were substantially replaced by an appreciation for the value of low stakes constructive feedback. They were also significantly more confident in the value of the intervention in the final year (p = .008), more likely to agree that leadership supports continuous improvement of patient care and gives feedback on outcomes (p = .02), and at a time that is convenient (p = .04). Patients who volunteered sometimes expressed concerns they were "spying" on their doctors, but most saw it as an opportunity to improve care. Leaders were supportive of the program but not yet prepared to commit to funding it exclusively with facility resources.ConclusionsA patient-collected audio program can be implemented when it is perceived as safe, not disruptive or burdensome, and as contributing to better health care.

Project description:BackgroundIn Ontario, Canada, a government agency known as Ontario Health is responsible for making audit and feedback reports available to all family physicians to encourage ongoing quality improvement. The confidential report provides summary data on 3 key areas of practice: safe prescription, cancer screening, and diabetes management.ObjectiveThis report was redesigned to improve its usability in line with evidence. The objective of this study was to explore how the redesign was perceived, with an emphasis on recipients' understanding of the report and their engagement with it.MethodsWe conducted qualitative semistructured interviews with family physicians who had experience with both versions of the report recruited through purposeful and snowball sampling. We analyzed the transcripts following an emergent and iterative approach.ResultsSaturation was reached after 17 family physicians participated. In total, 2 key themes emerged as factors that affected the perceived usability of the report: alignment between the report and the recipients' expectations and capacity to engage in quality improvement. Family physicians expected the report and its quality indicators to reflect best practices and to be valid and accurate. They also expected the report to offer feedback on the clinical activities they perceived to be within their control to change. Furthermore, family physicians expected the goal of the report to be aligned with their perspective on feasible quality improvement activities. Most of these expectations were not met, limiting the perceived usability of the report. The capacity to engage with audit and feedback was hindered by several organizational and physician-level barriers, including the lack of fit with the existing workflow, competing priorities, time constraints, and insufficient skills for bridging the gaps between their data and the corresponding desired actions.ConclusionsDespite recognized improvements in the design of the report to better align with best practices, it was not perceived as highly usable. Improvements in the presentation of the data could not overcome misalignment with family physicians' expectations or the limited capacity to engage with the report. Integrating iterative evaluations informed by user-centered design can complement evidence-based guidance for implementation strategies. Creating a space for bringing together audit and feedback designers and recipients may help improve usability and effectiveness.

Project description:BackgroundTheory-based implementation strategies, such as audit and feedback (A&F), can improve the adoption of evidence-based practices. However, few strategies have been developed and tested to meet the needs of specialty clinics. In particular, frontline staff can execute cardiovascular disease (CVD) risk reduction protocols, but A&F strategies to support them are not well examined. Our objective was to develop and evaluate a theory-based approach to A&F, Interactive and Participatory A&F (IPAF).MethodsWe developed IPAF informed by two complementary theories, self-regulation theory (SRT) and self-determination theory (SDT). IPAF applies concepts from these theories to inform (1) what to address with staff to improve rates of best practices (SRT) and (2) how to interact with staff to improve behaviors aligned with best practices (SDT). We promoted IPAF fidelity by developing a semi-structured guide to facilitate staff discussion of target behaviors, perceived barriers, goals, and action plans. We evaluated IPAF in the context of eight quasi-experimental implementations in specialty clinics across two health systems. Following a hybrid type 2 effectiveness-implementation design, we reported intervention outcomes for CVD risk reduction elsewhere. This paper reports implementation outcomes associated with IPAF, focusing on feasibility, appropriateness, acceptability, fidelity, and adoption. We evaluated implementation outcomes using mixed-methods data including electronic health record (EHR) data, team records, and staff questionnaire responses.ResultsEighteen staff participated in 99 monthly, individual, synchronous (face-to-face or phone) IPAF sessions during the first 6 months of implementation. Subsequently, we provided over 375 monthly feedback emails. Feasibility data revealed high staff attendance (90-93%) and engagement in IPAF sessions. Staff highly rated questionnaire items about IPAF acceptability. Team records and staff responses demonstrated fidelity of IPAF delivery and receipt. Adoption of target behaviors increased significantly (all P values < 0.05), and adoption or behaviors were maintained for over 24 months.ConclusionsWe developed and evaluated a theory-based approach to A&F with frontline staff in specialty clinics to improve the implementation of evidence-based interventions. The findings support feasibility, appropriateness, acceptability, and fidelity of IPAF, and staff adoption and maintenance of target behaviors. By evaluating multi-site implementation outcomes, we extended prior research on clinic protocols and A&F beyond primary care settings and providers.