Dataset Information

Implementation and Evaluation of Audit and Feedback for Monitoring Treat-to-Target (T2T) Strategies in Rheumatoid Arthritis Using Performance Measures.

ABSTRACT:

Introduction

In collaboration with the Alberta Medical Association's Physician Learning Program we developed individualized physician reports and held a group feedback session on rheumatoid arthritis (RA) performance measures (PM) to facilitate treat-to-target (T2T) strategies and evaluated physician experiences with this process.

Methods

5 PMs addressing T2T concepts from an established Canadian quality framework were operationalized for physician practice reports at 2 university-affiliated rheumatology clinics. Rheum4U, a quality improvement and research platform, was the data source. The audit results were reviewed in a facilitated group feedback session. Rheumatologists provided experiential feedback on the process through survey and/or an interview. Transcripts from interviews were analyzed using a 6-step thematic analysis.

Results

11 of 12 eligible rheumatologists consented to receive practice reports and provided feedback through surveys (n = 5) and interviews (n = 6). The practice reports from Rheum4U (n = 448 patients) revealed high rates of yearly follow-up (> 85%, PM1) and 100% performance on documentation of disease activity at ≥ 50% of visits (PM2). Only 34% of patients were seen within 3 months if not in remission (PM3) with 62% (2017) and 69% (2018) of those with active RA achieving a LDA state within 6 months (PM4). Approximately 70% of patients were in remission at any time point (PM5). All survey respondents agreed or strongly agreed comparison to peers was valuable and helped them reflect on their practice. Several strategies for improvement were identified, including but not limited to, leveraging of electronic records for future audit and feedback reports, providing additional granularity of results, additional stratification of results, and using high-performing peers as the comparator rather than the group mean.

Conclusions

Audit and feedback was perceived by clinicians as a useful strategy for evaluating T2T efforts in RA. Future work will focus on longitudinal evaluation of the clinical impact of this quality improvement initiative.

SUBMITTER: Barber CEH

PROVIDER: S-EPMC7695654 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundAudit and feedback (A&F) is a widely used implementation strategy. Understanding mechanisms of action of A&F increases the likelihood that the strategy will lead to implementation of an evidence-based practice. We therefore sought to understand one hospital's experience selecting and implementing an A&F intervention, to determine the implementation strategies that were used by staff and to specify the mechanism of action of those implementation strategies using causal pathway models, with the ultimate goal of improving acute stroke treatment practices.MethodsWe selected an A&F strategy in a hospital, initially based on implementation determinants and staff consideration of their performance on acute stroke treatment measures. After 7 months of A&F, we conducted semi-structured interviews of hospital providers and administrative staff to understand how it contributed to implementing guideline-concordant acute stroke treatment (medication named tissue plasminogen activator). We coded the interviews to identify the implementation strategies that staff used following A&F and to assess their mechanisms of action.ResultsWe identified five implementation strategies that staff used following the feedback intervention. These included (1) creating folders containing the acute stroke treatment protocol for the emergency department, (2) educating providers about the protocol for acute stroke, (3) obtaining computed tomography imaging of stroke patients immediately upon emergency department arrival, (4) increasing access to acute stroke medical treatment in the emergency department, and (5) providing additional staff support for implementation of the protocol in the emergency department. We identified enablement, training, and environmental restructuring as mechanisms of action through which the implementation strategies acted to improve guideline-concordant and timely acute stroke treatment.ConclusionsA&F of a hospital's acute stroke treatment practices generated additional implementation strategies that acted through various mechanisms of action. Future studies should focus on how initial implementation strategies can be amplified through internal mechanisms.

Project description:BackgroundAdjusting medication of patients with rheumatoid arthritis (RA) until predefined disease activity targets are met, i.e. Treat-to-Target (T2T), is the currently recommended treatment approach. However, not much is known about long-term cost-effectiveness of different T2T strategies.We model the 5-year costs and effects of a step-up approach (MTX mono - > MTX + csDMARD combination - > Adalimumab - > second anti-TNF) and an initial combination therapy approach (MTX + csDMARD - > MTX + csDMARD higher dose - > anti-TNFs) from the healthcare and societal perspectives, by adapting a previously validated Markov model.MethodsWe constructed a Markov model in which 3-monthly transitions between DAS28-defined health states of remission (≤2.6), low (2.6 < DAS28 ≤ 3.2), moderate (3.2 < DAS28 ≤ 5.1), and high disease activity (DAS28 > 5.1) were simulated. Modelled patients proceeded to subsequent treatments in case of non-remission at each (3-month) cycle start. In case of remission for two consecutive cycles medication was tapered, until medication-free remission was achieved. Transition probabilities for individual treatment steps were estimated using data of Dutch Rheumatology Monitoring registry Remission Induction Cohort I (step-up) and II (initial combination). Expected costs, utility, and ICER after 5 years were compared between the two strategies. To account for parameter uncertainty, probabilistic sensitivity analysis was employed through Gamma, Normal, and Dirichlet distributions. All utilities, costs, and transition probabilities were replaced by fitted distributions.ResultsOver a 5-year timespan, initial combination therapy was less costly and more effective than step-up therapy. Initial combination therapy accrued €16,226.3 and 3.552 QALY vs €20,183.3 and 3.517 QALYs for step-up therapy. This resulted in a negative ICER, indicating that initial combination therapy was both less costly and more effective in terms of utility gained. This can be explained by higher (±5%) remission percentages in initial combination strategy at all time points. More patients in remission generates less healthcare and productivity loss costs and higher utility. Additionally, higher remission percentages caused less bDMARD use in the initial combination strategy, lowering overall costs.ConclusionInitial combination therapy was found favourable over step-up therapy in the treatment of Rheumatoid Arthritis, when considering cost-effectiveness. Initial combination therapy resulted in more utility at a lower cost over 5 years.

Project description:BackgroundIn Ontario, Canada, a government agency known as Ontario Health is responsible for making audit and feedback reports available to all family physicians to encourage ongoing quality improvement. The confidential report provides summary data on 3 key areas of practice: safe prescription, cancer screening, and diabetes management.ObjectiveThis report was redesigned to improve its usability in line with evidence. The objective of this study was to explore how the redesign was perceived, with an emphasis on recipients' understanding of the report and their engagement with it.MethodsWe conducted qualitative semistructured interviews with family physicians who had experience with both versions of the report recruited through purposeful and snowball sampling. We analyzed the transcripts following an emergent and iterative approach.ResultsSaturation was reached after 17 family physicians participated. In total, 2 key themes emerged as factors that affected the perceived usability of the report: alignment between the report and the recipients' expectations and capacity to engage in quality improvement. Family physicians expected the report and its quality indicators to reflect best practices and to be valid and accurate. They also expected the report to offer feedback on the clinical activities they perceived to be within their control to change. Furthermore, family physicians expected the goal of the report to be aligned with their perspective on feasible quality improvement activities. Most of these expectations were not met, limiting the perceived usability of the report. The capacity to engage with audit and feedback was hindered by several organizational and physician-level barriers, including the lack of fit with the existing workflow, competing priorities, time constraints, and insufficient skills for bridging the gaps between their data and the corresponding desired actions.ConclusionsDespite recognized improvements in the design of the report to better align with best practices, it was not perceived as highly usable. Improvements in the presentation of the data could not overcome misalignment with family physicians' expectations or the limited capacity to engage with the report. Integrating iterative evaluations informed by user-centered design can complement evidence-based guidance for implementation strategies. Creating a space for bringing together audit and feedback designers and recipients may help improve usability and effectiveness.

Project description:BackgroundThere is a significant variation among individual primary care providers in prescribing of potentially problematic, low-value medicines which cause avoidable patient harm. Audit and feedback is generally effective at improving prescribing. However, progress has been hindered by research waste, leading to unanswered questions about how to include audit and feedback for specific problems and circumstances. Trials of different ways of providing audit and feedback in implementation laboratories have been proposed as a way of improving population healthcare while generating robust evidence on feedback effects. However, there is limited experience in their design and delivery.AimTo explore priorities, feasibility, and ethical challenges of establishing a primary care prescribing audit and feedback implementation laboratory.Design and settingTwo-stage Delphi consensus process involving primary care pharmacy leads, audit and feedback researchers, and patient and public.MethodParticipants initially scored statements relating to priorities, feasibility, and ethical considerations for an implementation laboratory. These covered current feedback practice, priority topics for feedback, usefulness of feedback in improving prescribing and different types of prescribing data, acceptability and desirability of different organization levels of randomization, options for trial consent, different methods of delivering feedback, and interest in finding out how effective different ways of presenting feedback would be. After receiving collated results, participants then scored the items again. The consensus was defined using the GRADE criteria. The results were analyzed by group and overall score.ResultsFourteen participants reached consensus for 38 out of 55 statements. Addressing antibiotic and opioid prescribing emerged as the highest priorities for action. The panel supported statements around addressing high-priority prescribing issues, taking an "opt-out" approach to practice consent if waiving consent was not permitted, and randomizing at lower rather than higher organizational levels. Participants supported patient-level prescribing data and further research evaluating most of the different feedback methods we presented them with.ConclusionsThere is a good level of support for evaluating a wide range of potential enhancements to improve the effects of feedback on prescribing. The successful design and delivery of a primary care audit and feedback implementation laboratory depend on identifying shared priorities and addressing practical and ethical considerations.