Dataset Information

Implementation and Evaluation of Audit and Feedback for Monitoring Treat-to-Target (T2T) Strategies in Rheumatoid Arthritis Using Performance Measures.

ABSTRACT:

Introduction

In collaboration with the Alberta Medical Association's Physician Learning Program we developed individualized physician reports and held a group feedback session on rheumatoid arthritis (RA) performance measures (PM) to facilitate treat-to-target (T2T) strategies and evaluated physician experiences with this process.

Methods

5 PMs addressing T2T concepts from an established Canadian quality framework were operationalized for physician practice reports at 2 university-affiliated rheumatology clinics. Rheum4U, a quality improvement and research platform, was the data source. The audit results were reviewed in a facilitated group feedback session. Rheumatologists provided experiential feedback on the process through survey and/or an interview. Transcripts from interviews were analyzed using a 6-step thematic analysis.

Results

11 of 12 eligible rheumatologists consented to receive practice reports and provided feedback through surveys (n = 5) and interviews (n = 6). The practice reports from Rheum4U (n = 448 patients) revealed high rates of yearly follow-up (> 85%, PM1) and 100% performance on documentation of disease activity at ≥ 50% of visits (PM2). Only 34% of patients were seen within 3 months if not in remission (PM3) with 62% (2017) and 69% (2018) of those with active RA achieving a LDA state within 6 months (PM4). Approximately 70% of patients were in remission at any time point (PM5). All survey respondents agreed or strongly agreed comparison to peers was valuable and helped them reflect on their practice. Several strategies for improvement were identified, including but not limited to, leveraging of electronic records for future audit and feedback reports, providing additional granularity of results, additional stratification of results, and using high-performing peers as the comparator rather than the group mean.

Conclusions

Audit and feedback was perceived by clinicians as a useful strategy for evaluating T2T efforts in RA. Future work will focus on longitudinal evaluation of the clinical impact of this quality improvement initiative.

SUBMITTER: Barber CEH

PROVIDER: S-EPMC7695654 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundAudit and feedback (A&F) is a widely used implementation strategy. Understanding mechanisms of action of A&F increases the likelihood that the strategy will lead to implementation of an evidence-based practice. We therefore sought to understand one hospital's experience selecting and implementing an A&F intervention, to determine the implementation strategies that were used by staff and to specify the mechanism of action of those implementation strategies using causal pathway models, with the ultimate goal of improving acute stroke treatment practices.MethodsWe selected an A&F strategy in a hospital, initially based on implementation determinants and staff consideration of their performance on acute stroke treatment measures. After 7 months of A&F, we conducted semi-structured interviews of hospital providers and administrative staff to understand how it contributed to implementing guideline-concordant acute stroke treatment (medication named tissue plasminogen activator). We coded the interviews to identify the implementation strategies that staff used following A&F and to assess their mechanisms of action.ResultsWe identified five implementation strategies that staff used following the feedback intervention. These included (1) creating folders containing the acute stroke treatment protocol for the emergency department, (2) educating providers about the protocol for acute stroke, (3) obtaining computed tomography imaging of stroke patients immediately upon emergency department arrival, (4) increasing access to acute stroke medical treatment in the emergency department, and (5) providing additional staff support for implementation of the protocol in the emergency department. We identified enablement, training, and environmental restructuring as mechanisms of action through which the implementation strategies acted to improve guideline-concordant and timely acute stroke treatment.ConclusionsA&F of a hospital's acute stroke treatment practices generated additional implementation strategies that acted through various mechanisms of action. Future studies should focus on how initial implementation strategies can be amplified through internal mechanisms.

Project description:BackgroundAdjusting medication of patients with rheumatoid arthritis (RA) until predefined disease activity targets are met, i.e. Treat-to-Target (T2T), is the currently recommended treatment approach. However, not much is known about long-term cost-effectiveness of different T2T strategies.We model the 5-year costs and effects of a step-up approach (MTX mono - > MTX + csDMARD combination - > Adalimumab - > second anti-TNF) and an initial combination therapy approach (MTX + csDMARD - > MTX + csDMARD higher dose - > anti-TNFs) from the healthcare and societal perspectives, by adapting a previously validated Markov model.MethodsWe constructed a Markov model in which 3-monthly transitions between DAS28-defined health states of remission (≤2.6), low (2.6 < DAS28 ≤ 3.2), moderate (3.2 < DAS28 ≤ 5.1), and high disease activity (DAS28 > 5.1) were simulated. Modelled patients proceeded to subsequent treatments in case of non-remission at each (3-month) cycle start. In case of remission for two consecutive cycles medication was tapered, until medication-free remission was achieved. Transition probabilities for individual treatment steps were estimated using data of Dutch Rheumatology Monitoring registry Remission Induction Cohort I (step-up) and II (initial combination). Expected costs, utility, and ICER after 5 years were compared between the two strategies. To account for parameter uncertainty, probabilistic sensitivity analysis was employed through Gamma, Normal, and Dirichlet distributions. All utilities, costs, and transition probabilities were replaced by fitted distributions.ResultsOver a 5-year timespan, initial combination therapy was less costly and more effective than step-up therapy. Initial combination therapy accrued €16,226.3 and 3.552 QALY vs €20,183.3 and 3.517 QALYs for step-up therapy. This resulted in a negative ICER, indicating that initial combination therapy was both less costly and more effective in terms of utility gained. This can be explained by higher (±5%) remission percentages in initial combination strategy at all time points. More patients in remission generates less healthcare and productivity loss costs and higher utility. Additionally, higher remission percentages caused less bDMARD use in the initial combination strategy, lowering overall costs.ConclusionInitial combination therapy was found favourable over step-up therapy in the treatment of Rheumatoid Arthritis, when considering cost-effectiveness. Initial combination therapy resulted in more utility at a lower cost over 5 years.

Project description:BackgroundThere is a significant variation among individual primary care providers in prescribing of potentially problematic, low-value medicines which cause avoidable patient harm. Audit and feedback is generally effective at improving prescribing. However, progress has been hindered by research waste, leading to unanswered questions about how to include audit and feedback for specific problems and circumstances. Trials of different ways of providing audit and feedback in implementation laboratories have been proposed as a way of improving population healthcare while generating robust evidence on feedback effects. However, there is limited experience in their design and delivery.AimTo explore priorities, feasibility, and ethical challenges of establishing a primary care prescribing audit and feedback implementation laboratory.Design and settingTwo-stage Delphi consensus process involving primary care pharmacy leads, audit and feedback researchers, and patient and public.MethodParticipants initially scored statements relating to priorities, feasibility, and ethical considerations for an implementation laboratory. These covered current feedback practice, priority topics for feedback, usefulness of feedback in improving prescribing and different types of prescribing data, acceptability and desirability of different organization levels of randomization, options for trial consent, different methods of delivering feedback, and interest in finding out how effective different ways of presenting feedback would be. After receiving collated results, participants then scored the items again. The consensus was defined using the GRADE criteria. The results were analyzed by group and overall score.ResultsFourteen participants reached consensus for 38 out of 55 statements. Addressing antibiotic and opioid prescribing emerged as the highest priorities for action. The panel supported statements around addressing high-priority prescribing issues, taking an "opt-out" approach to practice consent if waiving consent was not permitted, and randomizing at lower rather than higher organizational levels. Participants supported patient-level prescribing data and further research evaluating most of the different feedback methods we presented them with.ConclusionsThere is a good level of support for evaluating a wide range of potential enhancements to improve the effects of feedback on prescribing. The successful design and delivery of a primary care audit and feedback implementation laboratory depend on identifying shared priorities and addressing practical and ethical considerations.