Dataset Information

Effect of audit and feedback with peer review on general practitioners' prescribing and test ordering performance: a cluster-randomized controlled trial.

ABSTRACT:

Background

Much research worldwide is focussed on cost containment and better adherence to guidelines in healthcare. The research focussing on professional behaviour is often performed in a well-controlled research setting. In this study a large-scale implementation of a peer review strategy was tested on both test ordering and prescribing behaviour in primary care in the normal quality improvement setting.

Methods

We planned a cluster-RCT in existing local quality improvement collaboratives (LQICs) in primary care. The study ran from January 2008 to January 2011. LQICs were randomly assigned to one of two trial arms, with each arm receiving the same intervention of audit and feedback combined with peer review. Both arms were offered five different clinical topics and acted as blind controls for the other arm. The differences in test ordering rates and prescribing rates between both arms were analysed in an intention-to-treat pre-post analysis and a per-protocol analysis.

Results

Twenty-one LQIC groups, including 197 GPs working in 88 practices, entered the trial. The intention-to-treat analysis did not show a difference in the changes in test ordering or prescribing performance between intervention and control groups. The per-protocol analysis showed positive results for half of the clinical topics. The increase in total tests ordered was 3% in the intervention arm and 15% in the control arm. For prescribing the increase in prescriptions was 20% in the intervention arm and 66% in the control group. It was observed that the groups with the highest baseline test ordering and prescription volumes showed the largest improvements.

Conclusions

Our study shows that the results from earlier work could not be confirmed by our attempt to implement the strategy in the field. We did not see a decrease in the volumes of tests ordered or of the drugs prescribed but were able to show a lesser increase instead. Implementing the peer review with audit and feedback proved to be not feasible in primary care in the Netherlands.

Trial registration

This trial was registered at the Dutch trial register under number ISRCTN40008171 on August 7^th 2007.

SUBMITTER: Trietsch J

PROVIDER: S-EPMC5390393 | biostudies-literature | 2017 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effect of audit and feedback with peer review on general practitioners' prescribing and test ordering performance: a cluster-randomized controlled trial.

Trietsch J J van Steenkiste B B Grol R R Winkens B B Ulenkate H H Metsemakers J J van der Weijden T T

BMC family practice 20170413 1

<h4>Background</h4>Much research worldwide is focussed on cost containment and better adherence to guidelines in healthcare. The research focussing on professional behaviour is often performed in a well-controlled research setting. In this study a large-scale implementation of a peer review strategy was tested on both test ordering and prescribing behaviour in primary care in the normal quality improvement setting.<h4>Methods</h4>We planned a cluster-RCT in existing local quality improvement col ...[more]

PMID: 28407754

Similar Datasets

Project description:BACKGROUND:Dentists prescribe approximately 10% of antibiotics dispensed in UK community pharmacies. Despite clear clinical guidance, dentists often prescribe antibiotics inappropriately. This cluster-randomised controlled trial used routinely collected National Health Service (NHS) dental prescribing and treatment claim data to compare the impact of individualised audit and feedback (A&F) interventions on dentists' antibiotic prescribing rates. METHODS AND FINDINGS:All 795 antibiotic prescribing NHS general dental practices in Scotland were included. Practices were randomised to the control (practices = 163; dentists = 567) or A&F intervention group (practices = 632; dentists = 1,999). A&F intervention practices were allocated to one of two A&F groups: (1) individualised graphical A&F comprising a line graph plotting an individual dentist's monthly antibiotic prescribing rate (practices = 316; dentists = 1,001); or (2) individualised graphical A&F plus a written behaviour change message synthesising and reiterating national guidance recommendations for dental antibiotic prescribing (practices = 316; dentists = 998). Intervention practices were also simultaneously randomised to receive A&F: (i) with or without a health board comparator comprising the addition of a line to the graphical A&F plotting the monthly antibiotic prescribing rate of all dentists in the health board; and (ii) delivered at 0 and 6 mo or at 0, 6, and 9 mo, giving a total of eight intervention groups. The primary outcome, measured by the trial statistician who was blinded to allocation, was the total number of antibiotic items dispensed per 100 NHS treatment claims over the 12 mo post-delivery of the baseline A&F. Primary outcome data was available for 152 control practices (dentists = 438) and 609 intervention practices (dentists = 1,550). At baseline, the number of antibiotic items prescribed per 100 NHS treatment claims was 8.3 in the control group and 8.5 in the intervention group. At follow-up, antibiotic prescribing had decreased by 0.4 antibiotic items per 100 NHS treatment claims in control practices and by 1.0 in intervention practices. This represents a significant reduction (-5.7%; 95% CI -10.2% to -1.1%; p = 0.01) in dentists' prescribing rate in the intervention group relative to the control group. Intervention subgroup analyses found a 6.1% reduction in the antibiotic prescribing rate of dentists who had received the written behaviour change message relative to dentists who had not (95% CI -10.4% to -1.9%; p = 0.01). There was no significant between-group difference in the prescribing rate of dentists who received a health board comparator relative to those who did not (-4.3%; 95% CI -8.6% to 0.1%; p = 0.06), nor between dentists who received A&F at 0 and 6 mo relative to those who received A&F at 0, 6, and 9 mo (0.02%; 95% CI -4.2% to 4.2%; p = 0.99). The key limitations relate to the use of routinely collected datasets which did not allow evaluation of any effects on inappropriate prescribing. CONCLUSIONS:A&F derived from routinely collected datasets led to a significant reduction in the antibiotic prescribing rate of dentists. TRIAL REGISTRATION:Current Controlled Trials ISRCTN49204710.

Project description:BackgroundRedundant use of diagnostic tests in primary care has shown to be a contributor to rising Dutch healthcare costs. A price display in the test ordering system of the electronic health records (EHRs) could potentially be a low-cost and easy to implement intervention to a decrease in test ordering rate in the primary care setting by creating more cost-awareness among general practitioners (GPs). The aim of this study was to assess the effect of a price display for diagnostic laboratory tests in the EHR on laboratory test ordering behavior of GPs in the Westelijke Mijnstreek region in the Netherlands.MethodsA pre-post intervention study among 154 GPs working in 57 general practices was conducted from September 2019, until March 2020, in the Netherlands. The intervention consisted of displaying the costs of 22 laboratory tests at the time of ordering. The primary outcome was the mean test ordering rate per 1.000 patients per month, per general practice.ResultsTest ordering rates were on average rising prior to the intervention. The total mean monthly test order volume showed a non-statistically significant interruption in this rising trend after the intervention, with the mean monthly test ordering rate levelling out from 322.4 to 322.2 (P = 0.86). A subgroup analysis for solely individually priced tests showed a statistically significant decrease in mean monthly test ordering rate after implementation of the price display for the sum of all tests from 67.2 to 63.3 (P = 0.01), as well as for some of these tests individually (i.e. thrombocytes, ALAT, TSH, folic acid). Leucocytes, ESR, vitamin B12, anti-CCP and NT-proBNP also showed a decrease, albeit not statistically significant (P > 0.05).ConclusionsOur study suggests that a price display intervention is a simple tool that can alter physicians order behavior and constrain the expanding use of laboratory tests. Future research might consider alternative study designs and a longer follow-up period. Furthermore, in future studies, the combination with a multitude of interventions, like educational programs and feedback strategies, should be studied, while potentially adverse events caused by reduced testing should also be taken into consideration.

Project description:BackgroundLaboratory tests and transfusions are sometimes ordered inappropriately, particularly in the critical care setting, which sees frequent use of both. Audit and Feedback (A&F) is a potentially useful intervention for modifying healthcare provider behaviors, but its application to the complex, team-based environment of critical care is not well understood. We conducted a systematic review of the literature on A&F interventions for improving test or transfusion ordering in the critical care setting.MethodsFive databases, two registries, and the bibliographies of relevant articles were searched. We included critical care studies that assessed the use of A&F targeting healthcare provider behaviors, alone or in combination with other interventions to improve test and transfusion ordering, as compared to historical practice, no intervention, or another healthcare behaviour change intervention. Studies were included only if they reported laboratory test or transfusion orders, or the appropriateness of orders, as outcomes. There were no restrictions based on study design, date of publication, or follow-up time. Intervention characteristics and absolute differences in outcomes were summarized. The quality of individual studies was assessed using a modified version of the Effective Practice and Organisation of Care Cochrane Review Group's criteria.ResultsWe identified 16 studies, including 13 uncontrolled before-after studies, one randomized controlled trial, one controlled before-after study, and one controlled clinical trial (quasi-experimental). These studies described 17 interventions, mostly (88%) multifaceted interventions with an A&F component. Feedback was most often provided in a written format only (41%), more than once (53%), and most often only provided data aggregated to the group-level (41%). Most studies saw a change in the hypothesized direction, but not all studies provided statistical analyses to formally test improvement. Overall study quality was low, with studies often lacking a concurrent control group.ConclusionsOur review summarizes characteristics of A&F interventions implemented in the critical care context, points to some mechanisms by which A&F might be made more effective in this setting, and provides an overview of how the appropriateness of orders was reported. Our findings suggest that A&F can be effective in the context of critical care; however, further research is required to characterize approaches that optimize the effectiveness in this setting alongside more rigorous evaluation methods.Trial registrationPROSPERO CRD42016051941.

Project description:BACKGROUND:Antibiotic prescribing in dentistry accounts for 9% of total antibiotic prescriptions in Scottish primary care. The Scottish Dental Clinical Effectiveness Programme (SDCEP) published guidance in April 2008 (2nd edition, August 2011) for Drug Prescribing in Dentistry, which aims to assist dentists to make evidence-based antibiotic prescribing decisions. However, wide variation in prescribing persists and the overall use of antibiotics is increasing. METHODS:RAPiD is a 12-month partial factorial cluster randomised trial conducted in NHS General Dental Practices across Scotland. Its aim is to compare the effectiveness of individualised audit and feedback (A&F) strategies for the translation into practice of SDCEP recommendations on antibiotic prescribing. The trial uses routinely collected electronic healthcare data in five aspects of its design in order to: identify the study population; apply eligibility criteria; carry out stratified randomisation; generate the trial intervention; analyse trial outcomes. Eligibility was determined on contract status and a minimum level of recent NHS treatment provision. All eligible dental practices in Scotland were simultaneously randomised at baseline either to current audit practice or to an intervention group. Randomisation was stratified by single-handed/multi-handed practices. General dental practitioners (GDPs) working at intervention practices will receive individualised graphical representations of their antibiotic prescribing rate from the previous 14 months at baseline and an update at six months. GDPs could not be blinded to their practice allocation. Intervention practices were further randomised using a factorial design to receive feedback with or without: a health board comparator; a supplementary text-based intervention; additional feedback at nine months. The primary outcome is the total antibiotic prescribing rate per 100 courses of treatment over the year following delivery of the baseline intervention. A concurrent qualitative process evaluation will apply theory-based approaches using the Consolidated Framework for Implementation Research to explore the acceptability of the interventions and the Theoretical Domains Framework to identify barriers and enablers to evidence-based antibiotic prescribing behaviour by GDPs. DISCUSSION:RAPiD will provide a robust evaluation of A&F in dentistry in Scotland. It also demonstrates that linked administrative datasets have the potential to be used efficiently and effectively across all stages of an randomised controlled trial. TRIAL REGISTRATION:Current Controlled Trials ISRCTN49204710.

Project description:BackgroundPotentially inappropriate prescribing (PIP) has been linked with adverse health outcomes and increased healthcare costs. Feedback interventions targeting PIP have shown promising results. However, translation from research to everyday practice remains a challenge. With the Normalisation Process Theory (NPT) as overarching framework, we aimed to explore the implementation processes performed by general practices in a real-life, quality improvement intervention using feedback on practice-level prescribing.MethodsAll 376 general practices in the Central Denmark Region received a prescribing feedback intervention targeting selected types of PIP. Six months later, they received an evaluation questionnaire, to which 45% responded. Among 102 practices reporting to have made changes in response to the intervention, we conducted individual, semi-structured interviews with ten GPs. Maximum variation was sought in terms of baseline prescribing status, implementation activities, practice type and geographical location. The interviews were analysed thematically using NPT.ResultsThe implementation processes in general practice reflected the four NPT constructs. Key motivators for implementation included the GPs' professional values and interests, but pragmatic considerations were also of importance (coherence). A collective versus an individual approach to the engagement and planning of the implementation process (cognitive participation) was observed. Similarly, a distinction was evident between practice-level actions involving the entire practice team as opposed to individual-level actions performed by the individual GP (collective action). Several challenges to the implementation processes were identified, including patient influences and competing priorities at multiple levels (reflexive monitoring). Additionally, internal evaluation and normalisation of new practices occurred in varying degrees.ConclusionNPT provided a useful framework for understanding implementation processes in general practice. Our results emphasise that clear professional aims and feasible content of interventions are key for GP motivation. This may be ensured through cooperation with GPs' professional organisation, which may strengthen intervention legitimacy and uptake. Two main implementation strategies were identified: practice-level and GP-level strategies. Intervention developers need to recognise both strategies to deliver intervention content and implementation support that promote sustainable improvements in prescribing practice. Competing demands and patient influences remain important challenges that need to be addressed in future studies to further facilitate the reduction of PIPs.

Project description:ImportanceStatins are not prescribed to approximately 50% of patients who could benefit from them.ObjectiveTo evaluate the effectiveness of an automated patient dashboard using active choice framing with and without peer comparison feedback on performance to nudge primary care physicians (PCPs) to increase guideline-concordant statin prescribing.Design, setting, and participantsThis 3-arm cluster randomized clinical trial was conducted from February 21, 2017, to April 21, 2017, at 32 practice sites in Pennsylvania and New Jersey. Participants included 96 PCPs and 4774 patients not previously receiving statin therapy. Data were analyzed from April 25, 2017, to June 16, 2017.InterventionsPrimary care physicians in the 2 intervention arms were emailed a link to an automated online dashboard listing their patients who met national guidelines for statin therapy but had not been prescribed this medication. The dashboard included relevant patient information, and for each patient, PCPs were asked to make an active choice to prescribe atorvastatin, 20 mg, once daily, atorvastatin at another dose, or another statin or not prescribe a statin and select a reason. The dashboard was available for 2 months. In 1 intervention arm, the email to PCPs also included feedback on their statin prescribing rate compared with their peers. Primary care physicians in the usual care group received no interventions.Main outcomes and measuresStatin prescription rates.ResultsPatients had a mean (SD) age of 62.4 (8.3) years and a mean (SD) 10-year atherosclerotic cardiovascular disease risk score of 13.6 (8.2); 2625 (55.0%) were male, 3040 (63.7%) were white, and 1318 (27.6%) were black. In the active choice arm, 16 of 32 PCPs (50.0%) accessed the patient dashboard, but only 2 of 32 (6.3%) signed statin prescription orders. In the active choice with peer comparison arm, 12 of 32 PCPs (37.5%) accessed the patient dashboard and 8 of 32 (25.0%) signed statin prescription orders. Statins were prescribed in 40 of 1566 patients (2.6%) in the usual care arm, 116 of 1743 (6.7%) in the active choice arm, and 117 of 1465 (8.0%) in the active choice with peer comparison arm. In the main adjusted model, compared with usual care, there was a significant increase in statin prescribing in the active choice with peer comparison arm (adjusted difference in percentage points, 5.8; 95% CI, 0.9-13.5; P = .008), but not in the active choice arm (adjusted difference in percentage points, 4.1; 95% CI, -0.8 to 13.1; P = .11).Conclusions and relevanceAn automated patient dashboard using both active choice framing and peer comparison feedback led to a modest but significant increase in guideline-concordant statin prescribing rates.Trial registrationClinicalTrials.gov Identifier: NCT03021759.

Dataset Information

Effect of audit and feedback with peer review on general practitioners' prescribing and test ordering performance: a cluster-randomized controlled trial.

Background

Methods

Results

Conclusions

Trial registration

Publications

Effect of audit and feedback with peer review on general practitioners' prescribing and test ordering performance: a cluster-randomized controlled trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets