No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention.
Ontology highlight
ABSTRACT:
SUBMITTER: Ivers NM
PROVIDER: S-EPMC3896824 | biostudies-other | 2014 Jan
REPOSITORIES: biostudies-other
Publications
No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention.
Ivers Noah M NM Sales Anne A Colquhoun Heather H Michie Susan S Foy Robbie R Francis Jill J JJ Grimshaw Jeremy M JM
Implementation science : IS 20140117
<h4>Background</h4>Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key 'active ingredients.'<h4>Discussion</h4>Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the 'business as usual' approach to evalu ...[more]
Similar Datasets
Project description:BackgroundAudit and feedback (A&F) interventions are one of the most common approaches for implementing evidence-based practices. A key barrier to more effective A&F interventions is the lack of a theory-guided approach to the accumulation of evidence. Recent interviews with theory experts identified 313 theory-informed hypotheses, spread across 30 themes, about how to create more effective A&F interventions. In the current survey, we sought to elicit from stakeholders which hypotheses were most likely to advance the field if studied further.MethodsFrom the list of 313, three members of the research team identified 216 that were clear and distinguishable enough for prioritization. A web-based survey was then sent to 211 A&F intervention stakeholders asking them to choose up to 50 'priority' hypotheses following the header "A&F interventions will be more effective if…". Analyses included frequencies of endorsement of the individual hypotheses and themes into which they were grouped.Results68 of the 211 invited participants responded to the survey. Seven hypotheses were chosen by >?50% of respondents, including A&F interventions will be more effective… "if feedback is provided by a trusted source"; "if recipients are involved in the design/development of the feedback intervention"; "if recommendations related to the feedback are based on good quality evidence"; "if the behaviour is under the control of the recipient"; "if it addresses barriers and facilitators (drivers) to behaviour change"; "if it suggests clear action plans"; and "if target/goal/optimal rates are clear and explicit". The most endorsed theme was Recipient Priorities (four hypotheses were chosen 92 times as a 'priority' hypotheses).ConclusionsThis work determined a set of hypotheses thought by respondents to be to be most likely to advance the field through future A&F intervention research. This work can inform a coordinated research agenda that may more efficiently lead to more effective A&F interventions.
| S-EPMC7805176 | biostudies-literature
Project description:Audit and feedback (A&F) is a common strategy for helping health providers to implement evidence into practice. Despite being extensively studied, health care A&F interventions remain variably effective, with overall effect sizes that have not improved since 2003. Contributing to this stagnation is the fact that most health care A&F interventions have largely been designed without being informed by theoretical understanding from the behavioral and social sciences. To determine if the trend can be improved, the objective of this study was to develop a list of testable, theory-informed hypotheses about how to design more effective A&F interventions.Using purposive sampling, semi-structured 60-90-min telephone interviews were conducted with experts in theories related to A&F from a range of fields (e.g., cognitive, health and organizational psychology, medical decision-making, economics). Guided by detailed descriptions of A&F interventions from the health care literature, interviewees described how they would approach the problem of designing improved A&F interventions. Specific, theory-informed hypotheses about the conditions for effective design and delivery of A&F interventions were elicited from the interviews. The resulting hypotheses were assigned by three coders working independently into themes, and categories of themes, in an iterative process.We conducted 28 interviews and identified 313 theory-informed hypotheses, which were placed into 30 themes. The 30 themes included hypotheses related to the following five categories: A&F recipient (seven themes), content of the A&F (ten themes), process of delivery of the A&F (six themes), behavior that was the focus of the A&F (three themes), and other (four themes).We have identified a set of testable, theory-informed hypotheses from a broad range of behavioral and social science that suggest conditions for more effective A&F interventions. This work demonstrates the breadth of perspectives about A&F from non-healthcare-specific disciplines in a way that yields testable hypotheses for healthcare A&F interventions. These results will serve as the foundation for further work seeking to set research priorities among the A&F research community.
| S-EPMC5622490 | biostudies-other
Project description:Background. Audit and feedback (A/F) reports are one of the few knowledge translation activities that can effect change in physician behavior. In this study, we pilot-tested an endoscopist A/F report to elicit opinions about the proposed report's usability, acceptability and usefulness, and implications for knowledge translation. Methods. Semi-structured qualitative interviews were conducted with eleven endoscopists in Ontario, Canada. We tested an A/F report template comprising 9 validated, accepted colonoscopy quality indicators populated with simulated data. Interview transcripts were coded using techniques such as constant comparison and themes were identified inductively over several team meetings. Results. Four interrelated themes were identified: (1) overall perceptions of the A/F report; (2) accountability and consequences for poor performance; (3) motivation to change/improve skills; and (4) training for performance enhancement and available resources. The A/F report was well received; however, participants cited some possible threats to the report's effectiveness including the perceived threat of loss of privileges or licensing and the potential for the data to be dismissed. Conclusions. Participants agreed that A/F has the potential to improve colonoscopy performance. However, in order to be effective in changing physician behavior, A/F must be thoughtfully implemented with attention to the potential concerns of its recipients.
| S-EPMC5045985 | biostudies-literature
Project description:The current state of much of the Wuhan pneumonia virus (severe acute respiratory syndrome coronavirus 2 [SARS-CoV-2]) research shows a regrettable lack of data sharing and considerable analytical obfuscation. This impedes global research cooperation, which is essential for tackling public health emergencies and requires unimpeded access to data, analysis tools, and computational infrastructure. Here, we show that community efforts in developing open analytical software tools over the past 10 years, combined with national investments into scientific computational infrastructure, can overcome these deficiencies and provide an accessible platform for tackling global health emergencies in an open and transparent manner. Specifically, we use all SARS-CoV-2 genomic data available in the public domain so far to (1) underscore the importance of access to raw data and (2) demonstrate that existing community efforts in curation and deployment of biomedical software can reliably support rapid, reproducible research during global health crises. All our analyses are fully documented at https://github.com/galaxyproject/SARS-CoV-2.
| S-EPMC7425854 | biostudies-literature
Project description:BackgroundThe use of clinical performance feedback to support quality improvement (QI) activities is based on the sound rationale that measurement is necessary to improve quality of care. However, concerns persist about the reliability of this strategy, known as Audit and Feedback (A&F) to support QI. If successfully implemented, A&F should reflect an iterative, self-regulating QI process. Whether and how real-world A&F initiatives result in this type of feedback loop are scarcely reported. This study aimed to identify barriers or facilitators to implementation in a team-based primary care context.MethodsSemi-structured interviews were conducted with key informants from team-based primary care practices in Ontario, Canada. At the time of data collection, practices could have received up to three iterations of the voluntary A&F initiative. Interviews explored whether, how, and why practices used the feedback to guide their QI activities. The Consolidated Framework for Implementation Research was used to code transcripts and the resulting frameworks were analyzed inductively to generate key themes.ResultsTwenty-five individuals representing 18 primary care teams participated in the study. Analysis of how the A&F intervention was used revealed that implementation reflected an incomplete feedback loop. Participation was facilitated by the reliance on an external resource to facilitate the practice audit. The frequency of feedback, concerns with data validity, the design of the feedback report, the resource requirements to participate, and the team relationship were all identified as barriers to implementation of A&F.ConclusionsThe implementation of a real-world, voluntary A&F initiative did not lead to desired QI activities despite substantial investments in performance measurement. In small primary care teams, it may take long periods of time to develop capacity for QI and future evaluations may reveal shifts in the implementation state of the initiative. Findings from the present study demonstrate that the potential mechanism of action of A&F may be deceptively clear; in practice, moving from measurement to action can be complex.
| S-EPMC6591867 | biostudies-literature
Project description:BackgroundAudit and feedback is a common intervention for supporting clinical behaviour change. Increasingly, health data are available in electronic format. Yet, little is known regarding if and how electronic audit and feedback (e-A&F) improves quality of care in practice.ObjectiveThe study aimed to assess the effectiveness of e-A&F interventions in a primary care and hospital context and to identify theoretical mechanisms of behaviour change underlying these interventions.MethodsIn August 2016, we searched five electronic databases, including MEDLINE and EMBASE via Ovid, and the Cochrane Central Register of Controlled Trials for published randomised controlled trials. We included studies that evaluated e-A&F interventions, defined as a summary of clinical performance delivered through an interactive computer interface to healthcare providers. Data on feedback characteristics, underlying theoretical domains, effect size and risk of bias were extracted by two independent review authors, who determined the domains within the Theoretical Domains Framework (TDF). We performed a meta-analysis of e-A&F effectiveness, and a narrative analysis of the nature and patterns of TDF domains and potential links with the intervention effect.ResultsWe included seven studies comprising of 81,700 patients being cared for by 329 healthcare professionals/primary care facilities. Given the extremely high heterogeneity of the e-A&F interventions and five studies having a medium or high risk of bias, the average effect was deemed unreliable. Only two studies explicitly used theory to guide intervention design. The most frequent theoretical domains targeted by the e-A&F interventions included 'knowledge', 'social influences', 'goals' and 'behaviour regulation', with each intervention targeting a combination of at least three. None of the interventions addressed the domains 'social/professional role and identity' or 'emotion'. Analyses identified the number of different domains coded in control arm to have the biggest role in heterogeneity in e-A&F effect size.ConclusionsGiven the high heterogeneity of identified studies, the effects of e-A&F were found to be highly variable. Additionally, e-A&F interventions tend to implicitly target only a fraction of known theoretical domains, even after omitting domains presumed not to be linked to e-A&F. Also, little evaluation of comparative effectiveness across trial arms was conducted. Future research should seek to further unpack the theoretical domains essential for effective e-A&F in order to better support strategic individual and team goals.
| S-EPMC5427645 | biostudies-literature
Project description:Increasing atmospheric partial pressure of CO2 (pCO2) is a major threat to coral reefs, but some argue that the threat is mitigated by factors such as the variability in the response of coral calcification to acidification, differences in bleaching susceptibility, and the potential for rapid adaptation to anthropogenic warming. However the evidence for these mitigating factors tends to involve experimental studies on corals, as opposed to coral reefs, and rarely includes the influence of multiple variables (e.g., temperature and acidification) within regimes that include diurnal and seasonal variability. Here, we demonstrate that the inclusion of all these factors results in the decalcification of patch-reefs under business-as-usual scenarios and reduced, although positive, calcification under reduced-emission scenarios. Primary productivity was found to remain constant across all scenarios, despite significant bleaching and coral mortality under both future scenarios. Daylight calcification decreased and nocturnal decalcification increased sharply from the preindustrial and control conditions to the future scenarios of low (reduced emissions) and high (business-as-usual) increases in pCO2. These changes coincided with deeply negative carbonate budgets, a shift toward smaller carbonate sediments, and an increase in the abundance of sediment microbes under the business-as-usual emission scenario. Experimental coral reefs demonstrated highest net calcification rates and lowest rates of coral mortality under preindustrial conditions, suggesting that reef processes may not have been able to keep pace with the relatively minor environmental changes that have occurred during the last century. Taken together, our results have serious implications for the future of coral reefs under business-as-usual environmental changes projected for the coming decades and century.
| S-EPMC3780867 | biostudies-other
Project description:BackgroundThere is considerable evidence about the effectiveness of audit coupled with feedback, although few audit with feedback interventions have been conducted in long-term care (LTC) settings to date. In general, the effects have been found to be modest at best, although in settings where there has been little history of audit and feedback, the effects may be greater, at least initially. The primary purpose of the Data for Improvement and Clinical Excellence (DICE) Long-Term Care project is to assess the effects of an audit with feedback intervention delivered monthly over 13 months in four LTC facilities. The research questions we addressed are:1. What effects do feedback reports have on processes and outcomes over time?2. How do different provider groups in LTC and home care respond to feedback reports based on data targeted at improving quality of care?Methods/designThe research team conducting this study comprises researchers and decision makers in continuing care in the province of Alberta, Canada. The intervention consists of monthly feedback reports in nine LTC units in four facilities in Edmonton, Alberta. Data for the feedback reports comes from the Resident Assessment Instrument Minimum Data Set (RAI) version 2.0, a standardized instrument mandated for use in LTC facilities throughout Alberta. Feedback reports consist of one page, front and back, presenting both graphic and textual information. Reports are delivered to all staff working in the four LTC facilities. The primary evaluation uses a controlled interrupted time series design both adjusted and unadjusted for covariates. The concurrent process evaluation uses observation and self-report to assess uptake of the feedback reports. Following the project phase described in this protocol, a similar intervention will be conducted in home care settings in Alberta. Depending on project findings, if they are judged useful by decision makers participating in this research team, we plan dissemination and spread of the feedback report approach throughout Alberta.
| S-EPMC2964554 | biostudies-literature
Project description:Audit and feedback to physicians is a commonly used quality improvement strategy, but its optimal design is unknown. This trial tested the effects of a theory-informed worksheet to facilitate goal setting and action planning, appended to feedback reports on chronic disease management, compared to feedback reports provided without these worksheets.A two-arm pragmatic cluster randomized trial was conducted, with allocation at the level of primary care clinics. Participants were family physicians who contributed data from their electronic medical records. The 'usual feedback' arm received feedback every six months for two years regarding the proportion of their patients meeting quality targets for diabetes and/or ischemic heart disease. The intervention arm received these same reports plus a worksheet designed to facilitate goal setting and action plan development in response to the feedback reports. Blood pressure (BP) and low-density lipoprotein cholesterol (LDL) values were compared after two years as the primary outcomes. Process outcomes measured the proportion of guideline-recommended actions (e.g., testing and prescribing) conducted within the appropriate timeframe. Intention-to-treat analysis was performed.Outcomes were similar across groups at baseline. Final analysis included 20 physicians from seven clinics and 1,832 patients in the intervention arm (15% loss to follow up) and 29 physicians from seven clinics and 2,223 patients in the usual feedback arm (10% loss to follow up). Ten of 20 physicians completed the worksheet at least once during the study. Mean BP was 128/72 in the feedback plus worksheet arm and 128/73 in the feedback alone arm, while LDL was 2.1 and 2.0, respectively. Thus, no significant differences were observed across groups in the primary outcomes, but mean haemoglobin A1c was lower in the feedback plus worksheet arm (7.2% versus 7.4%, p<0.001). Improvements in both arms were noted over time for one-half of the process outcomes.Appending a theory-informed goal setting and action planning worksheet to an externally produced audit and feedback intervention did not lead to improvements in patient outcomes. The results may be explained in part by passive dissemination of the worksheet leading to inadequate engagement with the intervention.ClinicalTrials.gov NCT00996645.
| S-EPMC3878579 | biostudies-literature
Project description:Since 1990 and the World Conference on Education for All well over half a trillion dollars has been disbursed as aid to education with much of it targeted on low income countries especially those in Sub-Saharan Africa. Some of the beneficiaries of this aid have transformed their economies and their education systems to the point where they can act as fiscal states and finance their recurrent and capital spending on education from domestic revenue. But too many states have failed to make this transition and remain overly dependent on sequential waves of external assistance to reduce gaps between the finance available and what is needed. Grant aid is now unlikely to grow as COVID-19 related recession supresses donor spending. Concessional lending to countries with sub-prime credit ratings and high debt service ratios looks imprudent. The architecture and goals of external assistance need to change to focus on making better use of the resources that are available though much increased efficiency and effectiveness, and on ensuring domestic revenue is increased since this is the only pathway to sustainable development that avoids the infinite do-loop of using aid to fill gaps rather than to address their causes.
| S-EPMC7395592 | biostudies-literature