Dataset Information

Health professionals' perceptions about their clinical performance and the influence of audit and feedback on their intentions to improve practice: a theory-based study in Dutch intensive care units.

ABSTRACT: BACKGROUND:Audit and feedback aims to guide health professionals in improving aspects of their practice that need it most. Evidence suggests that feedback fails to increase accuracy of professional perceptions about clinical performance, which likely reduces audit and feedback effectiveness. This study investigates health professionals' perceptions about their clinical performance and the influence of feedback on their intentions to change practice. METHODS:We conducted an online laboratory experiment guided by Control Theory with 72 intensive care professionals from 21 units. For each of four new pain management indicators, we collected professionals' perceptions about their clinical performance; peer performance; targets; and improvement intentions before and after receiving first-time feedback. An electronic audit and feedback dashboard provided ICU's own performance, median and top 10% peer performance, and improvement recommendations. The experiment took place approximately 1 month before units enrolled into a cluster-randomised trial assessing the impact of adding a toolbox with suggested actions and materials to improve intensive care pain management. During the experiment, the toolbox was inaccessible; all participants accessed the same version of the dashboard. RESULTS:We analysed 288 observations. In 53.8%, intensive care professionals overestimated their clinical performance; but in only 13.5%, they underestimated it. On average, performance was overestimated by 22.9% (on a 0-100% scale). Professionals similarly overestimated peer performance, and set targets 20.3% higher than the top performance benchmarks. In 68.4% of cases, intentions to improve practice were consistent with actual gaps in performance, even before professionals had received feedback; which increased to 79.9% after receiving feedback (odds ratio, 2.41; 95% CI, 1.53 to 3.78). However, in 56.3% of cases, professionals still wanted to improve care aspects at which they were already top performers. Alternatively, in 8.3% of cases, they lacked improvement intentions because they did not consider indicators important; did not trust the data; or deemed benchmarks unrealistic. CONCLUSIONS:Audit and feedback helps health professionals to work on aspects for which improvement is recommended. Given the abundance of professionals' prior good improvement intentions, the limited effects typically found by audit and feedback studies are likely predominantly caused by barriers to translation of intentions into actual change in clinical practice. TRIAL REGISTRATION:ClinicalTrials.gov NCT02922101 . Registered 26 September 2016.

SUBMITTER: Gude WT

PROVIDER: S-EPMC5816547 | biostudies-literature | 2018 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Health professionals' perceptions about their clinical performance and the influence of audit and feedback on their intentions to improve practice: a theory-based study in Dutch intensive care units.

Gude Wouter T WT Roos-Blom Marie-José MJ van der Veer Sabine N SN Dongelmans Dave A DA de Jonge Evert E Francis Jill J JJ Peek Niels N de Keizer Nicolette F NF

Implementation science : IS 20180217 1

<h4>Background</h4>Audit and feedback aims to guide health professionals in improving aspects of their practice that need it most. Evidence suggests that feedback fails to increase accuracy of professional perceptions about clinical performance, which likely reduces audit and feedback effectiveness. This study investigates health professionals' perceptions about their clinical performance and the influence of feedback on their intentions to change practice.<h4>Methods</h4>We conducted an online ...[more]

PMID: 29454393

Similar Datasets

Project description:BACKGROUND:ICU patients frequently undergo chest radiographs (CXRs). The diagnostic and therapeutic efficacy of routine CXRs are now known to be low, but the discussion regarding specific indications for CXRs in critically ill patients and the safety of abandoning routine CXRs is still ongoing. We performed a survey of Dutch intensivists on the current practice of chest radiography in their departments. METHODS:Web-based questionnaires, containing questions regarding ICU characteristics, ICU patients, daily CXR strategies, indications for routine CXRs and the practice of radiologic evaluation, were sent to the medical directors of all adult ICUs in the Netherlands. CXR strategies were compared between all academic and non-academic hospitals and between ICUs of different sizes. A comparison was made between the survey results obtained in 2006 and 2013. RESULTS:Of the 83 ICUs that were contacted, 69 (83%) responded to the survey. Only 7% of responding ICUs were currently performing daily routine CXRs for all patients, and 61% of the responding ICUs were said never to perform CXRs on a routine basis. A daily meeting with a radiologist is an established practice in 72% of the responding ICUs and is judged to be important or even essential by those ICUs. The therapeutic efficacy of routine CXRs was assumed by intensivists to be lower than 10% or to be between 10 and 20%. The efficacy of 'on-demand' CXRs was assumed to be between 10 and 60%. There is a consensus between intensivists to perform a routine CXR after endotracheal intubation, chest tube placement or central venous catheterization. CONCLUSION:The strategy of daily routine CXRs for critically ill and mechanically ventilated patients has turned from being a common practice in 2006 to a rare current practice. Other routine strategies and an 'on-demand only' strategy have become more popular. Intensivists still assume the value of CXRs to be higher than the efficacy that is reported in the literature.

Project description:BackgroundAudit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance our understanding of how A&F works best. This study aimed to systematically specify BCTs in A&F interventions targeting healthcare professional practice change.MethodsWe conducted a directed content analysis of intervention descriptions in 287 randomized trials included in an ongoing Cochrane systematic review update of A&F interventions (searched up to June 2020). Three trained researchers identified and categorized BCTs in all trial arms (treatment & control/comparator) using the 93-item BCT Taxonomy version 1. The original BCT definitions and examples in the taxonomy were adapted to include A&F-specific decision rules and examples. Two additional BCTs ('Education (unspecified)' and 'Feedback (unspecified)') were added, such that 95 BCTs were considered for coding.ResultsIn total, 47/95 BCTs (49%) were identified across 360 treatment arms at least once (median = 5.0, IQR = 2.3, range = 129 per arm). The most common BCTs were 'Feedback on behaviour' (present 89% of the time; e.g. feedback on drug prescribing), 'Instruction on how to perform the behaviour' (71%; e.g. issuing a clinical guideline), 'Social comparison' (52%; e.g. feedback on performance of peers), 'Credible source' (41%; e.g. endorsements from respected professional body), and 'Education (unspecified)' (31%; e.g. giving a lecture to staff). A total of 130/287 (45%) control/comparator arms contained at least one BCT (median = 2.0, IQR = 3.0, range = 0-15 per arm), of which the most common were identical to those identified in treatment arms.ConclusionsA&F interventions to improve healthcare professional practice include a moderate range of BCTs, focusing predominantly on providing behavioural feedback, sharing guidelines, peer comparison data, education, and leveraging credible sources. We encourage the use of our A&F-specific list of BCTs to improve knowledge of what is being delivered in A&F interventions. Our study provides a basis for exploring which BCTs are associated with intervention effectiveness.Trial registrationsN/A.

Project description:BackgroundAudit and feedback (A&F) is a common quality improvement strategy with highly variable effects on patient care. It is unclear how A&F effectiveness can be maximised. Since the core mechanism of action of A&F depends on drawing attention to a discrepancy between actual and desired performance, we aimed to understand current and best practices in the choice of performance comparator.MethodsWe described current choices for performance comparators by conducting a secondary review of randomised trials of A&F interventions and identifying the associated mechanisms that might have implications for effective A&F by reviewing theories and empirical studies from a recent qualitative evidence synthesis.ResultsWe found across 146 trials that feedback recipients' performance was most frequently compared against the performance of others (benchmarks; 60.3%). Other comparators included recipients' own performance over time (trends; 9.6%) and target standards (explicit targets; 11.0%), and 13% of trials used a combination of these options. In studies featuring benchmarks, 42% compared against mean performance. Eight (5.5%) trials provided a rationale for using a specific comparator. We distilled mechanisms of each comparator from 12 behavioural theories, 5 randomised trials, and 42 qualitative A&F studies.ConclusionClinical performance comparators in published literature were poorly informed by theory and did not explicitly account for mechanisms reported in qualitative studies. Based on our review, we argue that there is considerable opportunity to improve the design of performance comparators by (1) providing tailored comparisons rather than benchmarking everyone against the mean, (2) limiting the amount of comparators being displayed while providing more comparative information upon request to balance the feedback's credibility and actionability, (3) providing performance trends but not trends alone, and (4) encouraging feedback recipients to set personal, explicit targets guided by relevant information.

Project description:BackgroundAudit and feedback (A&F) is a common strategy for helping health providers to implement evidence into practice. Despite being extensively studied, health care A&F interventions remain variably effective, with overall effect sizes that have not improved since 2003. Contributing to this stagnation is the fact that most health care A&F interventions have largely been designed without being informed by theoretical understanding from the behavioral and social sciences. To determine if the trend can be improved, the objective of this study was to develop a list of testable, theory-informed hypotheses about how to design more effective A&F interventions.MethodsUsing purposive sampling, semi-structured 60-90-min telephone interviews were conducted with experts in theories related to A&F from a range of fields (e.g., cognitive, health and organizational psychology, medical decision-making, economics). Guided by detailed descriptions of A&F interventions from the health care literature, interviewees described how they would approach the problem of designing improved A&F interventions. Specific, theory-informed hypotheses about the conditions for effective design and delivery of A&F interventions were elicited from the interviews. The resulting hypotheses were assigned by three coders working independently into themes, and categories of themes, in an iterative process.ResultsWe conducted 28 interviews and identified 313 theory-informed hypotheses, which were placed into 30 themes. The 30 themes included hypotheses related to the following five categories: A&F recipient (seven themes), content of the A&F (ten themes), process of delivery of the A&F (six themes), behavior that was the focus of the A&F (three themes), and other (four themes).ConclusionsWe have identified a set of testable, theory-informed hypotheses from a broad range of behavioral and social science that suggest conditions for more effective A&F interventions. This work demonstrates the breadth of perspectives about A&F from non-healthcare-specific disciplines in a way that yields testable hypotheses for healthcare A&F interventions. These results will serve as the foundation for further work seeking to set research priorities among the A&F research community.

Project description:BackgroundFinnish clinical guidelines are evolving toward integration of knowledge modules into the electronic health record in the Evidence-Based Medicine electronic Decision Support project. It therefore became important to study which factors affect professionals' intention to use clinical guidelines generally in their decision-making on patient care. A theory-based approach is a possible solution to explore determinants of professionals' behaviour. The study's aim was to produce baseline information for developers and implementers by using the theory of planned behaviour.MethodsA cross-sectional internet-based survey was carried out in Finnish healthcare organisations within three hospital districts. The target population (n = 2,252) included physicians, nurses, and other professionals, of whom 806 participated. Indicators of the intention to use clinical guidelines were observed by using a theory-based questionnaire. The main data analysis was done by means of multiple linear regressions.ResultsThe results indicated that all theory-based variables--the attitude toward the behaviour, the subjective norm, and the perceived behaviour control--were important factors associated with the professionals' intention to use clinical practice guidelines for their area of specialisation in the decisions they would make on the care of patients in the next three months. In addition, both the nurse and the physician factors had positive (p < 0.01) effects on this intention in comparison to other professionals. In the similar models for all professions, the strongest factor for the physicians was the perceived behaviour control, while the key factor for the nurses and the other professionals was the subjective norm. This means that context- and guideline-based factors either facilitate or hinder the intention to use clinical guidelines among physicians and, correspondingly, normative beliefs related to social pressures do so for nurses and other healthcare professionals.ConclusionsThe results confirm suggestions that the theory of planned behaviour is a suitable theoretical basis for implementing clinical guidelines in healthcare practices. Our new finding was that, in general, profession had an effect on intention to use clinical guidelines in patient care. Therefore, the study reaffirms the general contention that different strategies need to be in place when clinical guidelines are targeted at different professional groups.

Dataset Information

Health professionals' perceptions about their clinical performance and the influence of audit and feedback on their intentions to improve practice: a theory-based study in Dutch intensive care units.

Publications

Health professionals' perceptions about their clinical performance and the influence of audit and feedback on their intentions to improve practice: a theory-based study in Dutch intensive care units.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets