How well do critical care audit and feedback interventions adhere to best practice? Development and application of the REFLECT-52 evaluation tool.
Ontology highlight
ABSTRACT:
SUBMITTER: Foster M
PROVIDER: S-EPMC8369748 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Animal-assisted interventions (AAI) in educational and other settings have steadily increased over the last fifty years and a steep rise in AAI has been observed in many countries and settings in recent years. Surprisingly, while different providers and organisations provide a range of guidelines, no unified, standardised guidelines or risk assessment tools for AAI exist. This means that in practice AAI takes place in an unregulated manner and without a gold standard of best practice. In addition, knowledge of which interventions are effective is still scarce and the mechanisms of successful interventions are not yet fully understood. This is partly due to AAI being a relatively new research field and standards of research and practice have often lacked rigour in the past. Furthermore, knowledge and experience of providers undertaking interventions varies greatly as there is no standardised training either. We address the striking lack of standardised guidelines and procedures. In all AAI, high importance should be placed on safety and welfare of all involved. Children and other AAI participants, staff and animals should be given equal consideration when assessing risks and welfare needs. To ensure safe AAI worldwide, we provide urgently needed guidelines on best practice in relation to risk assessment, safeguarding and animal welfare priorities. The guidelines were developed for a large-scale longitudinal, randomised controlled trial AAI project and are relevant to AAIs within educational and other settings. We also provide the first set of comprehensive risk assessment and animal welfare tools to achieve consistent welfare and safety standards for best practice across educational and other settings around the world.
| S-EPMC7341237 | biostudies-literature
Project description:IntroductionPharmacists, as experts in medicines, are increasingly employed in general practices and undertake a range of responsibilities. Audit and feedback (A&F) interventions are effective in achieving behaviour change, including prescribing. The extent of pharmacist involvement in A&F interventions to influence prescribing is unknown. This review aimed to assess the effectiveness of A&F interventions involving pharmacists on prescribing in general practice compared with no A&F/usual care and to describe features of A&F interventions and pharmacist characteristics.MethodsElectronic databases (MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, (Social) Science Citation Indexes, ISI Web of Science) were searched (2012, 2019, 2020). Cochrane systematic review methods were applied to trial identification, selection, and risk of bias. Results were summarized descriptively and heterogeneity was assessed. A random-effects meta-analysis was conducted where studies were sufficiently homogenous in design and outcome.ResultsEleven cluster-randomized studies from 9 countries were included. Risk of bias across most domains was low. Interventions focussed on older patients, specific clinical area(s), or specific medications. Meta-analysis of 6 studies showed improved prescribing outcomes (pooled risk ratio: 0.78, 95% confidence interval: 0.64-0.94). Interventions including both verbal and written feedback or computerized decision support for prescribers were more effective. Pharmacists who received study-specific training, provided ongoing support to prescribers or reviewed prescribing for individual patients, contributed to more effective interventions.ConclusionsA&F interventions involving pharmacists can lead to small improvements in evidence-based prescribing in general practice settings. Future implementation of A&F within general practice should compare different ways of involving pharmacists to determine how to optimize effectiveness.PRISMA-compliant abstract included in Supplementary Material 1.
| S-EPMC10745261 | biostudies-literature
Project description:BackgroundWe describe the creation and evaluation of a personal audit and feedback (A&F) tool for anesthesiologists.MethodsA survey aimed at capturing barriers for personal improvement efforts and feedback preferences was administered to attending anesthesiologists. The results informed the design and implementation of 4 dashboards that display information on individual practice characteristics as well as comparative performance on several quality metrics. The dashboards' usability was then tested using the human-centered design framework.ResultsAnesthesiologists listed lack of information on current practice as the main barrier for improvement. Regarding usability, participants gave the dashboards an average score of 3.8 (scale 1-5) on consistency, learnability, and information organization, and performed the assigned tasks well, with an average score of 89% (range 79-100%).ConclusionsWe describe the design, implementation, and usability testing of an innovative tool that utilizes data derived from the electronic health record (EHR) system to provide A&F to anesthesiology providers.
| S-EPMC6951966 | biostudies-literature
Project description:Audit and feedback (A&F) is a common strategy for helping health providers to implement evidence into practice. Despite being extensively studied, health care A&F interventions remain variably effective, with overall effect sizes that have not improved since 2003. Contributing to this stagnation is the fact that most health care A&F interventions have largely been designed without being informed by theoretical understanding from the behavioral and social sciences. To determine if the trend can be improved, the objective of this study was to develop a list of testable, theory-informed hypotheses about how to design more effective A&F interventions.Using purposive sampling, semi-structured 60-90-min telephone interviews were conducted with experts in theories related to A&F from a range of fields (e.g., cognitive, health and organizational psychology, medical decision-making, economics). Guided by detailed descriptions of A&F interventions from the health care literature, interviewees described how they would approach the problem of designing improved A&F interventions. Specific, theory-informed hypotheses about the conditions for effective design and delivery of A&F interventions were elicited from the interviews. The resulting hypotheses were assigned by three coders working independently into themes, and categories of themes, in an iterative process.We conducted 28 interviews and identified 313 theory-informed hypotheses, which were placed into 30 themes. The 30 themes included hypotheses related to the following five categories: A&F recipient (seven themes), content of the A&F (ten themes), process of delivery of the A&F (six themes), behavior that was the focus of the A&F (three themes), and other (four themes).We have identified a set of testable, theory-informed hypotheses from a broad range of behavioral and social science that suggest conditions for more effective A&F interventions. This work demonstrates the breadth of perspectives about A&F from non-healthcare-specific disciplines in a way that yields testable hypotheses for healthcare A&F interventions. These results will serve as the foundation for further work seeking to set research priorities among the A&F research community.
| S-EPMC5622490 | biostudies-other
Project description:BackgroundAudit and feedback (A&F) interventions are one of the most common approaches for implementing evidence-based practices. A key barrier to more effective A&F interventions is the lack of a theory-guided approach to the accumulation of evidence. Recent interviews with theory experts identified 313 theory-informed hypotheses, spread across 30 themes, about how to create more effective A&F interventions. In the current survey, we sought to elicit from stakeholders which hypotheses were most likely to advance the field if studied further.MethodsFrom the list of 313, three members of the research team identified 216 that were clear and distinguishable enough for prioritization. A web-based survey was then sent to 211 A&F intervention stakeholders asking them to choose up to 50 'priority' hypotheses following the header "A&F interventions will be more effective if…". Analyses included frequencies of endorsement of the individual hypotheses and themes into which they were grouped.Results68 of the 211 invited participants responded to the survey. Seven hypotheses were chosen by >?50% of respondents, including A&F interventions will be more effective… "if feedback is provided by a trusted source"; "if recipients are involved in the design/development of the feedback intervention"; "if recommendations related to the feedback are based on good quality evidence"; "if the behaviour is under the control of the recipient"; "if it addresses barriers and facilitators (drivers) to behaviour change"; "if it suggests clear action plans"; and "if target/goal/optimal rates are clear and explicit". The most endorsed theme was Recipient Priorities (four hypotheses were chosen 92 times as a 'priority' hypotheses).ConclusionsThis work determined a set of hypotheses thought by respondents to be to be most likely to advance the field through future A&F intervention research. This work can inform a coordinated research agenda that may more efficiently lead to more effective A&F interventions.
| S-EPMC7805176 | biostudies-literature
Project description:ObjectivesAdopting an attributional perspective, the current article investigates how audit and feedback group sessions contribute to general practitioners' (GPs) motivation to change their practice behaviour to improve care. We focus on the contributions of the audit and feedback itself (content) and the group discussion (process).MethodsFour focus groups, comprising a total of 39 participating Dutch GPs, discussed and compared audit and feedback of their practices. The focus groups were analysed thematically.ResultsAudit and feedback contributed to GPs' motivation to change in two ways: by raising awareness about aspects of their current care practice and by providing indications of the possible impact of change. For these contributions to play out, the audit and feedback should be reliable and valid, specific, recent and recurrent and concern GPs' own practices or practices within their own influence sphere. Care behaviour attributed to external, uncontrollable or unstable causes would not induce change. The added value of the group is twofold as well: group discussion contributed to GPs' motivation to change by providing a frame of reference and by affording insights that participants would not have been able to achieve on their own.ConclusionsIn audit and feedback group sessions, both audit and feedback information and group discussion can valuably contribute to GPs' motivation to change care practice behaviour. Peer interaction can positively contribute to explore alternative practices and avenues for improvement. Local or regional peer meetings would be beneficial in facilitating reflection and discussion. An important avenue for future studies is to explore the contribution of audit and feedback and small-group discussion to actual practice change.
| S-EPMC6549704 | biostudies-literature
Project description:BACKGROUND:Studying the determinants and the long-term consequences of fetal adipose accretion requires accurate assessment of neonatal body composition. In large epidemiological studies, in-depth body composition measurement methods are usually not feasible for cost and logistical reasons, and there is a need to identify anthropometric measures that adequately reflect neonatal adiposity. METHODS:In a multiethnic Asian mother-offspring cohort in Singapore, anthropometric measures (weight, length, abdominal circumference, skinfold thicknesses) were measured using standardized protocols in newborn infants, and anthropometric indices (weight/length, weight/length2 (body mass index, BMI), weight/length3 (ponderal index, PI)) derived. Neonatal total adiposity was measured using air displacement plethysmography (ADP) and abdominal adiposity using magnetic resonance imaging (MRI). Correlations of the anthropometric measures with ADP- and MRI-based adiposity were assessed using Pearson's correlation coefficients (rp), including in subsamples stratified by sex and ethnicity. RESULTS:Study neonates (n=251) had a mean (s.d.) age of 10.2 (2.5) days. Correlations between ADP-based fat mass (ADPFM) and anthropometric measures were moderate (rp range: 0.44-0.67), with the strongest being with weight/length, weight, BMI and sum of skinfolds (rp=0.67, 0.66, 0.62, 0.62, respectively, all P<0.01). All anthropometric measures except skinfold thicknesses correlated more strongly with ADP-based fat-free mass than ADPFM, indicating that skinfold measures may have more discriminative power in terms of neonatal total body adiposity. For MRI-based measures, weight and weight/length consistently showed strong positive correlations (rp?0.7) with abdominal adipose tissue compartments. These correlations were consistent in boys and girls, across different ethnic groups, and when conventional determinants of neonatal adiposity were adjusted for potential confounding. Abdominal circumference was not strongly associated with ADPFM or abdominal fat mass. CONCLUSIONS:Simple anthropometric measures (weight and weight/length) correlated strongly with neonatal adiposity, with some evidence for greater discriminative power for skinfold measures. These simple measures could be of value in large epidemiological studies.
| S-EPMC5862425 | biostudies-literature
Project description:Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key 'active ingredients.'Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the 'business as usual' approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature.We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness.
| S-EPMC3896824 | biostudies-other
Project description:Audit and feedback to physicians is a commonly used quality improvement strategy, but its optimal design is unknown. This trial tested the effects of a theory-informed worksheet to facilitate goal setting and action planning, appended to feedback reports on chronic disease management, compared to feedback reports provided without these worksheets.A two-arm pragmatic cluster randomized trial was conducted, with allocation at the level of primary care clinics. Participants were family physicians who contributed data from their electronic medical records. The 'usual feedback' arm received feedback every six months for two years regarding the proportion of their patients meeting quality targets for diabetes and/or ischemic heart disease. The intervention arm received these same reports plus a worksheet designed to facilitate goal setting and action plan development in response to the feedback reports. Blood pressure (BP) and low-density lipoprotein cholesterol (LDL) values were compared after two years as the primary outcomes. Process outcomes measured the proportion of guideline-recommended actions (e.g., testing and prescribing) conducted within the appropriate timeframe. Intention-to-treat analysis was performed.Outcomes were similar across groups at baseline. Final analysis included 20 physicians from seven clinics and 1,832 patients in the intervention arm (15% loss to follow up) and 29 physicians from seven clinics and 2,223 patients in the usual feedback arm (10% loss to follow up). Ten of 20 physicians completed the worksheet at least once during the study. Mean BP was 128/72 in the feedback plus worksheet arm and 128/73 in the feedback alone arm, while LDL was 2.1 and 2.0, respectively. Thus, no significant differences were observed across groups in the primary outcomes, but mean haemoglobin A1c was lower in the feedback plus worksheet arm (7.2% versus 7.4%, p<0.001). Improvements in both arms were noted over time for one-half of the process outcomes.Appending a theory-informed goal setting and action planning worksheet to an externally produced audit and feedback intervention did not lead to improvements in patient outcomes. The results may be explained in part by passive dissemination of the worksheet leading to inadequate engagement with the intervention.ClinicalTrials.gov NCT00996645.
| S-EPMC3878579 | biostudies-literature
Project description:BackgroundIn Ontario, an online audit and feedback tool that provides primary care physicians with detailed information about patients who are overdue for cancer screening is underused. In the present study, we aimed to examine the effect of messages operationalizing 3 behaviour change techniques on access to the audit and feedback tool and on cancer screening rates.MethodsDuring May-September 2017, a pragmatic 2×2×2 factorial experiment tested 3 behaviour change techniques: anticipated regret, material incentive, and problem-solving. Outcomes were assessed using routinely collected administrative data. A qualitative process evaluation explored how and why the e-mail messages did or did not support Screening Activity Report access.ResultsOf 5449 primary care physicians randomly allocated to 1 of 8 e-mail messages, fewer than half opened the messages and fewer than 1 in 10 clicked through the messages. Messages with problem-solving content were associated with a 12.9% relative reduction in access to the tool (risk ratio: 0.871; 95% confidence interval: 0.791 to 0.958; p = 0.005), but a 0.3% increase in cervical cancer screening (rate ratio: 1.003; 95% confidence interval: 1.001 to 1.006; p = 0.003). If true, that association would represent 7568 more patients being screened. No other significant effects were observed.ConclusionsFor audit and feedback to work, recipients must engage with the data; for e-mail messages to prompt activity, recipients must open and review the message content. This large factorial experiment demonstrated that small changes in the content of such e-mail messages might influence clinical behaviour. Future research should focus on strategies to make cancer screening more user-centred.
| S-EPMC6588071 | biostudies-literature