Dataset Information

Testing Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content.

ABSTRACT: BACKGROUND:Cancer Care Ontario's Screening Activity Report (SAR) is an online audit and feedback tool designed to help primary care physicians in Ontario, Canada, identify patients who are overdue for cancer screening or have abnormal results requiring follow-up. Use of the SAR is associated with increased screening rates. To encourage SAR use, Cancer Care Ontario sends monthly emails to registered primary care physicians announcing that updated data are available. However, analytics reveal that 50% of email recipients do not open the email and less than 7% click the embedded link to log in to their report. OBJECTIVE:The goal of the study is to determine whether rewritten emails result in increased log-ins. This manuscript describes how different user- and theory-informed messages intended to improve the impact of the monthly emails will be experimentally tested and how a process evaluation will explore why and how any effects observed were (or were not) achieved. METHODS:A user-centered approach was used to rewrite the content of the monthly email, including messages operationalizing 3 behavior change techniques: anticipated regret, material incentive (behavior), and problem solving. A pragmatic, 2x2x2 factorial experiment within a multiphase optimization strategy will test the redesigned emails with an embedded qualitative process evaluation to understand how and why the emails may or may not have worked. Trial outcomes will be ascertained using routinely collected administrative data. Physicians will be recruited for semistructured interviews using convenience and snowball sampling. RESULTS:As of April 2017, 5576 primary care physicians across the province of Ontario, Canada, had voluntarily registered for the SAR, and in so doing, signed up to receive the monthly email updates. From May to August 2017 participants received the redesigned monthly emails with content specific to their allocated experimental condition prompting use of the SAR. We have not yet begun analyses. CONCLUSIONS:This study will inform how to communicate effectively with primary care providers by email and identify which behavior change techniques tested are most effective at encouraging engagement with an audit and feedback report. TRIAL REGISTRATION:ClinicalTrials.gov NCT03124316; https://clinicaltrials.gov/ct2/show/NCT03124316 (Archived by WebCite at http://www.webcitation.org/6w2MqDWGu).

SUBMITTER: Vaisson G

PROVIDER: S-EPMC5834752 | biostudies-literature | 2018 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Testing Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content.

Vaisson Gratianne G Witteman Holly O HO Bouck Zachary Z Bravo Caroline A CA Desveaux Laura L Llovet Diego D Presseau Justin J Saragosa Marianne M Taljaard Monica M Umar Shama S Grimshaw Jeremy M JM Tinmouth Jill J Ivers Noah M NM

JMIR research protocols 20180216 2

<h4>Background</h4>Cancer Care Ontario's Screening Activity Report (SAR) is an online audit and feedback tool designed to help primary care physicians in Ontario, Canada, identify patients who are overdue for cancer screening or have abnormal results requiring follow-up. Use of the SAR is associated with increased screening rates. To encourage SAR use, Cancer Care Ontario sends monthly emails to registered primary care physicians announcing that updated data are available. However, analytics rev ...[more]

PMID: 29453190

Similar Datasets

Project description:Background: There is growing interest in the impact of national clinical audit programmes on the quality of healthcare. There is also an evolving evidence-base for enhancing the design and delivery of audit and feedback. We assessed the extent to which a sample of UK national clinical audit feedback reports met a set of good practice criteria over three time points.Methods: We undertook three cross-sectional content analyses. We developed good practice criteria for the content and delivery of feedback based upon evidence, behavioural theory and expert opinion. We applied these to a feedback reports from 23 national audits listed on the Healthcare Quality Improvement Partnership (HQIP) website in November 2015. We repeated our assessments in January 2017 for 20 repeat feedback reports, after HQIP had published reporting guidance for national audits, and in August 2019 for a further 14 repeat feedback reports. We verified our assessments, where possible, with audit leads.Results: Feedback reports consistently included strengths at baseline, including past or planned repeated audit cycles (21; 91%), stating the importance of the topic in relation to patient care (22; 93%), using multi-modal data presentation (23; 100%), and summarising key findings (23; 100%). We observed improvements over subsequent assessments, so that by 2019, at least 13 out of 14 (93%) feedback reports presented easily identifiable key findings and recommendations, linked recommendations to audit standards, and proposed easily identifiable action plans. Whilst the use of regional comparators did not improve, audit leads highlighted that programmes now provide local data via additional means. The main shortcoming was the time lag between data collection and feedback; none of the 14 reports assessed in 2019 presented performance data less than 6 months old. Audit leads highlighted that some of these data might be available via programme websites.Conclusion: We identified increased adherence to good practice in feedback by national clinical audit programmes that may enhance their impact on service delivery and outcomes. There is scope for improvement, especially in the recency of performance data. With further refinements, a criterion-based assessment offers an efficient means of monitoring the quality of national clinical audit feedback reports.

Project description:BackgroundAudit and feedback (A&F) often successfully enhances health professionals' intentions to improve quality of care but does not consistently lead to practice changes. Recipients often cite data credibility and limited resources as barriers impeding their ability to act upon A&F, suggesting the intention-to-action gap manifests while recipients are interacting with their data. While attention has been paid to the role feedback and contextual variables play in contributing to (or impeding) success, we lack a nuanced understanding of how healthcare professionals interact with and process clinical performance data.MethodsWe used qualitative, semi-structured interviews guided by Normalization Process Theory (NPT). Questions explored the role of data in quality improvement, experiences with the A&F report, perceptions of the data, and interpretations and reflections. Interviews were audio-recorded and transcribed verbatim. Data were analyzed using a combination of inductive and deductive strategies using reflexive thematic analysis informed by a constructivist paradigm.ResultsHealthcare professional characteristics (individual quality improvement capabilities and beliefs about data) seem to influence engagement with A&F to a greater degree than feedback variables (i.e., delivered by peers) and observed contextual factors (i.e., strong quality improvement culture). Most participants lacked the capabilities to interpret practice-level data in an actionable way despite a motivation to engage meaningfully. Reasons for the intention-to-action gap included challenges interpreting longitudinal data, appreciating the nuances of common data sources, understanding how aggregate data provides insights into individualized care, and identifying practice-level actions to improve quality. These factors limited effective cognitive participation and collective action, as outlined in NPT.ConclusionsA well-designed A&F intervention is necessary but not sufficient to inform practice changes. A&F initiatives must include co-interventions to address recipient characteristics (i.e., beliefs and capabilities) and context to optimize impact. Effective strategies to overcome the intention-to-action gap may include modelling how to use A&F to inform practice change, providing opportunities for social interaction relating to the A&F, and circulating examples of effective actions taken in response to A&F. More broadly, undergraduate medical education and post-graduate training must ensure physicians are equipped with QI capabilities, with an emphasis on the skills required to interpret and act on practice-level data.

Project description:BackgroundMeaningful variations in physician performance are not always discernible from the medical record.ObjectiveWe used unannounced standardized patients to measure and provide feedback on care quality and fidelity of documentation, and examined downstream effects on reimbursement claims.DesignStatic group pre-post comparison study conducted between 2017 and 2019.SettingFourteen New Jersey primary care practice groups (22 practices) enrolled in Horizon BCBS's value-based program received the intervention. For claims analyses, we identified 14 additional comparison practice groups matched on county, practice size, and claims activity.ParticipantsFifty-nine of 64 providers volunteered to participate.InterventionUnannounced standardized patients (USPs) made 217 visits portraying patients with 1-2 focal conditions (diabetes, depression, back pain, smoking, or preventive cancer screening). After two baseline visits to a provider, we delivered feedback and conducted two follow-up visits.MeasurementsUSP-completed checklists of guideline-based provider care behaviors, visit audio recordings, and provider notes were used to measure behaviors performed and documentation errors pre- and post-feedback. We also compared changes in 3-month office-based claims by actual patients between the intervention and comparison practice groups before and after feedback.ResultsExpected clinical behaviors increased from 46% to 56% (OR = 1.53, 95% CI 1.29-1.83, p < 0.0001), with significant improvements in smoking cessation, back pain, and depression screening. Providers were less likely to document unperformed tasks after (16%) than before feedback (18%; OR = 0.74, 95% CI 0.62 to 0.90, p = 0.002). Actual claim costs increased significantly less in the study than comparison group for diabetes and depression but significantly more for smoking cessation, cancer screening, and low back pain.LimitationsSelf-selection of participating practices and lack of access to prescription claims.ConclusionDirect observation of care identifies hidden deficits in practice and documentation, and with feedback can improve both, with concomitant effects on costs.

Project description:Background:As part of their professional role, healthcare providers enact multiple competing goal-directed behaviours in time-constrained environments. Better understanding healthcare providers' motivation to engage in the pursuit of particular goals may help inform the development of implementation interventions. We investigated healthcare providers' pursuit of multiple goals as part of a trial evaluating the effectiveness of an audit and feedback intervention in supporting appropriate adjustment of high-risk medication prescribing by physicians working in nursing homes. Our objectives were to determine whether goal priority and constructs from Social Cognitive Theory (self-efficacy, outcome expectations, and descriptive norms) predicted intention to adjust prescribing of multiple high-risk medications and to investigate how physicians in nursing homes prioritise their goals related to high-risk medication prescribing. Methods:Physicians in Ontario, Canada, who signed up for and accessed the audit and feedback report were invited to complete a questionnaire assessing goal priority, self-efficacy, outcome expectations, descriptive norms, and intention in relation to the three targeted behaviours (adjusting prescribing of antipsychotics, benzodiazepines, and antidepressants) and a control behaviour (adjusting statin prescribing). We conducted multiple linear regression analyses to identify predictors of intention. We also conducted semi-structured qualitative interviews to investigate how physicians in nursing homes prioritise their goals in relation to appropriately adjusting prescribing of the medications included in the report: analysis was informed by the framework analysis method. Results:Thirty-three of 89 (37%) physicians completed the questionnaire. Goal priority was the only significant predictor of intention for each medication type; the greater a priority it was for physicians to appropriately adjust their prescribing, the stronger was their intention to do so. Across five interviews, physicians reported prioritising adjustment of antipsychotic prescribing specifically. This was influenced by negative media coverage of antipsychotic prescribing in nursing homes, the provincial government's mandate to address antipsychotic prescribing, and by the deprescribing initiatives or best practice routines in place in their nursing homes. Conclusions:Goal priority predicted nursing home physicians' intention to adjust prescribing. Targeting goal priority through implementation interventions therefore has the potential to influence behaviour via increased motivation. Implementation intervention developers should consider the external factors that may drive physicians' prioritization.

Project description:BackgroundIn nursing homes, 25%-75% of antibiotic days of treatment are inappropriate or unnecessary and are often continued for longer durations than necessary. In Ontario, physicians can receive a provincial audit and feedback report that provides individualised, confidential, data about their antibiotic prescribing. Objectives of this study were to explore antibiotic prescribing of nursing home physicians and the influence of the report.MethodsAll physicians who received a personalised MyPractice: Long-Term Care report from Ontario Health (Quality) (OH(Q)) in January 2019 (n=361) were eligible to participate in semistructured telephone interviews that were recorded then transcribed verbatim. Recruitment emails were sent from OH(Q) until saturation of ideas. Analysis was conducted by two team members inductively, then deductively using the theoretical domains framework, a comprehensive, theory-informed framework to classify determinants of specific behaviours.ResultsInterviews were conducted with n=18 physicians; 78% (n=14) were men, practising for an average of 27 years, with 18 years of experience working in nursing homes. Physicians worked in a median of 2 facilities (range 1-6), with 72% (n=13) in an urban setting. 56% (n=10) were medical directors for at least one home. Professional role and identity impacted all aspects of antibiotic prescribing. Key roles included being an 'Appropriate prescriber', an 'Educator' and a 'Change driver'. For antibiotic initiation, these roles interacted with Knowledge, Skills, Beliefs about consequence, Beliefs about capabilities, and Social influence to determine the resulting prescribing behaviour. When considering the impact of interacting with the report, participants' perceived roles interacted with Reinforcement, Social influence, and Intention. Environmental context and resources was an overarching domain.ConclusionThis theory-informed approach is being used to inform upcoming versions of existing audit and feedback initiatives. Appealing to the role that prescribers see themselves offers a unique opportunity to encourage desired changes, such as providing tools for physicians to be Educators and facilitating, particularly medical directors, to be Change drivers.

Project description:BACKGROUND:Antibiotic prescribing in dentistry accounts for 9% of total antibiotic prescriptions in Scottish primary care. The Scottish Dental Clinical Effectiveness Programme (SDCEP) published guidance in April 2008 (2nd edition, August 2011) for Drug Prescribing in Dentistry, which aims to assist dentists to make evidence-based antibiotic prescribing decisions. However, wide variation in prescribing persists and the overall use of antibiotics is increasing. METHODS:RAPiD is a 12-month partial factorial cluster randomised trial conducted in NHS General Dental Practices across Scotland. Its aim is to compare the effectiveness of individualised audit and feedback (A&F) strategies for the translation into practice of SDCEP recommendations on antibiotic prescribing. The trial uses routinely collected electronic healthcare data in five aspects of its design in order to: identify the study population; apply eligibility criteria; carry out stratified randomisation; generate the trial intervention; analyse trial outcomes. Eligibility was determined on contract status and a minimum level of recent NHS treatment provision. All eligible dental practices in Scotland were simultaneously randomised at baseline either to current audit practice or to an intervention group. Randomisation was stratified by single-handed/multi-handed practices. General dental practitioners (GDPs) working at intervention practices will receive individualised graphical representations of their antibiotic prescribing rate from the previous 14 months at baseline and an update at six months. GDPs could not be blinded to their practice allocation. Intervention practices were further randomised using a factorial design to receive feedback with or without: a health board comparator; a supplementary text-based intervention; additional feedback at nine months. The primary outcome is the total antibiotic prescribing rate per 100 courses of treatment over the year following delivery of the baseline intervention. A concurrent qualitative process evaluation will apply theory-based approaches using the Consolidated Framework for Implementation Research to explore the acceptability of the interventions and the Theoretical Domains Framework to identify barriers and enablers to evidence-based antibiotic prescribing behaviour by GDPs. DISCUSSION:RAPiD will provide a robust evaluation of A&F in dentistry in Scotland. It also demonstrates that linked administrative datasets have the potential to be used efficiently and effectively across all stages of an randomised controlled trial. TRIAL REGISTRATION:Current Controlled Trials ISRCTN49204710.

Dataset Information

Testing Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content.

Publications

Testing Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets