Dataset Information

Interruptive Electronic Alerts for Choosing Wisely Recommendations: A Cluster Randomized Controlled Trial.

ABSTRACT:

Objective

To assess the efficacy of interruptive electronic alerts in improving adherence to the American Board of Internal Medicine's Choosing Wisely recommendations to reduce unnecessary laboratory testing.

Materials and methods

We administered 5 cluster randomized controlled trials simultaneously, using electronic medical record alerts regarding prostate-specific antigen (PSA) testing, acute sinusitis treatment, vitamin D testing, carotid artery ultrasound screening, and human papillomavirus testing. For each alert, we assigned 5 outpatient clinics to an interruptive alert and 5 were observed as a control. Primary and secondary outcomes were the number of postalert orders per 100 patients at each clinic and number of triggered alerts divided by orders, respectively. Post hoc analysis evaluated whether physicians experiencing interruptive alerts reduced their alert-triggering behaviors.

Results

Median postalert orders per 100 patients did not differ significantly between treatment and control groups; absolute median differences ranging from 0.04 to 0.40 for PSA testing. Median alerts per 100 orders did not differ significantly between treatment and control groups; absolute median differences ranged from 0.004 to 0.03. In post hoc analysis, providers receiving alerts regarding PSA testing in men were significantly less likely to trigger additional PSA alerts than those in the control sites (Incidence Rate Ratio 0.12, 95% CI [0.03-0.52]).

Discussion

Interruptive point-of-care alerts did not yield detectable changes in the overall rate of undesired orders or the order-to-alert ratio between active and silent sites. Complementary behavioral or educational interventions are likely needed to improve efforts to curb medical overuse.

Conclusion

Implementation of interruptive alerts at the time of ordering was not associated with improved adherence to 5 Choosing Wisely guidelines.

Trial registration

NCT02709772.

SUBMITTER: Ho VT

PROVIDER: S-EPMC10161518 | biostudies-literature | 2022 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Interruptive Electronic Alerts for Choosing Wisely Recommendations: A Cluster Randomized Controlled Trial.

Ho Vy T VT Aikens Rachael C RC Tso Geoffrey G Heidenreich Paul A PA Sharp Christopher C Asch Steven M SM Chen Jonathan H JH Shah Neil K NK

Journal of the American Medical Informatics Association : JAMIA 20221001 11

<h4>Objective</h4>To assess the efficacy of interruptive electronic alerts in improving adherence to the American Board of Internal Medicine's Choosing Wisely recommendations to reduce unnecessary laboratory testing.<h4>Materials and methods</h4>We administered 5 cluster randomized controlled trials simultaneously, using electronic medical record alerts regarding prostate-specific antigen (PSA) testing, acute sinusitis treatment, vitamin D testing, carotid artery ultrasound screening, and human ...[more]

PMID: 36018731

Similar Datasets

Project description:BackgroundHeadaches, including migraines, are one of the most common causes of disability and account for nearly 20%-30% of referrals from primary care to neurology. In primary care, electronic health record-based alerts offer a mechanism to influence health care provider behaviors, manage neurology referrals, and optimize headache care.ObjectiveThis project aimed to evaluate the impact of an electronic alert implemented in primary care on patients' overall headache management.MethodsWe conducted a stratified cluster-randomized study across 38 primary care clinic sites between December 2021 to December 2022 at a large integrated health care delivery system in the United States. Clinics were stratified into 6 blocks based on region and patient-to-health care provider ratios and then 1:1 randomized within each block into either the control or intervention. Health care providers practicing at intervention clinics received an interruptive alert in the electronic health record. The primary end point was a change in headache burden, measured using the Headache Impact Test 6 scale, from baseline to 6 months. Secondary outcomes included changes in headache frequency and intensity, access to care, and resource use. We analyzed the difference-in-differences between the arms at follow-up at the individual patient level.ResultsWe enrolled 203 adult patients with a confirmed headache diagnosis. At baseline, the average Headache Impact Test 6 scores in each arm were not significantly different (intervention: mean 63, SD 6.9; control: mean 61.8, SD 6.6; P=.21). We observed a significant reduction in the headache burden only in the intervention arm at follow-up (3.5 points; P=.009). The reduction in the headache burden was not statistically different between groups (difference-in-differences estimate -1.89, 95% CI -5 to 1.31; P=.25). Similarly, secondary outcomes were not significantly different between groups. Only 11.32% (303/2677) of alerts were acted upon.ConclusionsThe use of an interruptive electronic alert did not significantly improve headache outcomes. Low use of alerts by health care providers prompts future alterations of the alert and exploration of alternative approaches.

Project description:OBJECTIVES:Choosing Wisely holds promise for increasing awareness of low-value care in physiotherapy. However, it is unclear how physiotherapists' view Choosing Wisely recommendations. The aim of this study was to evaluate physiotherapists' feedback on Choosing Wisely recommendations and investigate agreement with each recommendation. SETTING:The Australian Physiotherapy Association emailed a survey to all 20 029 physiotherapist members in 2015 seeking feedback on a list of Choosing Wisely recommendations. PARTICIPANTS:A total of 9764 physiotherapists opened the email invitation (49%) and 543 completed the survey (response rate 5.6%). Participants were asked about the acceptability of the wording of recommendations using a closed (Yes/No) and free-text response option (section 1). Then using a similar response format, participants were asked whether they agreed with each Choosing Wisely recommendation (sections 2-6). PRIMARY AND SECONDARY OUTCOMES:We performed a content analysis of free-text responses (primary outcome) and used descriptive statistics to report agreement and disagreement with each recommendation (secondary outcome). RESULTS:There were 872 free-text responses across the six sections. A total of 347 physiotherapists (63.9%) agreed with the 'don't' style of wording. Agreement with recommendations ranged from 52.3% (electrotherapy for back pain) to 76.6% (validated decision rules for imaging). The content analysis revealed that physiotherapists felt that blanket rules were inappropriate (range across recommendations: 13.9%-30.1% of responses), clinical experience is more valuable than evidence (11.7%-28.3%) and recommendations would benefit from further refining or better defining key terms (7.3%-22.4%). CONCLUSIONS:Although most physiotherapists agreed with both the style of wording for Choosing Wisely recommendations and with the recommendations, their feedback highlighted a number of areas of disagreement and suggestions for improvement. These findings will support the development of future recommendations and are the first step towards increasing the impact Choosing Wisely has on physiotherapy practice.

Project description:BackgroundThe Choosing Wisely campaign has spread to many countries. Methods for developing recommendations are inconsistent. We describe our process of developing such recommendations from a comprehensive national set of clinical practice guidelines (Current Care, CC) and the results of a one-year Choosing Wisely Finland project.MethodsTwo of the authors drafted the quality and process criteria for all the Choosing Wisely Finland recommendations. The quality criteria were relevance, feasibility, evidence-based and strength. These were discussed in editors' meetings and subsequently revised. Two different processes for developing recommendations within national clinical practice guidelines were designed and piloted (processes A and B). Process A was based on a published guideline. The recommendations are drafted by an editor and revised and approved by the guideline development group. In process B the development of the recommendations is integrated with guideline production or update. Choosing Wisely recommendations were then drafted for half of the published CC Guidelines. An additional process (process C) was designed for producing independent recommendations outside a guideline.ResultsAt least one Choosing Wisely recommendation could be identified from 39 out of 52 reviewed guidelines. Of the 106 recommendations drafted, 62 (58%) were accepted for publication. The main reasons for rejection were inability to give a strong recommendation (n = 18, 41%) and insufficient relevance (n = 14, 32%). Two thirds (n = 41, 66%) of the published recommendations were based on high to moderate level of evidence, and 18% (n = 11) on low or very low level of evidence, whereas for the rest, the quality of evidence was not critically appraised.ConclusionsChoosing Wisely recommendations can be produced systematically from existing clinical practice guidelines. The rigorous methods of evidence-based medicine ensure high-quality recommendations. We welcome the use of our processes and methods describes in this article by other guideline-producing organizations.

Dataset Information

Interruptive Electronic Alerts for Choosing Wisely Recommendations: A Cluster Randomized Controlled Trial.

Objective

Materials and methods

Results

Discussion

Conclusion

Trial registration

Publications

Interruptive Electronic Alerts for Choosing Wisely Recommendations: A Cluster Randomized Controlled Trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets