Dataset Information

A retrospective quantitative implementation evaluation of Safer Opioid Prescribing, a Canadian continuing education program.

ABSTRACT:

Background

Continuing health professions education (CHPE) is an important policy intervention for the opioid epidemic. Besides effectiveness or impact, health policy implementation should be studied to understand how an intervention was delivered within complex environments. Implementation outcomes can be used to help interpret CHPE effects and impacts, help answer questions of "how" and "why" programs work, and inform transferability. We evaluated Safer Opioid Prescribing (SOP), a national CHPE program, using implementation outcomes of reach, dose, fidelity, and participant responsiveness.

Methods

We conducted a retrospective quantitative implementation evaluation of the 2014-2017 cohorts of SOP. To measure reach and dose, we examined participation and completion data. We used Ontario physician demographic data, including regulatory status with respect to controlled substances, to examine relevant trends. To measure fidelity and participant responsiveness, we analyzed participant-provided evaluations of bias, active learning, and relevance to practice. We used descriptive statistics and measures of association for both continuous and categorical variables. We used logistic regression to determine predictors of workshop participation and analysis of covariance to examine variation in satisfaction across different-sized sessions.

Results

Reach: In total, there were 472 unique participants, 84.0% of whom were family physicians. Among Ontario physician participants, 90.0% were family physicians with characteristics representative of province-wide demographics. Dose: Webinar completion rate was 86.2% with no differences in completion based on rurality, gender, or controlled substance prescribing status with medical regulatory authorities. Fidelity and participant responsiveness: Nearly all participants rated the three webinars and workshop as balanced, and each element of SOP was also rated as highly relevant to clinical practice.

Conclusions

This evaluation demonstrates that Safer Opioid Prescribing was implemented as intended. Over a short period and without any external funding, the program reached more than 1% of the Ontario physician workforce. This suggests that the program may be a good model for using virtual CHPE to reach a critical mass of prescribers. This study represents a methodological advance of adapting evaluation methods from health policy and complex interventions for continuing health professions education. Future studies will assess effectiveness and impact on opioid prescribing and utilization within evaluation models of complex interventions.

SUBMITTER: Sud A

PROVIDER: S-EPMC7880212 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PurposeContinuing health provider education (HPE) is an important intervention supported by health policy to counter the opioid epidemic; knowledge regarding appropriate program design and evaluation is lacking. The authors aim to provide a comprehensive understanding of evaluations of opioid-related continuing HPE programs and their appropriateness as interventions to improve population health.MethodIn January 2020, the authors conducted a systematic search of 7 databases, seeking studies of HPE programs on opioid analgesic prescribing and overdose prevention. Reviewers independently screened the titles and abstracts of all studies and then assessed the full texts of all studies potentially eligible for inclusion. The authors extracted a range of data using categories for evaluating complex programs: the use of theory, program purpose, inputs, activities, outputs, outcomes, and industry involvement. Results were reported in a narrative synthesis.ResultsThirty-nine reports on 32 distinct HPE programs met inclusion criteria. Of these 32, 31 (97%) were U.S./Canadian programs and 28 (88%) were reported after 2010. Measurements of changes in knowledge and confidence were common. Performance outcomes were less common and typically self-reported. Most studies (n = 27 [84%]) used concerns of opioid-related harms at the population health level to justify the educational intervention, but only 5 (16%) measured patient- or population-level outcomes directly related to the educational programs. Six programs (19%) had direct or indirect opioid manufacturer involvement.ConclusionsContinuing HPE has been promoted as an important means of addressing population-level opioid-related harms by policymakers and educators, yet published evaluations of HPE programs focusing on opioid analgesics inadequately evaluate patient- or population-level outcomes. Instead, they primarily focus on self-reported performance outcomes. Conceptual models are needed to guide the development and evaluation of continuing HPE programs intended to have population health benefits.

Project description:BackgroundThe 2016 U.S. Centers for Disease Control Opioid Prescribing Guideline (CDC Guideline) is currently being revised amid concern that it may be harmful to people with chronic pain on long-term opioid therapy (CP-LTOT). However, a methodology to faithfully implement the CDC guideline, measure prescriber adherence, and systematically test its effect on patient and public health outcomes is lacking. We developed and tested a CDC Guideline implementation strategy (termed TOWER), focusing on an outpatient HIV-focused primary care setting.MethodsTOWER was developed in a stakeholder-engaged, multi-step iterative process within an Information, Motivation and Behavioral Skills (IMB) framework of behavior change. TOWER consists of: 1) a patient-facing opioid management app (OM-App); 2) a progress note template (OM-Note) to guide the office visit; and 3) a primary care provider (PCP) training. TOWER was evaluated in a 9-month, randomized-controlled trial of HIV-PCPs (N = 11) and their patients with HIV and CP-LTOT (N = 40). The primary outcome was CDC Guideline adherence based on electronic health record (EHR) documentation and measured by the validated Safer Opioid Prescribing Evaluation Tool (SOPET). Qualitative data including one-on-one PCP interviews were collected. We also piloted patient-reported outcome measures (PROMs) reflective of domains identified as important by stakeholders (pain intensity and function; mood; substance use; medication use and adherence; relationship with provider; stigma and discrimination).ResultsPCPs randomized to TOWER were 48% more CDC Guideline adherent (p < 0.0001) with significant improvements in use of: non-pharmacologic treatments, functional treatment goals, opioid agreements, prescription drug monitoring programs (PDMPs), opioid benefit/harm assessment, and naloxone prescribing. Qualitative data demonstrated high levels of confidence in conducting these care processes among intervention providers, and that OM-Note supported these efforts while experience with OM-App was mixed. There were no intervention-associated safety concerns (defined as worsening of any of the PROMs).ConclusionsCDC-guideline adherence can be promoted and measured, and is not associated with worsening of outcomes for people with HIV receiving LTOT for CP. Future work would be needed to document scalability of these results and to determine whether CDC-guideline adherence results in a positive effect on public health. Trial registration https://clinicaltrials.gov/ct2/show/NCT03669939 . Registration date: 9/13/2018.

Project description:ImportanceInsurers are increasingly limiting the duration of opioid prescriptions for acute pain. Among patients undergoing surgery, it is unclear whether implementation of these limits is associated with changes in opioid prescribing and patient-reported outcomes, such as pain.ObjectiveTo assess changes in surgical opioid prescribing and patient-reported outcomes after implementation of an opioid prescribing limit by a large commercial insurer in Michigan.Design, setting, and participantsThis was a cross-sectional study with an interrupted time series analysis. Data analyses were conducted from October 1, 2022, to February 28, 2023. The primary data source was the Michigan Surgical Quality Collaborative, a statewide registry containing data on opioid prescribing and patient-reported outcomes from adults undergoing common general surgical procedures. This registry is linked to Michigan's prescription drug monitoring program database, allowing observation of opioid dispensing. The study included 6045 adults who were covered by the commercial insurer and underwent surgery from January 1, 2017, to October 31, 2019.ExposurePolicy limiting opioid prescriptions to a 5-day supply in February 2018.Main outcomes and measuresAmong all patients, segmented regression models were used to assess for level or slope changes during February 2018 in 3 patient-reported outcomes: pain in the week after surgery (assessed on a scale of 1-4: 1 = none, 2 = minimal, 3 = moderate, and 4 = severe), satisfaction with surgical experience (scale of 0-10, with 10 being the highest satisfaction), and amount of regret regarding undergoing surgery (scale of 1-5, with 1 being the highest level of regret). Among patients with a discharge opioid prescription and a dispensed opioid prescription (prescription filled within 3 days of discharge), additional outcomes included total morphine milligram equivalents in these prescriptions, a standardized measure of opioid volume.ResultsAmong the 6045 patients included in the study, mean (SD) age was 48.7 (12.6) years and 3595 (59.5%) were female. Limit implementation was not associated with changes in patient-reported satisfaction or regret and was associated with only a slight level decrease in patient-reported pain score (-0.15 [95% CI, -0.26 to -0.03]). Among 4396 patients (72.7%) with a discharge and dispensed opioid prescription, limit implementation was associated with a -22.3 (95% CI, -32.8 to -11.9) and -26.1 (95% CI, -40.9 to -11.3) level decrease in monthly mean total morphine milligram equivalents of discharge and dispensed opioid prescriptions, respectively. These decreases corresponded approximately to 3 to 3.5 pills containing 5 mg of oxycodone.ConclusionsThis cross-sectional analysis of data from adults undergoing general surgical procedures found that implementation of an insurer's limit was associated with modest reductions in opioid prescribing but not with worsened patient-reported outcomes. Whether these findings generalize to other procedures warrants further study.