Dataset Information

Assessing long-term sustainment of clinic participation in NIATx200: Results and a new methodological approach.

ABSTRACT: BACKGROUND:Sustainability frameworks differentiate between sustainability capacity and sustainment of organizational change. Multiple studies have examined sustainability capacity. Methodological approaches to assess long-term sustainment have not been explored. This study addresses this gap by describing the development of a long-term sustainment methodology and evaluating its application utilizing data from substance abuse clinics participating in a quality improvement collaborative. METHODS:The study involved clinics (n?=?121) in three states (MI, NY and WA) participating in the 2007-2009 NIATx200 quality improvement (QI) intervention. It extended the primary analysis to focus on clinics' long-term sustainment of wait time, retention and admission improvements. Long-term sustainment was defined as two years post end of the active implementation period (Calendar Years 2010 and 2011). The analysis defined case exclusion criteria and spline "knot" time intervals; allowed for Cp statistic use to address clinic data volatility; established the structure of sustainment plots and explored differences between NIATx implementation strategies. RESULTS:Example spline and sustain plots highlight the application of the long-term sustainment methodology for NIATx200 clinics. In clinics with available longitudinal outcome data, 40.8% (n?=?31 of 76 clinics) sustained improvements in wait time, 26.7% (n?=?20 of 75 clinics) in retention, and 28.1% (n?=?32 of 114 clinics) for admissions. Clinic assignment to a NIATx200 implementation strategy did not significantly influence a clinics' long-term sustainment except for lower wait time changes in the interest circle interventions. Thirty clinics (24.8%) sustained improvements for two outcomes and six clinics (5.0%) did so for all three outcomes. The clinics that sustained multiple outcome improvements were assigned to the interest circle (n?=?12), learning session (n?=?10), combination (n?=?8), and coaching (n?=?6) implementation strategies. Guidance for applying the long-term sustainment methodology in other quality improvement settings is described. CONCLUSIONS:Research about sustainability capacity and sustainment of change has become increasingly important in dissemination and implementation research. Assessment of long-term sustainment in a multi-organizational quality improvement collaborative (QIC) is needed to identify when program drift and intervention decay occurs. If "cut-points" indicate when effects diminish, specific sustainability modules could be developed and introduced within the structure of a QIC to improve organizational long-term sustainment. Coaches and change teams could be trained to focus on organizational change sustainment and strengthen the likelihood of institutionalization. ClinicalTrials.gov Identifier: NCT00934141 Registered July 6, 2009. Retrospectively registered.

SUBMITTER: Ford JH

PROVIDER: S-EPMC6336112 | biostudies-literature | 2018 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessing long-term sustainment of clinic participation in NIATx200: Results and a new methodological approach.

Ford James H JH Stumbo Scott P SP Robinson James M JM

Journal of substance abuse treatment 20180627

<h4>Background</h4>Sustainability frameworks differentiate between sustainability capacity and sustainment of organizational change. Multiple studies have examined sustainability capacity. Methodological approaches to assess long-term sustainment have not been explored. This study addresses this gap by describing the development of a long-term sustainment methodology and evaluating its application utilizing data from substance abuse clinics participating in a quality improvement collaborative.<h ...[more]

PMID: 30032945

Similar Datasets

Project description:IntroductionAlive and Thrive (A&T) implemented infant and young child feeding (IYCF) interventions in Bangladesh. We examine the sustained impacts on health workers' IYCF knowledge, service delivery, job satisfaction, and job readiness three years after the program's conclusion.MethodsWe use data from a cluster-randomized controlled trial design, including repeated cross-sectional surveys with health workers in 2010 (baseline, n = 290), 2014 (endline, n = 511) and 2017 (post-endline, n = 600). Health workers in 10 sub-districts were trained and incentivized to deliver intensified IYCF counseling, and participated in social mobilization activities, while health workers in 10 comparison sub-districts delivered standard counseling activities. Accompanying mass media and policy change activities occurred at the national level. The primary outcome is quality of IYCF service delivery (number of IYCF messages reportedly communicated during counseling); intermediate outcomes are IYCF knowledge, job satisfaction, and job readiness. We also assess the role of hypothesized modifiers of program sustainment, i.e. activities of the program: comprehensiveness of refresher trainings and receipt of financial incentives. Multivariable difference-in-difference linear regression models, including worker characteristic covariates and adjusted for clustering at the survey sampling level, are used to compare differences between groups (intervention vs. comparison areas) and over time (baseline, endline, post-endline).ResultsAt endline, health workers in intervention areas discussed significantly more IYCF topics than those in comparison areas (4.9 vs. 4.0 topics, p < 0.001), but levels decreased and the post-endline gap was no longer significant (4.0 vs. 3.3 topics, p = 0.067). Comprehensive refresher trainings were protective against deterioration in service delivery. Between baseline and endline, the intervention increased health workers' knowledge (3.5-point increase in knowledge scores in intervention areas, vs. 1.5-point increase in comparison areas, p < 0.0001); and this improvement persisted to post-endline, suggesting a sustained program effect on knowledge. Job satisfaction and readiness both saw improvements among workers in intervention areas during the project period (baseline to endline) but regressed to a similar level as comparison areas by post-endline.DiscussionOur study showed sustained impact of IYCF interventions on health workers' knowledge, but not job satisfaction or job readiness-and, critically, no sustained program effect on service delivery. Programs of limited duration may seek to assess the status of and invest in protective factors identified in this study (e.g., refresher trainings) to encourage sustained impact of improved service delivery. Studies should also prioritize collecting post-endline data to empirically test and refine concepts of sustainment.

Dataset Information

Assessing long-term sustainment of clinic participation in NIATx200: Results and a new methodological approach.

Publications

Assessing long-term sustainment of clinic participation in NIATx200: Results and a new methodological approach.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets