Dataset Information

A Method for Tracking Implementation Strategies: An Exemplar Implementing Measurement-Based Care in Community Behavioral Health Clinics.

ABSTRACT: Implementation experts suggest tailoring strategies to the intended context may enhance outcomes. However, it remains unclear which strategies are best suited to address specific barriers to implementation, in part because few measurement methods exist that adhere to recommendations for reporting. In the context of a dynamic cluster randomized trial comparing a standardized to tailored approach to implementing measurement-based care (MBC), this study aimed to (a) describe a method for tracking implementation strategies, (b) demonstrate the method by tracking strategies generated by teams tasked with implementing MBC at their clinics in the tailored condition, and (c) conduct preliminary examinations of the relation between strategy use and implementation outcomes (i.e., self-reported fidelity to MBC). The method consisted of a coding form based on Proctor, Powell, and McMillen (2013) implementation strategy reporting guidelines and Powell et al.'s (2012) taxonomy to facilitate specification of the strategies. A trained research specialist coded digitally recorded implementation team meetings. The method allowed for the following characterization of strategy use. Each site generated 39 unique strategies across an average of six meetings in five months. There was little variability in the use of types of implementation strategies across sites with the following order of prevalence: quality management (50.00%), restructuring (16.53%), communication (15.68%), education (8.90%), planning (7.20%), and financing (1.69%). We identified a new category of strategies not captured by the existing taxonomy, labeled "communication." There was no evidence that number of implementation strategies enacted was statistically significantly associated with changes in self-reported fidelity to MBC-however, financing strategies were associated with increased fidelity. This method has the capacity to yield rich data that will inform investigations into tailored implementation approaches.

SUBMITTER: Boyd MR

PROVIDER: S-EPMC6020155 | biostudies-literature | 2018 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Method for Tracking Implementation Strategies: An Exemplar Implementing Measurement-Based Care in Community Behavioral Health Clinics.

Boyd Meredith R MR Powell Byron J BJ Endicott David D Lewis Cara C CC

Behavior therapy 20171212 4

Implementation experts suggest tailoring strategies to the intended context may enhance outcomes. However, it remains unclear which strategies are best suited to address specific barriers to implementation, in part because few measurement methods exist that adhere to recommendations for reporting. In the context of a dynamic cluster randomized trial comparing a standardized to tailored approach to implementing measurement-based care (MBC), this study aimed to (a) describe a method for tracking i ...[more]

PMID: 29937255

Similar Datasets

Project description:BackgroundTechnology-based self-assessment (TB-SA) benefits patients and providers and has shown feasibility, ease of use, efficiency, and cost savings. A promising TB-SA, the VA eScreening program, has shown promise for the efficient and effective collection of mental and physical health information. To assist adoption of eScreening by healthcare providers, we assessed technology-related as well as individual- and system-level factors that might influence the implementation of eScreening in four diverse VA clinics.MethodsThis was a mixed-method, pre-post, quasi-experimental study originally designed as a quality improvement project. The clinics were selected to represent a range of environments that could potentially benefit from TB-SA and that made use of the variety eScreening functions. Because of limited resources, the implementation strategy consisted of staff education, training, and technical support as needed. Data was collected using pre- and post-implementation interviews or focus groups of leadership and clinical staff, eScreening usage data, and post-implementation surveys. Data was gathered on: 1) usability of eScreening; 2) knowledge about and acceptability and 3) facilitators and barriers to the successful implementation of eScreening.ResultsOverall, staff feedback about eScreening was positive. Knowledge about eScreening ranged widely between the clinics. Nearly all staff felt eScreening would fit well into their clinical setting at pre-implementation; however some felt it was a poor fit with emergent cases and older adults at post-implementation. Lack of adequate personnel support and perceived leadership support were barriers to implementation. Adequate training and technical assistance were cited as important facilitators. One clinic fully implemented eScreening, two partially implemented, and one clinic did not implement eScreening as part of normal practice after 6 months as measured by usage data and self-report. Organizational engagement survey scores were higher among clinics with full or partial implementation and low in the clinic that did not implement.ConclusionsDespite some added work load for some staff and perceived lack of leadership support, eScreening was at least partially implemented in three clinics. The technology itself posed no barriers in any of the settings. An implementation strategy that accounts for increased work burden and includes accountability may help in future eScreening implementation efforts. Note. This abstract was previously published (e.g., Annals of Behavioral Medicine 53: S1-S842, 2019).

Project description:BackgroundCommunication-based activities and products (i.e., training programs, webinars) are a critical component of implementation strategies that relay information to various audiences. Audience perceptions of communication effectiveness contribute important insight into the processes and mechanisms through which an implementation effort may succeed or fail. To advance research on this front, a psychometrically sound instrument for measuring perceived communication effectiveness (PCE) is needed.MethodsAn expert panel identified the theoretical foundations and conceptual domains of PCE and drafted preliminary items. Five focus groups of correctional professionals who had recently completed an implementation leadership training reviewed the items and provided feedback for refinement. Revised items were then included in a survey-based evaluation of an ongoing eLearning curriculum designed to improve the practices used by front-line probation officers in supervising individuals in the field. The factorial structure of a final 6-item scale as well as its convergent, divergent, and predictive validity was evaluated using data from the evaluation surveys (Nfollow-up = 358, Nbaseline+follow-up = 159).ResultsConfirmatory factor analysis of the final scale of PCE demonstrated adequate fit. PCE was strongly correlated with measures of implementation outcomes (acceptability, r = .819, p < .001; appropriateness, r = .809, p < .001; and feasibility, r = .754, p < .001), yet uncorrelated with a scale of need to evaluate (r = - .051, p = .422), demonstrating both convergent and divergent validities. The predictive validity of PCE was evidenced by significant associations between PCE and key training outcomes, including perceived staff use of evidence-based practices (β = .230, p < .05), agency climate (β = .261, p < .05), and value concordance (β = .209, p < .05), after controlling for baseline values and other confounders.ConclusionsThe PCE scale is psychometrically sound and can be a useful tool for gauging audience receptivity to and the potential impact of communication-based implementation activities and products.

Project description:BackgroundDeveloping effective implementation strategies requires adequate tracking and reporting on their application. Guidelines exist for defining and reporting on implementation strategy characteristics, but not for describing how strategies are adapted and modified in practice. We built on existing implementation science methods to provide novel methods for tracking strategy modifications.MethodsThese methods were developed within a stepped-wedge trial of an implementation strategy package designed to help community clinics adopt social determinants of health-related activities: in brief, an 'Implementation Support Team' supports clinics through a multi-step process. These methods involve five components: 1) describe planned strategy; 2) track its use; 3) monitor barriers; 4) describe modifications; and 5) identify / describe new strategies. We used the Expert Recommendations for Implementing Change taxonomy to categorize strategies, Proctor et al.'s reporting framework to describe them, the Consolidated Framework for Implementation Research to code barriers / contextual factors necessitating modifications, and elements of the Framework for Reporting Adaptations and Modifications-Enhanced to describe strategy modifications.ResultsWe present three examples of the use of these methods: 1) modifications made to a facilitation-focused strategy (clinics reported that certain meetings were too frequent, so their frequency was reduced in subsequent wedges); 2) a clinic-level strategy addition which involved connecting one study clinic seeking help with community health worker-related workflows to another that already had such a workflow in place; 3) a study-level strategy addition which involved providing assistance in overcoming previously encountered (rather than de novo) challenges.ConclusionsThese methods for tracking modifications made to implementation strategies build on existing methods, frameworks, and guidelines; however, as none of these were a perfect fit, we made additions to several frameworks as indicated, and used certain frameworks' components selectively. While these methods are time-intensive, and more work is needed to streamline them, they are among the first such methods presented to implementation science. As such, they may be used in research on assessing effective strategy modifications and for replication and scale-up of effective strategies. We present these methods to guide others seeking to document implementation strategies and modifications to their studies.Trial registrationclinicaltrials.gov ID: NCT03607617 (first posted 31/07/2018).

Project description:The increasing demand for palliative care in New Zealand presents a potential threat to the quality of service delivery. One strategy to overcome this is through the implementation of valid and reliable patient-reported outcome measures. This mixed-methods study aimed to (1) implement measurement-based palliative care (MBPC) in a community palliative care service in Auckland, New Zealand; (2) evaluate the clinical utility of MBPC perceived by clinicians; (3) describe patient characteristics as measured by the Integrated Palliative Care Outcome Scale (IPOS), the Australasian Modified Karnofsky Performance Scale (AKPS), and Phase of Illness (POI); and (4) evaluate the internal consistency of the IPOS. Participants were over 18 years of age from a community outpatient palliative care service. In a phased approach to implementation, healthcare staff were educated on each instrument used for patient assessment. Uptake and internal consistency were evaluated through descriptive statistics. An interpretive descriptive methodology was used to explore the clinical utility of MBPC through semi-structured interviews with seven clinical staff members. Individual patient assessments (n = 1507) were undertaken predominantly on admission, with decreasing frequency as patients advanced through to the terminal phase of their care. Mean total IPOS scores were 17.97 (SD = 10.39, α = 0.78). The POI showed that 65% of patients were in the stable phase, 20% were in the unstable phase, 9% were in the deteriorating phase, and 2% were in the terminal phase. Clinicians reported that MBPC facilitated holistic and comprehensive assessments, as well as the development of a common interdisciplinary language. Clinicians expressed discomfort using the psychosocial and spiritual items. Measurement-based palliative care was only partially implemented but it was valued by staff and perceived to increase the quality of service delivery. Future research should determine the optimal timing of assessments, cultural responsivity for Māori and Pacific patients, and the role of MBPC in decision support for clinicians.

Project description:Collaborative-care management is an evidence-based practice for improving depression outcomes in primary care. The Department of Veterans Affairs (VA) has mandated the implementation of collaborative-care management in its satellite clinics, known as Community Based Outpatient Clinics (CBOCs). However, the organizational characteristics of CBOCs present added challenges to implementation. The objective of this study was to evaluate the effectiveness of evidence-based quality improvement (EBQI) as a strategy to facilitate the adoption of collaborative-care management in CBOCs.This nonrandomized, small-scale, multisite evaluation of EBQI was conducted at three VA Medical Centers and 11 of their affiliated CBOCs. The Plan phase of the EBQI process involved the localized tailoring of the collaborative-care management program to each CBOC. Researchers ensured that the adaptations were evidence based. Clinical and administrative staff were responsible for adapting the collaborative-care management program for local needs, priorities, preferences and resources. Plan-Do-Study-Act cycles were used to refine the program over time. The evaluation was based on the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) Framework and used data from multiple sources: administrative records, web-based decision-support systems, surveys, and key-informant interviews.Adoption: 69.0% (58/84) of primary care providers referred patients to the program. Reach: 9.0% (298/3,296) of primary care patients diagnosed with depression who were not already receiving specialty care were enrolled in the program. Fidelity: During baseline care manager encounters, education/activation was provided to 100% (298/298) of patients, barriers were assessed and addressed for 100% (298/298) of patients, and depression severity was monitored for 100% (298/298) of patients. Less than half (42.5%, 681/1603) of follow-up encounters during the acute stage were completed within the timeframe specified. During the acute phase of treatment for all trials, the Patient Health Questionnaire (PHQ9) symptom-monitoring tool was used at 100% (681/681) of completed follow-up encounters, and self-management goals were discussed during 15.3% (104/681) of completed follow-up encounters. During the acute phase of treatment for pharmacotherapy and combination trials, medication adherence was assessed at 99.1% (575/580) of completed follow-up encounters, and side effects were assessed at 92.4% (536/580) of completed follow-up encounters. During the acute phase of treatment for psychotherapy and combination trials, counseling session adherence was assessed at 83.3% (239/287) of completed follow-up encounters. Effectiveness: 18.8% (56/298) of enrolled patients remitted (symptom free) and another 22.1% (66/298) responded to treatment (50% reduction in symptom severity). Maintenance: 91.9% (10/11) of the CBOCs chose to sustain the program after research funds were withdrawn.Provider adoption was good, although reach into the target population was relatively low. Fidelity and maintenance were excellent, and clinical outcomes were comparable to those in randomized controlled trials. Despite the organizational barriers, these findings suggest that EBQI is an effective facilitation strategy for CBOCs.Clinical trial # NCT00317018.

Project description:BackgroundImplementation strategies have flourished in an effort to increase integration of research evidence into clinical practice. Most strategies are complex, socially mediated processes. Many are complicated, expensive, and ultimately impractical to deliver in real-world settings. The field lacks methods to assess the extent to which strategies are usable and aligned with the needs and constraints of the individuals and contexts who will deliver or receive them. Drawn from the field of human-centered design, cognitive walkthroughs are an efficient assessment method with potential to identify aspects of strategies that may inhibit their usability and, ultimately, effectiveness. This article presents a novel walkthrough methodology for evaluating strategy usability as well as an example application to a post-training consultation strategy to support school mental health clinicians to adopt measurement-based care.MethodThe Cognitive Walkthrough for Implementation Strategies (CWIS) is a pragmatic, mixed-methods approach for evaluating complex, socially mediated implementation strategies. CWIS includes six steps: (1) determine preconditions; (2) hierarchical task analysis; (3) task prioritization; (4) convert tasks to scenarios; (5) pragmatic group testing; and (6) usability issue identification, classification, and prioritization. A facilitator conducted two group testing sessions with clinician users (N = 10), guiding participants through 6 scenarios and 11 associated subtasks. Clinicians reported their anticipated likelihood of completing each subtask and provided qualitative justifications during group discussion. Following the walkthrough sessions, users completed an adapted quantitative assessment of strategy usability.ResultsAverage anticipated success ratings indicated substantial variability across participants and subtasks. Usability ratings (scale 0-100) of the consultation protocol averaged 71.3 (SD = 10.6). Twenty-one usability problems were identified via qualitative content analysis with consensus coding, and classified by severity and problem type. High-severity problems included potential misalignment between consultation and clinical service timelines as well as digressions during consultation processes.ConclusionsCWIS quantitative usability ratings indicated that the consultation protocol was at the low end of the "acceptable" range (based on norms from the unadapted scale). Collectively, the 21 resulting usability issues explained the quantitative usability data and provided specific direction for usability enhancements. The current study provides preliminary evidence for the utility of CWIS to assess strategy usability and generate a blueprint for redesign.

Dataset Information

A Method for Tracking Implementation Strategies: An Exemplar Implementing Measurement-Based Care in Community Behavioral Health Clinics.

Publications

A Method for Tracking Implementation Strategies: An Exemplar Implementing Measurement-Based Care in Community Behavioral Health Clinics.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets