Dataset Information

Measurement of a model of implementation for health care: toward a testable theory.

ABSTRACT:

Background

Greenhalgh et al. used a considerable evidence-base to develop a comprehensive model of implementation of innovations in healthcare organizations [1]. However, these authors did not fully operationalize their model, making it difficult to test formally. The present paper represents a first step in operationalizing Greenhalgh et al.'s model by providing background, rationale, working definitions, and measurement of key constructs.

Methods

A systematic review of the literature was conducted for key words representing 53 separate sub-constructs from six of the model's broad constructs. Using an iterative process, we reviewed existing measures and utilized or adapted items. Where no one measure was deemed appropriate, we developed other items to measure the constructs through consensus.

Results

The review and iterative process of team consensus identified three types of data that can been used to operationalize the constructs in the model: survey items, interview questions, and administrative data. Specific examples of each of these are reported.

Conclusion

Despite limitations, the mixed-methods approach to measurement using the survey, interview measure, and administrative data can facilitate research on implementation by providing investigators with a measurement tool that captures most of the constructs identified by the Greenhalgh model. These measures are currently being used to collect data concerning the implementation of two evidence-based psychotherapies disseminated nationally within Department of Veterans Affairs. Testing of psychometric properties and subsequent refinement should enhance the utility of the measures.

SUBMITTER: Cook JM

PROVIDER: S-EPMC3541168 | biostudies-literature | 2012 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measurement of a model of implementation for health care: toward a testable theory.

Cook Joan M JM O'Donnell Casey C Dinnen Stephanie S Coyne James C JC Ruzek Josef I JI Schnurr Paula P PP

Implementation science : IS 20120703

<h4>Background</h4>Greenhalgh et al. used a considerable evidence-base to develop a comprehensive model of implementation of innovations in healthcare organizations [1]. However, these authors did not fully operationalize their model, making it difficult to test formally. The present paper represents a first step in operationalizing Greenhalgh et al.'s model by providing background, rationale, working definitions, and measurement of key constructs.<h4>Methods</h4>A systematic review of the liter ...[more]

PMID: 22759451

Similar Datasets

Project description:OBJECTIVE:To develop a resource allocation model to optimize health departments' Centers for Disease Control and Prevention (CDC)-funded HIV prevention budgets to prevent the most new cases of HIV infection and to evaluate the model's implementation in 4 health departments. DESIGN, SETTINGS, AND PARTICIPANTS:We developed a linear programming model combined with a Bernoulli process model that allocated a fixed budget among HIV prevention interventions and risk subpopulations to maximize the number of new infections prevented. The model, which required epidemiologic, behavioral, budgetary, and programmatic data, was implemented in health departments in Philadelphia, Chicago, Alabama, and Nebraska. MAIN OUTCOME MEASURES:The optimal allocation of funds, the site-specific cost per case of HIV infection prevented rankings by intervention, and the expected number of HIV cases prevented. RESULTS:The model suggested allocating funds to HIV testing and continuum-of-care interventions in all 4 health departments. The most cost-effective intervention for all sites was HIV testing in nonclinical settings for men who have sex with men, and the least cost-effective interventions were behavioral interventions for HIV-negative persons. The pilot sites required 3 to 4 months of technical assistance to develop data inputs and generate and interpret the results. Although the sites found the model easy to use in providing quantitative evidence for allocating HIV prevention resources, they criticized the exclusion of structural interventions and the use of the model to allocate only CDC funds. CONCLUSIONS:Resource allocation models have the potential to improve the allocation of limited HIV prevention resources and can be used as a decision-making guide for state and local health departments. Using such models may require substantial staff time and technical assistance. These model results emphasize the allocation of CDC funds toward testing and continuum-of-care interventions and populations at highest risk of HIV transmission.

Project description:BackgroundHubbell's 2001 neutral theory unifies biodiversity and biogeography by modelling steady-state distributions of species richness and abundances across spatio-temporal scales. Accurate predictions have issued from its core premise that all species have identical vital rates. Yet no ecologist believes that species are identical in reality. Here I explain this paradox in terms of the ecological equivalence that species must achieve at their coexistence equilibrium, defined by zero net fitness for all regardless of intrinsic differences between them. I show that the distinction of realised from intrinsic vital rates is crucial to evaluating community resilience.Principal findingsAn analysis of competitive interactions reveals how zero-sum patterns of abundance emerge for species with contrasting life-history traits as for identical species. I develop a stochastic model to simulate community assembly from a random drift of invasions sustaining the dynamics of recruitment following deaths and extinctions. Species are allocated identical intrinsic vital rates for neutral dynamics, or random intrinsic vital rates and competitive abilities for niche dynamics either on a continuous scale or between dominant-fugitive extremes. Resulting communities have steady-state distributions of the same type for more or less extremely differentiated species as for identical species. All produce negatively skewed log-normal distributions of species abundance, zero-sum relationships of total abundance to area, and Arrhenius relationships of species to area. Intrinsically identical species nevertheless support fewer total individuals, because their densities impact as strongly on each other as on themselves. Truly neutral communities have measurably lower abundance/area and higher species/abundance ratios.ConclusionsNeutral scenarios can be parameterized as null hypotheses for testing competitive release, which is a sure signal of niche dynamics. Ignoring the true strength of interactions between and within species risks a substantial misrepresentation of community resilience to habitat loss.

Project description:BackgroundAlthough eMental health interventions are a viable solution to address disparities in access to mental healthcare and increase its efficiency, they still face challenges of implementation. Literature highlights numerous barriers such as diffusion of responsibility and unclear expectations of what implementation entails might hinder this process. While research mostly focuses on analyzing these barriers, there is an urgent need to increase uptake in practice. In turn, commercial companies focus mostly on increasing uptake, while overlooking research outputs. To bridge the gap between research and practice, attention to how implementation occurs in practice is required. This study investigates "Make it Happen" (MiH), the implementation model developed by the eMental Health company Minddistrict, aiming to gain more insight into operationalizing implementation frameworks by 1) describing MiH and its conceptual underpinnings, and 2) gaining lessons learned from the development of MiH. Ultimately, this work aims at improving existing scientific frameworks by extending them with knowledge from practice.MethodsFirst, individual interviews and focus groups with Minddistrict implementation managers were performed. Second, individual interviews with project leads in mental healthcare organizations that were involved in the implementation of Minddistrict were conducted. Within Minddistrict, 7 implementation managers and account managers were involved, in addition to 11 project leads from mental healthcare organizations. Data were elaborated with thematic analysis.ResultsA comprehensive description of MiH and its 5 main phases was achieved. During the 1) Onboarding phase, implementing organizations are guided by Minddistrict to build a team responsible for implementation, which then 2) designs patient and client journeys, 3) builds, tailors and configures their offer, 4) trains key-users and, 5) evaluates the success of implementation. All participants had extensive and aligned definitions and articulated expectations on implementation. Points of improvement for the model such as role ambiguity and excessive workload were identified. As strengths, internal motivation and good relationships with the provider were valued.ConclusionThe present study highlights the importance of clear role division and stakeholder engagement in implementation processes, and suggest that a strong collaboration between companies and academia could optimize implementation efforts and ensure a better fit between humans, context, and technologies.

Project description:Alcohol measurement delivered by health care providers in primary health care settings is an efficacious and cost-effective intervention to reduce alcohol consumption among patients. However, this intervention is not yet routinely implemented in practice. Community support has been recommended as a strategy to stimulate the delivery of alcohol measurement by health care providers, yet evidence on the effectiveness of community support in this regard is scarce. The current study used a pre-post quasi-experimental design in order to investigate the effect of community support in three Latin American municipalities in Colombia, Mexico, and Peru on health care providers' rates of measuring alcohol consumption in their patients. The analysis is based on the first 5 months of implementation. Moreover, the study explored possible mechanisms underlying the effects of community support, through health care providers' awareness of support, as well as their attitudes, subjective norms, self-efficacy, and subsequent intention toward delivering the intervention. An ANOVA test indicated that community support had a significant effect on health care providers' rates of measuring alcohol consumption in their patients (F (1, 259) = 4.56, p = 0.034, ηp2 = 0.018). Moreover, a path analysis showed that community support had a significant indirect positive effect on providers' self-efficacy to deliver the intervention (b = 0.07, p = 0.008), which was mediated through awareness of support. Specifically, provision of community support resulted in a higher awareness of support among health care providers (b = 0.31, p < 0.001), which then led to higher self-efficacy to deliver brief alcohol advice (b = 0.23, p = 0.010). Results indicate that adoption of an alcohol measurement intervention by health care providers may be aided by community support, by directly impacting the rates of alcohol measurement sessions, and by increasing providers' self-efficacy to deliver this intervention, through increased awareness of support. Trial Registration ID: NCT03524599; Registered 15 May 2018; https://clinicaltrials.gov/ct2/show/NCT03524599.

Project description:BackgroundThis paper reports on a qualitative evaluation of a hybrid type II stepped-wedge, cluster randomized trial using implementation facilitation to implement team-based care in the form of the collaborative chronic care model (CCM) in interdisciplinary outpatient mental health teams. The objective of this analysis is to compare the alignment of sites' clinical processes with the CCM elements at baseline (time 1) and after 12 months of implementation facilitation (time 2) from the perspective of providers.MethodsWe conducted semi-structured interviews to assess the extent to which six CCM elements were in place: work role redesign, patient self-management support, provider decision support, clinical information systems, linkages to community resources, and organizational/leadership support. Interviews were transcribed and a priori CCM elements were coded using a directed content analysis approach at times 1 and 2. We sought consensus on, and compared, the extent to which each CCM element was in place at times 1 and 2.ResultsWe conducted 27 and 31 telephone interviews at times 1 and 2, respectively, with outpatient mental health providers at nine participating sites. At time 1 and time 2, three CCM elements were most frequently present across the sites: work role redesign, patient self-management support, and provider decision support. The CCM elements with increased implementation from time 1 to time 2 were work role redesign, patient self-management support, and clinical information systems. For two CCM elements, linkages to community resources and organizational/leadership support, some sites had increased implementation at time 2 compared to time 1, while others had reductions. For the provider decision support element, we saw little change in the extent of its implementation.ConclusionsSites increased the extent of implementation on several CCM elements. The most progress was made in the CCM elements where sites had CCM-aligned processes in place at time 1. Teams made progress on elements they could more easily control, such as work role redesign. Our results suggest that maximizing the benefits of CCM-based outpatient mental health care may require targeting resources and training toward specific CCM elements-especially in the use of clinical information systems and linking with community resources.Trial registrationClinical Trials NCT02543840 .

Project description:Implementation experts suggest tailoring strategies to the intended context may enhance outcomes. However, it remains unclear which strategies are best suited to address specific barriers to implementation, in part because few measurement methods exist that adhere to recommendations for reporting. In the context of a dynamic cluster randomized trial comparing a standardized to tailored approach to implementing measurement-based care (MBC), this study aimed to (a) describe a method for tracking implementation strategies, (b) demonstrate the method by tracking strategies generated by teams tasked with implementing MBC at their clinics in the tailored condition, and (c) conduct preliminary examinations of the relation between strategy use and implementation outcomes (i.e., self-reported fidelity to MBC). The method consisted of a coding form based on Proctor, Powell, and McMillen (2013) implementation strategy reporting guidelines and Powell et al.'s (2012) taxonomy to facilitate specification of the strategies. A trained research specialist coded digitally recorded implementation team meetings. The method allowed for the following characterization of strategy use. Each site generated 39 unique strategies across an average of six meetings in five months. There was little variability in the use of types of implementation strategies across sites with the following order of prevalence: quality management (50.00%), restructuring (16.53%), communication (15.68%), education (8.90%), planning (7.20%), and financing (1.69%). We identified a new category of strategies not captured by the existing taxonomy, labeled "communication." There was no evidence that number of implementation strategies enacted was statistically significantly associated with changes in self-reported fidelity to MBC-however, financing strategies were associated with increased fidelity. This method has the capacity to yield rich data that will inform investigations into tailored implementation approaches.

Project description:BackgroundTailored implementation approaches are touted as superior to standardized ones with the reasoning that tailored approaches afford opportunities to select strategies to resolve determinants of the local context. However, results from implementation trials on this topic are equivocal. Therefore, it is important to explore relevant contextual factors that function as determinants to evaluate if they are improved by tailoring and subsequently associated with changes in implementation outcomes (i.e., via statistical mediation) to better understand how tailoring achieves (or does not achieve) its effects. The present study examined the association between a tailored and standardized implementation approach, contextual factors that might mediate change, and a target implementation outcome in an initiative to implement measurement-based care (specifically the clinical integration of the Patient Health Questionnaire [PHQ-9] for depression) in a community mental health organization.MethodsUsing a cluster randomized control design, twelve community-based mental health clinics were assigned to a tailored or standardized implementation group. Clinicians completed a self-report battery assessing contextual factors that served as candidate mediators informed by the Framework for Dissemination at three time points: baseline, 5 months after active implementation support, and 10 months after sustainment monitoring. A subset of clinicians also participated in focus groups at 5 months. The routine use of the PHQ-9 (implementation outcome) was monitored during the 10-month sustainment period. Multi-level mediation analyses assessed the association between the implementation group and contextual factors and the association between contextual factors and PHQ-9 completion. Quantitative results were then elaborated by analyzing qualitative data from exemplar sites.ResultsAlthough tailored clinics outperformed standard clinics in terms of PHQ-9 completion at the end of active implementation, these group differences disappeared post sustainment monitoring. Perhaps related to this, no significant mediators emerged from our quantitative analyses. Exploratory qualitative analyses of focus group content emphasized the importance of support from colleagues, supervisors, and leadership when implementing clinical innovations in practice.ConclusionsAlthough rates of PHQ-9 completion improved across the study, their sustained levels were roughly equivalent across groups and low overall. No mediators were established using quantitative methods; however, several partial quantitative pathways, as well as themes from the qualitative data, reveal fruitful areas for future research.Trial registrationStandardized versus tailored implementation of measurement-based care for depression.Clinicaltrialsgov NCT02266134, first posted on October 16, 2014.

Project description:BACKGROUND:Successfully implementing eMental health (eMH) interventions in routine mental health care constitutes a major challenge. Reliable instruments to assess implementation progress are essential. The Normalization MeAsure Development (NoMAD) study developed a brief self-report questionnaire that could be helpful in measuring implementation progress. Based on the Normalization Process Theory, this instrument focuses on 4 generative mechanisms involved in implementation processes: coherence, cognitive participation, collective action, and reflexive monitoring. OBJECTIVE:The aim of this study was to translate the NoMAD questionnaire to Dutch and to confirm the factor structure in Dutch mental health care settings. METHODS:Dutch mental health care professionals involved in eMH implementation were invited to complete the translated NoMAD questionnaire. Confirmatory factor analysis (CFA) was conducted to verify interpretability of scale scores for 3 models: (1) the theoretical 4-factor structure, (2) a unidimensional model, and (3) a hierarchical model. Potential improvements were explored, and correlated scale scores with 3 control questions were used to assess convergent validity. RESULTS:A total of 262 professionals from mental health care settings in the Netherlands completed the questionnaire (female: 81.7%; mean age: 45 [SD=11]). The internal consistency of the 20-item questionnaire was acceptable (.62≤alpha≤.85). The theorized 4-factor model fitted the data slightly better in the CFA than the hierarchical model (Comparative Fit Index=0.90, Tucker Lewis Index=0.88, Root Mean Square Error of Approximation=0.10, Standardized Root Mean Square Residual=0.12, χ22=22.5, P≤.05). However, the difference is small and possibly not outweighing the practical relevance of a total score and subscale scores combined in one hierarchical model. One item was identified as weak (λCA.2=0.10). A moderate-to-strong convergent validity with 3 control questions was found for the Collective Participation scale (.47≤r≤.54, P≤.05). CONCLUSIONS:NoMAD's theoretical factor structure was confirmed in Dutch mental health settings to acceptable standards but with room for improvement. The hierarchical model might prove useful in increasing the practical utility of the NoMAD questionnaire by combining a total score with information on the 4 generative mechanisms. Future research should assess the predictive value and responsiveness over time and elucidate the conceptual interpretability of NoMAD in eMH implementation practices.

Dataset Information

Measurement of a model of implementation for health care: toward a testable theory.

Background

Methods

Results

Conclusion

Publications

Measurement of a model of implementation for health care: toward a testable theory.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets