Project description:BackgroundQualitative approaches, alone or in mixed methods, are prominent within implementation science. However, traditional qualitative approaches are resource intensive, which has led to the development of rapid qualitative approaches. Published rapid approaches are often inductive in nature and rely on transcripts of interviews. We describe a deductive rapid analysis approach using the Consolidated Framework for Implementation Research (CFIR) that uses notes and audio recordings. This paper compares our rapid versus traditional deductive CFIR approach.MethodsSemi-structured interviews were conducted for two cohorts of the Veterans Health Administration (VHA) Diffusion of Excellence (DoE). The CFIR guided data collection and analysis. In cohort A, we used our traditional CFIR-based deductive analysis approach (directed content analysis), where two analysts completed independent in-depth manual coding of interview transcripts using qualitative software. In cohort B, we used our new rapid CFIR-based deductive analysis approach (directed content analysis), where the primary analyst wrote detailed notes during interviews and immediately "coded" notes into a MS Excel CFIR construct by facility matrix; a secondary analyst then listened to audio recordings and edited the matrix. We tracked time for our traditional and rapid deductive CFIR approaches using a spreadsheet and captured transcription costs from invoices. We retrospectively compared our approaches in terms of effectiveness and rigor.ResultsCohorts A and B were similar in terms of the amount of data collected. However, our rapid deductive CFIR approach required 409.5 analyst hours compared to 683 h during the traditional deductive CFIR approach. The rapid deductive approach eliminated $7250 in transcription costs. The facility-level analysis phase provided the greatest savings: 14 h/facility for the traditional analysis versus 3.92 h/facility for the rapid analysis. Data interpretation required the same number of hours for both approaches.ConclusionOur rapid deductive CFIR approach was less time intensive and eliminated transcription costs, yet effective in meeting evaluation objectives and establishing rigor. Researchers should consider the following when employing our approach: (1) team expertise in the CFIR and qualitative methods, (2) level of detail needed to meet project aims, (3) mode of data to analyze, and (4) advantages and disadvantages of using the CFIR.
Project description:PurposeThe KLIK Patient-Reported Outcome Measure (PROM) portal is an evidence-based intervention implemented in clinical practice in > 25 Dutch hospitals for patients (children and adults) who regularly visit the outpatient clinic. Implementation science frameworks can be used to understand why implementation succeeded or failed, to structure barriers and enablers, and to develop implementation strategies to overcome barriers. This paper aimed to (A) retrospectively describe determinants of successful KLIK PROM implementation using the Consolidated Framework for Implementation Research (CFIR), and (B) identify current barriers and match implementation strategies.Methods(A) The KLIK implementation process was described retrospectively based on literature and experience, using the 39 CFIR constructs organized in five general domains: intervention characteristics, outer setting, inner setting, characteristics of individuals, and implementation process. (B) The CFIR-Expert Recommendations for Implementing Change (ERIC) Implementation Strategy Matching tool identified current barriers in the KLIK implementation and matched implementation strategies that addressed the identified barriers.Results(A) The most prominent determinants of successful KLIK PROM implementation lie in the following CFIR domains: intervention characteristics (e.g., easy to use), characteristics of individuals (e.g., motivation), and process of implementation (e.g., support). (B) 13 CFIR constructs were identified as current barriers for implementing the KLIK PROM portal. The highest overall advised ERIC strategy for the specific KLIK barriers was to identify and prepare champions.ConclusionUsing an implementation science framework, e.g., CFIR, is recommended for groups starting to use PROMs in clinical care as it offers a structured approach and provides insight into possible enablers and barriers.
Project description:BackgroundIn the United States, as in many other parts of the world, the prevalence of overweight/obesity is at epidemic proportions in the adult population and even higher among Veterans. To address the high prevalence of overweight/obesity among Veterans, the MOVE!(®) weight management program was disseminated nationally to Veteran Affairs (VA) medical centers. The objective of this paper is two-fold: to describe factors that explain the wide variation in implementation of MOVE!; and to illustrate, step-by-step, how to apply a theory-based framework using qualitative data.MethodsFive VA facilities were selected to maximize variation in implementation effectiveness and geographic location. Twenty-four key stakeholders were interviewed about their experiences in implementing MOVE!. The Consolidated Framework for Implementation Research (CFIR) was used to guide collection and analysis of qualitative data. Constructs that most strongly influence implementation effectiveness were identified through a cross-case comparison of ratings.ResultsOf the 31 CFIR constructs assessed, ten constructs strongly distinguished between facilities with low versus high program implementation effectiveness. The majority (six) were related to the inner setting: networks and communications; tension for change; relative priority; goals and feedback; learning climate; and leadership engagement. One construct each, from intervention characteristics (relative advantage) and outer setting (patient needs and resources), plus two from process (executing and reflecting) also strongly distinguished between high and low implementation. Two additional constructs weakly distinguished, 16 were mixed, three constructs had insufficient data to assess, and one was not applicable. Detailed descriptions of how each distinguishing construct manifested in study facilities and a table of recommendations is provided.ConclusionsThis paper presents an approach for using the CFIR to code and rate qualitative data in a way that will facilitate comparisons across studies. An online Wiki resource (http://www.wiki.cfirwiki.net) is available, in addition to the information presented here, that contains much of the published information about the CFIR and its constructs and sub-constructs. We hope that the described approach and open access to the CFIR will generate wide use and encourage dialogue and continued refinement of both the framework and approaches for applying it.
Project description:BACKGROUND:Since 2012 Gavi, the Vaccine Alliance has provided financial support for HPV vaccine introduction in low- and middle-income countries (LMICs); however, funding has been contingent on establishing a demonstration project prior to national scale-up, in order to gauge effectiveness of delivery models. Although by 2016, most beneficiary countries had completed demonstration projects, few have scaled up delivery nationwide. An important barrier was the dearth of published, country-specific implementation recommendations. We employed the Consolidated Framework for Implementation Research (CFIR) as a lens to identify drivers of heterogeneous (dissimilar) implementation performance during Mozambique's 2-year demonstration project. Mozambique presents a compelling example as the country conducted demonstration projects in three different districts with extremely different economic resources and sociocultural practices. METHODS:A post implementation interpretive evaluation was undertaken. Forty key informant interviews were conducted with district and health facility immunization staff, Ministry of Education managers, and teachers across the three demonstration districts, central level informants from MOH, research institutes, and immunization program partners. We compared valence and strength ratings of CFIR constructs, across diverse implementation sites, so as to explain drivers and barriers to implementation success. Two researchers coded separately, and subsequent content analysis followed pre-defined CFIR construct themes. RESULTS:Eighteen constructs emerged from informants' responses as implementation influencers. Adaptability was identified as an important construct because delivery modalities needed to meet differing levels of girls' school attendance. Expanding outside of school-based delivery was needed in the low-performing district, making the vaccine delivery process more complex. Available resources varied across the three sites, with one site receiving direct Gavi support, while others received primarily state-based support. These latter sites reported considerably more implementation bottlenecks, in part related to weaker infrastructural characteristics and insufficient organizational incentives. Health workers' beliefs in importance of vaccines and an organizational culture of making personal sacrifice for immunization program activities drove implementation performance. Advocacy and social mobilization through the right opinion leaders and champions generated higher demand. CONCLUSION:HPV vaccination presents a pertinent opportunity for the prevention of cervical cancer in Mozambique, sub-Saharan Africa, and other LMICs. However, important barriers to broad-scale implementation exist. We recommend the development of local and global strategies to overcome barriers and facilitate its expanded utilization.
Project description:The importance of providing evidence-based palliative care for people with dementia is increasingly acknowledged as important for patient outcomes. In Ireland, evidence-based guidance has been developed in order to address key features of dementia palliative care, including the management of pain, medications and hydration and nutrition. The aim of this study was to identify and explore the factors affecting the implementation of evidence-based guidance on dementia palliative care. The Consolidated Framework for Implementation (CFIR) guided a mixed-method pre-post study. One guidance document pertaining to the management of pain, medication or hydration and nutrition was implemented in three long-term care facilities. Participatory action research in the form of work-based learning groups was used to implement the guidance, drawing on a situational analysis (pre-implementation). Staff questionnaires and audits were conducted pre- and post-implementation while champion interviews were also conducted post-implementation. Features of the guidance, the inner setting components such as readiness to change, and the process of implementation were most frequently identified as impacting implementation. Components of the outer setting, such as external policy incentives and individual characteristics, featured less commonly. Data from qualitative interviews revealed that the guidance was perceived as advantageous or complimentary to previous care provided. Within the inner setting, leadership and support from other colleagues facilitated implementation. However, limited availability of other healthcare professionals to assist with carrying out guidance actions presented a barrier in some facilities. The external facilitators of the work-based learning groups (WBLGs) were perceived as experienced and encouraged active participation and reflection on practices. Despite the challenge of releasing staff to attend the WBLGs, quantitative data demonstrated reduced staff de-motivation amongst those who did attend was noted post-implementation (pre-Mdn = 19.50 versus post-Mdn = 22.00, U = 497.00, p = 0.07). A situational analysis informed by the CFIR framework in conjunction with a participatory action research approach helped to advance the implementation of the guidance. The progress of implementation depended on the extent to which evidence-based care was previously being implemented at each site. Post-implementation analysis using CFIR identified challenges to address in future projects such as staff cover and timing of training to facilitate attendance for staff with different working hours. Facilitators included multidisciplinary engagement with the intervention and champions at each site to support the implementation process.
Project description:BackgroundThe COVID-19 pandemic created major challenges in long-term care (LTC) homes across Canada and globally. A nurse practitioner-led interdisciplinary huddle intervention was developed to support staff wellbeing in two LTC homes in Ontario, Canada. The objective of this study was to identify the constructs strongly influencing the process of implementation of huddles across both sites, capturing the overall barriers and facilitators and the intervention's intrinsic properties.MethodsNineteen participants were interviewed about their experiences, pre-, post-, and during huddle implementation. The Consolidated Framework for Implementation Research (CFIR) was used to guide data collection and analysis. CFIR rating rules and a cross-comparison analysis was used to identify differentiating factors between sites. A novel extension to the CFIR analysis process was designed to assess commonly influential factors across both sites.ResultsNineteen of twenty selected CFIR constructs were coded in interviews from both sites. Five constructs were determined to be strongly influential across both implementation sites and a detailed description is provided: evidence strength and quality; needs and resources of those served by the organization; leadership engagement; relative priority; and champions. A summary of ratings and an illustrative quote are provided for each construct.ConclusionSuccessful huddles require long-term care leaders to consider their involvement, the inclusion all team members to help build relationships and foster cohesion, and the integration of nurse practitioners as full-time staff members within LTC homes to support staff and facilitate initiatives for wellbeing. This research provides an example of a novel approach using the CFIR methodology, extending its use to identify significant factors for implementation when it is not possible to compare differences in success.
Project description:BackgroundMuch research does not address the practical needs of stakeholders responsible for introducing health care delivery interventions into organizations working to achieve better outcomes. In this article, we present an approach to using the Consolidated Framework for Implementation Research (CFIR) to guide systematic research that supports rapid-cycle evaluation of the implementation of health care delivery interventions and produces actionable evaluation findings intended to improve implementation in a timely manner.MethodsTo present our approach, we describe a formative cross-case qualitative investigation of 21 primary care practices participating in the Comprehensive Primary Care (CPC) initiative, a multi-payer supported primary care practice transformation intervention led by the Centers for Medicare and Medicaid Services. Qualitative data include observational field notes and semi-structured interviews with primary care practice leadership, clinicians, and administrative and medical support staff. We use intervention-specific codes, and CFIR constructs to reduce and organize the data to support cross-case analysis of patterns of barriers and facilitators relating to different CPC components.ResultsUsing the CFIR to guide data collection, coding, analysis, and reporting of findings supported a systematic, comprehensive, and timely understanding of barriers and facilitators to practice transformation. Our approach to using the CFIR produced actionable findings for improving implementation effectiveness during this initiative and for identifying improvements to implementation strategies for future practice transformation efforts.ConclusionsThe CFIR is a useful tool for guiding rapid-cycle evaluation of the implementation of practice transformation initiatives. Using the approach described here, we systematically identified where adjustments and refinements to the intervention could be made in the second year of the 4-year intervention. We think the approach we describe has broad application and encourage others to use the CFIR, along with intervention-specific codes, to guide the efficient and rigorous analysis of rich qualitative data.Trial registrationNCT02318108.
Project description:BackgroundThe concept of intersectionality proposes that demographic and social constructs intersect with larger social structures of oppression and privilege to shape experiences. While intersectionality is a widely accepted concept in feminist and gender studies, there has been little attempt to use this lens in implementation science. We aimed to supplement the Consolidated Framework for Implementation Research (CFIR), a commonly used framework in implementation science, to support the incorporation of intersectionality in implementation science projects by (1) integrating an intersectional lens to the CFIR; and (2) developing a tool for researchers to be used alongside the updated framework.MethodsUsing a nominal group technique, an interdisciplinary framework committee (n = 17) prioritized the CFIR as one of three implementation science models, theories, and frameworks to supplement with intersectionality considerations; the modification of the other two frameworks are described in other papers. The CFIR subgroup (n = 7) reviewed the five domains and 26 constructs in the CFIR and prioritized domains and constructs for supplementation with intersectional considerations. The subgroup then iteratively developed recommendations and prompts for incorporating an intersectional approach within the prioritized domains and constructs. We developed recommendations and prompts to help researchers consider how personal identities and power structures may affect the facilitators and inhibitors of behavior change and the implementation of subsequent interventions.ResultsWe achieved consensus on how to apply an intersectional lens to CFIR after six rounds of meetings. The final intersectionality supplemented CFIR includes the five original domains, and 28 constructs; the outer systems and structures and the outer cultures constructs were added to the outer setting domain. Intersectionality prompts were added to 13 of the 28 constructs.ConclusionThrough an expert-consensus approach, we modified the CFIR to include intersectionality considerations and developed a tool with prompts to help implementation users apply an intersectional lens using the updated framework.
Project description:Background The Consolidated Framework for Implementation Research (CFIR), introduced in 2009, has the potential to provide a comprehensive understanding of the determinants of implementation-effectiveness of health service innovations. Although the CFIR has been increasingly used in recent years to examine factors influencing telehealth implementation, no comprehensive reviews currently exist on the scope of knowledge gained exclusively from applications of the CFIR to telehealth implementation initiatives. This review sought to address this gap. Methods PRISMA-ScR criteria were used to inform a scoping review of the literature. Five academic databases (PUBMED, PROQUEST, SCIDIRECT, CINAHL, and WoS) were searched for eligible sources of evidence from 01.01.2010 through 12.31.2021. The initial search yielded a total of 18,388 records, of which, 64 peer-reviewed articles met the inclusion criteria for the review. Included articles were reviewed in full to extract data, and data collected were synthesized to address the review questions. Results Most included articles were published during or after 2020 (64%), and a majority (77%) were qualitative or mixed-method studies seeking to understand barriers or facilitators to telehealth implementation using the CFIR. There were few comparative- or implementation-effectiveness studies containing outcome measures (5%). The database search however, revealed a growing number of protocols for implementation-effectiveness studies published since 2020. Most articles (91%) reported the CFIR Inner Setting domain (e.g., leadership engagement) to have a predominant influence over telehealth implementation success. By comparison, few articles (14%) reported the CFIR Outer Setting domain (e.g., telehealth policies) to have notable influence. While more (63%) telehealth initiatives were focused on specialty (vs primary) care, a vast majority (78%) were focused on clinical practice over medical education, healthcare administration, or population health. Conclusions Organized provider groups have historically paid considerable attention to advocating for telehealth policy (Outer Setting) reform. However, results suggest that for effective telehealth implementation, provider groups need to refocus their efforts on educating individual providers on the complex inter-relationships between Inner Setting constructs and telehealth implementation-effectiveness. On a separate note, the growth in implementation-effectiveness study protocols since 2020, suggests that additional outcome measures may soon be available, to provide a more nuanced understanding of the determinants of effective telehealth implementation based on the CFIR domains and constructs. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-022-08871-w.
Project description:BackgroundWe investigated the implementation process of an Integrated Community Approach (ICA) applied in four low socio-economic status neighbourhoods in Maastricht, the Netherlands. The ICA is a Population Health Management initiative and aims to improve population health, quality of care, professional's satisfaction and decrease costs of care. This study addresses the facilitators and barriers for implementing the ICA from a stakeholder perspective, including steering group members, professionals and citizens.MethodsWe conducted a mixed-methods study using a triangulation of methods to investigate the implementation from 1 December 2016 to 31 December 2020. The Consolidated Framework for Implementation Research guided data collection and data-analysis for evaluating the implementation process. In total, 77 interviews, 97 observations, seven focus groups, 65 collected documents and two surveys with open-ended questions were conducted.ResultsFacilitators for implementation were the use of citizen science to bring residents' needs into sharp focus, the integration of the ideology of Positive Health into the working routines of the professionals and leadership at the steering group level to overcome barriers in the ICA. The existing accounting and financial infrastructure obstructed combining budgets at neighbourhood level.ConclusionsEngaging citizens and professionals at an early stage is an important facilitator for implementation. The use of a shared vision on health also worked as a facilitator since it created a shared language among professionals, which is important in Population Health Management initiatives where multiple professionals are expected to collaborate.Trial registrationNTR 6543; registration date, 25 July 2017.