Dataset Information

Rapid versus traditional qualitative analysis using the Consolidated Framework for Implementation Research (CFIR).

ABSTRACT:

Background

Qualitative approaches, alone or in mixed methods, are prominent within implementation science. However, traditional qualitative approaches are resource intensive, which has led to the development of rapid qualitative approaches. Published rapid approaches are often inductive in nature and rely on transcripts of interviews. We describe a deductive rapid analysis approach using the Consolidated Framework for Implementation Research (CFIR) that uses notes and audio recordings. This paper compares our rapid versus traditional deductive CFIR approach.

Methods

Semi-structured interviews were conducted for two cohorts of the Veterans Health Administration (VHA) Diffusion of Excellence (DoE). The CFIR guided data collection and analysis. In cohort A, we used our traditional CFIR-based deductive analysis approach (directed content analysis), where two analysts completed independent in-depth manual coding of interview transcripts using qualitative software. In cohort B, we used our new rapid CFIR-based deductive analysis approach (directed content analysis), where the primary analyst wrote detailed notes during interviews and immediately "coded" notes into a MS Excel CFIR construct by facility matrix; a secondary analyst then listened to audio recordings and edited the matrix. We tracked time for our traditional and rapid deductive CFIR approaches using a spreadsheet and captured transcription costs from invoices. We retrospectively compared our approaches in terms of effectiveness and rigor.

Results

Cohorts A and B were similar in terms of the amount of data collected. However, our rapid deductive CFIR approach required 409.5 analyst hours compared to 683 h during the traditional deductive CFIR approach. The rapid deductive approach eliminated $7250 in transcription costs. The facility-level analysis phase provided the greatest savings: 14 h/facility for the traditional analysis versus 3.92 h/facility for the rapid analysis. Data interpretation required the same number of hours for both approaches.

Conclusion

Our rapid deductive CFIR approach was less time intensive and eliminated transcription costs, yet effective in meeting evaluation objectives and establishing rigor. Researchers should consider the following when employing our approach: (1) team expertise in the CFIR and qualitative methods, (2) level of detail needed to meet project aims, (3) mode of data to analyze, and (4) advantages and disadvantages of using the CFIR.

SUBMITTER: Nevedal AL

PROVIDER: S-EPMC8252308 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMuch research does not address the practical needs of stakeholders responsible for introducing health care delivery interventions into organizations working to achieve better outcomes. In this article, we present an approach to using the Consolidated Framework for Implementation Research (CFIR) to guide systematic research that supports rapid-cycle evaluation of the implementation of health care delivery interventions and produces actionable evaluation findings intended to improve implementation in a timely manner.MethodsTo present our approach, we describe a formative cross-case qualitative investigation of 21 primary care practices participating in the Comprehensive Primary Care (CPC) initiative, a multi-payer supported primary care practice transformation intervention led by the Centers for Medicare and Medicaid Services. Qualitative data include observational field notes and semi-structured interviews with primary care practice leadership, clinicians, and administrative and medical support staff. We use intervention-specific codes, and CFIR constructs to reduce and organize the data to support cross-case analysis of patterns of barriers and facilitators relating to different CPC components.ResultsUsing the CFIR to guide data collection, coding, analysis, and reporting of findings supported a systematic, comprehensive, and timely understanding of barriers and facilitators to practice transformation. Our approach to using the CFIR produced actionable findings for improving implementation effectiveness during this initiative and for identifying improvements to implementation strategies for future practice transformation efforts.ConclusionsThe CFIR is a useful tool for guiding rapid-cycle evaluation of the implementation of practice transformation initiatives. Using the approach described here, we systematically identified where adjustments and refinements to the intervention could be made in the second year of the 4-year intervention. We think the approach we describe has broad application and encourage others to use the CFIR, along with intervention-specific codes, to guide the efficient and rigorous analysis of rich qualitative data.Trial registrationNCT02318108.

Project description:BackgroundIn the United States, as in many other parts of the world, the prevalence of overweight/obesity is at epidemic proportions in the adult population and even higher among Veterans. To address the high prevalence of overweight/obesity among Veterans, the MOVE!(®) weight management program was disseminated nationally to Veteran Affairs (VA) medical centers. The objective of this paper is two-fold: to describe factors that explain the wide variation in implementation of MOVE!; and to illustrate, step-by-step, how to apply a theory-based framework using qualitative data.MethodsFive VA facilities were selected to maximize variation in implementation effectiveness and geographic location. Twenty-four key stakeholders were interviewed about their experiences in implementing MOVE!. The Consolidated Framework for Implementation Research (CFIR) was used to guide collection and analysis of qualitative data. Constructs that most strongly influence implementation effectiveness were identified through a cross-case comparison of ratings.ResultsOf the 31 CFIR constructs assessed, ten constructs strongly distinguished between facilities with low versus high program implementation effectiveness. The majority (six) were related to the inner setting: networks and communications; tension for change; relative priority; goals and feedback; learning climate; and leadership engagement. One construct each, from intervention characteristics (relative advantage) and outer setting (patient needs and resources), plus two from process (executing and reflecting) also strongly distinguished between high and low implementation. Two additional constructs weakly distinguished, 16 were mixed, three constructs had insufficient data to assess, and one was not applicable. Detailed descriptions of how each distinguishing construct manifested in study facilities and a table of recommendations is provided.ConclusionsThis paper presents an approach for using the CFIR to code and rate qualitative data in a way that will facilitate comparisons across studies. An online Wiki resource (http://www.wiki.cfirwiki.net) is available, in addition to the information presented here, that contains much of the published information about the CFIR and its constructs and sub-constructs. We hope that the described approach and open access to the CFIR will generate wide use and encourage dialogue and continued refinement of both the framework and approaches for applying it.

Project description:BackgroundSince 2012 Gavi, the Vaccine Alliance has provided financial support for HPV vaccine introduction in low- and middle-income countries (LMICs); however, funding has been contingent on establishing a demonstration project prior to national scale-up, in order to gauge effectiveness of delivery models. Although by 2016, most beneficiary countries had completed demonstration projects, few have scaled up delivery nationwide. An important barrier was the dearth of published, country-specific implementation recommendations. We employed the Consolidated Framework for Implementation Research (CFIR) as a lens to identify drivers of heterogeneous (dissimilar) implementation performance during Mozambique's 2-year demonstration project. Mozambique presents a compelling example as the country conducted demonstration projects in three different districts with extremely different economic resources and sociocultural practices.MethodsA post implementation interpretive evaluation was undertaken. Forty key informant interviews were conducted with district and health facility immunization staff, Ministry of Education managers, and teachers across the three demonstration districts, central level informants from MOH, research institutes, and immunization program partners. We compared valence and strength ratings of CFIR constructs, across diverse implementation sites, so as to explain drivers and barriers to implementation success. Two researchers coded separately, and subsequent content analysis followed pre-defined CFIR construct themes.ResultsEighteen constructs emerged from informants' responses as implementation influencers. Adaptability was identified as an important construct because delivery modalities needed to meet differing levels of girls' school attendance. Expanding outside of school-based delivery was needed in the low-performing district, making the vaccine delivery process more complex. Available resources varied across the three sites, with one site receiving direct Gavi support, while others received primarily state-based support. These latter sites reported considerably more implementation bottlenecks, in part related to weaker infrastructural characteristics and insufficient organizational incentives. Health workers' beliefs in importance of vaccines and an organizational culture of making personal sacrifice for immunization program activities drove implementation performance. Advocacy and social mobilization through the right opinion leaders and champions generated higher demand.ConclusionHPV vaccination presents a pertinent opportunity for the prevention of cervical cancer in Mozambique, sub-Saharan Africa, and other LMICs. However, important barriers to broad-scale implementation exist. We recommend the development of local and global strategies to overcome barriers and facilitate its expanded utilization.

Project description:The importance of providing evidence-based palliative care for people with dementia is increasingly acknowledged as important for patient outcomes. In Ireland, evidence-based guidance has been developed in order to address key features of dementia palliative care, including the management of pain, medications and hydration and nutrition. The aim of this study was to identify and explore the factors affecting the implementation of evidence-based guidance on dementia palliative care. The Consolidated Framework for Implementation (CFIR) guided a mixed-method pre-post study. One guidance document pertaining to the management of pain, medication or hydration and nutrition was implemented in three long-term care facilities. Participatory action research in the form of work-based learning groups was used to implement the guidance, drawing on a situational analysis (pre-implementation). Staff questionnaires and audits were conducted pre- and post-implementation while champion interviews were also conducted post-implementation. Features of the guidance, the inner setting components such as readiness to change, and the process of implementation were most frequently identified as impacting implementation. Components of the outer setting, such as external policy incentives and individual characteristics, featured less commonly. Data from qualitative interviews revealed that the guidance was perceived as advantageous or complimentary to previous care provided. Within the inner setting, leadership and support from other colleagues facilitated implementation. However, limited availability of other healthcare professionals to assist with carrying out guidance actions presented a barrier in some facilities. The external facilitators of the work-based learning groups (WBLGs) were perceived as experienced and encouraged active participation and reflection on practices. Despite the challenge of releasing staff to attend the WBLGs, quantitative data demonstrated reduced staff de-motivation amongst those who did attend was noted post-implementation (pre-Mdn = 19.50 versus post-Mdn = 22.00, U = 497.00, p = 0.07). A situational analysis informed by the CFIR framework in conjunction with a participatory action research approach helped to advance the implementation of the guidance. The progress of implementation depended on the extent to which evidence-based care was previously being implemented at each site. Post-implementation analysis using CFIR identified challenges to address in future projects such as staff cover and timing of training to facilitate attendance for staff with different working hours. Facilitators included multidisciplinary engagement with the intervention and champions at each site to support the implementation process.

Project description:BackgroundThe Consolidated Framework for Implementation Research (CFIR), introduced in 2009, has the potential to provide a comprehensive understanding of the determinants of implementation-effectiveness of health service innovations. Although the CFIR has been increasingly used in recent years to examine factors influencing telehealth implementation, no comprehensive reviews currently exist on the scope of knowledge gained exclusively from applications of the CFIR to telehealth implementation initiatives. This review sought to address this gap.MethodsPRISMA-ScR criteria were used to inform a scoping review of the literature. Five academic databases (PUBMED, PROQUEST, SCIDIRECT, CINAHL, and WoS) were searched for eligible sources of evidence from 01.01.2010 through 12.31.2021. The initial search yielded a total of 18,388 records, of which, 64 peer-reviewed articles met the inclusion criteria for the review. Included articles were reviewed in full to extract data, and data collected were synthesized to address the review questions.ResultsMost included articles were published during or after 2020 (64%), and a majority (77%) were qualitative or mixed-method studies seeking to understand barriers or facilitators to telehealth implementation using the CFIR. There were few comparative- or implementation-effectiveness studies containing outcome measures (5%). The database search however, revealed a growing number of protocols for implementation-effectiveness studies published since 2020. Most articles (91%) reported the CFIR Inner Setting domain (e.g., leadership engagement) to have a predominant influence over telehealth implementation success. By comparison, few articles (14%) reported the CFIR Outer Setting domain (e.g., telehealth policies) to have notable influence. While more (63%) telehealth initiatives were focused on specialty (vs primary) care, a vast majority (78%) were focused on clinical practice over medical education, healthcare administration, or population health.ConclusionsOrganized provider groups have historically paid considerable attention to advocating for telehealth policy (Outer Setting) reform. However, results suggest that for effective telehealth implementation, provider groups need to refocus their efforts on educating individual providers on the complex inter-relationships between Inner Setting constructs and telehealth implementation-effectiveness. On a separate note, the growth in implementation-effectiveness study protocols since 2020, suggests that additional outcome measures may soon be available, to provide a more nuanced understanding of the determinants of effective telehealth implementation based on the CFIR domains and constructs.

Project description:BackgroundScaling evidence-based interventions are key to impacting population health. The National DPP lifestyle change program is one such intervention that has been scaled across the USA over the past 20 years; however, enrollment is an ongoing challenge. Furthermore, little is known about which organizations are most successful with program delivery, enrollment, and scaling. This study aims to understand more about the internal and external organization factors that impact program implementation and reach.MethodsBetween August 2020 and January 2021, data were collected through semi-structured key informant interviews with 30 National DPP delivery organization implementers. This study uses a qualitative cross-case construct rating methodology to assess which Consolidated Framework for Implementation Research (CFIR) inner and outer setting constructs contributed (both in valence and magnitude) to the organization's current level of implementation reach (measured by average participant enrollment per year). A construct by case matrix was created with ratings for each CFIR construct by interviewee and grouped by implementation reach level.ResultsAcross the 16 inner and outer setting constructs and subconstructs, the interviewees with greater enrollment per year provided stronger and more positive examples related to implementation and enrollment of the program, while the lower reach groups reported stronger and more negative examples across rated constructs. Four inner setting constructs/subconstructs (structural characteristics, compatibility, goals and feedback, and leadership engagement) were identified as "distinguishing" between enrollment reach levels based on the difference between groups by average rating, the examination of the number of extreme ratings within levels, and the thematic analysis of the content discussed. Within these constructs, factors such as organization size and administrative processes; program fit with existing organization services and programs; the presence of enrollment goals; and active leadership involvement in implementation were identified as influencing program reach.ConclusionsOur study identified a number of influential CFIR constructs and their impact on National DPP implementation reach. These findings can be leveraged to improve efforts in recruiting and assisting delivery organizations to increase the reach and scale of the National DPP as well as other evidence-based interventions.

Project description:BACKGROUND:Amid the current burden of non-communicable (NCD) diseases in Malaysia, there is a growing demand for more efficient service delivery of primary healthcare. A complex intervention is proposed to improve NCD management in Malaysia. This exploratory study aimed to assess primary healthcare providers' receptiveness towards change prior to implementation of the proposed complex intervention. METHOD:This study was conducted using an exploratory qualitative approach on purposely selected healthcare providers at primary healthcare clinics. Twenty focus group discussions and three in-depth interviews were conducted using a semi-structured interview guide. Consent was obtained prior to interviews and for audio-recordings. Interviews were transcribed verbatim and thematically analysed, guided by the Consolidated Framework for Implementation Research (CFIR), a framework comprised of five major domains promoting implementation theory development and verification across multiple contexts. RESULTS:The study revealed via CFIR that most primary healthcare providers were receptive towards any proposed changes or intervention for the betterment of NCD care management. However, many challenges were outlined across four CFIR domains-intervention characteristics, outer setting, inner setting, and individual characteristics-that included perceived barriers to implementation. Perception of issues that triggered proposed changes reflected the current situation, including existing facilitating aspects that can support the implementation of any future intervention. The importance of strengthening the primary healthcare delivery system was also expressed. CONCLUSION:Understanding existing situations faced at the primary healthcare setting is imperative prior to implementation of any intervention. Healthcare providers' receptiveness to change was explored, and using CFIR framework, challenges or perceived barriers among healthcare providers were identified. CFIR was able to outline the clinics' setting, individual behaviour and external agency factors that have direct impact to the organisation. These are important indicators in ensuring feasibility, effectiveness and sustainability of any intervention, as well as future scalability considerations.

Project description:BackgroundFor successful implementation of an innovation within a complex adaptive system, we need to understand the ways that implementation processes and their contexts shape each other. To do this, we need to explore the work people do to make sense of an innovation and integrate it into their workflow and the contextual elements that impact implementation. Combining Normalization Process Theory (NPT) with the Consolidated Framework for Implementation Research (CFIR) offers an approach to achieve this. NPT is an implementation process theory that explains how changes in the way people think about and use an innovation occurs, while CFIR is a framework that categorizes and describes contextual determinants across five domains that influence implementation. We demonstrate through a case example from our prior research how we integrated NPT and CFIR to inform the development of the interview guide, coding manual, and analysis of the findings.MethodsIn collaboration with our stakeholders, we selected NPT and CFIR to study the implementation process and co-developed an interview guide to elicit responses that would illuminate concepts from both. We conducted, audio-recorded, and transcribed 28 interviews with various professionals involved with the implementation. Based on independent coding of select transcripts and team discussion comparing, clarifying, and crystallizing codes, we developed a coding manual integrating CFIR and NPT constructs. We applied the integrated codes to all interview transcripts.ResultsOur findings highlight how integrating CFIR domains with NPT mechanisms adds explanatory strength to the analysis of implementation processes, with particular implications for practical strategies to facilitate implementation. Multiple coding across both theoretical frames captured the entanglement of process and context. Integrating NPT and CFIR enriched understandings of how interactions between implementation processes and contextual determinants shaped each other during implementation.ConclusionThe integration of NPT and CFIR provides guidance to identify and explore complex entangled interactions between agents, processes, and contextual conditions within and beyond organizations to embed innovations into routine practices. Nuanced understandings gained through this approach moves understandings beyond descriptions of determinants to explain how change occurs or not during implementation. Mechanism-based explanations illuminate concrete practical strategies to support implementation.