Dataset Information

E-consult implementation: lessons learned using consolidated framework for implementation research.

ABSTRACT: In 2011, the Veterans Health Administration (VHA) implemented electronic consults (e-consults) as an alternative to in-person specialty visits to improve access and reduce travel for veterans. We conducted an evaluation to understand variation in the use of the new e-consult mechanism and the causes of variable implementation, guided by the Consolidated Framework for Implementation Research (CFIR).Qualitative case studies of 3 high- and 5 low-implementation e-consult pilot sites. Participants included e-consult site leaders, primary care providers, specialists, and support staff identified using a modified snowball sample.We used a 3-step approach, with a structured survey of e-consult site leaders to identify key constructs, based on the CFIR. We then conducted open-ended interviews, focused on key constructs, with all participants. Finally, we produced structured, site-level ratings of CFIR constructs and compared them between high- and low-implementation sites.Site leaders identified 14 initial constructs. We conducted 37 interviews, from which 4 CFIR constructs distinguished high implementation e-consult sites: compatibility, networks and communications, training, and access to knowledge and information. For example, illustrating compatibility, a specialist at a high-implementation site reported that the site changed the order of consult options so that all specialties listed e-consults first to maintain consistency. High-implementation sites also exhibited greater agreement on constructs.By using the CFIR to analyze results, we facilitate future synthesis with other findings, and we better identify common patterns of implementation determinants common across settings.

SUBMITTER: Haverhals LM

PROVIDER: S-EPMC4717483 | biostudies-literature | 2015 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

E-consult implementation: lessons learned using consolidated framework for implementation research.

Haverhals Leah M LM Sayre George G Helfrich Christian D CD Battaglia Catherine C Aron David D Stevenson Lauren D LD Kirsh Susan S Ho Michael M Lowery Julie J

The American journal of managed care 20151201 12

<h4>Objectives</h4>In 2011, the Veterans Health Administration (VHA) implemented electronic consults (e-consults) as an alternative to in-person specialty visits to improve access and reduce travel for veterans. We conducted an evaluation to understand variation in the use of the new e-consult mechanism and the causes of variable implementation, guided by the Consolidated Framework for Implementation Research (CFIR).<h4>Study design</h4>Qualitative case studies of 3 high- and 5 low-implementatio ...[more]

PMID: 26760426

Similar Datasets

Project description:BackgroundQualitative approaches, alone or in mixed methods, are prominent within implementation science. However, traditional qualitative approaches are resource intensive, which has led to the development of rapid qualitative approaches. Published rapid approaches are often inductive in nature and rely on transcripts of interviews. We describe a deductive rapid analysis approach using the Consolidated Framework for Implementation Research (CFIR) that uses notes and audio recordings. This paper compares our rapid versus traditional deductive CFIR approach.MethodsSemi-structured interviews were conducted for two cohorts of the Veterans Health Administration (VHA) Diffusion of Excellence (DoE). The CFIR guided data collection and analysis. In cohort A, we used our traditional CFIR-based deductive analysis approach (directed content analysis), where two analysts completed independent in-depth manual coding of interview transcripts using qualitative software. In cohort B, we used our new rapid CFIR-based deductive analysis approach (directed content analysis), where the primary analyst wrote detailed notes during interviews and immediately "coded" notes into a MS Excel CFIR construct by facility matrix; a secondary analyst then listened to audio recordings and edited the matrix. We tracked time for our traditional and rapid deductive CFIR approaches using a spreadsheet and captured transcription costs from invoices. We retrospectively compared our approaches in terms of effectiveness and rigor.ResultsCohorts A and B were similar in terms of the amount of data collected. However, our rapid deductive CFIR approach required 409.5 analyst hours compared to 683 h during the traditional deductive CFIR approach. The rapid deductive approach eliminated $7250 in transcription costs. The facility-level analysis phase provided the greatest savings: 14 h/facility for the traditional analysis versus 3.92 h/facility for the rapid analysis. Data interpretation required the same number of hours for both approaches.ConclusionOur rapid deductive CFIR approach was less time intensive and eliminated transcription costs, yet effective in meeting evaluation objectives and establishing rigor. Researchers should consider the following when employing our approach: (1) team expertise in the CFIR and qualitative methods, (2) level of detail needed to meet project aims, (3) mode of data to analyze, and (4) advantages and disadvantages of using the CFIR.

Project description:The importance of providing evidence-based palliative care for people with dementia is increasingly acknowledged as important for patient outcomes. In Ireland, evidence-based guidance has been developed in order to address key features of dementia palliative care, including the management of pain, medications and hydration and nutrition. The aim of this study was to identify and explore the factors affecting the implementation of evidence-based guidance on dementia palliative care. The Consolidated Framework for Implementation (CFIR) guided a mixed-method pre-post study. One guidance document pertaining to the management of pain, medication or hydration and nutrition was implemented in three long-term care facilities. Participatory action research in the form of work-based learning groups was used to implement the guidance, drawing on a situational analysis (pre-implementation). Staff questionnaires and audits were conducted pre- and post-implementation while champion interviews were also conducted post-implementation. Features of the guidance, the inner setting components such as readiness to change, and the process of implementation were most frequently identified as impacting implementation. Components of the outer setting, such as external policy incentives and individual characteristics, featured less commonly. Data from qualitative interviews revealed that the guidance was perceived as advantageous or complimentary to previous care provided. Within the inner setting, leadership and support from other colleagues facilitated implementation. However, limited availability of other healthcare professionals to assist with carrying out guidance actions presented a barrier in some facilities. The external facilitators of the work-based learning groups (WBLGs) were perceived as experienced and encouraged active participation and reflection on practices. Despite the challenge of releasing staff to attend the WBLGs, quantitative data demonstrated reduced staff de-motivation amongst those who did attend was noted post-implementation (pre-Mdn = 19.50 versus post-Mdn = 22.00, U = 497.00, p = 0.07). A situational analysis informed by the CFIR framework in conjunction with a participatory action research approach helped to advance the implementation of the guidance. The progress of implementation depended on the extent to which evidence-based care was previously being implemented at each site. Post-implementation analysis using CFIR identified challenges to address in future projects such as staff cover and timing of training to facilitate attendance for staff with different working hours. Facilitators included multidisciplinary engagement with the intervention and champions at each site to support the implementation process.

Project description:ObjectivesTo explore the process of implementation of an online health information web-based portal and referral system (HealthPathways) using implementation science theory: the Consolidated Framework for Implementation Research (CFIR).SettingSouthern Health Region of New Zealand (Otago and Southland).ParticipantsKey Informants (providers and planners of healthcare) (n=10) who were either involved in the process of implementing HealthPathways or who were intended end-users of HealthPathways.MethodsSemistructured interviews were undertaken. A deductive thematic analysis using CFIR was conducted using the framework method.ResultsCFIR postulates that for an intervention to be implemented successfully, account must be taken of the intervention's core components and the adaptable periphery. The core component of HealthPathways-the web portal and referral system that contains a large number of localised clinical care pathways-had been addressed well by the product developers. Little attention had, however, been paid to addressing the adaptable periphery (adaptable elements, structures and systems related to HealthPathways and the organisation into which it was being implemented); it was seen as sufficient just to deliver the web portal and referral system and the set of clinical care pathways as developed to effect successful implementation. In terms of CFIR's 'inner setting' corporate and professional cultures, the implementation climate and readiness for implementation were not properly addressed during implementation. There were also multiple failures of the implementation process (eg, lack of planning and engagement with clinicians). As a consequence, implementation of HealthPathways was highly problematic.ConclusionsThe use of CFIR has furthered our understanding of the factors needed for the successful implementation of a complex health intervention (HealthPathways) in the New Zealand health system. Those charged with implementing complex health interventions should always consider the local context within which they will be implemented and tailor their implementation strategy to address these.

Project description:BackgroundMany implementation efforts fail, even with highly developed plans for execution, because contextual factors can be powerful forces working against implementation in the real world. The Consolidated Framework for Implementation Research (CFIR) is one of the most commonly used determinant frameworks to assess these contextual factors; however, it has been over 10 years since publication and there is a need for updates. The purpose of this project was to elicit feedback from experienced CFIR users to inform updates to the framework.MethodsUser feedback was obtained from two sources: (1) a literature review with a systematic search; and (2) a survey of authors who used the CFIR in a published study. Data were combined across both sources and reviewed to identify themes; a consensus approach was used to finalize all CFIR updates. The VA Ann Arbor Healthcare System IRB declared this study exempt from the requirements of 38 CFR 16 based on category 2.ResultsThe systematic search yielded 376 articles that contained the CFIR in the title and/or abstract and 334 unique authors with contact information; 59 articles included feedback on the CFIR. Forty percent (n = 134/334) of authors completed the survey. The CFIR received positive ratings on most framework sensibility items (e.g., applicability, usability), but respondents also provided recommendations for changes. Overall, updates to the CFIR include revisions to existing domains and constructs as well as the addition, removal, or relocation of constructs. These changes address important critiques of the CFIR, including better centering innovation recipients and adding determinants to equity in implementation.ConclusionThe updates in the CFIR reflect feedback from a growing community of CFIR users. Although there are many updates, constructs can be mapped back to the original CFIR to ensure longitudinal consistency. We encourage users to continue critiquing the CFIR, facilitating the evolution of the framework as implementation science advances.

Project description:BackgroundSince 2012 Gavi, the Vaccine Alliance has provided financial support for HPV vaccine introduction in low- and middle-income countries (LMICs); however, funding has been contingent on establishing a demonstration project prior to national scale-up, in order to gauge effectiveness of delivery models. Although by 2016, most beneficiary countries had completed demonstration projects, few have scaled up delivery nationwide. An important barrier was the dearth of published, country-specific implementation recommendations. We employed the Consolidated Framework for Implementation Research (CFIR) as a lens to identify drivers of heterogeneous (dissimilar) implementation performance during Mozambique's 2-year demonstration project. Mozambique presents a compelling example as the country conducted demonstration projects in three different districts with extremely different economic resources and sociocultural practices.MethodsA post implementation interpretive evaluation was undertaken. Forty key informant interviews were conducted with district and health facility immunization staff, Ministry of Education managers, and teachers across the three demonstration districts, central level informants from MOH, research institutes, and immunization program partners. We compared valence and strength ratings of CFIR constructs, across diverse implementation sites, so as to explain drivers and barriers to implementation success. Two researchers coded separately, and subsequent content analysis followed pre-defined CFIR construct themes.ResultsEighteen constructs emerged from informants' responses as implementation influencers. Adaptability was identified as an important construct because delivery modalities needed to meet differing levels of girls' school attendance. Expanding outside of school-based delivery was needed in the low-performing district, making the vaccine delivery process more complex. Available resources varied across the three sites, with one site receiving direct Gavi support, while others received primarily state-based support. These latter sites reported considerably more implementation bottlenecks, in part related to weaker infrastructural characteristics and insufficient organizational incentives. Health workers' beliefs in importance of vaccines and an organizational culture of making personal sacrifice for immunization program activities drove implementation performance. Advocacy and social mobilization through the right opinion leaders and champions generated higher demand.ConclusionHPV vaccination presents a pertinent opportunity for the prevention of cervical cancer in Mozambique, sub-Saharan Africa, and other LMICs. However, important barriers to broad-scale implementation exist. We recommend the development of local and global strategies to overcome barriers and facilitate its expanded utilization.

Project description:BackgroundHealthcare-related adverse events occur because of complex healthcare systems. The patient safety reporting system is a core component of patient safety initiatives in hospitals. However, hospital management often encounters a cultural barrier with its implementation and struggles to overcome the same. Implementation science would be useful for analysing implementation strategies. This study determines the effects of the implemented strategy on an increase in the number of patient safety reports and the determinants of successful implementation, using the implementation framework.MethodsMixed method analysis was performed in Fujita Health University Hospital (FHUH), a large volume hospital in Japan. We identified strategies to implement the patient safety reporting system by scrutinising internal documents using the Consolidated Framework for Implementation Research (CFIR). The electronic reporting systems developed in 2004 in the FHUH and the number of reports were analysed using the staff data and hospital volumes.ResultsReports (n = 110,058) issued between April 2004 and March 2020 were analysed. The number of reports increased from 2004 to 2008 and from 2013 to 2019, reaching 14,037 reports per year. Between 2009 and 2012, the FHUH experienced a stagnation period where the number of reports were not increasing. From the qualitative materials, we identified 74 strategies which contributed to the implementation of the patient safety reporting system. Among these, the domain of 'intervention characteristics' in the CFIR contained 12 strategies, 'outer settings' contained 20, 'inner settings' contained 21, 'characteristics of individuals' contained 8, and 'process' contained 13. There were two concentrated periods of the implemented strategies, the number was 17 in 2007 and 10 in 2016. These concentrated periods preceded a remarkable increase in the number of patient safety reports.ConclusionsA safety culture had been fostered in FHUH in the study period. A relationship between number of strategies and development of a reporting culture was observed. The intensity of adequate strategies was needed for implementation of patient safety reporting system. Therefore, the implementation framework is useful for analysing patient safety initiatives for safety culture.

Project description:BackgroundIn the United States, as in many other parts of the world, the prevalence of overweight/obesity is at epidemic proportions in the adult population and even higher among Veterans. To address the high prevalence of overweight/obesity among Veterans, the MOVE!(®) weight management program was disseminated nationally to Veteran Affairs (VA) medical centers. The objective of this paper is two-fold: to describe factors that explain the wide variation in implementation of MOVE!; and to illustrate, step-by-step, how to apply a theory-based framework using qualitative data.MethodsFive VA facilities were selected to maximize variation in implementation effectiveness and geographic location. Twenty-four key stakeholders were interviewed about their experiences in implementing MOVE!. The Consolidated Framework for Implementation Research (CFIR) was used to guide collection and analysis of qualitative data. Constructs that most strongly influence implementation effectiveness were identified through a cross-case comparison of ratings.ResultsOf the 31 CFIR constructs assessed, ten constructs strongly distinguished between facilities with low versus high program implementation effectiveness. The majority (six) were related to the inner setting: networks and communications; tension for change; relative priority; goals and feedback; learning climate; and leadership engagement. One construct each, from intervention characteristics (relative advantage) and outer setting (patient needs and resources), plus two from process (executing and reflecting) also strongly distinguished between high and low implementation. Two additional constructs weakly distinguished, 16 were mixed, three constructs had insufficient data to assess, and one was not applicable. Detailed descriptions of how each distinguishing construct manifested in study facilities and a table of recommendations is provided.ConclusionsThis paper presents an approach for using the CFIR to code and rate qualitative data in a way that will facilitate comparisons across studies. An online Wiki resource (http://www.wiki.cfirwiki.net) is available, in addition to the information presented here, that contains much of the published information about the CFIR and its constructs and sub-constructs. We hope that the described approach and open access to the CFIR will generate wide use and encourage dialogue and continued refinement of both the framework and approaches for applying it.

Project description:BACKGROUND:Preventing the onset of poor mental health in adolescence is an international public health priority. Universal, whole school preventative approaches are valued for their reach, and anti-stigmatising and resilience building principles. Mindfulness approaches to well-being have the potential to be effective when delivered as a whole school approach for both young people and staff. However, despite growing demand, there is little understanding of possible and optimal ways to implement a mindfulness, whole school approach (M-WSA) to well-being. This study aimed to identify the determinants of early implementation success of a M-WSA. We tested the capacity of the Consolidated Framework for Implementation Research (CFIR), to capture the determinants of the implementation of a mental health intervention in a school setting. METHODS:Key members of school staff (n = 15) from five UK secondary schools attempting to implement a M-WSA were interviewed at two-time points, 6 months apart, generating a total of 30 interviews. Interviews explored participants' attitudes, beliefs and experiences around implementing a M-WSA. Interview data were coded as CFIR constructs or other (non CFIR) factors affecting implementation. We also mapped school-reported implementation activity and perceived success over 30 months. RESULTS:The CFIR captured the implementation activities and challenges well, with 74% of CFIR constructs identifiable in the dataset. Of the 38 CFIR constructs, 11 appeared to distinguish between high and low implementation schools. The most essential construct was school leadership. It strongly distinguished between high and low implementation schools and appeared inter-related with many other distinguishing constructs. Other strongly distinguishing constructs included relative priority, networks and communications, formally appointed implementation leaders, knowledge and beliefs about the intervention, and executing. CONCLUSIONS:Our findings suggest key implementation constructs that schools, commissioners and policy makers should focus on to promote successful early implementation of mental health programs. School leadership is a key construct to target at the outset. The CFIR appears useful for assessing the implementation of mental health programs in UK secondary schools.

Dataset Information

E-consult implementation: lessons learned using consolidated framework for implementation research.

Publications

E-consult implementation: lessons learned using consolidated framework for implementation research.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets