Dataset Information

Ethnographic process evaluation in primary care: explaining the complexity of implementation.

ABSTRACT: The recent growth of implementation research in care delivery systems has led to a renewed interest in methodological approaches that deliver not only intervention outcome data but also deep understanding of the complex dynamics underlying the implementation process. We suggest that an ethnographic approach to process evaluation, when informed by and integrated with quantitative data, can provide this nuanced insight into intervention outcomes. The specific methods used in such ethnographic process evaluations are rarely presented in detail; our objective is to stimulate a conversation around the successes and challenges of specific data collection methods in health care settings. We use the example of a translational clinical trial among 11 community clinics in Portland, OR that are implementing an evidence-based, health-information technology (HIT)-based intervention focused on patients with diabetes.Our ethnographic process evaluation employed weekly diaries by clinic-based study employees, observation, informal and formal interviews, document review, surveys, and group discussions to identify barriers and facilitators to implementation success, provide insight into the quantitative study outcomes, and uncover lessons potentially transferable to other implementation projects. These methods captured the depth and breadth of factors contributing to intervention uptake, while minimizing disruption to clinic work and supporting mid-stream shifts in implementation strategies. A major challenge is the amount of dedicated researcher time required. The deep understanding of the 'how' and 'why' behind intervention outcomes that can be gained through an ethnographic approach improves the credibility and transferability of study findings. We encourage others to share their own experiences with ethnography in implementation evaluation and health services research, and to consider adapting the methods and tools described here for their own research.

SUBMITTER: Bunce AE

PROVIDER: S-EPMC4265455 | biostudies-literature | 2014 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Ethnographic process evaluation in primary care: explaining the complexity of implementation.

Bunce Arwen E AE Gold Rachel R Davis James V JV McMullen Carmit K CK Jaworski Victoria V Mercer MaryBeth M Nelson Christine C

BMC health services research 20141205

<h4>Background</h4>The recent growth of implementation research in care delivery systems has led to a renewed interest in methodological approaches that deliver not only intervention outcome data but also deep understanding of the complex dynamics underlying the implementation process. We suggest that an ethnographic approach to process evaluation, when informed by and integrated with quantitative data, can provide this nuanced insight into intervention outcomes. The specific methods used in suc ...[more]

PMID: 25475025

Similar Datasets

Project description:BACKGROUND:With rural population aging there are growing numbers of people with dementia in rural and remote settings. The role of primary health care (PHC) is critical in rural locations, yet there is a lack of rural-specific PHC models for dementia, and little is known about factors influencing the development, implementation, and sustainability of rural PHC interventions. Using a community-based participatory research approach, researchers collaborated with a rural PHC team to co-design and implement an evidence-based interdisciplinary rural PHC memory clinic in the Canadian province of Saskatchewan. This paper reports barriers and facilitators to developing, implementing, and sustaining the intervention. METHODS:A qualitative longitudinal process evaluation was conducted over two and half years, from pre- to post-implementation. Data collection and analyses were guided by the Consolidated Framework for Implementation Research (CFIR) which consists of 38 constructs within five domains: innovation characteristics, outer setting, inner setting, individual characteristics, and process. Data were collected via focus groups with the PHC team and stakeholders, smaller team workgroup meetings, and team member interviews. Analysis was conducted using a deductive approach to apply CFIR codes to the data and an inductive analysis to identify barriers and facilitators. RESULTS:Across all domains, 14 constructs influenced development and implementation. Three domains (innovation characteristics, inner setting, process) were most important. Facilitators were the relative advantage of the intervention, ability to trial on a small scale, tension for change, leadership engagement, availability of resources, education and support from researchers, increased self-efficacy, and engagement of champions. Barriers included the complexity of multiple intervention components, required practice changes, lack of formal incentive programs, time intensiveness of modifying the EMR during iterative development, lack of EMR access by all team members, lack of co-location of team members, workload and busy clinical schedules, inability to justify a designated dementia care manager role, and turnover of PHC team members. CONCLUSIONS:The study identified key factors that supported and hindered the development and implementation of a rural-specific strategy for dementia assessment and management in PHC. Despite challenges related to the rural context, the researcher-academic partnership was successful in developing and implementing the intervention.

Project description:BACKGROUND:In Ontario, Canada, healthcare for transgender individuals is accessed through primary care; however, there are a limited number of practitioners providing transgender care, and patients are often on waiting lists and/or traveling great distances to receive care. Understanding how primary care is implemented and delivered to transgender individuals is key to improving access and eliminating healthcare barriers. The purpose of this study is to understand how the implementation of primary care services for transgender individuals compares across various models of primary care delivery in Ontario. METHODS:A qualitative, exploratory, multiple-case study guided by Normalization Process Theory (NPT) was used to compare transgender care delivery and implementation across three primary care models. Three cases known to provide transgender primary care and represent different primary care models in Ontario, Canada (i.e., family health team, community health centre, fee-for service physician) were explored. The NoMAD survey, a tool to measure implementation processes, and qualitative interviews with primary care practitioners and allied healthcare staff were administered. RESULTS:Using the NPT framework to guide analysis, key themes emerged about successful implementation of primary care services for transgender individuals. These themes include creating a safe space for patients, identifying gaps in services, understanding practitioners' roles, and the need for more training and education in transgender care for practitioners. CONCLUSIONS:Primary care services for transgender individuals can and should be delivered in all models of primary care. Training and awareness for healthcare practitioners are needed to develop capacity in providing primary care to transgender individuals. A greater number of practitioners and organizations are needed to take on this work, embedding and normalizing transgender care into routine practice to address barriers to access and improve quality of care for transgender individuals.

Project description:BackgroundAlthough there is evidence that tailored implementation strategies can be effective, there is little evidence on which methods of tailoring improve the effect. We designed and evaluated five tailored programs (TPs) each consisting of various strategies. The aim of this study was to examine (a) how determinants of practice prioritized in the design phase of the TPs were perceived by health care professionals who had been exposed to the TPs and whether they suggested other important determinants of practice and (b) how professionals used the offered strategies and whether they suggested other strategies that might have been more effective.MethodsWe conducted a mixed-method process evaluation linked to five cluster-randomized trials carried out in five European countries to implement recommendations for five chronic conditions in primary care settings. The five TPs used a total of 28 strategies which aimed to address 38 determinants of practice. Interviews of professionals in the intervention groups and a survey of professionals in the intervention and control groups were performed. Data collection was conducted by each research team in the respective national language. The interview data were first analyzed inductively by each research team, and subsequently, a meta-synthesis was conducted. The survey was analyzed descriptively.ResultsWe conducted 71 interviews; 125 professionals completed the survey. The survey showed that 76 % (n = 29) of targeted determinants of practice were perceived as relevant and 95 % (n = 36) as being modified by the implementation interventions by 66 to 100 % of professionals. On average, 47 % of professionals reported using the strategies and 51 % considered them helpful, albeit with substantial variance between countries and strategies. In the interviews, 89 determinants of practice were identified, of which 70 % (n = 62) had been identified and 45 % (n = 40) had been prioritized in the design phase. The interviewees suggested 65 additional strategies, of which 54 % (n = 35) had been identified and 20 % (n = 13) had been prioritized, but not selected in the final programs.ConclusionsThis study largely confirmed the perceived relevance of the targeted determinants of practice. This contrasts with the fact that no impact of the trials on the implementation of the recommendations could be observed. The findings suggest that better methods for prioritization of determinants and strategies are needed.Trial registrationEach of the five trials was registered separately in recognized trial registries. Details are given in the respective trial outcome papers.

Project description:IntroductionDementia care management is a complex intervention intended to support persons with dementia and their (caring) relatives in home-based care arrangements. Dementia care management was developed in the federal state of Mecklenburg-Western Pomerania in Germany and subsequently adapted for the German region of Siegen-Wittgenstein, where it will now be implemented. Four different service providers will carry out the implementation process. This study protocol describes the planned procedures for the parallel evaluation of the implementation process.Methods and analysisA multiple embedded case study design was chosen for the planned process evaluation. Data collection and analysis will be informed by the Consolidated Framework for Implementation Research, the Expert Recommendations for Implementing Change, the Medical Research Council framework for conducting process evaluations of complex interventions and the Taxonomy of Outcomes for Implementation Research. Information (qualitative and quantitative) will be collected from all stakeholders involved in the dementia care management intervention (ie, dementia care managers, general practitioners, people with dementia).Ethics and disseminationThe process evaluation is conducted in accordance with the Declaration of Helsinki, the recommendations on good scientific practice, the research ethics principles of the Code of Ethics of the German Society of Nursing Science, and on the basis of ethical approval from the Clinical Ethics Committee of University Medicine Greifswald (BB 110/22). The results of the process evaluation will be disseminated through reports to the funders of the study and also as a summary of recommendations for the sustainable implementation of dementia care management for future implementers. We also plan to publish the results of this process evaluation in an international peer-reviewed journal.Trial registration numberNCT05529277, Registered 7 September 2022, https://beta.Clinicaltrialsgov/study/NCT05529277.

Project description:Background: There is a lack of evidence concerning the effective implementation of strategies for stroke prevention and management, particularly in resource-limited settings. A primary-care-based integrated mobile health intervention (SINEMA intervention) has been implemented and evaluated via a 1-year-long cluster-randomized controlled trial. This study reports the findings from the trial implementation and process evaluation that investigate the implementation of the intervention and inform factors that may influence the wider implementation of the intervention in the future. Methods: We developed an evaluation framework by employing both the RE-AIM framework and the MRC process evaluation framework to describe the implementation indicators, related enablers and barriers, and illustrate some potential impact pathways that may influence the effectiveness of the intervention in the trial. Quantitative data were collected from surveys and extracted from digital health monitoring systems. In addition, we conducted quarterly in-depth interviews with stakeholders in order to understand barriers and enablers of program implementation and effectiveness. Quantitative data analysis and thematic qualitative data analysis were applied, and the findings were synthesized based on the evaluation framework. Results: The SINEMA intervention was successfully implemented in 25 rural villages, reached 637 patients with stroke in rural Northern China during the 12 months of the trial. Almost 90% of the participants received all follow-up visits per protocol, and about half of the participants received daily voice messages. The majority of the intervention components were adopted by village doctors with some adaptation made. The interaction between human-delivered and technology-enabled components reinforced the program implementation and effectiveness. However, characteristics of the participants, doctor-patient relationships, and the healthcare system context attributed to the variation of program implementation and effectiveness. Conclusion: A comprehensive evaluation of program implementation demonstrates that the SINEMA program was well implemented in rural China. Findings from this research provide additional information for program adaptation, which shed light on the future program scale-up. The study also demonstrates the feasibility of combining RE-AIM and MRC process evaluation frameworks in process and implementation evaluation in trials. Clinical Trial Registration: www.ClinicalTrials.gov, identifier: NCT03185858.

Project description:BackgroundInitial results from the SCALA study demonstrated that training primary health care providers is an effective implementation strategy to increase alcohol screening in Colombia, Mexico and Peru, but did not show evidence of superior performance for the standard compared to the shorter training arm. This paper elaborates on those outcomes by examining the relationship of training-related process evaluation indicators with the alcohol screening practice.MethodsA mix of convergent and exploratory mixed-methods design was employed. Data sources included training documentation, post-training questionnaires, observation forms, self-report forms and interviews. Available quantitative data were compared on outcome measure - providers' alcohol screening.ResultsTraining reach was high: three hundred fifty-two providers (72.3% of all eligible) participated in one or more training or booster sessions. Country differences in session length reflected adaptation to previous topic knowledge and experience of the providers. Overall, 49% of attendees conducted alcohol screening in practice. A higher dose received was positively associated with screening, but there was no difference between standard and short training arms. Although the training sessions were well received by participants, satisfaction with training and perceived utility for practice were not associated with screening. Profession, but not age or gender, was associated with screening: in Colombia and Mexico, doctors and psychologists were more likely to screen (although the latter represented only a small proportion of the sample) and in Peru, only psychologists.ConclusionsThe SCALA training programme was well received by the participants and led to half of the participating providers conducting alcohol screening in their primary health care practice. The dose received and the professional role were the key factors associated with conducting the alcohol screening in practice.Plain Language Summary: Primary health care providers can play an important role in detecting heavy drinkers among their consulting patients, and training can be an effective implementation strategy to increase alcohol screening and detection. Existing training literature predominantly focuses on evaluating trainings in high-income countries, or evaluating their effectiveness rather than implementation. As part of SCALA (Scale-up of Prevention and Management of Alcohol Use Disorders in Latin America) study, we evaluated training as implementation strategy to increase alcohol screening in primary health care in a middle-income context. Overall, 72.3% of eligible providers attended the training and 49% of training attendees conducted alcohol screening in practice after attending the training. Our process evaluation suggests that simple intervention with sufficient time to practice, adapted to limited provider availability, is optimal to balance training feasibility and effectiveness; that booster sessions are especially important in context with lower organizational or structural support; and that ongoing training refinement during the implementation period is necessary.

Project description:BackgroundThe Grip on Challenging Behavior care program for managing challenging behavior was implemented in the dementia special care units of 17 Dutch nursing homes. A process evaluation of the implementation of the care program was performed to determine the quality of the implementation and the lessons to be learned for future implementation.MethodsThe care program was implemented according to a stepped wedge design. First-order data (data on recruitment, reach, relevance and feasibility) were used to determine the validity of the study, and second-order data (intervention quality and the barriers and facilitators for implementing the care program) were used to describe the implementation process. Two structured questionnaires were administered to care staff and key stakeholders and semi-structured interviews were held in the units.ResultsUniversity affiliated and non-affiliated nursing homes from different parts of the Netherlands participated. The resident participation rate was over 95% and the participation rate for the training sessions was 82%. Respondents considered the care program relevant and feasible. The degree of implementation was not optimal. The barriers and facilitators in implementing the care program could be divided into three categories: organizational aspects, culture on the unit and aspects of the care program itself.ConclusionsThe recruitment, reach, relevance and feasibility are sufficient to allow for analysis and generalization of the effects of the care program, but the degree of implementation should be taken into account in further analysis. Future projects that involve implementation should consider the specific features of the organization and the cultural orientation of the unit to better adapt to specific needs.Trial registrationThe Netherlands National Trial register under number NTR2141 registered on 11 December 2009. Randomization took place in November 2010, and the first intervention group started using the intervention in February 2011.

Dataset Information

Ethnographic process evaluation in primary care: explaining the complexity of implementation.

Publications

Ethnographic process evaluation in primary care: explaining the complexity of implementation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets