Dataset Information

How does capacity building of health managers work? A realist evaluation study protocol.

ABSTRACT:

Introduction

There has been a lot of attention on the role of human resource management interventions to improve delivery of health services in low- and middle-income countries. However, studies on this subject are few due to limited research on implementation of programmes and methodological difficulties in conducting experimental studies on human resource interventions. The authors present the protocol of an evaluation of a district-level capacity-building intervention to identify the determinants of performance of health workers in managerial positions and to understand how changes (if any) are brought about.

Methods and analysis

The aim of this study is to understand how capacity building works. The authors will use realist evaluation to evaluate an intervention in Karnataka, India. The intervention is a capacity-building programme that seeks to improve management capacities of health managers at district and subdistrict levels through periodic classroom-based teaching and mentoring support at the workplace. The authors conducted interviews and reviewed literature on capacity building in health to draw out the programme theory of the intervention. Based on this, the authors formulated hypothetical pathways connecting the expected outcomes of the intervention (planning and supervision) to the inputs (contact classes and mentoring). The authors prepared a questionnaire to assess elements of the programme theory-organisational culture, self-efficacy and supervision. The authors shall conduct a survey among health managers as well as collect qualitative data through interviews with participants and non-participants selected purposively based on their planning and supervision performance. The authors will construct explanations in the form of context-mechanism-outcome configurations from the results. This will be iterative and the authors will use a realist evaluation framework to refine the explanatory theories that are based on the findings to explain and validate an improved theory on 'what works for whom and under what conditions'.

Discussion

The scope for applying realist evaluation to study human resource management interventions in health are discussed.

SUBMITTER: Prashanth NS

PROVIDER: S-EPMC3330260 | biostudies-literature | 2012

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How does capacity building of health managers work? A realist evaluation study protocol.

Prashanth N S NS Marchal Bruno B Hoeree Tom T Devadasan Narayanan N Macq Jean J Kegels Guy G Criel Bart B

BMJ open 20120330 2

<h4>Introduction</h4>There has been a lot of attention on the role of human resource management interventions to improve delivery of health services in low- and middle-income countries. However, studies on this subject are few due to limited research on implementation of programmes and methodological difficulties in conducting experimental studies on human resource interventions. The authors present the protocol of an evaluation of a district-level capacity-building intervention to identify the ...[more]

PMID: 22466036

Similar Datasets

Project description:BackgroundHealth systems interventions, such as capacity-building of health workers, are implemented across districts in order to improve performance of healthcare organisations. However, such interventions often work in some settings and not in others. Local health systems could be visualised as complex adaptive systems that respond variously to inputs of capacity building interventions, depending on their local conditions and several individual, institutional, and environmental factors. We aim at demonstrating how the realist evaluation approach advances complex systems thinking in healthcare evaluation by applying the approach to understand organisational change within local health systems in the Tumkur district of southern India.MethodsWe collected data on several input, process, and outcome measures of performance of the talukas (administrative sub-units of the district) and explore the interplay between the individual, institutional, and contextual factors in contributing to the outcomes using qualitative data (interview transcripts and observation notes) and quantitative measures of commitment, self-efficacy, and supervision style.ResultsThe talukas of Tumkur district responded differently to the intervention. Their responses can be explained by the interactions between several individual, institutional, and environmental factors. In a taluka with committed staff and a positive intention to make changes, the intervention worked through aligning with existing opportunities from the decentralisation process to improve performance. However, commitment towards the organisation was neither crucial nor sufficient. Committed staff in two other talukas were unable to actualise their intentions to improve organisational performance. In yet another taluka, the leadership was able to compensate for the lack of commitment.ConclusionsCapacity building of local health systems could work through aligning or countering existing relationships between internal (individual and organisational) and external (policy and socio-political environment) attributes of the organisation. At the design and implementation stage, intervention planners need to identify opportunities for such triggering alignments. Local health systems may differ in their internal configuration and hence capacity building programmes need to accommodate possibilities for change through different pathways. By a process of formulating and testing hypotheses, making critical comparisons, discovering empirical patterns, and monitoring their scope and extent, a realist evaluation enables a comprehensive assessment of system-wide change in health systems.

Project description:IntroductionIn 2006, the Congolese Ministry of Health developed a health system strengthening strategy focusing on health district development. This strategy called for reforming the provincial health administration in order to better support the health district development through leadership and management capacity building of district health management teams. The implementation is currently underway, yet, more evidence on how, for whom and under what conditions this capacity building works is needed. The proposed research aims to address this gap using a realist evaluation approach.Methods and analysisWe will follow the cycle of the realist evaluation. First, we will elicit the initial programme theory through a scoping review (completed in December 2022, using MEDLINE, Health Systems Evidence, Wiley Online Library, Cochrane Library, Google Scholar and grey literature), a review of health policy documents (completed in March 2023), and interviews with key stakeholders (by June 2023). Second, we will empirically test the initial programme theory using a multiple-embedded case study design in two provincial health administrations and four health districts (by March 2024). Data will be collected through document reviews, in-depth interviews, non-participant observations, a questionnaire, routine data from the health information management system and a context mapping tool. We will analyse data using the Intervention-Context-Actor-Mechanism-Outcome configuration heuristic. Last, we will refine the initial programme theory based on the results of the empirical studies and develop recommendations for policymakers (by June 2024).Ethics and disseminationThe Institutional Review Board of the Institute of Tropical Medicine and the Medical Ethics Committee of the University of Lubumbashi approved this study. We will also seek approvals from provincial-level and district-level health authorities before data collection in their jurisdictions. We will disseminate the study findings through the publication of articles in peer-reviewed academic journals, policy briefs for national policymakers and presentations at national and international conferences.

Project description:BackgroundTo ensure the provision of high-quality safety and cost-effective health and welfare services, managers and professionals are required to introduce and ensure the routine use of clinical guidelines and other evidence-based interventions. Despite this, they often lack training and support in implementation. This project aims to investigate how a team training intervention, with the goal to build implementation capacity, influences participants' implementation knowledge and skills, as well as how it influences implementation activities and implementation capacity within participating health and welfare organizations. Furthermore, the aim is to investigate how the organizations' contexts influence the intervention outcomes.MethodsThe building implementation capacity (BIC) intervention builds on the behavior change wheel, which considers implementation as a matter of behavior change. The intervention will be provided to teams of managers and professionals working in health and welfare organizations and seeking support to implement a guideline- or evidence-based intervention. The intervention consists of a series of interactive workshops that provides the participating teams with the knowledge and skills to apply a systematic implementation model. A longitudinal mixed-methods evaluation, including interviews, surveys, and document analysis, will be applied over 24 months. The normalization process theory measure will be used to assess how the intervention influences implementation activities in practice and implementation capacity in the teams and the wider organizations.DiscussionThis project has an ambition to add to the knowledge concerning how to promote the uptake of research findings into health care by building implementation capacity through team training in implementation. The project's uniqueness is that it is designed to move beyond individual-level outcomes and evaluate implementation activities and implementation capacity in participating organizations. Further, the intervention will be evaluated over 24 months to investigate long-term outcomes of implementation training.

Project description:Over the past 3 decades, there has been a substantial shift to the marketisation of government-funded health services. For organisations traditionally buffered from the competitive pressures of for-profit enterprises, such as community-based organisations, this means developing the capacity to adapt to competitive tendering processes, shifting client expectations, and increasing demands for greater accountability. Drawing on ideas of institutional entrepreneurship, we believe that attempts to build adaptive capacity require the transformation of existing institutional arrangements. Key in this may be identifying and fostering institutional entrepreneurs--actors who take the lead in being the impetus for, and giving direction to, structural change. This study focuses on the strategies used by institutional entrepreneurs to build adaptive capacity in the community-based healthcare sector.The research will use an adapted rapid realist review. The review will find underlying theories that explain the circumstances surrounding the implementation of capacity-building strategies that shape organisational response and generate outcomes by activating causal mechanisms. An early scoping of the literature, and consultations with key stakeholders, will be undertaken to identify an initial programme theory. We will search for relevant journal articles and grey literature. Data will be extracted based on contextual factors, mechanisms and outcomes, and their configurations. The analysis will seek patterns and regularities in these configurations and will focus on confirming, refuting or refining our programme theory.The study does not involve primary research and, therefore, does not require formal ethical approval. However, ethical standards of utility, usefulness, feasibility, propriety, accuracy and accountability will be followed. The results will be written up according to the Realist and Meta-Review Evidence Synthesis: Evolving Standards guidelines. Once completed, findings will be published in a peer-reviewed journal.CRD42015026487.

Project description:BackgroundQuality circles (QCs) are commonly used in primary health care in Europe to consider and improve standard practice over time. They represent a complex social intervention that occurs within the fast-changing system of primary health care. Numerous controlled trials, reviews, and studies have shown small but unpredictable positive effect sizes on behavior change. Although QCs seem to be effective, stakeholders have difficulty understanding how the results are achieved and in generalizing the results with confidence. They also lack understanding of the active components of QCs which result in changes in the behavior of health care professionals. This protocol for a realist synthesis will examine how configurations of components and the contextual features of QCs influence their performance.Methods/designStakeholder interviews and a scoping search revealed the processes of QCs and helped to describe their core components and underlying theories. After clarifying their historical and geographical distribution, a purposive and systematic search was developed to identify relevant papers to answer the research questions, which are: understanding why, how, and when QCs work, over what time frame, and in what circumstances. After selecting and abstracting appropriate data, configurations of contexts and mechanisms which influence the outcome of QCs within each study will be identified. Studies will be grouped by similar propositional statements in order to identify patterns and validation from stakeholders sought. Finally, theories will be explored in order to explain these patterns and to help stakeholders maintain and improve QC performance.DiscussionAnalyzing context-mechanism-outcome (CMO) patterns will reveal how QCs work and how contextual factors interact to influence their outcome. The aim is to investigate unique configurations that enable them to improve the performance of health care professionals. Using a standardized reporting system, this realist review will allow the research questions to be answered to the satisfaction of key stakeholders and enable on-going critical examination and dissemination of the findings.Study registrationPROSPERO registration number: CRD42013004826.

Project description:BackgroundAn intervention's success depends on how participants interact with it in local settings. Process evaluation examines these interactions, indicating why an intervention was or was not effective, and how it (and similar interventions) can be improved for better contextual fit. This is particularly important for innovative trials like Supporting Policy In health with Research: an Intervention Trial (SPIRIT), where causal mechanisms are poorly understood. SPIRIT was testing a multi-component intervention designed to increase the capacity of health policymakers to use research.MethodsOur mixed-methods process evaluation sought to explain variation in observed process effects across the six agencies that participated in SPIRIT. Data collection included observations of intervention workshops (n = 59), purposively sampled interviews (n = 76) and participant feedback forms (n = 553). Using a realist approach, data was coded for context-mechanism-process effect configurations (retroductive analysis) by two authors.ResultsIntervention workshops were very well received. There was greater variation of views regarding other aspects of SPIRIT such as data collection, communication and the intervention's overall value. We identified nine inter-related mechanisms that were crucial for engaging participants in these policy settings: (1) Accepting the premise (agreeing with the study's assumptions); (2) Self-determination (participative choice); (3) The Value Proposition (seeing potential gain); (4) 'Getting good stuff' (identifying useful ideas, resources or connections); (5) Self-efficacy (believing 'we can do this!'); (6) Respect (feeling that SPIRIT understands and values one's work); (7) Confidence (believing in the study's integrity and validity); (8) Persuasive leadership (authentic and compelling advocacy from leaders); and (9) Strategic insider facilitation (local translation and mediation). These findings were used to develop tentative explanatory propositions and to revise the programme theory.ConclusionThis paper describes how SPIRIT functioned in six policy agencies, including why strategies that worked well in one site were less effective in others. Findings indicate a complex interaction between participants' perception of the intervention, shifting contextual factors, and the form that the intervention took in each site. Our propositions provide transferable lessons about contextualised areas of strength and weakness that may be useful in the development and implementation of similar studies.

Project description:IntroductionThe growing political emphasis on the early years reflects the importance of these formative years of life. Health visitors in the UK are uniquely positioned to improve health outcomes for children and families and to reduce health inequalities. Recently, there has been a policy change in Scotland in an attempt to enhance the delivery of the universal health visiting service. This study aims to examine the extent to which the enhanced Universal Health Visiting Pathway is implemented and delivered across Scotland and to assess any associated impacts.Methods and analysisA mixed-methods study incorporating four methodological components and uses realist evaluation as the overall conceptual framework. It comprises three phases (1) initial programme theory development; (2) programme theory validation and (3) programme theory refinement. The programme theory validation will use interview and focus group data of parents and health visitors, and conduct a case note review at five study sites. It also involves a national survey of parents and health visitors and routine data analysis of existing secondary data. The analyses of the ensuing qualitative and quantitative data will be carried out using a convergent mixed-methods approach to ensure continuous triangulation of multiple data. The findings of the evaluation will provide contextually relevant understanding of how the Universal Health Visiting Pathway works and evidence the impact of increased investments in health visiting in Scotland.Ethics and disseminationThis protocol has been approved by the School of Health in Social Science Research Ethics Committee, University of Edinburgh. Additional approvals have been granted/will be sought from the Public Benefit and Privacy Panel for health and social care in Scotland for the case note review,survey and routine data analysis elements of the evaluation. The findings will be prepared as reports to the funders and presented at conferences. It will be submitted for publication in peer-reviewed journals.

Project description:Achievement of improved maternal and child health (MCH) outcomes continues to be an issue of international priority, particularly for sub-Saharan African countries such as Nigeria. Evidence suggests that the use of Community Health Workers (CHWs) can be effective in broadening access to, and coverage of, health services and improving MCH outcomes in such countries.In this paper, we report the methodology for a 5-year study which aims to evaluate the context, processes, outcomes and longer-term sustainability of a Nigerian CHW scheme. Evaluation of complex interventions requires a comprehensive understanding of intervention context, mechanisms and outcomes. The multidisciplinary and mixed-method realist approach will facilitate such evaluation. A favourable policy environment within which the study is conducted will ensure the successful uptake of results into policy and practice. A realist evaluation provides an overall methodological framework for this multidisciplinary and mixed methods research, which will be undertaken in Anambra state. The study will draw upon health economics, social sciences and statistics. The study comprises three steps: (1) initial theory development; (2) theory validation and (3) theory refinement and development of lessons learned. Specific methods for data collection will include in-depth interviews and focus group discussions with purposefully identified key stakeholders (managers, service providers and service users), document reviews, analyses of quantitative data from the CHW programme and health information system, and a small-scale survey. The impact of the programme on key output and outcome indicators will be assessed through an interrupted time-series analysis (ITS) of monthly quantitative data from health information system and programme reports. Ethics approvals for this study were obtained from the University of Leeds and the University of Nigeria.This study will provide a timely and important contribution to health systems strengthening specifically within Anambra state in southeast Nigeria but also more widely across Nigeria. This paper should be of interest to researchers who are interested in adapting and applying robust methodologies for assessing complex health system interventions. The paper will also be useful to policymakers and practitioners who are interested in commissioning and engaging in such complex evaluations to inform policies and practices.

Dataset Information

How does capacity building of health managers work? A realist evaluation study protocol.

Introduction

Methods and analysis

Discussion

Publications

How does capacity building of health managers work? A realist evaluation study protocol.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets