Dataset Information

Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria.

ABSTRACT: Logic models (LMs) have been used in programme evaluation for over four decades. Current debate questions the ability of logic modelling techniques to incorporate contextual factors into logic models. We share experience of developing a logic model within an ongoing realist evaluation which assesses the extent to which, and under what circumstances a community health workers (CHW) programme promotes access to maternity services in Nigeria. The article contributes to logic modelling debate by: i) reflecting on how other scholars captured context during LM development in theory-driven evaluations; and ii) explaining how we explored context during logic model development for realist evaluation of the CHW programme in Nigeria. Data collection methods that informed our logic model development included documents review, email discussions and teleconferences with programme stakeholders and a technical workshop with researchers to clarify programme goals and untangle relationships among programme elements. One of the most important findings is that, rather than being an end in itself, logic model development is an essential step for identifying initial hypotheses for tentative relevant contexts, mechanisms and outcomes (CMOs) and CMO configurations of how programmes produce change. The logic model also informed development of a methodology handbook that is guiding verification and consolidation of underlying programme theories.

SUBMITTER: Ebenso B

PROVIDER: S-EPMC6403102 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria.

Ebenso Bassey B Manzano Ana A Uzochukwu Benjamin B Etiaba Enyi E Huss Reinhard R Ensor Tim T Newell James J Onwujekwe Obinna O Ezumah Nkoli N Hicks Joe J Mirzoev Tolib T

Evaluation and program planning 20181207

Logic models (LMs) have been used in programme evaluation for over four decades. Current debate questions the ability of logic modelling techniques to incorporate contextual factors into logic models. We share experience of developing a logic model within an ongoing realist evaluation which assesses the extent to which, and under what circumstances a community health workers (CHW) programme promotes access to maternity services in Nigeria. The article contributes to logic modelling debate by: i) ...[more]

PMID: 30578941

Similar Datasets

Project description:Achievement of improved maternal and child health (MCH) outcomes continues to be an issue of international priority, particularly for sub-Saharan African countries such as Nigeria. Evidence suggests that the use of Community Health Workers (CHWs) can be effective in broadening access to, and coverage of, health services and improving MCH outcomes in such countries.In this paper, we report the methodology for a 5-year study which aims to evaluate the context, processes, outcomes and longer-term sustainability of a Nigerian CHW scheme. Evaluation of complex interventions requires a comprehensive understanding of intervention context, mechanisms and outcomes. The multidisciplinary and mixed-method realist approach will facilitate such evaluation. A favourable policy environment within which the study is conducted will ensure the successful uptake of results into policy and practice. A realist evaluation provides an overall methodological framework for this multidisciplinary and mixed methods research, which will be undertaken in Anambra state. The study will draw upon health economics, social sciences and statistics. The study comprises three steps: (1) initial theory development; (2) theory validation and (3) theory refinement and development of lessons learned. Specific methods for data collection will include in-depth interviews and focus group discussions with purposefully identified key stakeholders (managers, service providers and service users), document reviews, analyses of quantitative data from the CHW programme and health information system, and a small-scale survey. The impact of the programme on key output and outcome indicators will be assessed through an interrupted time-series analysis (ITS) of monthly quantitative data from health information system and programme reports. Ethics approvals for this study were obtained from the University of Leeds and the University of Nigeria.This study will provide a timely and important contribution to health systems strengthening specifically within Anambra state in southeast Nigeria but also more widely across Nigeria. This paper should be of interest to researchers who are interested in adapting and applying robust methodologies for assessing complex health system interventions. The paper will also be useful to policymakers and practitioners who are interested in commissioning and engaging in such complex evaluations to inform policies and practices.

Project description:BackgroundThe health visitors' role in many countries is changing. In Scotland, the role has undergone substantial changes through the introduction of an enhanced health visiting programme, which includes increased, structured home visits. This evaluation was conducted within NHS Ayrshire and Arran, one of the 14 Scottish Health Boards. Our aim was to understand and explain how, and why, the programme could contribute to improving health and wellbeing outcomes for children and families.MethodsWe used a realist evaluation approach, conducted in three phases. In phase one, eight managerial staff involved in developing and implementing the programme provided data, which were used to develop initial programme theories. In phase two, the programme theories were tested using qualitative data from 25 health visitors and 22 parents. The programme theories were refined through analyses and interpretation of data in phase three.ResultsThe home visiting context provided by the programme interacted with the mechanisms of the programme and produced outcomes such as early identification of health and wellbeing issues amongst families who needed more support, leading to referral and engagement with sources of additional help. The home visits facilitated development of parent-health visitor relationships, and parents considered health visitors as their first point of contact on children's wellbeing and developmental-related issues. Moreover, the programme provided more clarity to health visitors' role, which in turn enhanced partnership working. However, there were aspects of the programme that may require further development. For instance, both parents and health visitors were concerned about the wide gaps between some home visits.ConclusionsThe enhanced health visiting programme increased opportunities for monitoring and early identification of health and wellbeing concerns. It created structures for a more efficient partnership working and ensured that the needs of children and families were supported. These benefits need to be evaluated further in an effectiveness study.

Project description:INTRODUCTION:Well-trained, adequately skilled and motivated primary healthcare (PHC) workers are essential for attaining universal health coverage (UHC). While there is abundant literature on the drivers of workforce motivation, published knowledge on the mechanisms of motivation within different contexts is limited, particularly in resource-limited countries. This paper contributes to health workforce literature by reporting on how motivation works among PHC workers in a maternal and child health (MCH) programme in Nigeria. METHODS:We adopted a realist evaluation design combining document review with 56 in-depth interviews of PHC workers, facility managers and policy-makers to assess the impact of the MCH programme in Anambra State, Nigeria. A realist process of theory development, testing and consolidation was used to understand how and under what circumstances the MCH programme impacted on workers' motivation and which mechanisms explain how motivation works. We drew on Herzberg's two-factor and Adam's equity theories to unpack how context shapes worker motivation. RESULTS:A complex and dynamic interaction between the MCH programme and organisational and wider contexts triggered five mechanisms which explain PHC worker motivation: (1) feeling supported, (2) feeling comfortable with work environment, (3) feeling valued, (4) morale and confidence to perform tasks and (5) companionship. Some mechanisms were mutually reinforcing while others operated in parallel. Other conditions that enabled worker motivation were organisational values of fairness, recognition of workers' contributions and culture of task-sharing and teamwork. CONCLUSIONS:Policy designs and management strategies for improving workforce performance, particularly in resource-constrained settings should create working environments that foster feelings of being valued and supported while enabling workers to apply their knowledge and skills to improve healthcare delivery and promote UHC. Future research can test the explanatory framework generated by this study and explore differences in motivational mechanisms among different cadres of PHC workers to inform cadre-related motivational interventions.

Project description:BACKGROUND:There is accumulating evidence for the value of collective and shared approaches to leadership. However, relatively little research has explored collective leadership in healthcare and thus, there is a lack understanding of the mechanisms that promote or inhibit the practice of collective leadership in healthcare teams. This study describes the development of an initial programme theory (IPT) to provide insight into the mechanisms underpinning the enactment of collective leadership. METHODS:This IPT was informed by a multiple-method data collection process. The first stage involved a realist synthesis of the literature on collective leadership interventions in healthcare settings (n?=?21 studies). Next, we presented initial findings to receive feedback from a realist research peer support group. Interviews with members of teams identified as working collectively (n?=?23) were then conducted and finally, we consulted with an expert panel (n?=?5). Context-mechanism-outcome configurations (CMOCs) were extrapolated to build and iteratively refine the programme theory and finalise it for testing. RESULTS:Twelve CMOCs were extrapolated from these data to form the initial programme theory and seven were prioritised by the expert panel for focused testing. Contextual conditions that emerged included team training on-site, use of collaborative/co-design strategies, dedicated time for team reflection on performance, organisational and senior management support, inclusive communication and decision-making processes and strong supportive interpersonal relationships within teams. Mechanisms reported include motivation, empowerment, role clarity, feeling supported and valued and psychological safety which led to outcomes including improvements in quality and safety, staff and patient satisfaction, enhanced team working, and greater willingness to share and adopt leadership roles and responsibilities. CONCLUSIONS:This study has identified preliminary support for the contexts, mechanisms and outcomes underpinning the practice of collective leadership. However, it must be noted that while they may appear linear in presentation, in reality they are independent and interlinked and generative of additional configurations. This paper contributes to the nascent literature through addressing an identified gap in knowledge by penetrating below the surface level inputs and outputs of an intervention to understand why it works or doesn't work, and for whom it may work.

Project description:BackgroundDementia special care units represent a widely implemented care model in nursing homes. Their benefits must be thoroughly evaluated given the risk of exclusion and stigma. The aim of this study is to present an initial programme theory that follows the principles of realist methodology. The theory development was guided by the question of the mechanisms at play in the context of dementia special care units to produce or influence outcomes of interest in people with dementia.MethodsThe initial programme theory is based on qualitative interviews with dementia special care stakeholders in Germany and a realist review of complex interventions in dementia special care units. The interviews were analysed using content analysis techniques. For the realist review, a systematic literature search was conducted in four scientific databases; studies were appraised for quality and relevance. All data were analysed independently by two researchers. A realist informed logic model was developed, and context-mechanism-outcome (CMO) configurations were described.ResultsWe reviewed 16 empirical studies and interviewed 16 stakeholders. In the interviews, contextual factors at the system, organisation and individual levels that influence the provision of care in dementia special care units were discussed. The interviewees described the following four interventions typical of dementia special care units: adaptation to the environment, family and public involvement, provision of activities and behaviour management. With exception of family and public involvement, these interventions were the focus of the reviewed studies. The outcomes of interest of stakeholders include responsive behaviour and quality of life, which were also investigated in the empirical studies. By combining data from interviews and a realist review, we framed three CMO configurations relevant to environment, activity, and behaviour management.DiscussionAs important contextual factors of dementia special care units, we discuss the transparency of policies to regulate dementia care, segregation and admission policies, purposeful recruitment and education of staff and a good fit between residents and their environment.

Project description:INTRODUCTION:The lack of understanding of how complex integrated care programmes achieve their outcomes due to the lack of acceptable methods leads to difficulties in the development, implementation, adaptation and scaling up of similar interventions. In this study, we evaluate an integrated care network, the National University Health System (NUHS) Regional Health System (RHS), consisting of acute hospitals, step down care, primary care providers, social services and community partners using a theory-driven realist evaluation approach. This study aims to examine how and for whom the NUHS-RHS works to improve healthcare utilisations, outcomes, care experiences and reduce healthcare costs. By using a realist approach that balances the needs of context-specific evaluation with international comparability, this study carries the potential to address current research gaps. METHODS AND ANALYSIS:This evaluation will be conducted in three research phases: (1) development of initial programme theory (IPT) underlying the NUHS-RHS; (2) testing of programme theory using empirical data; and (3) refinement of IPT. IPT was elicited and developed through reviews of programme documents, informal discussions and in-depth interviews with relevant stakeholders. Then, a convergent parallel mixed method study will be conducted to assess context (C), mechanisms (M) and outcomes (O) to test the IPT. Findings will then be analysed according to the realist evaluation formula of CMO in which findings on the context, mechanisms will be used to explain the outcomes. Finally, based on findings gathered, IPT will be refined to highlight how to improve the NUHS-RHS by detailing what works (outcome), as well as how (mechanisms) and under what conditions (context). ETHICS AND DISSEMINATION:The National Healthcare Group, Singapore, Domain Specific Review Board reviewed and approved this study protocol. Study results will be published in international peer-reviewed journals and presented at conferences and internally to NUHS-RHS and Ministry of Health, Singapore.

Dataset Information

Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria.

Publications

Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets