Dataset Information

Designing and evaluating provider results-based financing for tuberculosis care in Georgia: a realist evaluation protocol.

ABSTRACT:

Introduction

In 2016, Georgian researchers and policymakers were developing a policy to improve the performance of the national tuberculosis (TB) control programme. The research programme 'Designing and Evaluating Provider Results-Based Financing for Tuberculosis Care in Georgia: Understanding Costs, Mechanisms of Effect and Impact (Results4TB)' was initiated to inform the policy formulation phase, document the policy implementation and assess the effectiveness, cost-effectiveness and the processes of change. To achieve this, the research team intends to combine an impact evaluation, a cost-effectiveness study and a realist evaluation (RE) within an overarching theory-informed design. This protocol is the RE component of the programme.

Methods

A realist methodological approach will be adopted to guide the research design and evaluation. RE answers the question of 'what works in which conditions for whom?' and starts with the development of an initial programme theory (IPT). The IPT will feed into other phases of the realist research cycle (study design, data collection, data analysis and synthesis and theory refinement). Data will be collected in a multiple embedded case study design (five intervention and three control sites) through document reviews, in-depth interviews, non-participant observations and context mapping at facility and national levels. Additional data from other research components (cost-effectiveness and impact evaluation) will aid data triangulation.

Ethics and dissemination

The Institutional Review Boards of the National Centre for Disease Control and Public Health in Georgia (ref. IRB # 2018-019) and the Institute of Tropical Medicine, Antwerp (ref. IRB #- 1240/18) have granted ethical approval to the study.

Trial registration number

ISRCTN14667607.

SUBMITTER: Marchal B

PROVIDER: S-EPMC6500265 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Designing and evaluating provider results-based financing for tuberculosis care in Georgia: a realist evaluation protocol.

Marchal Bruno B Giralt Ariadna Nebot AN Sulaberidze Lela L Chikovani Ivdity I Abejirinde Ibukun-Oluwa Omolade IO

BMJ open 20190414 4

<h4>Introduction</h4>In 2016, Georgian researchers and policymakers were developing a policy to improve the performance of the national tuberculosis (TB) control programme. The research programme 'Designing and Evaluating Provider Results-Based Financing for Tuberculosis Care in Georgia: Understanding Costs, Mechanisms of Effect and Impact (Results4TB)' was initiated to inform the policy formulation phase, document the policy implementation and assess the effectiveness, cost-effectiveness and th ...[more]

PMID: 30987995

Similar Datasets

Project description:BackgroundOver the last three decades in response to the growing burden of diabetes, countries worldwide have developed national and regional multifaceted programmes to improve the monitoring and management of diabetes and to enhance the coordination of care within and across settings. In Ireland in 2010, against a backdrop of limited dedicated strategic planning and engrained variation in the type and level of diabetes care, a national programme was established to standardise and improve care for people with diabetes in Ireland, known as the National Diabetes Programme (NDP). The NDP comprises a range of organisational and service delivery changes to support evidence-based practices and policies. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended.Methods/designThis mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. In stage 1, to identify the official programme theories, documentary analysis and qualitative interviews were conducted with national stakeholders involved in the design, development and management of the programme. In stage 2, as part of a multiple case study design with one case per administrative region in the health system, qualitative interviews are being conducted with frontline staff and service users to explore their responses to, and reasoning about, the programme's resources (mechanisms). Finally, administrative data will be used to examine intermediate implementation outcomes such as service uptake, acceptability, and fidelity to models of care.DiscussionThis evaluation is using the principles of realist evaluation to examine the implementation of a national programme to standardise and improve services for people with diabetes in Ireland. The concurrence of implementation and evaluation has enabled us to produce formative feedback for the NDP while also supporting the refinement and revision of initial theories about how the programme is being implemented in the dynamic and unstable context of the Irish healthcare system.

Project description:ObjectivesThis paper presents the iterative process of participatory multistakeholder engagement that informed the development of a new national tuberculosis (TB) policy in Georgia, and the lessons learnt.MethodsGuided by realist evaluation methods, a multistakeholder dialogue was organised to elicit stakeholders' assumptions on challenges and possible solutions for better TB control. Two participatory workshops were conducted with key actors, interspersed by reflection meetings within the research team and discussions with policymakers. Using concept mapping and causal mapping techniques, and drawing causal loop diagrams, we visualised how actors understood TB service provision challenges and the potential means by which a results-based financing (RBF) policy could address these.SettingThe study was conducted in Tbilisi, Georgia.ParticipantsA total of 64 key actors from the Ministry of Labour, Health and Social Affairs, staff of the Global Fund to Fight AIDS, TB and Malaria Georgia Project, the National Centre for Disease Control and Public Health, the National TB programme, TB service providers and members of the research team were involved in the workshops.ResultsFindings showed that beyond provider incentives, additional policy components were necessary. These included broadening the incentive package to include institutional and organisational incentives, retraining service providers, clear redistribution of roles to support an integrated care model, and refinement of monitoring tools. Health system elements, such as effective referral systems and health information systems were highlighted as necessary for service improvement.ConclusionsDeveloping policies that address complex issues requires methods that facilitate linkages between multiple stakeholders and between theory and practice. Such participatory approaches can be informed by realist evaluation principles and visually facilitated by causal loop diagrams. This approach allowed us leverage stakeholders' knowledge and expertise on TB service delivery and RBF to codesign a new policy.

Project description:INTRODUCTION:Long-term and late effects of cancer treatments can cause functional limitations and reduce quality of life. Cancer rehabilitation services, which can comprise physical exercise, psychological support and educational interventions depending on the individual's needs, have been found to have a positive effect on health-related quality of life worldwide. However, accessibility or the lack of awareness on available help can act as barriers and influence the uptake of services, resulting in people having unmet rehabilitation needs. In Wales, UK, 41% of people, who have had health and social care needs resulting from cancer and its treatments, reported that they did not receive care when needed. The reason for this lack of support has not yet been fully investigated. The aim of this study is to investigate the conditions in which cancer rehabilitation services work and their underpinning mechanisms in South Wales, UK, specifically addressing barriers, facilitators and costs. METHODS AND ANALYSIS:Realist evaluation, which explains for whom a service works in what circumstances and how through context-mechanism-outcome pattern conjunctions, will be used in three phases to investigate the conditions in which cancer rehabilitation services work and their underpinning mechanisms. Phase 1 will be secondary analysis of a cancer rehabilitation database from a local Health Board to give context to who are accessing rehabilitation. Phase 2 will be thematic analysis of face-to-face, semistructured rehabilitation participant (n=20) and healthcare professional (n=20) interviews to explore the mechanisms of how cancer rehabilitation works. Phase 3 will be two case studies and cost-consequences analysis of cancer rehabilitation services. ETHICS AND DISSEMINATION:This study received favourable ethical opinion from London South-East Research Ethics Committee (17/LO/2123) in December 2017. This project is part of the author's PhD thesis and it is expected that the findings will be disseminated in academic journals and at local and international conferences.

Project description:IntroductionThere has been a lot of attention on the role of human resource management interventions to improve delivery of health services in low- and middle-income countries. However, studies on this subject are few due to limited research on implementation of programmes and methodological difficulties in conducting experimental studies on human resource interventions. The authors present the protocol of an evaluation of a district-level capacity-building intervention to identify the determinants of performance of health workers in managerial positions and to understand how changes (if any) are brought about.Methods and analysisThe aim of this study is to understand how capacity building works. The authors will use realist evaluation to evaluate an intervention in Karnataka, India. The intervention is a capacity-building programme that seeks to improve management capacities of health managers at district and subdistrict levels through periodic classroom-based teaching and mentoring support at the workplace. The authors conducted interviews and reviewed literature on capacity building in health to draw out the programme theory of the intervention. Based on this, the authors formulated hypothetical pathways connecting the expected outcomes of the intervention (planning and supervision) to the inputs (contact classes and mentoring). The authors prepared a questionnaire to assess elements of the programme theory-organisational culture, self-efficacy and supervision. The authors shall conduct a survey among health managers as well as collect qualitative data through interviews with participants and non-participants selected purposively based on their planning and supervision performance. The authors will construct explanations in the form of context-mechanism-outcome configurations from the results. This will be iterative and the authors will use a realist evaluation framework to refine the explanatory theories that are based on the findings to explain and validate an improved theory on 'what works for whom and under what conditions'.DiscussionThe scope for applying realist evaluation to study human resource management interventions in health are discussed.

Project description:Background. Improving performance of primary care systems in low- and middle-income countries (LMICs) may be a necessary condition for achievement of universal health coverage in the age of Sustainable Development Goals. The Salud Mesoamerica Initiative (SMI), a large-scale, multi-country program that uses supply-side financial incentives directed at the central-level of governments, and continuous, external evaluation of public, health sector performance to induce improvements in primary care performance in eight LMICs. This study protocol seeks to explain whether and how these interventions generate program effects in El Salvador and Honduras. Methods. This study presents the protocol for a study that uses a realist evaluation approach to develop a preliminary program theory that hypothesizes the interactions between context, interventions and the mechanisms that trigger outcomes. The program theory was completed through a scoping review of relevant empirical, peer-reviewed and grey literature; a sense-making workshop with program stakeholders; and content analysis of key SMI documents. The study will use a multiple case-study design with embedded units with contrasting cases. We define as a case the two primary care systems of Honduras and El Salvador, each with different context characteristics. Data will be collected through in-depth interviews with program actors and stakeholders, documentary review, and non-participatory observation. Data analysis will use inductive and deductive approaches to identify causal patterns organized as 'context, mechanism, outcome' configurations. The findings will be triangulated with existing secondary, qualitative and quantitative data sources, and contrasted against relevant theoretical literature. The study will end with a refined program theory. Findings will be published following the guidelines generated by the Realist and Meta-narrative Evidence Syntheses study (RAMESES II). This study will be performed contemporaneously with SMI's mid-term stage of implementation. Of the methods described, the preliminary program theory has been completed. Data collection, analysis and synthesis remain to be completed.

Project description:INTRODUCTION:The lack of understanding of how complex integrated care programmes achieve their outcomes due to the lack of acceptable methods leads to difficulties in the development, implementation, adaptation and scaling up of similar interventions. In this study, we evaluate an integrated care network, the National University Health System (NUHS) Regional Health System (RHS), consisting of acute hospitals, step down care, primary care providers, social services and community partners using a theory-driven realist evaluation approach. This study aims to examine how and for whom the NUHS-RHS works to improve healthcare utilisations, outcomes, care experiences and reduce healthcare costs. By using a realist approach that balances the needs of context-specific evaluation with international comparability, this study carries the potential to address current research gaps. METHODS AND ANALYSIS:This evaluation will be conducted in three research phases: (1) development of initial programme theory (IPT) underlying the NUHS-RHS; (2) testing of programme theory using empirical data; and (3) refinement of IPT. IPT was elicited and developed through reviews of programme documents, informal discussions and in-depth interviews with relevant stakeholders. Then, a convergent parallel mixed method study will be conducted to assess context (C), mechanisms (M) and outcomes (O) to test the IPT. Findings will then be analysed according to the realist evaluation formula of CMO in which findings on the context, mechanisms will be used to explain the outcomes. Finally, based on findings gathered, IPT will be refined to highlight how to improve the NUHS-RHS by detailing what works (outcome), as well as how (mechanisms) and under what conditions (context). ETHICS AND DISSEMINATION:The National Healthcare Group, Singapore, Domain Specific Review Board reviewed and approved this study protocol. Study results will be published in international peer-reviewed journals and presented at conferences and internally to NUHS-RHS and Ministry of Health, Singapore.

Project description:BackgroundLittle is known about the role of private sector providers in providing and financing immunization. To fill this gap, the authors conducted a study in Benin, Malawi, and Georgia to estimate (1) the proportion of vaccinations taking place through the private sector; (2) private expenditures for vaccination; and (3) the extent of regulation.MethodsIn each country, the authors surveyed a stratified random sample of 50 private providers (private for-profit and not-for-profit) using a standardized, pre-tested questionnaire administered by trained enumerators. In addition, the authors conducted 300 or more client exit interviews in each country.ResultsThe three countries had different models of private service provision of vaccination. In Malawi, 44% of private facilities, predominantly faith-based organizations, administered an estimated 27% of all vaccinations. In Benin, 18% of private for-profit and not-for-profit facilities provided vaccinations, accounting for 8% of total vaccinations. In Georgia, all sample facilities were privately managed, and conducted 100% of private vaccinations. In all three countries, the Ministries of Health (MoHs) supplied vaccines and other support to private facilities. The study found that 6-76% of clients paid nominal fees for vaccination cards and services, and a small percentage (2-26%) chose to pay higher fees for vaccines not within their countries' national schedules. The percentage of private expenditure on vaccination was less than 1% of national health expenditures. The case studies revealed that service quality at private facilities was mixed, a finding that is similar to those of other studies on private sector vaccination. The three countries varied in how well the MoHs managed and supervised private sector services.Discussion/conclusionThe private sector plays a growing role in lower-income countries and is expanding access to services. Governments' ability to regulate and monitor immunization services and promote quality and affordable services in the private sector should be a priority.

Project description:The improvement of maternal health has been one of the aims of the health financing reforms in Georgia. Public-private relationships are the most notable part of the reform. This study aimed to assess the strengths and weakness of the maternal care financing in Georgia in terms of adequacy and effects.A qualitative design was used to explore the opinions of key stakeholders about the adequacy of maternal care financing and financial protection of pregnant women in Georgia. Women who had used maternal care during the past 4 years along with health care providers, policy makers, and representatives of international partner organizations and national professional body were the respondents in this study. Six focus group discussions to collect data from women and 15 face-to-face in-depth interviews to collect data from the other stakeholders were conducted. Each focus group discussion consisted of 7-8 women. Two focus group discussions were carried out at each of the target settings (i.e. Tbilisi, Imereti and Adjara). Women were selected in each location through the hospital registry and snowballing method.The evidence shows that there is a consensus among maternal care stakeholder groups on the influence of the healthcare financing reforms on maternal health. Specifically, the privatization of the maternal care services has had positive effects because it significantly improved the environment and technical capacity of the maternity houses. Also, in contrast to other former-soviet republics, there are no informal payments anymore for maternal care in Georgia. However the privatization, which was done without strict regulation, negatively influenced the reform process and provided the possibility to private providers to manipulate the formal user fees in maternal care. Stakeholders also indicated that the UHC programs implemented at the last stage of the healthcare financing reform as well as other state maternal health programs protect women from catastrophic health care expenditure.The results suggest a consensus among stakeholders on the influence of the healthcare financing reform on maternal healthcare. The total privatization of the maternal care services has had positive effects because it significantly improved the environment and the technical capacity of the maternity house. However, the aim to improve maternal health and to reduce maternal mortality was not fully achieved. Financial protection of mothers should be further studied to identify vulnerable groups who should be targeted in future programs.

Dataset Information

Designing and evaluating provider results-based financing for tuberculosis care in Georgia: a realist evaluation protocol.

Introduction

Methods

Ethics and dissemination

Trial registration number

Publications

Designing and evaluating provider results-based financing for tuberculosis care in Georgia: a realist evaluation protocol.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets