Dataset Information

Evaluating Large-Scale Integrated Care Projects: The Development of a Protocol for a Mixed Methods Realist Evaluation Study in Belgium

ABSTRACT: Background: The twelve Integrated Care Program pilot projects (ICPs) created by the government plan ‘Integrated Care for Better Health’ aim to achieve four outcome types (the Quadruple Aim) for people with chronic diseases in Belgium: improved population health, improved patient and provider experiences and improved cost efficiency. The aim of this article is to present the development of a mixed methods realist evaluation of this large-scale, whole system change programme. Methods: A scientific team was commissioned to co-design and implement an evaluation protocol in close collaboration with the government, the ICPs and several other involved stakeholders. Results: A protocol for a mixed methods realist evaluation was developed to gain insights into the mechanisms that foster successful results in ICPs. The qualitative evaluation proposed will be based on the document analysis of yearly ICP progress reports, selected case studies and focus group interviews with stakeholders. Processes and outcomes of all the projects will be monitored using indicators based on administrative data on population health and the quality and costs of care. A yearly survey will be organized to collect data on patient-reported outcomes and experiences and on provider-reported measures of inter-professional collaboration and proper wellbeing. Using both quantitative and qualitative data, we will develop theories about the mechanisms and the associated contextual factors that lead to integrated care and the Quadruple Aim outcomes. Discussion: The objective of this study is to deliver policy recommendations on strategies and best practices to improve care integration in Belgium and to implement a sustainable monitoring system that serves both policy makers and the stakeholders within the ICPs. Some challenges due to the large scale of the project and the multiple stakeholders involved may impede the successful implementation of this proposal.

SUBMITTER: Goderis G

PROVIDER: S-EPMC7518071 | biostudies-literature | 2020 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:INTRODUCTION:The lack of understanding of how complex integrated care programmes achieve their outcomes due to the lack of acceptable methods leads to difficulties in the development, implementation, adaptation and scaling up of similar interventions. In this study, we evaluate an integrated care network, the National University Health System (NUHS) Regional Health System (RHS), consisting of acute hospitals, step down care, primary care providers, social services and community partners using a theory-driven realist evaluation approach. This study aims to examine how and for whom the NUHS-RHS works to improve healthcare utilisations, outcomes, care experiences and reduce healthcare costs. By using a realist approach that balances the needs of context-specific evaluation with international comparability, this study carries the potential to address current research gaps. METHODS AND ANALYSIS:This evaluation will be conducted in three research phases: (1) development of initial programme theory (IPT) underlying the NUHS-RHS; (2) testing of programme theory using empirical data; and (3) refinement of IPT. IPT was elicited and developed through reviews of programme documents, informal discussions and in-depth interviews with relevant stakeholders. Then, a convergent parallel mixed method study will be conducted to assess context (C), mechanisms (M) and outcomes (O) to test the IPT. Findings will then be analysed according to the realist evaluation formula of CMO in which findings on the context, mechanisms will be used to explain the outcomes. Finally, based on findings gathered, IPT will be refined to highlight how to improve the NUHS-RHS by detailing what works (outcome), as well as how (mechanisms) and under what conditions (context). ETHICS AND DISSEMINATION:The National Healthcare Group, Singapore, Domain Specific Review Board reviewed and approved this study protocol. Study results will be published in international peer-reviewed journals and presented at conferences and internally to NUHS-RHS and Ministry of Health, Singapore.

Project description:INTRODUCTION:Long-term and late effects of cancer treatments can cause functional limitations and reduce quality of life. Cancer rehabilitation services, which can comprise physical exercise, psychological support and educational interventions depending on the individual's needs, have been found to have a positive effect on health-related quality of life worldwide. However, accessibility or the lack of awareness on available help can act as barriers and influence the uptake of services, resulting in people having unmet rehabilitation needs. In Wales, UK, 41% of people, who have had health and social care needs resulting from cancer and its treatments, reported that they did not receive care when needed. The reason for this lack of support has not yet been fully investigated. The aim of this study is to investigate the conditions in which cancer rehabilitation services work and their underpinning mechanisms in South Wales, UK, specifically addressing barriers, facilitators and costs. METHODS AND ANALYSIS:Realist evaluation, which explains for whom a service works in what circumstances and how through context-mechanism-outcome pattern conjunctions, will be used in three phases to investigate the conditions in which cancer rehabilitation services work and their underpinning mechanisms. Phase 1 will be secondary analysis of a cancer rehabilitation database from a local Health Board to give context to who are accessing rehabilitation. Phase 2 will be thematic analysis of face-to-face, semistructured rehabilitation participant (n=20) and healthcare professional (n=20) interviews to explore the mechanisms of how cancer rehabilitation works. Phase 3 will be two case studies and cost-consequences analysis of cancer rehabilitation services. ETHICS AND DISSEMINATION:This study received favourable ethical opinion from London South-East Research Ethics Committee (17/LO/2123) in December 2017. This project is part of the author's PhD thesis and it is expected that the findings will be disseminated in academic journals and at local and international conferences.

Project description:IntroductionThe growing political emphasis on the early years reflects the importance of these formative years of life. Health visitors in the UK are uniquely positioned to improve health outcomes for children and families and to reduce health inequalities. Recently, there has been a policy change in Scotland in an attempt to enhance the delivery of the universal health visiting service. This study aims to examine the extent to which the enhanced Universal Health Visiting Pathway is implemented and delivered across Scotland and to assess any associated impacts.Methods and analysisA mixed-methods study incorporating four methodological components and uses realist evaluation as the overall conceptual framework. It comprises three phases (1) initial programme theory development; (2) programme theory validation and (3) programme theory refinement. The programme theory validation will use interview and focus group data of parents and health visitors, and conduct a case note review at five study sites. It also involves a national survey of parents and health visitors and routine data analysis of existing secondary data. The analyses of the ensuing qualitative and quantitative data will be carried out using a convergent mixed-methods approach to ensure continuous triangulation of multiple data. The findings of the evaluation will provide contextually relevant understanding of how the Universal Health Visiting Pathway works and evidence the impact of increased investments in health visiting in Scotland.Ethics and disseminationThis protocol has been approved by the School of Health in Social Science Research Ethics Committee, University of Edinburgh. Additional approvals have been granted/will be sought from the Public Benefit and Privacy Panel for health and social care in Scotland for the case note review,survey and routine data analysis elements of the evaluation. The findings will be prepared as reports to the funders and presented at conferences. It will be submitted for publication in peer-reviewed journals.

Project description:INTRODUCTION:Responsiveness to service users' views is a widely recognised objective of health systems. A key component of responsive health systems is effective interaction between users and service providers. Despite a growing literature on patient feedback from high-income settings, less is known about effectiveness of such systems in low-income and middle-income countries. METHODOLOGY AND ANALYSIS:This paper disseminates the protocol for an 18-month 'RESPOND' project that aims to evaluate the system of collecting and responding to user feedback in Bangladesh. This mixed-method study uses a realist evaluation approach to examine user feedback systems at two Upazila health complexes in Comilla District of Bangladesh, and comprises three steps: (1) initial theory development; (2) theory validation; and (3) theory refinement and development of lessons learnt. The project also uses (1) process evaluation to understand causal mechanisms and contexts of implementation; (2) statistical analysis of patient feedback to clarify the nature of issues reported; (3) social science methods to illuminate feedback processes and user and provider experiences; and (4) health policy and systems research to clarify issues related to integration of feedback systems with quality assurance and human resource management. During data analysis, qualitative and quantitative findings will be integrated throughout to help achieve study objectives. Analysis of qualitative and quantitative data will be done using a convergent mixed-methods model, involving continuous triangulation of multiple data sets to facilitate greater understanding of the context of user feedback systems including the links with relevant policies, practices and programmes. ETHICS AND DISSEMINATION:Ethics approvals were obtained from the University of Leeds and the Bangladesh Medical Research Council. All data collected for this study will be anonymised, and identifying characteristics of respondents will not appear in a final manuscript or reports. The study findings will be presented at scientific conferences and published in peer-reviewed journals.

Project description:INTRODUCTION:Achieving effective integration of healthcare across primary, secondary and tertiary care is a key goal of the New Zealand (NZ) Health Strategy. NZ's regional District Health Board (DHB) groupings are fundamental to delivering integration, bringing the country's 20 DHBs together into four groups to collaboratively plan, fund and deliver health services within their defined geographical regions. This research aims to examine how, for whom and in what circumstances the regional DHB groupings work to improve health service integration, healthcare quality, health outcomes and health equity, particularly for Māori and Pacific peoples. METHODS AND ANALYSIS:This research uses a mixed methods realist evaluation design. It comprises three linked studies: (1) formulating initial programme theory (IPT) through developing programme logic models to describe regional DHB working; (2) empirically testing IPT through both a qualitative process evaluation of regional DHB working using a case study design; and (3) a quantitative analysis of the impact that DHB regional groupings may have on service integration, health outcomes, health equity and costs. The findings of these three studies will allow refinement of the IPT and should lead to a programme theory which will explain how, for whom and in what circumstances regional DHB groupings improve service integration, health outcomes and health equity in NZ. ETHICS AND DISSEMINATION:The University of Otago Human Ethics Committee has approved this study. The embedding of a clinician researcher within a participating regional DHB grouping has facilitated research coproduction, the research has been jointly conceived and designed and will be jointly evaluated and disseminated by researchers and practitioners. Uptake of the research findings by other key groups including policymakers, Māori providers and communities and Pacific providers and communities will be supported through key strategic relationships and dissemination activities. Academic dissemination will occur through publication and conference presentations.

Project description:BackgroundIntegrated knowledge translation (IKT) can optimize the uptake of research evidence into clinical practice by incorporating knowledge users as equal partners in the entire research process. Although several studies have investigated stakeholder involvement in research, the literature on partnerships between researchers and clinicians in rehabilitation and their impact on clinical practice is scarce. This study described the individual research projects, the outcomes of these projects on clinical practice and the partnership experiences of an initiative that funds IKT projects co-led by a rehabilitation clinician and a researcher.MethodsThis was a sequential explanatory mixed methods study where quantitative data (document reviews and surveys) informed the qualitative phase (focus groups with researchers and interviews with clinicians). Descriptive analysis was completed for the quantitative data and thematic analysis was used for the qualitative data.Results53 projects were classified within multiple steps of the KTA framework. Descriptive information on the projects and outcomes were obtained through the survey for 37 of the 53 funded projects (70%). Half of the respondents (n = 18) were very satisfied or satisfied with their project's impact. Only two (6%) projects reported having measured sustainability of their projects and four (11%) measured long-term impact. A focus group with six researchers and individual interviews with nine clinicians highlighted the benefits (e.g. acquired collaborative skills, stronger networks between clinicians and academia) and challenges (e.g. measuring KT outcomes, lack of planning for sustainability, barriers related to clinician involvement in research) of participating in this initiative. Considerations when partnering on IKT projects included: the importance of having a supportive organization culture and physical proximity between collaborators, sharing motives for participating, leveraging everyone's expertise, grounding projects in KT models, discussing feasibility of projects on a restricted timeline, and incorporating the necessary knowledge users. Clinicians discussed the main outputs (scientific contribution, training and development, increased awareness of best practice, step in a larger effort) as project outcomes, but highlighted the complexity of measuring outcomes on clinical practice.ConclusionThe study provides a portrait of an IKT funding model, sheds light on past IKT projects' strengths and weaknesses and provides strategies for promoting positive partnership experiences between researchers and rehabilitation clinicians.

Dataset Information

Evaluating Large-Scale Integrated Care Projects: The Development of a Protocol for a Mixed Methods Realist Evaluation Study in Belgium

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets