Dataset Information

Using Theories of Change to inform implementation of health systems research and innovation: experiences of Future Health Systems consortium partners in Bangladesh, India and Uganda.

ABSTRACT: BACKGROUND:The Theory of Change (ToC) is a management and evaluation tool supporting critical thinking in the design, implementation and evaluation of development programmes. We document the experience of Future Health Systems (FHS) Consortium research teams in Bangladesh, India and Uganda with using ToC. We seek to understand how and why ToCs were applied and to clarify how they facilitate the implementation of iterative intervention designs and stakeholder engagement in health systems research and strengthening. METHODS:This paper combines literature on ToC, with a summary of reflections by FHS research members on the motivation, development, revision and use of the ToC, as well as on the benefits and challenges of the process. We describe three FHS teams' experiences along four potential uses of ToCs, namely planning, communication, learning and accountability. RESULTS:The three teams developed ToCs for planning and evaluation purposes as required for their initial plans for FHS in 2011 and revised them half-way through the project, based on assumptions informed by and adjusted through the teams' experiences during the previous 2 years of implementation. All teams found that the revised ToCs and their accompanying narratives recognised greater feedback among intervention components and among key stakeholders. The ToC development and revision fostered channels for both internal and external communication, among research team members and with key stakeholders, respectively. The process of revising the ToCs challenged the teams' initial assumptions based on new evidence and experience. In contrast, the ToCs were only minimally used for accountability purposes. CONCLUSIONS:The ToC development and revision process helped FHS research teams, and occasionally key local stakeholders, to reflect on and make their assumptions and mental models about their respective interventions explicit. Other projects using the ToC should allow time for revising and reflecting upon the ToCs, to recognise and document the adaptive nature of health systems, and to foster the time, space and flexibility that health systems strengthening programmes must have to learn from implementation and stakeholder engagement.

SUBMITTER: Paina L

PROVIDER: S-EPMC5751673 | biostudies-literature | 2017 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using Theories of Change to inform implementation of health systems research and innovation: experiences of Future Health Systems consortium partners in Bangladesh, India and Uganda.

Paina Ligia L Wilkinson Annie A Tetui Moses M Ekirapa-Kiracho Elizabeth E Barman Debjani D Ahmed Tanvir T Mahmood Shehrin Shaila SS Bloom Gerry G Knezovich Jeff J George Asha A Bennett Sara S

Health research policy and systems 20171228 Suppl 2

<h4>Background</h4>The Theory of Change (ToC) is a management and evaluation tool supporting critical thinking in the design, implementation and evaluation of development programmes. We document the experience of Future Health Systems (FHS) Consortium research teams in Bangladesh, India and Uganda with using ToC. We seek to understand how and why ToCs were applied and to clarify how they facilitate the implementation of iterative intervention designs and stakeholder engagement in health systems ...[more]

PMID: 29297374

Similar Datasets

Project description:Many effective innovations and interventions are never effectively scaled up. Implementation research (IR) has the promise of supporting scale-up through enabling rapid learning about the intervention and its fit with the context in which it is implemented. We integrate conceptual frameworks addressing different dimensions of scaling up (specifically, the attributes of the service or innovation being scaled, the actors involved, the context, and the scale-up strategy) and questions commonly addressed by IR (concerning acceptability, appropriateness, adoption, feasibility, fidelity to original design, implementation costs, coverage and sustainability) to explore how IR can support scale-up.We draw upon three IR studies conducted by Future Health Systems (FHS) in Afghanistan, Bangladesh and Uganda. We reviewed project documents from the period 2011-2016 to identify information related to the dimensions of scaling up. Further, for each country, we developed rich descriptions of how the research teams approached scaling up, and how IR contributed to scale-up. The rich descriptions were checked by FHS research teams. We identified common patterns and differences across the three cases.The three cases planned quite different innovations/interventions and had very different types of scale-up strategies. In all three cases, the research teams had extensive prior experience within the study communities, and little explicit attention was paid to contextual factors. All three cases involved complex interactions between the research teams and other stakeholders, among stakeholders, and between stakeholders and the intervention. The IR planned by the research teams focussed primarily on feasibility and effectiveness, but in practice, the research teams also had critical insights into other factors such as sustainability, acceptability, cost-effectiveness and appropriateness. Stakeholder analyses and other project management tools further complemented IR.IR can provide significant insights into how best to scale-up a particular intervention. To take advantage of insights from IR, scale-up strategies require flexibility and IR must also be sufficiently flexible to respond to new emerging questions. While commonly used conceptual frameworks for scale-up clearly delineate actors, such as implementers, target communities and the support team, in our experience, IR blurred the links between these groups.

Project description:BackgroundComputerized clinical decision support systems (CDSSs) are essential components of modern health system service delivery, particularly within acute care settings such as hospitals. Theories, models, and frameworks may assist in facilitating the implementation processes associated with CDSS innovation and its use within these care settings. These processes include context assessments to identify key determinants, implementation plans for adoption, promoting ongoing uptake, adherence, and long-term evaluation. However, there has been no prior review synthesizing the literature regarding the theories, models, and frameworks that have informed the implementation and adoption of CDSSs within hospitals.ObjectiveThis scoping review aims to identify the theory, model, and framework approaches that have been used to facilitate the implementation and adoption of CDSSs in tertiary health care settings, including hospitals. The rationales reported for selecting these approaches, including the limitations and strengths, are described.MethodsA total of 5 electronic databases were searched (CINAHL via EBSCOhost, PubMed, Scopus, PsycINFO, and Embase) to identify studies that implemented or adopted a CDSS in a tertiary health care setting using an implementation theory, model, or framework. No date or language limits were applied. A narrative synthesis was conducted using full-text publications and abstracts. Implementation phases were classified according to the "Active Implementation Framework stages": exploration (feasibility and organizational readiness), installation (organizational preparation), initial implementation (initiating implementation, ie, training), full implementation (sustainment), and nontranslational effectiveness studies.ResultsA total of 81 records (42 full text and 39 abstracts) were included. Full-text studies and abstracts are reported separately. For full-text studies, models (18/42, 43%), followed by determinants frameworks (14/42,33%), were most frequently used to guide adoption and evaluation strategies. Most studies (36/42, 86%) did not list the limitations associated with applying a specific theory, model, or framework.ConclusionsModels and related quality improvement methods were most frequently used to inform CDSS adoption. Models were not typically combined with each other or with theory to inform full-cycle implementation strategies. The findings highlight a gap in the application of implementation methods including theories, models, and frameworks to facilitate full-cycle implementation strategies for hospital CDSSs.

Project description:BACKGROUND:There is increasing interest in using systems thinking to tackle 'wicked' policy problems in preventive health, but this can be challenging for policy-makers because the literature is amorphous and often highly theoretical. Little is known about how best to support health policy-makers to gain skills in understanding and applying systems thinking for policy action. METHODS:In-depth interviews were conducted with 18 policy-makers who are participating in an Australian research collaboration that uses a systems approach. Our aim was to explore factors that support policy-makers to use systems approaches, and to identify any impacts of systems thinking on policy thinking or action, including the pathways through which these impacts occurred. RESULTS:All 18 policy-makers agreed that systems thinking has merit but some questioned its practical policy utility. A small minority were confused about what systems thinking is or which approaches were being used in the collaboration. The majority were engaged with systems thinking and this group identified concrete impacts on their work. They reported using systems-focused research, ideas, tools and resources in policy work that were contributing to the development of practical methodologies for policy design, scaling up, implementation and evaluation; and to new prevention narratives. Importantly, systems thinking was helping some policy-makers to reconceptualise health problems and contexts, goals, potential policy solutions and methods. In short, they were changing how they think about preventive health. CONCLUSION:These results show that researchers and policy-makers can put systems thinking into action as part of a research collaboration, and that this can result in discernible impacts on policy processes. In this case, action-oriented collaboration and capacity development over a 5-year period facilitated mutual learning and practical application. This indicates that policy-makers can get substantial applied value from systems thinking when they are involved in extended co-production processes that target policy impact and are supported by responsive capacity strategies.

Project description:Background: Multiple Sclerosis Partners Advancing Technology and Health Solutions (MS PATHS) is the first example of a learning health system in multiple sclerosis (MS). This paper describes the initial implementation of MS PATHS and initial patient characteristics. Methods: MS PATHS is an ongoing initiative conducted in 10 healthcare institutions in three countries, each contributing standardized information acquired during routine care. Institutional participation required the following: active MS patient census of ≥500, at least one Siemens 3T magnetic resonance imaging scanner, and willingness to standardize patient assessments, share standardized data for research, and offer universal enrolment to capture a representative sample. The eligible participants have diagnosis of MS, including clinically isolated syndrome, and consent for sharing pseudonymized data for research. MS PATHS incorporates a self-administered patient assessment tool, the Multiple Sclerosis Performance Test, to collect a structured history, patient-reported outcomes, and quantitative testing of cognition, vision, dexterity, and walking speed. Brain magnetic resonance imaging is acquired using standardized acquisition sequences on Siemens 3T scanners. Quantitative measures of brain volume and lesion load are obtained. Using a separate consent, the patients contribute DNA, RNA, and serum for future research. The clinicians retain complete autonomy in using MS PATHS data in patient care. A shared governance model ensures transparent data and sample access for research. Results: As of August 5, 2019, MS PATHS enrolment included participants (n = 16,568) with broad ranges of disease subtypes, duration, and severity. Overall, 14,643 (88.4%) participants contributed data at one or more time points. The average patient contributed 15.6 person-months of follow-up (95% CI: 15.5-15.8); overall, 166,158 person-months of follow-up have been accumulated. Those with relapsing-remitting MS demonstrated more demographic heterogeneity than the participants in six randomized phase 3 MS treatment trials. Across sites, a significant variation was observed in the follow-up frequency and the patterns of disease-modifying therapy use. Conclusions: Through digital health technology, it is feasible to collect standardized, quantitative, and interpretable data from each patient in busy MS practices, facilitating the merger of research and patient care. This approach holds promise for data-driven clinical decisions and accelerated systematic learning.

Project description:The key to high impact health services is institutionalizing and sustaining programme evaluation. Uganda represents a success story in the use of a specific programme evaluation method: Lot Quality Assurance Sampling (LQAS). Institutionalization is defined by two C's: competent programme evaluators and control mechanisms that effectively use evaluation data to improve health services. Sustainability means continued training and funding for the evaluation approach. Social science literature that researches institutionalization has emphasized 'stability', whereas in global health, the issue is determining how to improve the impact of services by 'changing' programmes. In Uganda, we measured the extent of the institutionalization and sustainability of evaluating programmes that produce change in nine districts sampled to represent three largely rural regions and varying levels of effective health programmes. We used the proportion of mothers with children aged 0-11?months who delivered in a health facility as the principal indicator to measure programme effectiveness. Interviews and focus groups were conducted among directors, evaluation supervisors, data collectors in the district health offices, and informant interviews conducted individually at the central government level. Seven of the nine districts demonstrated a high level of institutionalization of evaluation. The two others had only conducted one round of programme evaluation. When we control for the availability of health facilities, we find that the degree of institutionalization is moderately related to the prevalence of the delivery of a baby in a health facility. Evaluation was institutionalized at the central government level. Sustainability existed at both levels. Several measures indicate that lessons from the nine district case studies may be relevant to the 74 districts that had at least two rounds of programme evaluation. We note that there is an association between the evaluation data being used to change health services, and the four separate indicators being used to measure women's health and child survival services. We conclude that the two C's (competent evaluators and control mechanisms) have been critical for sustaining programme evaluation in Uganda.

Dataset Information

Using Theories of Change to inform implementation of health systems research and innovation: experiences of Future Health Systems consortium partners in Bangladesh, India and Uganda.

Publications

Using Theories of Change to inform implementation of health systems research and innovation: experiences of Future Health Systems consortium partners in Bangladesh, India and Uganda.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets