Dataset Information

Tackling the tensions in evaluating capacity strengthening for health research in low- and middle-income countries.

ABSTRACT: Strengthening research capacity in low- and middle-income countries is one of the most effective ways of advancing their health and development but the complexity and heterogeneity of health research capacity strengthening (RCS) initiatives means it is difficult to evaluate their effectiveness. Our study aimed to enhance understanding about these difficulties and to make recommendations about how to make health RCS evaluations more effective. Through discussions and surveys of health RCS funders, including the ESSENCE on Health Research initiative, we identified themes that were important to health RCS funders and used these to guide a systematic analysis of their evaluation reports. Eighteen reports, produced between 2000 and 2013, representing 12 evaluations, were purposefully selected from 54 reports provided by the funders to provide maximum variety. Text from the reports was extracted independently by two authors against a pre-designed framework. Information about the health RCS approaches, tensions and suggested solutions was re-constructed into a narrative. Throughout the process contacts in the health RCS funder agencies were involved in helping us to validate and interpret our results. The focus of the health RCS evaluations ranged from individuals and institutions to national, regional and global levels. Our analysis identified tensions around how much stakeholders should participate in an evaluation, the appropriate balance between measuring and learning and between a focus on short-term processes vs longer-term impact and sustainability. Suggested solutions to these tensions included early and ongoing stakeholder engagement in planning and evaluating health RCS, modelling of impact pathways and rapid assimilation of lessons learned for continuous improvement of decision making and programming. The use of developmental approaches could improve health RCS evaluations by addressing common tensions and promoting sustainability. Sharing learning about how to do robust and useful health RCS evaluations should happen alongside, not after, health RCS efforts.

SUBMITTER: Bates I

PROVIDER: S-EPMC4353897 | biostudies-other | 2015 Apr

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Tackling the tensions in evaluating capacity strengthening for health research in low- and middle-income countries.

Bates Imelda I Boyd Alan A Aslanyan Garry G Cole Donald C DC

Health policy and planning 20140408 3

Strengthening research capacity in low- and middle-income countries is one of the most effective ways of advancing their health and development but the complexity and heterogeneity of health research capacity strengthening (RCS) initiatives means it is difficult to evaluate their effectiveness. Our study aimed to enhance understanding about these difficulties and to make recommendations about how to make health RCS evaluations more effective. Through discussions and surveys of health RCS funders ...[more]

PMID: 24717984

Similar Datasets

Project description:Between August 2012 and April 2013 the Career Development Fellowship programme of the Special Programme for Research and Training in Tropical Diseases (World Health Organization) underwent an external evaluation to assess its past performance and determine recommendations for future programme development and continuous performance improvement. The programme provides a year-long training experience for qualified researchers from low and middle income countries at pharmaceutical companies or product development partnerships. Independent evaluators from the Swiss Tropical and Public Health Institute and the Barcelona Institute for Global Health used a results-based methodology to review the programme. Data were gathered through document review, surveys, and interviews with a range of programme participants. The final evaluation report found the Career Development Fellowship to be relevant to organizers' and programme objectives, efficient in its operations, and effective in its training scheme, which was found to address needs and gaps for both fellows and their home institutions. Evaluators found that the programme has the potential for impact and sustainability beyond the programme period, especially with the successful reintegration of fellows into their home institutions, through which newly-developed skills can be shared at the institutional level. Recommendations included the development of a scheme to support the re-integration of fellows into their home institutions post-fellowship and to seek partnerships to facilitate the scaling-up of the programme. The impact of the Professional Membership Scheme, an online professional development tool launched through the programme, beyond the scope of the Career Development Fellowship programme itself to other applications, has been identified as a positive unintended outcome. The results of this evaluation may be of interest for other efforts in the field of research capacity strengthening in LMICs or, generally, to other professional development schemes of a similar structure.

Project description:OBJECTIVES:Substantial development assistance and research funding are invested in health research capacity strengthening (HRCS) interventions in low-income and middle-income countries, yet the effectiveness, impact and value for money of these investments are not well understood. A major constraint to evidence-informed HRCS intervention has been the disparate nature of the research effort to date. This review aims to map and critically analyse the existing HRCS effort to better understand the level, type, cohesion and conceptual sophistication of the current evidence base. The overall goal of this article is to advance the development of a unified, implementation-focused HRCS science. METHODS:We used a scoping review methodology to identify peer-reviewed HRCS literature within the following databases: PubMed, Global Health and Scopus. HRCS publications available in English between the period 2000 and 2016 were included. 1195 articles were retrieved of which 172 met the final inclusion criteria. A priori thematic analysis of all included articles was completed. Content analysis of identified HRCS definitions was conducted. RESULTS:The number of HRCS publications increased exponentially between 2000 and 2016. Most publications during this period were perspective, opinion or commentary pieces; however, original research publications were the primary publication type since 2013. Twenty-five different definitions of research capacity strengthening were identified, of which three aligned with current HRCS guidelines. CONCLUSIONS:The review findings indicate that an HRCS research field with a focus on implementation science is emerging, although the conceptual and empirical bases are not yet sufficiently advanced to effectively inform HRCS programme planning. Consolidating an HRCS implementation science therefore presents as a viable option that may accelerate the development of a useful evidence base to inform HRCS programme planning. Identifying an agreed operational definition of HRCS, standardising HRCS-related terminology, developing a needs-based HRCS-specific research agenda and synthesising currently available evidence may be useful first steps.

Project description:Development of antimicrobial resistance (AMR) threatens our ability to treat common and life threatening infections. Identifying the emergence of AMR requires strengthening of surveillance for AMR, particularly in low and middle-income countries (LMICs) where the burden of infection is highest and health systems are least able to respond. This work aimed, through a combination of desk-based investigation, discussion with colleagues worldwide, and visits to three contrasting countries (Ethiopia, Malawi and Vietnam), to map and compare existing models and surveillance systems for AMR, to examine what worked and what did not work. Current capacity for AMR surveillance varies in LMICs, but and systems in development are focussed on laboratory surveillance. This approach limits understanding of AMR and the extent to which laboratory results can inform local, national and international public health policy. An integrated model, combining clinical, laboratory and demographic surveillance in sentinel sites is more informative and costs for clinical and demographic surveillance are proportionally much lower. The speed and extent to which AMR surveillance can be strengthened depends on the functioning of the health system, and the resources available. Where there is existing laboratory capacity, it may be possible to develop 5-20 sentinel sites with a long term view of establishing comprehensive surveillance; but where health systems are weaker and laboratory infrastructure less developed, available expertise and resources may limit this to 1-2 sentinel sites. Prioritising core functions, such as automated blood cultures, reduces investment at each site. Expertise to support AMR surveillance in LMICs may come from a variety of international, or national, institutions. It is important that these organisations collaborate to support the health systems on which AMR surveillance is built, as well as improving technical capacity specifically relating to AMR surveillance. Strong collaborations, and leadership, drive successful AMR surveillance systems across countries and contexts.

Project description:The Special Programme for Research and Training in Tropical Diseases (TDR) co-sponsored by UNICEF, UNDP, World Bank and WHO has been supporting research capacity strengthening in low- and middle-income countries for over 40 years. In order to assess and continuously optimize its capacity strengthening approaches, an evaluation of the influence of TDR training grants on research career development was undertaken. The assessment was part of a larger evaluation conducted by the European Science Foundation. A comprehensive survey questionnaire was developed and sent to a group of 117 trainees supported by TDR who had completed their degree (masters or PhD) between 2000 and 2012; of these, seventy seven (77) responded. Most of the respondents (80%) rated TDR support as a very important factor that influenced their professional career achievements. The "brain drain" phenomenon towards high-income countries was particularly low amongst TDR grantees: the rate of return to their region of origin upon completion of their degree was 96%. A vast majority of respondents are still working in research (89%), with 81% of respondents having participated in multidisciplinary research activities; women engaged in multidisciplinary collaboration to a higher extent than men. However, only a minority of all have engaged in intersectoral collaboration, an aspect that would require further study. The post-degree career choices made by the respondents were strongly influenced by academic considerations. At the time of the survey, 92% of all respondents hold full-time positions, mainly in the public sector. Almost 25% of the respondents reported that they had influenced policy and practice changes. Some of the challenges and opportunities faced by trainees at various stages of their research career have been identified. Modalities to overcome these will require further investigation. The survey evidenced how TDR's research capacity grant programmes made a difference on researchers' career development and on south-south collaborations, by strengthening and localizing research capacity in lower income regions, and also showed there is more that needs to be done. The factors involved, challenges and lessons learnt may help donors and policy makers improve their future interventions with regard to designing capacity strengthening programmes and setting funding priorities.

Project description:Background: Patient and public involvement (PPI) is an active partnership between the public and researchers in the research process. In dementia research, PPI ensures that the perspectives of the person with "lived experience" of dementia are considered. To date, in many lower- and middle-income countries (LMIC), where dementia research is still developing, PPI is not well-known nor regularly undertaken. Thus, here, we describe PPI activities undertaken in seven research sites across South Asia as exemplars of introducing PPI into dementia research for the first time. Objective: Through a range of PPI exemplar activities, our objectives were to: (1) inform the feasibility of a dementia-related study; and (2) develop capacity and capability for PPI for dementia research in South Asia. Methods: Our approach had two parts. Part 1 involved co-developing new PPI groups at seven clinical research sites in India, Pakistan and Bangladesh to undertake different PPI activities. Mapping onto different "rings" of the Wellcome Trust's "Public Engagement Onion" model. The PPI activities included planning for public engagement events, consultation on the study protocol and conduct, the adaptation of a study screening checklist, development and delivery of dementia training for professionals, and a dementia training programme for public contributors. Part 2 involved an online survey with local researchers to gain insight on their experience of applying PPI in dementia research. Results: Overall, capacity and capability to include PPI in dementia research was significantly enhanced across the sites. Researchers reported that engaging in PPI activities had enhanced their understanding of dementia research and increased the meaningfulness of the work. Moreover, each site reported their own PPI activity-related outcomes, including: (1) changes in attitudes and behavior to dementia and research involvement; (2) best methods to inform participants about the dementia study; (3) increased opportunities to share knowledge and study outcomes; and (4) adaptations to the study protocol through co-production. Conclusions: Introducing PPI for dementia research in LMIC settings, using a range of activity types is important for meaningful and impactful dementia research. To our knowledge, this is the first example of PPI for dementia research in South Asia.

Dataset Information

Tackling the tensions in evaluating capacity strengthening for health research in low- and middle-income countries.

Publications

Tackling the tensions in evaluating capacity strengthening for health research in low- and middle-income countries.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets