Dataset Information

The utilisation of health research in policy-making: concepts, examples and methods of assessment.

ABSTRACT: The importance of health research utilisation in policy-making, and of understanding the mechanisms involved, is increasingly recognised. Recent reports calling for more resources to improve health in developing countries, and global pressures for accountability, draw greater attention to research-informed policy-making. Key utilisation issues have been described for at least twenty years, but the growing focus on health research systems creates additional dimensions.The utilisation of health research in policy-making should contribute to policies that may eventually lead to desired outcomes, including health gains. In this article, exploration of these issues is combined with a review of various forms of policy-making. When this is linked to analysis of different types of health research, it assists in building a comprehensive account of the diverse meanings of research utilisation.Previous studies report methods and conceptual frameworks that have been applied, if with varying degrees of success, to record utilisation in policy-making. These studies reveal various examples of research impact within a general picture of underutilisation.Factors potentially enhancing utilisation can be identified by exploration of: priority setting; activities of the health research system at the interface between research and policy-making; and the role of the recipients, or 'receptors', of health research. An interfaces and receptors model provides a framework for analysis.Recommendations about possible methods for assessing health research utilisation follow identification of the purposes of such assessments. Our conclusion is that research utilisation can be better understood, and enhanced, by developing assessment methods informed by conceptual analysis and review of previous studies.

SUBMITTER: Hanney SR

PROVIDER: S-EPMC151555 | biostudies-literature | 2003 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The utilisation of health research in policy-making: concepts, examples and methods of assessment.

Hanney Stephen R SR Gonzalez-Block Miguel A MA Buxton Martin J MJ Kogan Maurice M

Health research policy and systems 20030113 1

The importance of health research utilisation in policy-making, and of understanding the mechanisms involved, is increasingly recognised. Recent reports calling for more resources to improve health in developing countries, and global pressures for accountability, draw greater attention to research-informed policy-making. Key utilisation issues have been described for at least twenty years, but the growing focus on health research systems creates additional dimensions.The utilisation of health re ...[more]

PMID: 12646071

Similar Datasets

Project description:BACKGROUND:Measuring the policy and practice impacts of research is becoming increasingly important. Policy impacts can be measured from two directions - tracing forward from research and tracing backwards from a policy outcome. In this review, we compare these approaches and document the characteristics of studies assessing research impacts on policy and the policy utilisation of research. METHODS:Keyword searches of electronic databases were conducted in December 2016. Included studies were published between 1995 and 2016 in English and reported methods and findings of studies measuring policy impacts of specified health research, or research use in relation to a specified health policy outcome, and reviews reporting methods of research impact assessment. Using an iterative data extraction process, we developed a framework to define the key elements of empirical studies (assessment reason, assessment direction, assessment starting point, unit of analysis, assessment methods, assessment endpoint and outcomes assessed) and then documented the characteristics of included empirical studies according to this framework. RESULTS:We identified 144 empirical studies and 19 literature reviews. Empirical studies were derived from two parallel streams of research of equal size, which we termed 'research impact assessments' and 'research use assessments'. Both streams provided insights about the influence of research on policy and utilised similar assessment methods, but approached measurement from opposite directions. Research impact assessments predominantly utilised forward tracing approaches while the converse was true for research use assessments. Within each stream, assessments focussed on narrow or broader research/policy units of analysis as the starting point for assessment, each with associated strengths and limitations. The two streams differed in terms of their relative focus on the contributions made by specific research (research impact assessments) versus research more generally (research use assessments) and the emphasis placed on research and the activities of researchers in comparison to other factors and actors as influencers of change. CONCLUSIONS:The Framework presented in this paper provides a mechanism for comparing studies within this broad field of research enquiry. Forward and backward tracing approaches, and their different ways of 'looking', tell a different story of research-based policy change. Combining approaches may provide the best way forward in terms of linking outcomes to specific research, as well as providing a realistic picture of research influence.

Project description:BackgroundAlthough important syntheses and theoretical works exist in relation to understanding the organisational factors that facilitate research use, these contributions differ in their scope and object of study as well as their theoretical underpinnings. Therefore, from an exploratory angle, it may be useful to map out the current literature on organisational factors of research use in public health policy-making when revisiting existing theories and frameworks to gain further theoretical insights.MethodsHerein, a scoping review technique and thematic content analysis were used to bring together findings from both synthesised and empirical studies of different types to map out the organisational factors that facilitate research use in public health policy-making.ResultsA total of 14 reviews and 40 empirical studies were included in the analysis. These were thematically coded and the intra-organisational factors reported as enabling research use were examined. Five main categories of organisational factors that advance research use in policy organisations - (1) individual factors, (2) the management of research integration, (3) organisational systems and infrastructures of research use, (4) institutional structures and rules for policy-making, and (5) organisational characteristics - were derived as well as 18 subcategories and a total of 64 specific factors, where 27 factors were well supported by research.ConclusionsUsing a scoping review methodology, the intra-organisational factors influencing research use in policy-making (including individual factors) were systematically mapped and the theories applied in this area of research were assessed. The review findings confirm the importance of an intra-organisational perspective when exploring research use, showing that many organisational factors are critical facilitators of research use but also that many factors and mechanisms are understudied. The synthesis shows a lack of studies on politicians and the need for more theoretically founded research. Despite increased efforts to update the existing evidential and theoretical basis of research use, we still need frameworks that combine different approaches and theories to help us grasp the complex organisational mechanisms that facilitate research use in policy settings.

Project description:There is increasing interest globally in the use of more rigorous processes to ensure that maternal, newborn, and child health (MNCH) care recommendations are informed by the best available research evidence use. The purpose of this study was to engage Nigerian MNCH policy-makers and other stakeholders to consider issues around research to policy and practice interface and to assess their existing knowledge and capacity on the use of research evidence for policy-making and practice.The study design is a cross-sectional evaluation of MNCH stakeholders' knowledge as it pertains different dimensions of research to practice. This was undertaken during a national MNCH stakeholders' engagement event convened under the auspices of the West African Health Organization (WAHO) and the Federal Ministry of Health (FMoH) in Abuja, Nigeria. A questionnaire was administered to participants, which was designed to assess participants' knowledge, capacity and organizational process of generation, synthesis and utilization of research evidence in policy-making regarding MNCH.A total of 40 participants signed the informed consent form and completed the questionnaire. The mean ratings (MNRs) of participants' knowledge of electronic databases and capacity to identify and obtain relevant research evidence from electronic databases ranged from 3.62-3.68 on the scale of 5. The MNRs of participants' level of understanding of a policy brief, a policy dialogue and the role of researchers in policy-making ranged from 3.50-3.86. The MNRs of participants' level of understanding of evidence in policy-making context, types and sources of evidence, capacity to identify, select, adapt, and transform relevant evidence into policy ranged from 3.63-4.08. The MNRs of the participants' organization's capacity to cover their geographical areas of operation were generally low ranging from 3.32-3.38 in terms of manpower, logistics, facilities, and external support. The lowest MNR of 2.66 was recorded in funding.The outcomes of this study suggest that a stakeholders' engagement event can serve as an important platform to assess policy-makers' knowledge and capacity for evidence-informed policy-making and for the promotion of evidence use in the policy process.

Project description:BackgroundPerforming cancer research relies on substantial financial investment, and contributions in time and effort from patients. It is therefore important that this research has real life impacts which are properly evaluated. The optimal approach to cancer research impact evaluation is not clear. The aim of this study was to undertake a systematic review of review articles that describe approaches to impact assessment, and to identify examples of cancer research impact evaluation within these reviews.MethodsIn total, 11 publication databases and the grey literature were searched to identify review articles addressing the topic of approaches to research impact assessment. Information was extracted on methods for data collection and analysis, impact categories and frameworks used for the purposes of evaluation. Empirical examples of impact assessments of cancer research were identified from these literature reviews. Approaches used in these examples were appraised, with a reflection on which methods would be suited to cancer research impact evaluation going forward.ResultsIn total, 40 literature reviews were identified. Important methods to collect and analyse data for impact assessments were surveys, interviews and documentary analysis. Key categories of impact spanning the reviews were summarised, and a list of frameworks commonly used for impact assessment was generated. The Payback Framework was most often described. Fourteen examples of impact evaluation for cancer research were identified. They ranged from those assessing the impact of a national, charity-funded portfolio of cancer research to the clinical practice impact of a single trial. A set of recommendations for approaching cancer research impact assessment was generated.ConclusionsImpact evaluation can demonstrate if and why conducting cancer research is worthwhile. Using a mixed methods, multi-category assessment organised within a framework, will provide a robust evaluation, but the ability to perform this type of assessment may be constrained by time and resources. Whichever approach is used, easily measured, but inappropriate metrics should be avoided. Going forward, dissemination of the results of cancer research impact assessments will allow the cancer research community to learn how to conduct these evaluations.

Project description:BackgroundCurrent incentive programmes are not sufficient to motivate researchers and policy-makers to use research evidence in policy-making. We conducted a mixed-methods design to identify context-based policy options for strengthening motivations among health researchers and policy-makers to support evidence-informed health policy-making (EIHP) in Iran.MethodsThis study was conducted in 2019 in two phases. In the first phase, we conducted a scoping review to extract interventions implemented or proposed to strengthen motivations to support EIHP. Additionally, we employed a comparative case study design for reviewing the performance evaluation (PE) processes in Iran and other selected countries to determine the current individual and organizational incentives to encourage EIHP. In the second phase, we developed two policy briefs and then convened two policy dialogues, with 12 and 8 key informants, respectively, where the briefs were discussed. Data were analysed using manifest content analysis in order to propose contextualized policy options.ResultsThe policy options identified to motivate health researchers and policy-makers to support EIHP in Iran were: revising the criteria of academic PE; designing appropriate incentive programmes for nonacademic researchers; developing an indicator for the evaluation of research impact on policy-making or health outcomes; revising the current policies of scientific journals; revising existing funding mechanisms; presenting the knowledge translation plan when submitting a research proposal, as a mandatory condition; encouraging and supporting mechanisms for increasing interactions between policy-makers and researchers; and revising some administrative processes (e.g. managers and staff PEs; selection, appointment, and changing managers and reward mechanisms).ConclusionsThe current individual or organizational incentives are mainly focused on publications, rather than encouraging researchers and policy-makers to support EIHP. Relying more on incentives that consider the other impacts of research (e.g. impacts on health system and policy, or health outcomes) is recommended. These incentives may encourage individuals and organizations to be more involved in conducting research evidence, resulting in promoting EIHP.Trial registrationNA.

Project description:BACKGROUND:There is increased interest in using narratives or storytelling to influence health policies. We aimed to systematically review the evidence on the use of narratives to impact the health policy-making process. METHODS:Eligible study designs included randomised studies, non-randomised studies, process evaluation studies, economic studies, qualitative studies, stakeholder analyses, policy analyses, and case studies. The MEDLINE, PsycINFO, Cochrane Library, Cumulative Index to Nursing and Allied Health Literature (CINAHL), WHO Global Health Library, Communication and Mass Media Complete, and Google Scholar databases were searched. We followed standard systematic review methodology for study selection, data abstraction and risk of bias assessment. We synthesised the findings narratively and presented the results stratified according to the following stages of the policy cycle: (1) agenda-setting, (2) policy formulation, (3) policy adoption, (4) policy implementation and (5) policy evaluation. Additionally, we presented the knowledge gaps relevant to using narrative to impact health policy-making. RESULTS:Eighteen studies met the eligibility criteria, and included case studies (n?=?15), participatory action research (n?=?1), documentary analysis (n?=?1) and biographical method (n?=?1). The majority were of very low methodological quality. In addition, none of the studies formally evaluated the effectiveness of the narrative-based interventions. Findings suggest that narratives may have a positive influence when used as inspiration and empowerment tools to stimulate policy inquiries, as educational and awareness tools to initiate policy discussions and gain public support, and as advocacy and lobbying tools to formulate, adopt or implement policy. There is also evidence of undesirable effects of using narratives. In one case study, narrative use led to widespread insurance reimbursement of a therapy for breast cancer that was later proven to be ineffective. Another case study described how the use of narrative inappropriately exaggerated the perceived risk of a procedure, which led to limiting its use and preventing a large number of patients from its benefits. A third case study described how optimistic 'cure' or 'hope' stories of children with cancer were selectively used to raise money for cancer research that ignored the negative realities. The majority of included studies did not provide information on the definition or content of narratives, the theoretical framework underlying the narrative intervention or the possible predictors of the success of narrative interventions. CONCLUSION:The existing evidence base precludes any robust inferences about the impact of narrative interventions on health policy-making. We discuss the implications of the findings for research and policy. TRIAL REGISTRATION:The review protocol is registered in PROSPERO International prospective register of systematic reviews (ID?=? CRD42018085011 ).

Dataset Information

The utilisation of health research in policy-making: concepts, examples and methods of assessment.

Publications

The utilisation of health research in policy-making: concepts, examples and methods of assessment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets