Dataset Information

Assessing how information is packaged in rapid reviews for policy-makers and other stakeholders: a cross-sectional study

ABSTRACT: Background Rapid reviews (RRs) are useful products to healthcare policy-makers and other stakeholders, who require timely evidence. Therefore, it is important to assess how well RRs convey useful information in a format that is easy to understand so that decision-makers can make best use of evidence to inform policy and practice. Methods We assessed a diverse sample of 103 RRs against the BRIDGE criteria, originally developed for communicating clearly to support healthcare policy-making. We modified the criteria to increase assessability and to align with RRs. We identified RRs from key database searches and through searching organisations known to produce RRs. We assessed each RR on 26 factors (e.g. organisation of information, lay language use). Results were descriptively analysed. Further, we explored differences between RRs published in journals and those published elsewhere. Results Certain criteria were well covered across the RRs (e.g. all aimed to synthesise research evidence and all provided references of included studies). Further, most RRs provided detail on the problem or issue (96%; n =?99) and described methods to conduct the RR (91%; n =?94), while several addressed political or health systems contexts (61%; n =?63). Many RRs targeted policy-makers and key stakeholders as the intended audience (66%; n =?68), yet only 32% (n =?33) involved their tacit knowledge, while fewer (27%; n =?28) directly involved them reviewing the content of the RR. Only six RRs involved patient partners in the process. Only 23% (n =?24) of RRs were prepared in a format considered to make information easy to absorb (i.e. graded entry) and 25% (n =?26) provided specific key messages. Readability assessment indicated that the text of key RR sections would be hard to understand for an average reader (i.e. would require post-secondary education) and would take 42 (± 36) minutes to read. Conclusions Overall, conformity of the RRs with the modified BRIDGE criteria was modest. By assessing RRs against these criteria, we now understand possible ways in which they could be improved to better meet the information needs of healthcare decision-makers and their potential for innovation as an information-packaging mechanism. The utility and validity of these items should be further explored. Protocol availability The protocol, published on the Open Science Framework, is available at: osf.io/68tj7

SUBMITTER: Garritty C

PROVIDER: S-EPMC7523380 | biostudies-literature | 2020 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundRapid reviews are increasingly used by policy agencies to access relevant research in short timeframes. Despite the growing number of programmes, little is known about how rapid reviews are used by health policy agencies. This study examined whether and how rapid reviews commissioned using a knowledge brokering programme were used by Australian policy-makers.MethodsThis study used interview data to examine the use of 139 rapid reviews by health policy agencies that were commissioned between 2006 and 2015. Transcripts were coded to identify how rapid reviews were used, the type of policy processes in which they were used, what evidence of use was provided and what reasons were given when rapid reviews were not used. Fisher's exact test was used to assess variation between types of agencies.ResultsOverall, 89% of commissioned rapid reviews were used by the commissioning agencies and 338 separate instances of use were identified, namely, on average, three uses per review. Policy-makers used reviews primarily to determine the details of a policy or programme, identify priorities for future action or investment, negotiate interjurisdictional decisions, evaluate alternative solutions for a policy problem, and communicate information to stakeholders. Some variation in use was observed across agencies. Reasons for non-use were related to changes in organisational structures, resources or key personnel in the commissioning agencies, or changes in the broader political environment.ConclusionsThis study found that almost all rapid reviews had been used by the agencies who commissioned them, primarily in policy and programme development, agenda-setting, and to communicate information to stakeholders. Reviews were used mostly in instrumental and conceptual ways and there was little evidence of symbolic use. Variations in use were identified across agencies. The findings suggest that commissioned rapid reviews are an effective means of providing timely relevant research for use in policy processes and that review findings may be applied in a variety of ways.

Project description:BackgroundThe use of research evidence as an input for health decision-making is a need for most health systems. There are a number of approaches for promoting evidence use at different levels of the health system, but knowledge of their effectiveness is still scarce. The objective of this overview was to evaluate the effectiveness of knowledge communication and dissemination interventions, strategies or approaches targeting policy-makers and health managers.MethodsThis overview of systematic reviews used systematic review methods and was conducted according to a predefined and published protocol. A comprehensive electronic search of 13 databases and a manual search in four websites were conducted. Both published and unpublished reviews in English, Spanish or Portuguese were included. A narrative synthesis was undertaken, and effectiveness statements were developed, informed by the evidence identified.ResultsWe included 27 systematic reviews. Three studies included only a communication strategy, while eight only included dissemination strategies, and the remaining 16 included both. None of the selected reviews provided "sufficient evidence" for any of the strategies, while four provided some evidence for three communication and four dissemination strategies. Regarding communication strategies, the use of tailored and targeted messages seemed to successfully lead to changes in the decision-making practices of the target audience. Regarding dissemination strategies, interventions that aimed at improving only the reach of evidence did not have an impact on its use in decisions, while interventions aimed at enhancing users' ability to use and apply evidence had a positive effect on decision-making processes. Multifaceted dissemination strategies also demonstrated the potential for changing knowledge about evidence but not its implementation in decision-making.ConclusionsThere is limited evidence regarding the effectiveness of interventions targeting health managers and policy-makers, as well as the mechanisms required for achieving impact. More studies are needed that are informed by theoretical frameworks or specific tools and using robust methods, standardized outcome measures and clear descriptions of the interventions. We found that passive communication increased access to evidence but had no effect on uptake. Some evidence indicated that the use of targeted messages, knowledge-brokering and user training was effective in promoting evidence use by managers and policy-makers.

Project description:BackgroundOpportunities exist to disseminate evidence-based cancer control strategies to state-level policy makers in both the legislative and executive branches. We explored factors that influence the likelihood that state-level policy makers will find a policy brief understandable, credible, and useful.MethodsA systematic approach was used to develop four types of policy briefs on the topic of mammography screening to reduce breast cancer mortality: data-focused brief with state-level data, data-focused brief with local-level data, story-focused brief with state-level data, and story-focused brief with local-level data. Participants were recruited from three groups of state-level policy makers-legislative staff, legislators, and executive branch administrators- in six states that were randomly chosen after stratifying all 50 states by population size and dominant political party in state legislature. Participants from each of the three policy groups were randomly assigned to receive one of the four types of policy briefs and completed a questionnaire that included a series of Likert scale items. Primary outcomes-whether the brief was understandable, credible, likely to be used, and likely to be shared-were measured by a 5-point Likert scale according to the degree of agreement (1 = strongly disagree, 5 = strongly agree). Data were analyzed with analysis of variance and with classification trees. All statistical tests were two-sided.ResultsData on response to the policy briefs (n = 291) were collected from February through December 2009 (overall response rate = 35%). All three policy groups found the briefs to be understandable and credible, with mean ratings that ranged from 4.3 to 4.5. The likelihood of using the brief (the dependent variable) differed statistically significantly by study condition for staffers (P = .041) and for legislators (P = .018). Staffers found the story-focused brief containing state-level data most useful, whereas legislators found the data-focused brief containing state-level data most useful. Exploratory classification trees showed distinctive patterns for brief usefulness across the three policy groups.ConclusionOur results suggest that taking a "one-size-fits-all" approach when delivering information to policy makers may be less effective than communicating information based on the type of policy maker.

Project description:BackgroundWide-spread implementation of treatment regimens for the radical cure of vivax malaria is hindered by a range of factors. This has resulted in an increase in the relative proportion of vivax malaria and is an important obstacle in the achievement of global malaria elimination by 2030. The main objective of this study was to explore the current policies guiding the treatment plans on vivax malaria, and the factors affecting the implementation of radical cure in South/South East Asian and Asian Pacific countries.MethodsThis was a qualitative study among respondents who represented national malaria control programmes (NMCPs) or had a role and influence in the national malaria policies. 33 respondents from 17 countries in South/South East Asia and Asia Pacific participated in interviews between October 15 and December 15, 2020. Semi-structured interviews were conducted virtually except for two face to face interviews and audio-recorded. Transcribed audio-records underwent thematic analysis using QSR NVivo.ResultsPolicies against vivax malaria were underprioritized, compared with the focus on falciparum malaria and, in particular, drug resistant Plasmodium falciparum strains. Despite the familiarity with primaquine (PQ) as the essential treatment to achieve the radical cure, the respondents contested the need for G6PD testing. Optional G6PD testing was reported to have poor adherence. The fear of adverse events led health workers to hesitate prescribing PQ. In countries where G6PD was mandatory, respondents experienced frequent stockouts of G6PD rapid diagnostic kits in peripheral health facilities, which was compounded by a short shelf life of these tests. These challenges were echoed across participating countries to various degrees. Most respondents agreed that a shorter treatment regimen, such as single dose tafenoquine could resolve these problems but mandatory G6PD testing will be needed. The recommendation of shorter regimens including tafenoquine or high dose PQ requires operational evidence demonstrating the robust performance of point of care G6PD tests (biosensors).ConclusionThere was sparse implementation and low adherence to the radical cure in South/South East Asian and Asian pacific countries. Shorter treatment regimens with appropriate point of care quantitative G6PD tests may resolve the current challenges. Operational evidence on point of care quantitative G6PD tests that includes the feasibility of integrating such tests into the radical cure regimen are critical to ensure its implementation.

Project description:BackgroundSystematic identification of evidence in health policy can be time-consuming and challenging. This study examines three questions pertaining to systematic reviews on obesity prevention policy, in order to identify the most efficient search methods: (1) What percentage of the primary studies selected for inclusion in the reviews originated in scholarly as opposed to gray literature? (2) How much of the primary scholarly literature in this topic area is indexed in PubMed/MEDLINE? (3) Which databases index the greatest number of primary studies not indexed in PubMed, and are these databases searched consistently across systematic reviews?MethodsWe identified systematic reviews on obesity prevention policy and explored their search methods and citations. We determined the percentage of scholarly vs. gray literature cited, the most frequently cited journals, and whether each primary study was indexed in PubMed. We searched 21 databases for all primary study articles not indexed in PubMed to determine which database(s) indexed the highest number of these relevant articles.ResultsIn total, 21 systematic reviews were identified. Ten of the 21 systematic reviews reported searching gray literature, and 12 reviews ultimately included gray literature in their analyses. Scholarly articles accounted for 577 of the 649 total primary study papers. Of these, 495 (76%) were indexed in PubMed. Google Scholar retrieved the highest number of the remaining 82 non-PubMed scholarly articles, followed by Scopus and EconLit. The Journal of the American Dietetic Association was the most-cited journal.ConclusionsResearchers can maximize search efficiency by searching a small yet targeted selection of both scholarly and gray literature resources. A highly sensitive search of PubMed and those databases that index the greatest number of relevant articles not indexed in PubMed, namely multidisciplinary and economics databases, could save considerable time and effort. When combined with a gray literature search and additional search methods, including cited reference searching and consulting with experts, this approach could help maintain broad retrieval of relevant studies while improving search efficiency. Findings also have implications for designing specialized databases for public health research.

Dataset Information

Assessing how information is packaged in rapid reviews for policy-makers and other stakeholders: a cross-sectional study

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets