Challenges in applying the GRADE approach in public health guidelines and systematic reviews: a concept article from the GRADE Public Health Group.
Ontology highlight
ABSTRACT: Background and objective
This article explores the need for conceptual advances and practical guidance in the application of the GRADE approach within public health contexts.Methods
We convened an expert workshop and conducted a scoping review to identify challenges experienced by GRADE users in public health contexts. We developed this concept article through thematic analysis and an iterative process of consultation and discussion conducted with members electronically and at three GRADE Working Group meetings.Results
Five priority issues can pose challenges for public health guideline developers and systematic reviewers when applying GRADE: (1) incorporating the perspectives of diverse stakeholders; (2) selecting and prioritizing health and "nonhealth" outcomes; (3) interpreting outcomes and identifying a threshold for decision-making; (4) assessing certainty of evidence from diverse sources, including nonrandomized studies; and (5) addressing implications for decision makers, including concerns about conditional recommendations. We illustrate these challenges with examples from public health guidelines and systematic reviews, identifying gaps where conceptual advances may facilitate the consistent application or further development of the methodology and provide solutions.Conclusion
The GRADE Public Health Group will respond to these challenges with solutions that are coherent with existing guidance and can be consistently implemented across public health decision-making contexts.
SUBMITTER: Hilton Boon M
PROVIDER: S-EPMC8352629 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:This is a protocol for a scoping review that aims to determine how guideline authors using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach have addressed previously identified challenges related to public health. The Joanna Briggs Institute (JBI) methodology for scoping reviews will be followed. We will search and screen titles of guidelines for all languages published in 2013-2021 in: the GIN library, BIGG database, Epistemonikos GRADE guidelines repository, GRADEpro Database, MAGICapp, NICE and WHO websites. Two reviewers will independently screen full texts of the documents identified. The following information will be extracted: methods used for identifying different stakeholders and incorporating their perspectives; methods for identification and prioritization of non-health outcomes; methods for determining thresholds for decision-making; methods for incorporating and grading evidence from non-randomized studies; methods for addressing concerns with conditional recommendations in public health; methods for reaching consensus; additional methodological concerns; and any modifications made to GRADE. A combination of directed content analysis and descriptive statistics will be used for data analysis, and the findings presented narratively in a tabular and graphical form. In this protocol, we present the pilot results from 13 identified eligible guidelines issued between January and August 2021. We will publish the full review results when they become available.
| S-EPMC8775462 | biostudies-literature
Project description:BackgroundThe rapid review is an approach to synthesizing research evidence when a shorter timeframe is required. The implications of what is lost in terms of rigour, increased bias and accuracy when conducting a rapid review have not yet been elucidated.MethodsWe assessed the potential implications of methodological shortcuts on the outcomes of three completed systematic reviews addressing agri-food public health topics. For each review, shortcuts were applied individually to assess the impact on the number of relevant studies included and whether omitted studies affected the direction, magnitude or precision of summary estimates from meta-analyses.ResultsIn most instances, the shortcuts resulted in at least one relevant study being omitted from the review. The omission of studies affected 39 of 143 possible meta-analyses, of which 14 were no longer possible because of insufficient studies (<2). When meta-analysis was possible, the omission of studies generally resulted in less precise pooled estimates (i.e. wider confidence intervals) that did not differ in direction from the original estimate.ConclusionsThe three case studies demonstrated the risk of missing relevant literature and its impact on summary estimates when methodological shortcuts are applied in rapid reviews. © 2016 The Authors. Research Synthesis Methods Published by John Wiley & Sons Ltd.
| S-EPMC5215373 | biostudies-literature
Project description:BackgroundThe Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach has been adopted by many national and international organisations as a systematic and transparent framework for evidence-based guideline development. With reference to an ongoing debate in the literature and within public health organisations, this study reviews current experience with the GRADE approach in rating the quality of evidence in the field of public health and identifies challenges encountered.MethodsWe conducted semi-structured interviews with individuals/groups that have applied the GRADE approach in the context of systematic reviews or guidelines in the field of public health, as well as with representatives of groups or organisations that actively decided against its use. We initially contacted potential participants by email. Responses were obtained by telephone interview or email, and written interview summaries were validated with participants. We analysed data across individual interviews to distil common themes and challenges.ResultsBased on 25 responses, we undertook 18 interviews and obtained 15 in-depth responses relating to specific systematic reviews or guideline projects; a majority of the latter were contributed by groups within the World Health Organization. All respondents that have used the GRADE approach appreciated the systematic and transparent process of assessing the quality of the evidence. However, respondents reported a range of minor and major challenges relating to complexity of public health interventions, choice of outcomes and outcome measures, ability to discriminate between different types of observational studies, use of non-epidemiological evidence, GRADE terminology and the GRADE and guideline development process. Respondents' suggestions to make the approach more applicable to public health interventions included revisiting terminology, offering better guidance on how to apply GRADE to complex interventions and making modifications to the current grading scheme.ConclusionsOur findings suggest that GRADE principles are applicable to public health and well-received but also highlight common challenges. They provide a starting point for exploring options for improvements and, where applicable, testing these across different types of public health interventions. Several public health organisations are currently testing GRADE, and the GRADE Working Group is eager to engage with these groups to find ways to address concerns.
| S-EPMC3546302 | biostudies-literature
Project description:BackgroundAs a source of readily available evidence, rigorously synthesized and interpreted by expert clinicians and methodologists, clinical guidelines are part of an evidence-based practice toolkit, which, transformed into practice recommendations, have the potential to improve both the process of care and patient outcomes. In Brazil, the process of development and updating of the clinical guidelines for the Brazilian Unified Health System (Sistema Único de Saúde, SUS) is already well systematized by the Ministry of Health. However, the implementation process of those guidelines has not yet been discussed and well structured. Therefore, the first step of this project and the primary objective of this study was to summarize the evidence on the effectiveness of strategies used to promote clinical practice guideline implementation and dissemination.MethodsThis overview used systematic review methodology to locate and evaluate published systematic reviews regarding strategies for clinical practice guideline implementation and adhered to the PRISMA guidelines for systematic review (PRISMA).ResultsThis overview identified 36 systematic reviews regarding 30 strategies targeting healthcare organizations, healthcare providers and patients to promote guideline implementation. The most reported interventions were educational materials, educational meetings, reminders, academic detailing and audit and feedback. Care pathways-single intervention, educational meeting-single intervention, organizational culture, and audit and feedback-both strategies implemented in combination with others-were strategies categorized as generally effective from the systematic reviews. In the meta-analyses, when used alone, organizational culture, educational intervention and reminders proved to be effective in promoting physicians' adherence to the guidelines. When used in conjunction with other strategies, organizational culture also proved to be effective. For patient-related outcomes, education intervention showed effective results for disease target results at a short and long term.ConclusionThis overview provides a broad summary of the best evidence on guideline implementation. Even if the included literature highlights the various limitations related to the lack of standardization, the methodological quality of the studies, and especially the lack of conclusion about the superiority of one strategy over another, the summary of the results provided by this study provides information on strategies that have been most widely studied in the last few years and their effectiveness in the context in which they were applied. Therefore, this panorama can support strategy decision-making adequate for SUS and other health systems, seeking to positively impact on the appropriate use of guidelines, healthcare outcomes and the sustainability of the SUS.
| S-EPMC8785489 | biostudies-literature
Project description:The global refugee crisis has become an urgent, pressing humanitarian issue, with an estimated 37 million children forcibly displaced from their homes due to conflict, persecution, violence and other human rights violations by mid-2022. Of these children, only a small percentage are eligible for resettlement in a new country. This narrative review examines the physical health needs of resettled refugee children (RRC) in the United States. By analyzing nutrition and growth, infectious diseases, and general health care/screening measures, a set of comprehensive, evidence-based guidelines and public health perspectives are formulated to facilitate ongoing discussion to ensure that RRC receive equitable health care access. An urgent call to action emphasizes cross-border collaboration between governments, public health experts, refugee populations, and disease preparedness authorities in order to prioritize the physical health of RRC. This review will provide primary care providers, public health professionals, social service workers, and community advocates with up-to-date recommendations to meet the health needs of RRC in the U.S.
| S-EPMC10561301 | biostudies-literature
Project description:BackgroundPharmacy interventions are a subset of public health interventions and its research is usually performed within the scope of a trial. The economic evaluation of pharmacy interventions requires certain considerations which have some similarities to those of public health interventions and to economic evaluations alongside trials. The objective of this research is to perform an overview of systematic reviews of economic evaluations of pharmacy services and triangulate results with recommendations for economic evaluations of both public health interventions and alongside trials.Methods(1) Exploratory review of recommendations on the economic evaluation of public health interventions, (2) exploratory review of recommendations for conducting economic evaluations alongside trials, (3) overview of systematic reviews of economic evaluations of pharmacy interventions (protocol registered with PROSPERO 2016 outlining information sources, inclusion criteria, appraisal of reviews and synthesis methods).ResultsFourteen systematic reviews containing 75 index publications were included. Reviews reported favorable economic findings for 71% of studies with full economic evaluations. The types of economic analysis are diverse. Two critical quality domains are absent from most reviews. Key findings include the following: certain types of risk of bias, wider scope of study designs, and most economic quality criteria met but some issues unresolved or unclear. Triangulation revealed additional gaps. Limitations include choice of critical quality domains and potential biases in the overview process.ConclusionsEconomic evaluations of pharmacy-based public health interventions seem to follow most economic quality criteria, but there are still some issues in certain key areas to improve. These findings may assist in improving the design of pilot trials of economic evaluations in pharmacy, leading to robust evidence for payers. Based on the findings, we propose a methodological approach for the economic evaluation of pharmacy-based public health interventions.Systematic review registrationPROSPERO CRD42016032768.
| S-EPMC6844055 | biostudies-literature
Project description:This week an international panel announces a list of 14 Grand Challenges in Global Health, and scientists throughout the world will be invited to submit grant proposals to pursue them with funds provided by the Bill and Melinda Gates Foundation. We describe the characteristics of these challenges and the process by which they were formulated and selected after receiving over 1000 responses to a "call for ideas" from the scientific community.
| S-EPMC243493 | biostudies-literature
Project description:BackgroundExperience with public engagement activities regarding the risks and benefits of science and technology (S&T) is growing, especially in the industrialized world. However, public engagement in the developing world regarding S&T risks and benefits to explore health issues has not been widely explored.MethodsThis paper gives an overview about public engagement and related concepts, with a particular focus on challenges and benefits in the developing world. We then describe an Internet-based platform, which seeks to both inform and engage youth and the broader public on global water issues and their health impacts. Finally, we outline a possible course for future action to scale up this and similar online public engagement platforms.ResultsThe benefits of public engagement include creating an informed citizenry, generating new ideas from the public, increasing the chances of research being adopted, increasing public trust, and answering ethical research questions. Public engagement also fosters global communication, enables shared experiences and methodology, standardizes strategy, and generates global viewpoints. This is especially pertinent to the developing world, as it encourages previously marginalized populations to participate on a global stage. One of the core issues at stake in public engagement is global governance of science and technology. Also, beyond benefiting society at large, public engagement in science offers benefits to the scientific enterprise itself.ConclusionSuccessful public engagement with developing world stakeholders will be a critical part of implementing new services and technologies. Interactive engagement platforms, such as the Internet, have the potential to unite people globally around relevant health issues.
| S-EPMC2453523 | biostudies-literature
Project description:BackgroundThe study aimed to explore reporting characteristics of scoping reviews in dental public health and the impact of some factors on the reporting quality.MethodsThis study searched for dental public health scoping reviews in PubMed and Scopus without year restrictions and restricted to English-language publications. Study selection was undertaken by two reviewers independently. One reviewer, after training, extracted data from included studies considering general study characteristics and reporting characteristics. The impact of PRISMA-ScR publication, journal endorsement, and use of study protocol on the reporting was explored.ResultsEighty-one scoping reviews were included. Five items presented rates of appropriate reporting higher than 80% considering the overall percentage. Related to the impact of PRISMA-ScR publication, six items were found more often in scoping reviews published after the publication of PRISMA-ScR than in scoping reviews published before the publication of PRISMA-ScR. With regards to journals endorsement, only two reporting characteristics were found more often in scoping reviews published in journals that endorse the PRISMA-ScR statement than in scoping reviews published in non-endorsers journals. Last, regarding the use of the pre-specified protocol, five reporting characteristics presented differences in studies reporting the use of pre-specified protocol than in studies that did not mention the use of a protocol. All differences were statistically significant.ConclusionsImportant information is missing in the included scoping reviews demonstrating crucial reporting problems.
| S-EPMC9972695 | biostudies-literature
Project description:BackgroundA living systematic review (LSR) is an emerging review type that makes use of continual updating. In the COVID-19 pandemic, we were confronted with a shifting epidemiological landscape, clinical uncertainties and evolving evidence. These unexpected challenges compelled us to amend standard LSR methodology.Objective and outlineOur primary objective is to discuss some challenges faced when conducting LSRs in the context of the COVID-19 pandemic, and to provide methodological guidance for others doing similar work. Based on our experience and lessons learned from two Cochrane LSRs and challenges identified in several non-Cochrane LSRs, we highlight methodological considerations, particularly with regards to the study design, interventions and comparators, changes in outcome measure, and the search strategy. We discuss when to update, or rather when not to update the review, and the importance of transparency when reporting changes.Lessons learned and conclusionWe learned that a LSR is a very suitable review type for the pandemic context, even in the face of new methodological and clinical challenges. Our experience showed that the decision for updating a LSR depends not only on the evolving disease or emerging evidence, but also on the individual review question and the review teams' resources.
| S-EPMC8435072 | biostudies-literature