Dataset Information

Evidence to Decision framework provides a structured "roadmap" for making GRADE guidelines recommendations.

ABSTRACT: OBJECTIVES:It is unclear how guidelines panelists discuss and consider factors (criteria) that are formally and not formally included in the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. To describe the use of decision criteria, we explored how panelists adhered to GRADE criteria and sought to identify any emerging non-GRADE criteria when the panelists used the Evidence to Decision (EtD) framework as part of GRADE application. STUDY DESIGN AND SETTING:We used conventional and summative qualitative analyses to identify themes emerging from face-to-face, panel meeting discussions. Forty-eight members from 12 countries participated in the development of five guidelines for the management of venous thromboembolism by the American Society of Hematology. RESULTS:Ten themes corresponded to the GRADE approach and represented all panel discussions. Over half (53%) of the total panel discussions concerned the use of research evidence. When evidence was considered sufficient and clear, the decision-making process proved rapid. CONCLUSION:The GRADE EtD framework provides structure to guidelines panel meetings, and ensures that the panelists consider all established formal GRADE criteria as they decide on the recommendation text, strength, and direction (for or against an intervention). This is the first study assessing the use of GRADE's EtD framework during real-time guidelines development using panel discussions. Given the widespread use of GRADE, this study provides important information for practice recommendations generated when guidelines panels explicitly follow, in a transparent and systematic manner, the structured GRADE EtD framework. By recognizing the extent to which panels discuss and consider GRADE and other (non-GRADE) criteria for producing guideline recommendations, we are one step closer to understanding the decision-making process in panels that use a structured framework such as the GRADE EtD framework.

SUBMITTER: Li SA

PROVIDER: S-EPMC7275375 | biostudies-literature | 2018 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evidence to Decision framework provides a structured "roadmap" for making GRADE guidelines recommendations.

Li Shelly-Anne SA Alexander Paul E PE Reljic Tea T Cuker Adam A Nieuwlaat Robby R Wiercioch Wojtek W Guyatt Gordon G Schünemann Holger J HJ Djulbegovic Benjamin B

Journal of clinical epidemiology 20180922

<h4>Objectives</h4>It is unclear how guidelines panelists discuss and consider factors (criteria) that are formally and not formally included in the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. To describe the use of decision criteria, we explored how panelists adhered to GRADE criteria and sought to identify any emerging non-GRADE criteria when the panelists used the Evidence to Decision (EtD) framework as part of GRADE application.<h4>Study design and se ...[more]

PMID: 30253221

Similar Datasets

Project description:BackgroundAccurate diagnosis is a fundamental aspect of appropriate healthcare. However, clinicians need guidance when implementing diagnostic tests given the number of tests available and resource constraints in healthcare. Practitioners of health often feel compelled to implement recommendations in guidelines, including recommendations about the use of diagnostic tests. However, the understanding about diagnostic tests by guideline panels and the methodology for developing recommendations is far from completely explored. Therefore, we evaluated the factors that guideline developers and users need to consider for the development of implementable recommendations about diagnostic tests.MethodsUsing a critical analysis of the process, we present the results of a case study using the Grading of Recommendations Applicability, Development and Evaluation (GRADE) approach to develop a clinical practice guideline for the diagnosis of Cow Milk Allergy with the World Allergy Organization.ResultsTo ensure that guideline panels can develop informed recommendations about diagnostic tests, it appears that more emphasis needs to be placed on group processes, including question formulation, defining patient-important outcomes for diagnostic tests, and summarizing evidence. Explicit consideration of concepts of diagnosis from evidence-based medicine, such as pre-test probability and treatment threshold, is required to facilitate the work of a guideline panel and to formulate implementable recommendations.DiscussionThis case study provides useful guidance for guideline developers and clinicians about what they ought to demand from clinical practice guidelines to facilitate implementation and strengthen confidence in recommendations about diagnostic tests. Applying a structured framework like the GRADE approach with its requirement for transparency in the description of the evidence and factors that influence recommendations facilitates laying out the process and decision factors that are required for the development, interpretation, and implementation of recommendations about diagnostic tests.

Project description:BackgroundClass specific deprescribing guidelines could help clinicians taper and stop medications no longer needed or which may be causing more harm than benefit. We set out to develop methodology to create such guidelines using evidence-based methods for guideline development, evidence synthesis and recommendation rating.Methods and findingsUsing a comprehensive checklist for a successful guideline enterprise, we conducted a national modified Delphi consensus process to identify priorities for deprescribing guidelines, then conducted scoping exercises to identify feasible topics, and sequentially developed three deprescribing guidelines. We selected guideline development team members for clinical expertise; a GRADE member worked with staff to ensure guideline development processes were followed. We conducted or used systematic searches and reviews of deprescribing trials of selected drug classes, reviews or systematic reviews of drug class effectiveness, reviews of reviews of drug class harm and narrative syntheses of contextual questions to inform recommendations and guideline development. Our 8 step process for guideline development included defining scope and purpose, developing a logic model to guide the process and generate key clinical questions, setting criteria for admissible evidence and conducting systematic reviews, synthesizing evidence considering additional contextual information and performing quality estimates, formulating recommendations and providing strength estimations, adding clinical considerations, conducting clinical and stakeholder review and finally updating content pre-publication. Innovative aspects of the guideline development process included synthesizing evidence for outcomes of tapering or stopping medication, and incorporating evidence for medication harm into the recommendation strength rating. Through the development of three deprescribing guidelines (for proton pump inhibitors, benzodiazepine receptor agonists and antipsychotics) and associated decision-support algorithms, we were able to gradually hone the methodology; each guideline will be published separately.ConclusionOur methodology demonstrates the importance of searching for short and long-term outcomes, showing the benefits of deprescribing and studying patient preferences. This publication will support development of future deprescribing guidelines.

Project description:ObjectiveTo describe a framework for people making and using evidence-informed health system and public health recommendations and decisions.BackgroundWe developed the GRADE Evidence to Decision (EtD) framework for health system and public health decisions as part of the DECIDE project, in which we simultaneously developed frameworks for these and other types of healthcare decisions, including clinical recommendations, coverage decisions and decisions about diagnostic tests.Developing the frameworkBuilding on GRADE EtD tables, we used an iterative approach, including brainstorming, consultation of the literature and with stakeholders, and an international survey of policy-makers. We applied the framework to diverse examples, conducted workshops and user testing with health system and public health guideline developers and policy-makers, and observed and tested its use in real-life guideline panels.FindingsAll the GRADE EtD frameworks share the same basic structure, including sections for formulating the question, making an assessment and drawing conclusions. Criteria listed in the assessment section of the health system and public health framework cover the important factors for making these types of decisions; in addition to the effects and economic impact of an option, the priority of the problem, the impact of the option on equity, and its acceptability and feasibility are important considerations that can inform both whether and how to implement an option. Because health system and public health interventions are often complex, detailed implementation considerations should be made when making a decision. The certainty of the evidence is often low or very low, but decision-makers must still act. Monitoring and evaluation are therefore often important considerations for these types of decisions. We illustrate the different components of the EtD framework for health system and public health decisions by presenting their application in a framework adapted from a real-life guideline.DiscussionThis framework provides a structured and transparent approach to support policy-making informed by the best available research evidence, while making the basis for decisions accessible to those whom they will affect. The health system and public health EtD framework can also be used to facilitate dissemination of recommendations and enable decision-makers to adopt, and adapt, recommendations or decisions.

Project description:BackgroundWHO has recognised the need to improve its guideline methodology to ensure that guideline decision-making processes are transparent and evidence based, and that the resulting recommendations are relevant and applicable. To help achieve this, WHO guidelines now typically enhance intervention effectiveness data with evidence on a wider range of decision-making criteria, including how stakeholders value different outcomes, equity, gender and human rights impacts, and the acceptability and feasibility of interventions. Qualitative evidence syntheses (QES) are increasingly used to provide evidence on this wider range of issues. In this paper, we describe and discuss how to use the findings from QES to populate decision-making criteria in evidence-to-decision (EtD) frameworks. This is the second in a series of three papers that examines the use of QES in developing clinical and health system guidelines.MethodsWHO convened a writing group drawn from the technical teams involved in its recent (2010-2018) guidelines employing QES. Using a pragmatic and iterative approach that included feedback from WHO staff and other stakeholders, the group reflected on, discussed and identified key methods and research implications from designing QES and using the resulting findings in guideline development.ResultsWe describe a step-wise approach to populating EtD frameworks with QES findings. This involves allocating findings to the different EtD criteria (how stakeholders value different outcomes, equity, acceptability and feasibility, etc.), weaving the findings into a short narrative relevant to each criterion, and inserting this summary narrative into the corresponding 'research evidence' sections of the EtD. We also identify areas for further methodological research, including how best to summarise and present qualitative data to groups developing guidelines, how these groups draw on different types of evidence in their decisions, and the extent to which our experiences are relevant to decision-making processes in fields other than health.ConclusionsThis paper shows the value of incorporating QES within a guideline development process, and the roles that qualitative evidence can play in integrating the views and experiences of relevant stakeholders, including groups who may not be otherwise represented in the decision-making process.

Project description:BackgroundIn 2019, WHO prioritized updating recommendations relating to three labour induction topics: labour induction at or beyond term, mechanical methods for labour induction, and outpatient labour induction. As part of this process, we aimed to review the evidence addressing factors beyond clinical effectiveness (values, human rights and sociocultural acceptability, health equity, and economic and feasibility considerations) to inform WHO Guideline Development Group decision-making using the WHO-INTEGRATE evidence-to-decision framework, and to reflect on how methods for identifying, synthesizing and integrating this evidence could be improved.MethodsWe adapted the framework to consider the key criteria and sub-criteria relevant to our intervention. We searched for qualitative and other evidence across a variety of sources and mapped the eligible evidence to country income setting and perspective. Eligibility assessment and quality appraisal of qualitative evidence syntheses was undertaken using a two-step process informed by the ENTREQ statement. We adopted an iterative approach to interpret the evidence and provided both summary and detailed findings to the decision-makers. We also undertook a review to reflect on opportunities to improve the process of applying the framework and identifying the evidence.ResultsUsing the WHO-INTEGRATE framework allowed us to explore health rights and equity in a systematic and transparent way. We identified a lack of qualitative and other evidence from low- and middle-income settings and in populations that are most impacted by structural inequities or traditionally excluded from research. Our process review highlighted opportunities for future improvement, including adopting more systematic evidence mapping methods and working with social science researchers to strengthen theoretical understanding, methods and interpretation of the evidence.ConclusionsUsing the WHO-INTEGRATE evidence-to-decision framework to inform decision-making in a global guideline for induction of labour, we identified both challenges and opportunities relating to the lack of evidence in populations and settings of need and interest; the theoretical approach informing the development and application of WHO-INTEGRATE; and interpretation of the evidence. We hope these insights will be useful for primary researchers as well as the evidence synthesis and health decision-making communities, and ultimately contribute to a reduction in health inequities.

Project description:Background:Decision-making in public health and health policy is complex and requires careful deliberation of many and sometimes conflicting normative and technical criteria. Several approaches and tools, such as multi-criteria decision analysis, health technology assessments and evidence-to-decision (EtD) frameworks, have been proposed to guide decision-makers in selecting the criteria most relevant and appropriate for a transparent decision-making process. This study forms part of the development of the WHO-INTEGRATE EtD framework, a framework rooted in global health norms and values as reflected in key documents of the World Health Organization and the United Nations system. The objective of this study was to provide a comprehensive overview of criteria used in or proposed for real-world decision-making processes, including guideline development, health technology assessment, resource allocation and others. Methods:We conducted an overview of systematic reviews through a combination of systematic literature searches and extensive reference searches. Systematic reviews reporting criteria used for real-world health decision-making by governmental or non-governmental organization on a supranational, national, or programme level were included and their quality assessed through a bespoke critical appraisal tool. The criteria reported in the reviews were extracted, de-duplicated and sorted into first-level (i.e. criteria), second-level (i.e. sub-criteria) and third-level (i.e. decision aspects) categories. First-level categories were developed a priori using a normative approach; second- and third-level categories were developed inductively. Results:We included 36 systematic reviews providing criteria, of which one met all and another eleven met at least five of the items of our critical appraisal tool. The criteria were subsumed into 8 criteria, 45 sub-criteria and 200 decision aspects. The first-level of the category system comprised the following seven substantive criteria: "Health-related balance of benefits and harms"; "Human and individual rights"; "Acceptability considerations"; "Societal considerations"; "Considerations of equity, equality and fairness"; "Cost and financial considerations"; and "Feasibility and health system considerations". In addition, we identified an eight criterion "Evidence". Conclusion:This overview of systematic reviews provides a comprehensive overview of criteria used or suggested for real-world health decision-making. It also discusses key challenges in the selection of the most appropriate criteria and in seeking to implement a fair decision-making process.

Project description:IntroductionThe rapid spread of drug resistance is forcing standard treatment guidelines (STGs) to become more appropriate with due consideration of the evidence on the antimicrobial resistance (AMR) situation in Ethiopia. Therefore, we aimed to assess the local AMR recommendations in the STGs for empirical antibacterial prescriptions for the five common infectious syndromes. We also determined the quality of AMR reviews conducted in the country.MethodsWe conducted a review of the STGs used in the health centers, general hospitals, and primary hospitals in Ethiopia and assessed the AMR recommendations in STGs for empirical antibacterial prescriptions for community-acquired pneumonia (CAP), urinary tract infection (UTI), tonsillopharyngitis, acute otitis media (AOM), and bacterial dysentery. Next, we performed an overview of AMR reviews published in Ethiopia. We used the MEDLINE/PubMed, Embase, Cochrane Library, and Google Scholar databases to identify AMR reviews. The review characteristics were extracted. We also evaluated the quality of each included AMR review using a measurement tool to assess the systematic review scale (AMSTAR 2).ResultsA total of 6 STGs and 12 AMR reviews conducted in the country were included. The choice of empirical antibacterials for similar infectious syndromes (and editions) was comparable across the three levels of the health care system. None of the STGs evaluated included the local AMR recommendations for empirical antibacterial prescriptions for five common infectious syndromes. Of all the AMR reviews included, 75% had low and below methodologic quality, and none had a high-quality score using the AMSTAR 2 tool.ConclusionStandard treatment guidelines did not consider local AMR recommendations for empirically prescribing antibacterials for common infectious syndromes. The AMR reviews published in the country produced poor methodologic quality evidence for clinical applications. This highlights the need to improve the methodologic quality to provide the best available evidence for clinical decision-making and curb the ongoing AMR in Ethiopia.Trial registrationRetrospectively registered (15/07/2020).

Dataset Information

Evidence to Decision framework provides a structured "roadmap" for making GRADE guidelines recommendations.

Publications

Evidence to Decision framework provides a structured "roadmap" for making GRADE guidelines recommendations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets