Dataset Information

The GRADE evidence-to-decision framework: a report of its testing and application in 15 international guideline panels.

ABSTRACT: BACKGROUND:Judgments underlying guideline recommendations are seldom recorded and presented in a systematic fashion. The GRADE Evidence-to-Decision Framework (EtD) offers a transparent way to record and report guideline developers' judgments. In this paper, we report the experiences with the EtD frameworks in 15 real guideline panels. METHODS:Following the guideline panel meetings, we asked methodologists participating in the panel to provide feedback regarding the EtD framework. They were instructed to consider their own experience and the feedback collected from the rest of the panel. Two investigators independently summarized the responses and jointly interpreted the data using pre-specified domains as coding system. We asked methodologists to review the results and provide further input to improve the structure of the EtDs iteratively. RESULTS:The EtD framework was well received, and the comments were generally positive. Methodologists felt that in a real guideline panel, the EtD framework helps structuring a complex process through relatively simple steps in an explicit and transparent way. However, some sections (e.g., "values and preferences" and "balance between benefits and harms") required further development and clarification that were considered in the current version of the EtD framework. CONCLUSIONS:The use of an EtD framework in guideline development offers a structured and explicit way to record and report the judgments and discussion of guideline panels during the formulation of recommendations. In addition, it facilitates the formulation of recommendations, assessment of their strength, and identifying gaps in research.

SUBMITTER: Neumann I

PROVIDER: S-EPMC4946225 | biostudies-literature | 2016 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The GRADE evidence-to-decision framework: a report of its testing and application in 15 international guideline panels.

Neumann Ignacio I Brignardello-Petersen Romina R Wiercioch Wojtek W Carrasco-Labra Alonso A Cuello Carlos C Akl Elie E Mustafa Reem A RA Al-Hazzani Waleed W Etxeandia-Ikobaltzeta Itziar I Rojas Maria Ximena MX Falavigna Maicon M Santesso Nancy N Brozek Jan J Iorio Alfonso A Alonso-Coello Pablo P Schünemann Holger J HJ

Implementation science : IS 20160715

<h4>Background</h4>Judgments underlying guideline recommendations are seldom recorded and presented in a systematic fashion. The GRADE Evidence-to-Decision Framework (EtD) offers a transparent way to record and report guideline developers' judgments. In this paper, we report the experiences with the EtD frameworks in 15 real guideline panels.<h4>Methods</h4>Following the guideline panel meetings, we asked methodologists participating in the panel to provide feedback regarding the EtD framework. ...[more]

PMID: 27417219

Similar Datasets

Project description:OBJECTIVES:It is unclear how guidelines panelists discuss and consider factors (criteria) that are formally and not formally included in the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. To describe the use of decision criteria, we explored how panelists adhered to GRADE criteria and sought to identify any emerging non-GRADE criteria when the panelists used the Evidence to Decision (EtD) framework as part of GRADE application. STUDY DESIGN AND SETTING:We used conventional and summative qualitative analyses to identify themes emerging from face-to-face, panel meeting discussions. Forty-eight members from 12 countries participated in the development of five guidelines for the management of venous thromboembolism by the American Society of Hematology. RESULTS:Ten themes corresponded to the GRADE approach and represented all panel discussions. Over half (53%) of the total panel discussions concerned the use of research evidence. When evidence was considered sufficient and clear, the decision-making process proved rapid. CONCLUSION:The GRADE EtD framework provides structure to guidelines panel meetings, and ensures that the panelists consider all established formal GRADE criteria as they decide on the recommendation text, strength, and direction (for or against an intervention). This is the first study assessing the use of GRADE's EtD framework during real-time guidelines development using panel discussions. Given the widespread use of GRADE, this study provides important information for practice recommendations generated when guidelines panels explicitly follow, in a transparent and systematic manner, the structured GRADE EtD framework. By recognizing the extent to which panels discuss and consider GRADE and other (non-GRADE) criteria for producing guideline recommendations, we are one step closer to understanding the decision-making process in panels that use a structured framework such as the GRADE EtD framework.

Project description:ObjectiveTo describe a framework for people making and using evidence-informed health system and public health recommendations and decisions.BackgroundWe developed the GRADE Evidence to Decision (EtD) framework for health system and public health decisions as part of the DECIDE project, in which we simultaneously developed frameworks for these and other types of healthcare decisions, including clinical recommendations, coverage decisions and decisions about diagnostic tests.Developing the frameworkBuilding on GRADE EtD tables, we used an iterative approach, including brainstorming, consultation of the literature and with stakeholders, and an international survey of policy-makers. We applied the framework to diverse examples, conducted workshops and user testing with health system and public health guideline developers and policy-makers, and observed and tested its use in real-life guideline panels.FindingsAll the GRADE EtD frameworks share the same basic structure, including sections for formulating the question, making an assessment and drawing conclusions. Criteria listed in the assessment section of the health system and public health framework cover the important factors for making these types of decisions; in addition to the effects and economic impact of an option, the priority of the problem, the impact of the option on equity, and its acceptability and feasibility are important considerations that can inform both whether and how to implement an option. Because health system and public health interventions are often complex, detailed implementation considerations should be made when making a decision. The certainty of the evidence is often low or very low, but decision-makers must still act. Monitoring and evaluation are therefore often important considerations for these types of decisions. We illustrate the different components of the EtD framework for health system and public health decisions by presenting their application in a framework adapted from a real-life guideline.DiscussionThis framework provides a structured and transparent approach to support policy-making informed by the best available research evidence, while making the basis for decisions accessible to those whom they will affect. The health system and public health EtD framework can also be used to facilitate dissemination of recommendations and enable decision-makers to adopt, and adapt, recommendations or decisions.

Project description:Background: Guidelines based on patient preferences differ from those developed solely by clinicians and may promote patient adherence to guideline recommendations. There is scant evidence on how to develop patient-informed guidelines. This study aimed to describe how guideline developers identify, incorporate and report patient preferences.Methods: We employed a descriptive cross-sectional survey design. Eligible organizations were non-profit agencies who developed at least one guideline in the past five years and had considered patient preferences in guideline development. We identified developers through the Guidelines International Network and publicly-available guideline repositories, administered the survey online, and used summary statistics to report results.Results: The response rate was 18.3% (52/284). Respondents included professional societies, and government, academic, charitable and healthcare delivery organizations from 18 countries with at least 1 to ?6?years of experience generating patient-informed guidelines. Organizations most frequently identified preferences through patient panelists (86.5%) and published research (84.6%). Most organizations (48, 92.3%) used multiple approaches to identify preferences (median 3, range 1 to 5). Most often, organizations used preferences to generate recommendations (82.7%) or establish guideline questions (73.1%). Few organizations explicitly reported preferences; instead, they implicitly embedded preferences in guideline recommendations (82.7%), questions (73.1%), or point-of-care communication tools (61.5%). Most developers had little capacity to generate patient-informed guidelines. Few offered training to patients (30.8%), or had dedicated funding (28.9%), managers (9.6%) or staff (9.6%). Respondents identified numerous barriers to identifying preferences. They also identified processes, resources and clinician- and patient-strategies that can facilitate the development of patient-informed guidelines. In contrast to identifying preferences, developers noted few approaches for, or barriers or facilitators of incorporating or reporting preferences.Conclusions: Developers emphasized the need for knowledge on how to identify, incorporate and report patient preferences in guidelines. In particular, how to use patient preferences to formulate recommendations, and transparently report patient preferences and the influence of preferences on guidelines is unknown. Still, insights from responding developers may help others who may be struggling to generate guidelines informed by patient preferences.

Project description:Essential medicine lists (EMLs) are important medicine prioritization tools used by the World Health Organization (WHO) EML and over 130 countries. The criteria used by WHO's Expert Committee on the Selection and Use of Essential Medicines has parallels to the GRADE Evidence-to-Decision (EtD) frameworks. In this study, we explored the EtD frameworks and a visual abstract as adjunctive tools to strengthen the integrate evidence and improve the transparency of decisions of EML applications. We conducted user-experience testing interviews of key EML stakeholders using Morville's honeycomb model. Interviews explored multifaceted dimensions (e.g., usability) on two EML applications for the 2021 WHO EML-long-acting insulin analogues for diabetes and immune checkpoint inhibitors for lung cancer. Using a pre-determined coding framework and thematic analysis we iteratively improved both the EtD framework and the visual abstract. We coded the transcripts of 17 interviews with 13 respondents in 103 locations of the interview texts across all dimensions of the user-experience honeycomb. Respondents felt the EtD framework and visual abstract presented complementary useful and findable adjuncts to the traditional EML application. They felt this would increase transparency and efficiency in evidence assessed by EML committees. As EtD frameworks are also used in health practice guidelines, including those by the WHO, respondents articulated that the adoption of the EtD by EML applications represents a tangible mechanism to align EMLs and guidelines, decrease duplication of work and improve coordination. Improvements were made to clarify instructions for the EtD and visual abstract, and to refine the design and content included. 'Availability' was added as an additional criterion for EML applications to highlight this criterion in alignment with WHO EML criteria. EtD frameworks and visual abstracts present additional important tools to communicate evidence and support decision-criteria in EML applications, which have global health impact. Access to essential medicines is important for achieving universal health coverage, and the development of essential medicine lists should be as evidence-based and trustworthy as possible.

Project description:This is an update to the 2014 Canadian Hereditary Angioedema Guideline with an expanded scope to include the management of hereditary angioedema (HAE) patients worldwide. It is a collaboration of Canadian and international HAE experts and patient groups led by the Canadian Hereditary Angioedema Network. The objective of this guideline is to provide evidence-based recommendations, using the GRADE system, for the management of patients with HAE. This includes the treatment of attacks, short-term prophylaxis, long-term prophylaxis, and recommendations for self-administration, individualized therapy, quality of life, and comprehensive care. New to the 2019 version of this guideline are sections covering the diagnosis and recommended therapies for acute treatment in HAE patients with normal C1-INH, as well as sections on pregnant and paediatric patients, patient associations and an HAE registry. Hereditary angioedema results in random and often unpredictable attacks of painful swelling typically affecting the extremities, bowel mucosa, genitals, face and upper airway. Attacks are associated with significant functional impairment, decreased health-related quality of life, and mortality in the case of laryngeal attacks. Caring for patients with HAE can be challenging due to the complexity of this disease. The care of patients with HAE in Canada, as in many countries, continues to be neither optimal nor uniform. It lags behind some other countries where there are more organized models for HAE management, and greater availability of additional licensed therapeutic options. It is anticipated that providing this guideline to caregivers, policy makers, patients, and advocates will not only optimize the management of HAE, but also promote the importance of individualized care. The primary target users of this guideline are healthcare providers who are managing patients with HAE. Other healthcare providers who may use this guideline are emergency and intensive care physicians, primary care physicians, gastroenterologists, dentists, otolaryngologists, paediatricians, and gynaecologists who will encounter patients with HAE and need to be aware of this condition. Hospital administrators, insurers and policy makers may also find this guideline helpful.

Dataset Information

The GRADE evidence-to-decision framework: a report of its testing and application in 15 international guideline panels.

Publications

The GRADE evidence-to-decision framework: a report of its testing and application in 15 international guideline panels.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets