Dataset Information

Structured decision-making drives guidelines panels' recommendations "for" but not "against" health interventions.

ABSTRACT: BACKGROUND AND OBJECTIVES:The determinants of guideline panels' recommendations remain uncertain. The objective of this study was to investigate factors considered by members of 8 panels convened by the American Society of Hematology (ASH) to develop guidelines using Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system. STUDY DESIGN AND SETTING:Web-based survey of the participants in the ASH guidelines panels. ANALYSIS:two-level hierarchical, random-effect, multivariable regression analysis to explore the relation between GRADE and non-GRADE factors and strength of recommendations (SOR). RESULTS:In the primary analysis, certainty in evidence [OR = 1.83; (95CI% 1.45-2.31)], balance of benefits and harms [OR = 1.49 (95CI% 1.30-1.69)] and variability in patients' values and preferences [OR = 1.47 (95CI% 1.15-1.88)] proved the strongest predictors of SOR. In a secondary analysis, certainty of evidence was associated with a strong recommendation [OR = 3.60 (95% CI 2.16-6.00)] when panel members recommended "for" interventions but not when they made recommendations "against" interventions [OR = 0.98 (95%CI: 0.57-1.8)] consistent with "yes" bias. Agreement between individual members and the group in rating SOR varied (kappa ranged from -0.01 to 0.64). CONCLUSION:GRADE's conceptual framework proved, in general, to be highly associated with SOR. Failure of certainty of evidence to be associated with SOR against an intervention, suggest the need for improvements in the process.

SUBMITTER: Djulbegovic B

PROVIDER: S-EPMC7268742 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Structured decision-making drives guidelines panels' recommendations "for" but not "against" health interventions.

Djulbegovic Benjamin B Reljic Tea T Elqayam Shira S Cuker Adam A Hozo Iztok I Zhou Qi Q Li Shelly-Anne SA Alexander Paul P Nieuwlaat Robby R Wiercioch Wojtek W Schünemann Holger H Guyatt Gordon G

Journal of clinical epidemiology 20190216

<h4>Background and objectives</h4>The determinants of guideline panels' recommendations remain uncertain. The objective of this study was to investigate factors considered by members of 8 panels convened by the American Society of Hematology (ASH) to develop guidelines using Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system.<h4>Study design and setting</h4>Web-based survey of the participants in the ASH guidelines panels.<h4>Analysis</h4>two-level hierarchical, ra ...[more]

PMID: 30779950

Similar Datasets

Project description:OBJECTIVES:It is unclear how guidelines panelists discuss and consider factors (criteria) that are formally and not formally included in the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. To describe the use of decision criteria, we explored how panelists adhered to GRADE criteria and sought to identify any emerging non-GRADE criteria when the panelists used the Evidence to Decision (EtD) framework as part of GRADE application. STUDY DESIGN AND SETTING:We used conventional and summative qualitative analyses to identify themes emerging from face-to-face, panel meeting discussions. Forty-eight members from 12 countries participated in the development of five guidelines for the management of venous thromboembolism by the American Society of Hematology. RESULTS:Ten themes corresponded to the GRADE approach and represented all panel discussions. Over half (53%) of the total panel discussions concerned the use of research evidence. When evidence was considered sufficient and clear, the decision-making process proved rapid. CONCLUSION:The GRADE EtD framework provides structure to guidelines panel meetings, and ensures that the panelists consider all established formal GRADE criteria as they decide on the recommendation text, strength, and direction (for or against an intervention). This is the first study assessing the use of GRADE's EtD framework during real-time guidelines development using panel discussions. Given the widespread use of GRADE, this study provides important information for practice recommendations generated when guidelines panels explicitly follow, in a transparent and systematic manner, the structured GRADE EtD framework. By recognizing the extent to which panels discuss and consider GRADE and other (non-GRADE) criteria for producing guideline recommendations, we are one step closer to understanding the decision-making process in panels that use a structured framework such as the GRADE EtD framework.

Project description:BackgroundWhile shared decision making (SDM) and adherence to clinical practice guidelines (CPGs) are important, some believe they are incompatible. This study explored the mutual influence between physicians' intention to engage in SDM and their intention to follow CPGs.MethodsEmbedded within a clustered randomized trial to assess the impact of training physicians in SDM about using antibiotics to treat acute respiratory tract infections, this study evaluated physicians' intentions to both engage in SDM and follow CPGs. A self-administered questionnaire based on the theory of planned behavior evaluated both behavioral intentions and their respective determinants (attitude, subjective norm and perceived behavioral control) at study entry and exit. We used path analysis to explore the relationships between the intentions. We conducted statistical analyses using the maximum likelihood method and the variance-covariance matrix. Goodness of fit indices encompassed the chi-square statistic, the comparative fit index and the root mean square error of approximation.ResultsWe analyzed 244 responses at entry and 236 at exit. In the control group, at entry we observed that physicians' intention to engage in SDM (r?=?0, t?=?0.03) did not affect their intention to follow CPGs; however, their intention to follow CPGs (r?=?-0.31 t?=?-2.82) did negatively influence their intention to engage in SDM. At exit, neither behavioral intention influenced the other. In the experimental group, at entry neither behavioral intention influenced the other; at exit, the intention to engage in SDM still did not influence the intention to use CPGs, although the intention to follow CPGs (r?=?-0.15 t?=?-2.02) slightly negatively influenced the intention to engage in SDM, but this was not clinically significant.ConclusionPhysicians' intention to engage in SDM does not affect their intention to adopt CPGs even after SDM training. Physicians' intention to adopt CPGs had no clinically significant influence on intention to engage in SDM.Trial registrationClinicalTrials.gov NCT01116076.

Project description:BackgroundAustralian governments are increasingly mandating the use of cost-benefit analysis (CBA) to inform the efficient allocation of government resources. CBA is likely to be useful when evaluating preventive health interventions that are often cross-sectoral in nature and require Cabinet approval prior to implementation. This study outlines a CBA framework for the evaluation of preventive health interventions that balances the need for consistency with other agency guidelines whilst adhering to guidelines and conventions for health economic evaluations.MethodsWe analysed CBA and other evaluation guidance documents published by Australian federal and New South Wales (NSW) government departments. Data extraction compared the recommendations made by different agencies and the impact on the analysis of preventive health interventions. The framework specifies a reference case and sensitivity analyses based on the following considerations: (1) applied economic evaluation theory; (2) consistency between CBA across different government departments; (3) the ease of moving from a CBA to a more conventional cost-effectiveness/cost-utility analysis framework often used for health interventions; (4) the practicalities of application; and (5) the needs of end users being both Cabinet decision-makers and health policy-makers.ResultsNine documents provided CBA or relevant economic evaluation guidance. There were differences in terminology and areas of agreement and disagreement between the guidelines. Disagreement between guidelines involved (1) the community included in the societal perspective; (2) the number of options that should be appraised in ex ante analyses; (3) the appropriate time horizon for interventions with longer economic lives; (4) the theoretical basis and value of the discount rate; (5) parameter values for variables such as the value of a statistical life; and (6) the summary measure for decision-making.ConclusionsThis paper addresses some of the methodological challenges that have hindered the use of CBA in prevention by outlining a framework that is consistent with treasury department guidelines whilst considering the unique features of prevention policies. The effective use and implementation of a preventive health CBA framework is likely to require considerable investment of time and resources from state and federal government departments of health and treasury but has the potential to improve decision-making related to preventive health policies and programmes.

Project description:ImportanceShared decision-making (SDM) is a key component of the provision of ethical care, but prior reviews have indicated that clinical practice guidelines seldom promote or facilitate SDM. It is currently unknown whether these findings extend to contemporary cardiovascular guidelines.ObjectiveTo identify and characterize integration of SDM in contemporary cardiovascular guideline recommendations using a systematic classification system.Design, setting, and participantsThis cross-sectional study assessed the latest guidelines or subsequent updates that included pharmacotherapy recommendations and were published between January 2012 and December 2022 by the American College of Cardiology (ACC), Canadian Cardiovascular Society (CCS), and European Society of Cardiology (ESC). Data were analyzed from February 21 to July 21, 2023.Main outcomes and measuresAll pharmacotherapy recommendations were identified within each guideline. Recommendations that incorporated SDM were rated according to a systematic rating framework to evaluate the quality of SDM incorporation based on directness (range, 1-3; assessing whether SDM was incorporated directly and impartially into the recommendation's text, with 1 indicating direct and impartial incorporation of SDM into the recommendation's text) and facilitation (range, A-D; assessing whether decision aids or quantified benefits and harms were provided, with A indicating that a decision aid quantifying benefits and harms was provided). The proportion of recommendations incorporating SDM was also analyzed according to guideline society and category (eg, general cardiology, heart failure).ResultsAnalyses included 65 guideline documents, and 33 documents (51%) incorporated SDM either in a general statement or within specific recommendations. Of 7499 recommendations, 2655 (35%) recommendations addressed pharmacotherapy, and of these, 170 (6%) incorporated SDM. By category, general cardiology guidelines contained the highest proportion of pharmacotherapy recommendations incorporating SDM (86 of 865 recommendations [10%]), whereas heart failure and myocardial disease contained the least (9 of 315 recommendations [3%]). The proportion of pharmacotherapy recommendations incorporating SDM was comparable across societies (ACC: 75 of 978 recommendations [8%]; CCS: 29 of 333 recommendations [9%]; ESC: 67 of 1344 recommendations [5%]), with no trend for change over time. Only 5 of 170 SDM recommendations (3%) were classified as grade 1A (impartial recommendations for SDM supported by a decision aid), whereas 114 of 170 recommendations (67%) were grade 3D (SDM mentioned only in supporting text and without any tools or information to facilitate SDM).Conclusions and relevanceIn this cross-sectional study across guidelines published by 3 major cardiovascular societies over the last decade, 51% of guidelines mentioned the importance of SDM, yet only 6% of recommendations incorporated SDM in any form, and fewer adequately facilitated SDM.

Project description:BackgroundIncreasing patient engagement in healthcare has become a health policy priority. However, there has been concern that promoting supported shared decision-making could increase health inequalities.ObjectiveTo evaluate the impact of SDM interventions on disadvantaged groups and health inequalities.DesignSystematic review and meta-analysis of randomised controlled trials and observational studies.Data sourcesCINAHL, the Cochrane Register of Controlled Trials, the Cochrane Database of Systematic Reviews, EMBASE, HMIC, MEDLINE, the NHS Economic Evaluation Database, Open SIGLE, PsycINFO and Web of Knowledge were searched from inception until June 2012.Study eligibility criteriaWe included all studies, without language restriction, that met the following two criteria: (1) assess the effect of shared decision-making interventions on disadvantaged groups and/or health inequalities, (2) include at least 50% of people from disadvantaged groups, except if a separate analysis was conducted for this group.ResultsWe included 19 studies and pooled 10 in a meta-analysis. The meta-analyses showed a moderate positive effect of shared decision-making interventions on disadvantaged patients. The narrative synthesis suggested that, overall, SDM interventions increased knowledge, informed choice, participation in decision-making, decision self-efficacy, preference for collaborative decision making and reduced decisional conflict among disadvantaged patients. Further, 7 out of 19 studies compared the intervention's effect between high and low literacy groups. Overall, SDM interventions seemed to benefit disadvantaged groups (e.g. lower literacy) more than those with higher literacy, education and socioeconomic status. Interventions that were tailored to disadvantaged groups' needs appeared most effective.ConclusionResults indicate that shared decision-making interventions significantly improve outcomes for disadvantaged patients. According to the narrative synthesis, SDM interventions may be more beneficial to disadvantaged groups than higher literacy/socioeconomic status patients. However, given the small sample sizes and variety in the intervention types, study design and quality, those findings should be interpreted with caution.

Dataset Information

Structured decision-making drives guidelines panels' recommendations "for" but not "against" health interventions.

Publications

Structured decision-making drives guidelines panels' recommendations "for" but not "against" health interventions.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets