Dataset Information

Critical evaluation of oncology clinical practice guidelines.

ABSTRACT:

Purpose

Significant concerns exist regarding the content and reliability of oncology clinical practice guidelines (CPGs). The Institute of Medicine (IOM) report "Clinical Practice Guidelines We Can Trust" established standards for developing trustworthy CPGs. By using these standards as a benchmark, we sought to evaluate recent oncology guidelines.

Methods

CPGs and consensus statements addressing the screening, evaluation, or management of the four leading causes of cancer-related mortality in the United States (lung, breast, prostate, and colorectal cancers) published between January 2005 and December 2010 were identified. A standardized scoring system based on the eight IOM standards was used to critically evaluate the methodology, content, and disclosure policies of CPGs. All CPGs were given two scores; points were awarded for eight standards and 20 subcriteria.

Results

No CPG fully met all the IOM standards. The average overall scores were 2.75 of 8 possible standards and 8.24 of 20 possible subcriteria. Less than half the CPGs were based on a systematic review. Only half the CPG panels addressed conflicts of interest. Most did not comply with standards for inclusion of patient and public involvement in the development or review process, nor did they specify their process for updating. CPGs were most consistent with IOM standards for transparency, articulation of recommendations, and use of external review.

Conclusion

The vast majority of oncology CPGs fail to meet the IOM standards for trustworthy guidelines. On the basis of these results, there is still much to be done to make guidelines as methodologically sound and evidence-based as possible.

SUBMITTER: Reames BN

PROVIDER: S-EPMC5073383 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Objective: To report the quality and clinical heterogeneity of the published clinical practice guidelines (CPGs) on nutrition in pregnancy. Methods: MEDLINE, Embase, Scopus, and ISI Web of Science databases were searched. The following aspects related to nutrition in pregnancy were addressed: specific requirements during pregnancy, description of a balanced diet, weight gain, prevention of food-borne, nutrition in peculiar sub-groups of women, and maternal or perinatal outcomes. The assessment of the risk of bias and quality assessment of the included CPGs were performed using “The Appraisal of Guidelines for REsearch and Evaluation (AGREE II)” tool divided in six quality domains: scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, editorial independence. Mean ± standard deviation (SD) was used to summarize the scores across all the guidelines per domain. The quality of each guideline was computed using the scoring system proposed by Amer et al. A cut-off of >60% was sued to define a CGP as recommended. Results: Eighteen CPGs were included. There was a substantial heterogeneity in the recommended dose for vitamins, folic acid, and micronutrient intake during pregnancy among the different published CPGs. 27.8% (5/18) of the CPGs recommended a daily intake of folic acid of 200 mcg, 38.8% (7/18) 400 mcg, 16.7% (3/18) 600 mcg while the remaining CPGs suggested dose between 400 and 600–800 mc per day. Adequate maternal hydration was advocated in the large majority of included CPGs, but a specific amount of water intake was not reported in 83.3% (15/18) cases. There was also significant heterogeneity in various other aspects of nutrition recommendation among the different CPGs, including gestational weight gain (55.5%), prevention of food-borne diseases in pregnancy (72.2%), nutrition in particular groups of pregnant women (83.3%), maternal and perinatal outcomes (72.2%). The AGREE II standardized domain scores for the first overall assessment (OA1) had a mean of 65% but only half scored more than 60%. Conclusion: The published CPGs on nutrition in pregnancy show an overall good methodology, but also a substantial heterogeneity as regard as different major aspects on nutrition in pregnancy.

Project description:BackgroundOncologists who author clinical practice guidelines frequently have financial relationships with the pharmaceutical industry. It is unknown whether participation on clinical practice guideline committees is associated with differences in the amounts of industry money received.Materials and methodsWe conducted a nested case-control study from August 2013 to December 2018. We manually abstracted membership records of National Comprehensive Cancer Network (NCCN) Guidelines committees for the 20 most common cancers and linked to Open Payments. The study sample included medical oncologists selected to join an NCCN Guidelines committee ("joiners") during the study period. Joiners were matched 1:2 to medical oncologists who had no participation on NCCN committees (controls) by gender, NCCN institution, and medical school graduation year. We performed difference-in-differences (DiD) estimation to assess whether selection to an NCCN committee was associated with the dollar value of payments received from industry, using generalized estimating equations to address correlation between matched pairs and between repeated observations of the same pair.ResultsDuring the study period, 54 physicians joined an NCCN Guidelines committee. These physicians received more payments than matched controls in the year prior to joining ($11,259 vs. $3,427; p = .02); this difference did not increase in the year after joining (DiD = $731; p = .45).ConclusionMedical oncologists selected to NCCN Guidelines committees had greater financial ties to industry than their peers. The potential influence of industry in oncology clinical practice guidelines may be reduced through the selection of committee members with fewer ties to industry.Implications for practiceOncologists who author clinical practice guidelines frequently have financial conflicts of interest with the pharmaceutical industry. This creates concern about the potential for industry influence on guidelines. However, it is unknown whether oncologists who author guidelines have greater industry relationships than their peers. This study compared medical oncologists who were newly selected to join a National Comprehensive Cancer Network (NCCN) Guidelines panel with medical oncologists at the same institutions and at similar career stages. At the time they joined, oncologists joining NCCN Guidelines panels had received more than three times the dollar value of industry payments than their peers. The potential for industry influence may be reduced by the selection of less-conflicted panel members.

Project description:The landscape of local and systemic therapy of renal cell carcinoma (RCC) is rapidly changing. The increase in the incidental finding of small renal tumors has increased the application of nephron-sparing procedures, while ten novel agents targeting the vascular endothelial growth factor (VEGF) or the mammalian target of rapamycin pathways, or inhibiting the interaction of the programmed death 1 receptor with its ligand, have been approved since 2006 and have dramatically improved the prognosis of metastatic RCC (mRCC). These rapid developments have resulted in continuous changes in the respective Clinical Practice Guidelines/Expert Recommendations. We conducted a systematic review of the existing guidelines in MEDLINE according to the Preferred Reporting Items for Systematic Review and Meta-Analyses statement, aiming to identify areas of agreement and discrepancy among them and to evaluate the underlying reasons for such discrepancies. Data synthesis identified selection criteria for nonsurgical approaches in renal masses; the role of modern laparoscopic techniques in the context of partial nephrectomy; selection criteria for cytoreductive nephrectomy and metastasectomy in mRCC; systemic therapy of metastatic non-clear-cell renal cancers; and optimal sequence of available agents in mRCC relapsed after anti-VEGF therapy as the major areas of uncertainty. Agreement or uncertainty was not always correlated with the availability of data from phase III randomized controlled trials. Our review suggests that the combination of systematic review and critical evaluation can define practices of wide applicability and areas for future research by identifying areas of agreement and uncertainty among existing guidelines.Implications for practiceCurrently, there is uncertainity on the role of surgery in MRCC and on the choice of available guidelines in relapsed RCC. The best practice is individualization of targeted therapies. Systematic review of guidelines can help to identify unmet medical needs and areas of future research.

Project description:OBJECTIVE:Many treatment decisions are preference-sensitive and call for shared decision-making, notably when benefits are limited or uncertain, and harms impact quality of life. We explored if clinical practice guidelines (CPGs) acknowledge preference-sensitive decisions in how they motivate and phrase their recommendations. DESIGN:We performed a qualitative analysis of the content of CPGs and verified the results in semistructured interviews with CPG panel members. SETTING:Dutch oncology CPGs issued in 2010 or later, concerning primary treatment with curative intent. PARTICIPANTS:14 CPG panel members. MAIN OUTCOMES:For treatment recommendations from six CPG modules, two researchers extracted the following: strength of recommendation in terms of the Grading of Recommendations Assessment, Development and Evaluation and its consistency with the CPG text; completeness of presentation of benefits and harms; incorporation of patient preferences; statements on the panel's benefits-harm trade-off underlying recommendation; and advice on patient involvement in decision-making. RESULTS:We identified 32 recommendations, 18 were acknowledged preference-sensitive decisions. Three of 14 strong recommendations should have been weak based on the module text. The reporting of benefits and harms, and their probabilities, was sufficiently complete and clear to inform the strength of the recommendation in one of the six modules only. Numerical probabilities were seldom presented. None of the modules presented information on patient preferences. CPG panel's preferences were not made explicit, but appeared to have impacted 15 of 32 recommendations. Advice to involve patients and their preferences in decision-making was given for 20 recommendations (14 weak). Interviewees confirmed these findings. Explanations for lack of information were, for example, that clinicians know the information and that CPGs must be short. Explanations for trade-offs made were cultural-historical preferences, compliance with daily care, presumed role of CPGs and lack of time. CONCLUSIONS:The motivation and phrasing of CPG recommendations do not stimulate choice awareness and a neutral presentation of options, thus hindering shared decision-making.

Project description:ObjectivesThe objectives of this review are to: 1) appraise the methodological quality of clinical practice guidelines (CPGs) in juvenile idiopathic arthritis (JIA) providing pharmacological and/or non-pharmacological intervention recommendations, and 2) summarize the recommendations provided by the included CPGs and compare them where possible.MethodsA systematic search was performed. Three trained appraisers independently evaluated the methodological quality of the CPGs using a validated and reliable instrument, the Appraisal of Guidelines in Research and Evaluation II. Six domains were considered: 1) score and purpose; 2) stakeholder involvement; 3) rigor of development; 4) clarity of presentation; 5) applicability; and 6) editorial independence. The domains consist of a total of 23 items each scored on a 7-point scale. High quality CPGs were identified if they had a domain score above 60% in rigor of development, and two other domains.ResultsOf the three included CPGs, the Royal Australian College of General Practitioners (RACGP) and American College of Rheumatology (ACR) CPGs were considered to be of high quality, but the German Society for Pediatric Rheumatology was of lower quality. Domains one to four had high domain scores across the guidelines (mean (standard deviation)): 72.76 (13.80); 66.67 (9.81); 64.67 (7.77); and 87.00 (9.64), respectively. Lower scores were obtained for applicability (14.00 (5.57)) and editorial independence (43.44 (7.02)). Recommendations varied across CPGs due to differences in context, target audience (general practitioners, rheumatologists, and other multidisciplinary healthcare professionals) and patients' disease presentations. Despite this variability, progression of pharmacological treatment did not conflict between CPGs. Recommendations for non-pharmacological interventions were vague and the interventions considered varied between CPGs.ConclusionsOverall, recommendations were based on a paucity of evidence and weak study designs. Further research is needed on interventions in JIA, as well as higher quality CPGs to facilitate implementation of the best evidence-based recommendations in clinical practice.