Dataset Information

Quality of pediatric clinical practice guidelines.

ABSTRACT:

Background

There is a lack of a comprehensive evaluation for pediatric clinical practice guidelines (CPGs) published in recent years. Here, we assessed the quality of pediatric CPGs, considering factors that might affect their quality. The aim of the study is to promote a more coherent development and application of CPGs.

Methods

Pediatric CPGs published in PubMed, MedLive, Guidelines International Network, National Institute for Health and Care Excellence, and World Health Organization between 2017 and 2019 were searched and collected. Paired researchers conducted screening, data extraction, and quality assessment using the Appraisal of Guidelines for Research and Evaluation II (AGREE II). Linear regression analysis determined the factors affecting CPGs' quality.

Results

The study included a total of 216 CPGs, which achieved a mean score of 4.26 out of 7 points (60.86%) in the AGREE II assessment. Only 6.48% of the CPGs reached the "recommend" level. The remaining 69.91% should have been modified before recommendation, while the other 23.61% did not reach the recommended level at all. The overall quality of recent pediatric CPGs was higher than previously, and the proportion of CPGs with low-quality decreased over time. However, there were still too few CPGs that reached a high-quality level. The "applicability" and "rigor of development" domains had generally low scores. CPGs formulated by developing countries or regions, those that are not under an organizations or groups responsibility, and those that used non-evidence-based methods were found to be associated with poorer quality in different domains as independent or combinational factors.

Conclusions

The quality of pediatric CPGs still needs to be improved. Specifically, a quality control before applying new CPGs should be essential to ensure their quality and applicability.

SUBMITTER: Liu Y

PROVIDER: S-EPMC8103635 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundTraumatic brain injuries (TBI) are a significant cause of mortality and morbidity for children globally. Adherence to evidence-based treatment guidelines have been shown to improve TBI outcomes. To inform the creation of a pediatric TBI management guideline for a low and middle income country context, we assessed the quality of available clinical practice guidelines (CPGs) for the acute management pediatric TBI.MethodsArticles were identified and retrieved from MEDLINE, EMBASE, Cochrane Library, LILACS, Africa-Wide Information and Global Index Medicus. These articles were screened by four reviewers independently. Based on the eligibility criteria, with the exception of literature reviews, opinion papers and editor's letters, articles published from 1995 to November 11, 2016 which covered clinical recommendations, clinical practice or treatment guidelines for the acute management of pediatric TBI (within 24 hours) were included for review. A reference and citation analysis was performed. Seven independent reviewers from low, middle and high income clinical settings with knowledge of pediatric TBI management appraised the guidelines using the AGREE II instrument. Scores for the CPGs were aggregated by domain and overall assessment was determined.ResultsWe screened 2372 articles of which 17 were retained for data extraction and guideline appraisal. Except for one CPG from a middle income country, the majority (16/17) of the guidelines were developed in high income countries. Seven guidelines were developed specifically for the pediatric population, while the remaining CPGs addressed the acute management of TBI in both adult and pediatric populations. The New Zealand Guideline Group (NZGG, 2006) received the highest overall assessment score of 46/49 (93.88%) followed by the Scandinavian Neurotrauma Committee (SNC, 2016) with a score of 45/49 (91.84%) followed by the Scottish Intercollegiate Guideline Network (SIGN, 2009) and Brain Trauma Foundation (BTF 2012) both with scores of 44/49 (89.80%). CPGs from Cincinnati Children's Hospital (CCH 2006) and Sao Paulo Medical School Hospital/Brazilian Society of Neurosurgery (USP/BSN, 2001) received the lowest score of 27/49 (55.10%) subsequently followed by the Appropriateness Criteria (ACR, 2015) with 29/49 (59.18%). The domains for scope and purpose and clarity of presentation received the highest scores across the CPGs, while applicability and editorial independence domains had the lowest scores with a wider variability in score range for rigor of development and stakeholder involvement.ConclusionsTo our knowledge, this is the first systematic review and guideline appraisal for pediatric CPGs concerning the acute management of TBI. Targeted guideline creation specific to the pediatric population has the potential to improve the quality of acute TBI CPGs. Furthermore, it is crucial to address the applicability of a guideline to translate the CPG from a published manuscript into clinically relevant local practice tools and for resource limited practice settings.

Project description:OBJECTIVE:To determine the accessibility and currency of delirium guidelines, guideline summary papers and evaluation studies, and critically appraise guideline quality. DESIGN:Systematic literature search for formal guidelines (in English or French) with focus on delirium assessment and/or management in adults (≥18 years), guideline summary papers and evaluation studies.Full appraisal of delirium guidelines published between 2008 and 2013 and obtaining a 'Rigour of Development' domain screening score cut-off of >40% using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. DATA SOURCES:Multiple bibliographic databases, guideline organisation databases, complemented by a grey literature search. RESULTS:3327 database citations and 83 grey literature links were identified. A total of 118 retrieved delirium guidelines and related documents underwent full-text screening. A final 21 delirium guidelines (with 10 being >5 years old), 12 guideline summary papers and 3 evaluation studies were included. For 11 delirium guidelines published between 2008 and 2013, the screening AGREE II 'Rigour' scores ranged from 3% to 91%, with seven meeting the cut-off score of >40%. Overall, the highest rating AGREE II domains were 'Scope and Purpose' (mean 80.1%, range 64-100%) and 'Clarity and Presentation' (mean 76.7%, range 38-97%). The lowest rating domains were 'Applicability' (mean 48.7%, range 8-81%) and 'Editorial Independence' (mean 53%, range 2-90%). The three highest rating guidelines in the 'Applicability' domain incorporated monitoring criteria or audit and costing templates, and/or implementation strategies. CONCLUSIONS:Delirium guidelines are best sourced by a systematic grey literature search. Delirium guideline quality varied across all six AGREE II domains, demonstrating the importance of using a formal appraisal tool prior to guideline adaptation and implementation into clinical settings. Adding more knowledge translation resources to guidelines may improve their practical application and effective monitoring. More delirium guideline evaluation studies are needed to determine their effect on clinical practice.

Project description:INTRODUCTION:Concerns regarding the quality, credibility, and applicability of recently published pediatric urinary tract infection (UTI) clinical practice guidelines have been raised due to the inconsistencies of recommendations between them. We aimed to determine the quality of the recent clinical practice guidelines on pediatric UTI by using the Appraisal of Guidelines Research and Evaluation (AGREE II) instrument, and summarize the standard of care in diagnosis and management of pediatric UTI from the top three clinical practice guidelines. METHODS:A systematic literature search was performed on medical literature electronic databases and international guideline repository websites. English language-based clinical practice guidelines from 2007-2016 endorsed by any international society or government organization providing recommendations for the management of pediatric UTI were considered. Eligible clinical practice guidelines were independently appraised by six reviewers using the AGREE II tool. Clinical practice guidelines were assessed for standardized domains and summarized for overall quality. Inter-rater reliability was assessed using inter-class coefficient (ICC). RESULTS:Thirteen clinical practice guidelines were critically reviewed. The Spanish clinical practice guidelines, American Academy of Pediatrics, and National Institute for Health and Clinical Excellence clinical practice guidelines consistently scored high on all AGREE domains (total averaged domain scores 90, 88, and 88, respectively). Among the six reviewers, there was a high degree of inter-rater reliability (average measure ICC 0.938; p<0.0001). There is reasonable consensus among the top three clinical practice guidelines in their major recommendations. CONCLUSIONS:The clinical practice guidelines from Spain, American Academy of Pediatrics, and National Institute for Health and Clinical Excellence, with their major recommendations being similar, have scored highly on the AGREE II indicators of quality for the clinical practice guidelines development process.

Project description:Importance:Primary care clinicians, who are increasingly responsible for caring for the growing population of cancer survivors, may be unfamiliar with appropriate cancer surveillance strategies. Clinical practice guidelines can inform cancer follow-up care and surveillance testing. Vague recommendations and inconsistencies among guidelines can lead to overuse and underuse of health care resources and have a negative impact on cost and quality of survivorship care. Objective:To examine the specificity and consistency of recommendations for surveillance after active treatment across cancer guidelines. Design, Setting, and Participants:Retrospective cross-sectional analysis of national cancer guidelines from North America and Europe published since 2010 addressing posttreatment care for survivors of the 9 most common cancers. We categorized surveillance modalities into history and physical examinations, tumor markers, diagnostic procedures (eg, colonoscopy), and imaging. Within each guideline, we classified individual recommendations into 5 categories: (1) risk-based recommendation, (2) recommendation for surveillance, (3) addressed but no clear recommendation, (4) recommendation against surveillance, or (5) cases in which surveillance was not addressed. We reviewed each surveillance recommendation for frequency and a stop date, evaluated consistency among guidelines, and analyzed associations between the organizations proposing the guidelines and recommendation characteristics. Main Outcomes and Measures:Description of guideline recommendations for cancer surveillance. Results:We identified 41 guidelines published between January 1, 2010, and March 1, 2016. Eighty-five percent of guidelines (35) were from professional organizations. Ambiguous recommendations (ie, modality not discussed or discussed without a clear recommendation) were present in 83% of guidelines (34), and 44% (18) recommended against at least 1 test. European guidelines were more likely than North American guidelines to contain ambiguous recommendations (100% vs 68%; P?<?.01). Recommendations commonly specified testing frequency (from 88% [14 of 16] for tumor markers to 92% [24 of 26] for procedures and/or imaging) but infrequently provided a definitive stop time. Cross-sectional imaging recommendations varied among guidelines for each cancer. For example, among breast cancer guidelines, surveillance computed tomographic scans were recommended against in 2, discussed without a clear recommendation in 1, and not addressed in 3 guidelines. Conclusions and Relevance:Guidelines addressing the care of cancer survivors have low specificity and consistency. As guidelines continue to be revised, developers should clarify recommendations with simple, nonambiguous, definitive language for or against the use of specific tests to optimize care quality and resource utilization.

Project description:BACKGROUND:This report presents updated National Academy of Clinical Biochemistry Laboratory Medicine Practice Guidelines summarizing quality requirements for the use of tumor markers. METHODS:One subcommittee developed guidelines for analytical quality relevant to serum and tissue-based tumor markers in current clinical practice. Two other subcommittees formulated recommendations particularly relevant to the developing technologies of microarrays and mass spectrometry. RESULTS:Prerequisites for optimal use of tumor markers in routine practice include formulation of the correct clinical questions to ensure selection of the appropriate test, adherence to good clinical and laboratory practices (e.g., minimization of the risk of incorrect patient and/or specimen identification, tube type, or timing), use of internationally standardized and well-characterized methods, careful adherence to manufacturer instructions, and proactive and timely reactions to information derived from both internal QC and proficiency-testing specimens. Highly desirable procedures include those designed to minimize the risk of the reporting of erroneous results attributable to interferences such as heterophilic antibodies or hook effects, to facilitate the provision of informative clinical reports (e.g., cumulative and/or graphical reports, appropriately derived reference intervals, and interpretative comments), and when possible to integrate these reports with other patient information through electronic health records. Also mandatory is extensive validation encompassing all stages of analysis before introduction of new technologies such as microarrays and mass spectrometry. Provision of high-quality tumor marker services is facilitated by dialogue involving researchers, diagnostic companies, clinical and laboratory users, and regulatory agencies. CONCLUSIONS:Implementation of these recommendations, adapted to local practice, should encourage optimization of the clinical use of tumor markers.

Project description:AimsPediatric type 2 diabetes mellitus (T2DM) is a relatively new disease with increasing incidence corresponding to the obesity epidemic among youth. It is important for clinicians to have access to high-quality clinical practice guidelines (CPGs) for appropriate management of pediatric patients with T2DM. The objective of this systematic review was to evaluate overall quality of CPGs for the management of pediatric T2DM using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool.MethodsWe searched MEDLINE, Embase, CINAHL, Trip, National Guideline Clearinghouse, and grey literature to identify eligible CPGs. We also searched the webpages of national and international diabetes and pediatric organizations globally. We included CPGs from national and international diabetes and pediatric associations that were published as standalone guidelines for T2DM in children and adolescents (2-18 years of age). We also included pediatric and adult guidelines for type 1 diabetes if they included a section addressing T2DM management in children and adolescents. We retrieved the two most recent guidelines from each organization when available to assess change in quality over time. We excluded individual studies and systematic reviews that made treatment recommendations as well as CPGs that were developed for a single institution.ResultsWe included 21 unique CPGs in this systematic review. Of the included guidelines, 12 were developed or updated between 2012 and 2014. Five of all included CPGs were specific to pediatric populations. The analysis revealed that "Rigour of Development" (mean 45%, SD 28.68) and "Editorial Independence" (mean 45%, SD 35.19) were the lowest scoring domains on the AGREE II for the majority of guidelines, whereas "Clarity of Presentation" was the highest scoring domain (mean 72%, SD 18.89).ConclusionsOverall, two thirds of the pediatric T2DM guidelines were moderate to low quality and the remaining third ranked higher in quality. Low quality was especially due to the scores for the "Rigour of Development" domain, which directly measures guideline development methodology. It is important that future guidelines and updates of existing guidelines improve the methodology of development and quality of reporting in order to appropriately guide physicians managing children and adolescents with T2DM.Systematic review registrationPROSPERO CRD42016034187.