Dataset Information

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

ABSTRACT:

Background

Clinical practice guidelines (CPGs) are representative methods for promoting the standardization of healthcare and improvement of its quality. Few studies have investigated changes in the quality of CPGs published in a country over time. Our aim was to investigate changes in the quality of CPGs over time in the context of the available infrastructure for CPG development, public interest in healthcare quality, and healthcare providers' responses to this interest.

Methods

All CPGs pertaining to evidence-based medicine (EBM) issued between 2000 and 2014 in Japan (n = 373) were evaluated using the Japanese version of the Appraisal of Guidelines for Research and Evaluation (AGREE) I. Additionally, time trends in quality were analyzed. Using a cut-off point based on the publication year of CPG development literature, the evaluated CPGs were classified into those published until 2008 (pre-2008) and those published since 2009 (post-2008). Subsequently, we compared these groups in terms of 1) first edition CPGs and its second editions, and 2) patients' version of CPGs.

Results

Scores on all six domains of AGREE I improved each year. A comparison of the first- and second-edition of CPGs (n = 64) showed that scores on all domains improved significantly after revision. Significant improvement was observed in three domains (#2 stakeholder involvement, #3 rigor of development, and #4 clarity of presentation) in the pre-2008 group and in all domains in the post-2008 group. The comparison between the pre- and post-2008 groups in terms of CPGs for patients showed that the score increased in only one domain (#1 scope and purpose).

Conclusions

The number of published CPGs has been increasing and the quality of CPGs, as assessed using the AGREE I instrument, has been improving. These changes seem to be influenced by improvements in social infrastructure, such as the publication of CPG development procedures, availability of CPG preparation methodology training, and increase in CPG-related skills.

SUBMITTER: Seto K

PROVIDER: S-EPMC6497296 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

Seto Kanako K Matsumoto Kunichika K Fujita Shigeru S Kitazawa Takefumi T Amin Rebeka R Hatakeyama Yosuke Y Hasegawa Tomonori T

PloS one 20190502 5

<h4>Background</h4>Clinical practice guidelines (CPGs) are representative methods for promoting the standardization of healthcare and improvement of its quality. Few studies have investigated changes in the quality of CPGs published in a country over time. Our aim was to investigate changes in the quality of CPGs over time in the context of the available infrastructure for CPG development, public interest in healthcare quality, and healthcare providers' responses to this interest.<h4>Methods</h4 ...[more]

PMID: 31048914

Similar Datasets

Project description:BACKGROUND:Numerous clinical practice guidelines (CPGs) are published to guide management of osteoporosis. Little is known about their quality or how recommendations have changed over time. OBJECTIVE:To systematically assess the quality and content of the guidelines on screening for osteoporosis, using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool, and the Institute of Medicine (IOM) standards for trustworthy guidelines. METHODS:We conducted a systematic search for osteoporosis CPGs published between 2002-2016, using multiple databases and guideline websites. Two reviewers appraised the quality of eligible CPGs using the AGREE II. High quality CPGs were considered if they scored ? 60 in four or more domains including the domain for rigor of development. Non-parametric tests were used to test for the change of quality over time. One reviewer assessed the guidelines with IOM standards. We summarized the different evidence grading systems and extracted and compared the recommendations. RESULTS:A total of 33 CPGs were identified. The mean scores for AGREE II differed by domain (range: 42% to 71%). CPGs scored higher on domains for clarity of presentation, scope and purpose, and rigor of development. CPGs scored lower on domains for stakeholder involvement, editorial independence and applicability. Assessment of CPGs by IOM standards showed that CPGs scored better on standards for systematic review, establishing evidence foundation and rating strength of recommendation, articulation of recommendation, and establishing transparency. While scored lower on standards for updating, external review, and the development group composition. There was no difference in AGREE II and IOM defined guidelines' quality before and after the introduction of the two tools (P values >0.05). The IOM identified four more guidelines as high quality compared to the AGREE II. Examining these additional guidelines indicated that the two tools may give conflicting results especially for the rigor of development domain. Recommendations in certain areas showed substantial differences between guidelines. CONCLUSION:Osteoporosis screening CPGs are of variable quality, and their recommendations often differ. Guideline quality as measured by AGREE II and IOM standards has not improved overtime. Guideline developers should work together to improve the quality and consistency of recommendations to improve the likelihood that their guidelines will be used in practice.

Project description:ObjectiveTo assess the quality of Clinical Practice Guidelines (CPG) related to the management of paediatric dental emergencies applicable to the COVID-19 pandemic, through the use of the measuring instrument AGREE II (Appraisal of Guidelines for Research and Evaluation in Europe).Sources and data collectionA rigurous online search of CPG was accomplished among the main CPG compilers: National Institute for Health and Care Excellence (NICE), National Guideline Clearinghouse, Agency for Healthcare, Research and Quality (AHRQ), Andalusian Health Technology Assessment Department (AETSA), American Academy of Family Physicians, Tripdatabase. Furthermore, because of the need to identify CPG that meet the inclusion criteria, a manual search, among the main national and international dental organizations as well as recognized web sites, was also accomplished.Selection of research studiesAll of the guides focused on paediatric dental emergencies, available in the database and "gray" literature, and published between 2000 and 2020 (applicable to COVID-19 pandemic) were included without any language restrictions. The CPG that did not contain the full paper or were addressed to adults or children with special needs, were excluded from the selection. The evaluation of the CPG, independently included, were achieved by four (04) experts by using AGREE II.ResultsFive (05) out of twenty-three (23) selected CPG, were classified as "acceptable" according to AGREE II. These five guides were evaluated to determine their "Recommendation degree". Only one (01) CPG "Guía Clínica AUGE de Urgencias Odontológicas Ambulatorias-Chile, 2011" reached a score of 75%, the highest among the other guides (5 domains with a score ≥ 60%, including the domain III "Rigour of Development") to be considered as a "highly recommended" CPG.ConclusionsAccording to the quality assessment and recommendation degrees criteria from AGREE II, high, middle and low quality CPG were identified. Only one CPG reached a score of 75%, to be classified as "highly recommended". Therefore, it is suggested that the existing CPG updates and future CPG use the available tools and methodologies during their elaboration, in order to guarantee their quality.Clinical significanceHigh quality CPG for the management of dental emergencies are designed to support dental health professionals in decision-making to adopt specific dental procedures in the current COVID-19 pandemic. As a matter of fact, these CPG might contribute to reduce the risk of transmission, in case of fresh outbreak of the illness. Likewise, they might help to determine which cases warrant medical attention in centres with special facilities for COVID-19.

Project description:OBJECTIVE:The aim of this study was to systematically evaluate the quality of the clinical practice guidelines (CPGs) for diabetes mellitus published in China over the period of January 2007 to April 2017. METHODS:We searched the China National Knowledge Infrastructure, Chinese Biomedical Literature database, VIP database and WanFang databases and guideline websites for CPGs for diabetes mellitus published between January 2007 and April 2017 in China. Two reviewers independently screened the literature according to the inclusion and exclusion criteria and extracted data. We used the the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool (Canadian Institutes of Health Research, Ottawa, Canada) to evaluate the quality of the included guidelines, calculated the scores of each domain and evaluated the consistency among the assessors via use of the intragroup correlation coefficient. And then we compared the results with Chinese CPGs and international CPGs. We conducted a subgroup analysis based on different classification criteria and compared scores of each domain subgroup analyses. RESULTS:A total of 98 guidelines were identified. The correlation coefficient within the group was 0.93, suggesting that the consistency between the evaluators was good. The scores of the six domains of AGREE II were described in median (IQR) as follows: scope and purpose 53.7 (50.0-59.7), stakeholder involvement 31.5 (27.3-37.0), rigour of development 19.1 (15.3-22.2), clarity of presentation 59.3 (50.0-64.8), applicability 18.1 (13.9-25.7) and editorial independence 0.0 (0.0-0.0). The mean score in each domain of quality of Chinese diabetes CPGs was lower than that of CPGs published worldwide but higher than the mean score of Chinese guidelines of all topics. A funding source, the updated version, organisation and publishers of the guidelines and target fields are all the factors influencing the quality of CPGs to a certain degree. CONCLUSIONS:A large number of Chinese diabetes CPGs have been produced. Their quality remain unsatisfactorily low compared with CPGs worldwide, there is still room for improvement. Chinese guideline developers should pay more attention to the transparency of methodology, and use the AGREE II instrument to develop and report guidelines.

Project description:BACKGROUND:Clinical practice guidelines (CPGs) provide recommendations for practice, but the proliferation of CPGs issued by multiple organisations in recent years has raised concern about their quality. The aim of this study was to systematically appraise CPGs quality for low back pain (LBP) interventions and to explore inter-rater reliability (IRR) between quality appraisers. The time between systematic review search and publication of CPGs was recorded. METHODS:Electronic databases (PubMed, Embase, PEDro, TRIP), guideline organisation databases, websites, and grey literature were searched from January 2016 to January 2020 to identify GPCs on rehabilitative, pharmacological or surgical intervention for LBP management. Four independent reviewers used the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool to evaluate CPGs quality and record the year the CPGs were published and the year the search strategies were conducted. RESULTS:A total of 21 CPGs met the inclusion criteria and were appraised. Seven (33%) were broad in scope and involved surgery, rehabilitation or pharmacological intervention. The score for each AGREE II item was: Editorial Independence (median 67%, interquartile range [IQR] 31-84%), Scope and Purpose (median 64%, IQR 22-83%), Rigour of Development (median 50%, IQR 21-72%), Clarity and Presentation (median 50%, IQR 28-79%), Stakeholder Involvement (median 36%, IQR 10-74%), and Applicability (median 11%, IQR 0-46%). The IRR between the assessors was nearly perfect (interclass correlation 0.90; 95% confidence interval 0.88-0.91). The median time span was 2?years (range, 1-4), however, 38% of the CPGs did not report the coverage dates for systematic searches. CONCLUSIONS:We found methodological limitations that affect CPGs quality. In our opinion, a universal database is needed in which guidelines can be registered and recommendations dynamically developed through a living systematic reviews approach to ensure that guidelines are based on updated evidence. LEVEL OF EVIDENCE:1 TRIAL REGISTRATION: REGISTRATION PROSPERO DETAILS: CRD42019127619 .

Project description:AimsPediatric type 2 diabetes mellitus (T2DM) is a relatively new disease with increasing incidence corresponding to the obesity epidemic among youth. It is important for clinicians to have access to high-quality clinical practice guidelines (CPGs) for appropriate management of pediatric patients with T2DM. The objective of this systematic review was to evaluate overall quality of CPGs for the management of pediatric T2DM using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool.MethodsWe searched MEDLINE, Embase, CINAHL, Trip, National Guideline Clearinghouse, and grey literature to identify eligible CPGs. We also searched the webpages of national and international diabetes and pediatric organizations globally. We included CPGs from national and international diabetes and pediatric associations that were published as standalone guidelines for T2DM in children and adolescents (2-18 years of age). We also included pediatric and adult guidelines for type 1 diabetes if they included a section addressing T2DM management in children and adolescents. We retrieved the two most recent guidelines from each organization when available to assess change in quality over time. We excluded individual studies and systematic reviews that made treatment recommendations as well as CPGs that were developed for a single institution.ResultsWe included 21 unique CPGs in this systematic review. Of the included guidelines, 12 were developed or updated between 2012 and 2014. Five of all included CPGs were specific to pediatric populations. The analysis revealed that "Rigour of Development" (mean 45%, SD 28.68) and "Editorial Independence" (mean 45%, SD 35.19) were the lowest scoring domains on the AGREE II for the majority of guidelines, whereas "Clarity of Presentation" was the highest scoring domain (mean 72%, SD 18.89).ConclusionsOverall, two thirds of the pediatric T2DM guidelines were moderate to low quality and the remaining third ranked higher in quality. Low quality was especially due to the scores for the "Rigour of Development" domain, which directly measures guideline development methodology. It is important that future guidelines and updates of existing guidelines improve the methodology of development and quality of reporting in order to appropriately guide physicians managing children and adolescents with T2DM.Systematic review registrationPROSPERO CRD42016034187.

Dataset Information

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

Background

Methods

Results

Conclusions

Publications

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets