Dataset Information

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

ABSTRACT:

Background

Clinical practice guidelines (CPGs) are representative methods for promoting the standardization of healthcare and improvement of its quality. Few studies have investigated changes in the quality of CPGs published in a country over time. Our aim was to investigate changes in the quality of CPGs over time in the context of the available infrastructure for CPG development, public interest in healthcare quality, and healthcare providers' responses to this interest.

Methods

All CPGs pertaining to evidence-based medicine (EBM) issued between 2000 and 2014 in Japan (n = 373) were evaluated using the Japanese version of the Appraisal of Guidelines for Research and Evaluation (AGREE) I. Additionally, time trends in quality were analyzed. Using a cut-off point based on the publication year of CPG development literature, the evaluated CPGs were classified into those published until 2008 (pre-2008) and those published since 2009 (post-2008). Subsequently, we compared these groups in terms of 1) first edition CPGs and its second editions, and 2) patients' version of CPGs.

Results

Scores on all six domains of AGREE I improved each year. A comparison of the first- and second-edition of CPGs (n = 64) showed that scores on all domains improved significantly after revision. Significant improvement was observed in three domains (#2 stakeholder involvement, #3 rigor of development, and #4 clarity of presentation) in the pre-2008 group and in all domains in the post-2008 group. The comparison between the pre- and post-2008 groups in terms of CPGs for patients showed that the score increased in only one domain (#1 scope and purpose).

Conclusions

The number of published CPGs has been increasing and the quality of CPGs, as assessed using the AGREE I instrument, has been improving. These changes seem to be influenced by improvements in social infrastructure, such as the publication of CPG development procedures, availability of CPG preparation methodology training, and increase in CPG-related skills.

SUBMITTER: Seto K

PROVIDER: S-EPMC6497296 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

Seto Kanako K Matsumoto Kunichika K Fujita Shigeru S Kitazawa Takefumi T Amin Rebeka R Hatakeyama Yosuke Y Hasegawa Tomonori T

PloS one 20190502 5

<h4>Background</h4>Clinical practice guidelines (CPGs) are representative methods for promoting the standardization of healthcare and improvement of its quality. Few studies have investigated changes in the quality of CPGs published in a country over time. Our aim was to investigate changes in the quality of CPGs over time in the context of the available infrastructure for CPG development, public interest in healthcare quality, and healthcare providers' responses to this interest.<h4>Methods</h4 ...[more]

PMID: 31048914

Similar Datasets

Project description:BackgroundNumerous clinical practice guidelines (CPGs) are published to guide management of osteoporosis. Little is known about their quality or how recommendations have changed over time.ObjectiveTo systematically assess the quality and content of the guidelines on screening for osteoporosis, using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool, and the Institute of Medicine (IOM) standards for trustworthy guidelines.MethodsWe conducted a systematic search for osteoporosis CPGs published between 2002-2016, using multiple databases and guideline websites. Two reviewers appraised the quality of eligible CPGs using the AGREE II. High quality CPGs were considered if they scored ≥ 60 in four or more domains including the domain for rigor of development. Non-parametric tests were used to test for the change of quality over time. One reviewer assessed the guidelines with IOM standards. We summarized the different evidence grading systems and extracted and compared the recommendations.ResultsA total of 33 CPGs were identified. The mean scores for AGREE II differed by domain (range: 42% to 71%). CPGs scored higher on domains for clarity of presentation, scope and purpose, and rigor of development. CPGs scored lower on domains for stakeholder involvement, editorial independence and applicability. Assessment of CPGs by IOM standards showed that CPGs scored better on standards for systematic review, establishing evidence foundation and rating strength of recommendation, articulation of recommendation, and establishing transparency. While scored lower on standards for updating, external review, and the development group composition. There was no difference in AGREE II and IOM defined guidelines' quality before and after the introduction of the two tools (P values >0.05). The IOM identified four more guidelines as high quality compared to the AGREE II. Examining these additional guidelines indicated that the two tools may give conflicting results especially for the rigor of development domain. Recommendations in certain areas showed substantial differences between guidelines.ConclusionOsteoporosis screening CPGs are of variable quality, and their recommendations often differ. Guideline quality as measured by AGREE II and IOM standards has not improved overtime. Guideline developers should work together to improve the quality and consistency of recommendations to improve the likelihood that their guidelines will be used in practice.

Project description:ObjectiveTo assess the quality of available and accessible national Clinical Practice Guidelines (CPGs) in Kenya using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool.MethodsWe searched the websites of the Kenyan Ministry of Health, professional associations and contacted experts in relevant organisations. Our scope was guidelines on maternal, neonatal, nutritional disorders, injuries, communicable and non-communicable diseases in Kenya published in the last 5 years until 30 June 2022. Study selection and data extraction were done by three independent reviewers with disagreements resolved via discussion or with a senior reviewer. We conducted a quality assessment using the online English version of AGREE II tool across six domains. Descriptive statistics were analysed using Stata software V.17. The primary outcome was the methodological quality of the included CPGs assessed by the AGREE II tool score.ResultsWe retrieved 95 CPGs and included 24 in the analysis after screening for eligibility. The CPGs scored best in clarity of presentation and least in the rigour of development. In descending order, the appraisal scores (mean and CI) per domain were as follows: Clarity of presentation 82.96% (95% CI 78.35% to 87.57%) with all guidelines scoring above 50%. Scope and purpose 61.75% (95% CI 54.19% to 69.31%) with seven guidelines scoring less than 50%. Stakeholder involvement 45.25% (95% CI 40.01% to 50.49%) with 16 CPGs scoring less than 50%. Applicability domain 19.88% (95% CI 13.32% to 26.43%) with only one CPG scoring above 50%. Editorial independence 6.92% (95% CI 3.47% to 10.37%) with no CPG scoring above 50% and rigour of development 3% (95% CI 0.61% to 5.39%) with no CPG scoring at least 50%.ConclusionOur findings suggest that the quality of CPGs in Kenya is limited mainly by the rigour of development, editorial independence, applicability and stakeholder involvement. Training initiatives on evidence-based methodology among guideline developers are needed to improve the overall quality of CPGs for better patient care.

Project description:OBJECTIVE:The aim of this study was to systematically evaluate the quality of the clinical practice guidelines (CPGs) for diabetes mellitus published in China over the period of January 2007 to April 2017. METHODS:We searched the China National Knowledge Infrastructure, Chinese Biomedical Literature database, VIP database and WanFang databases and guideline websites for CPGs for diabetes mellitus published between January 2007 and April 2017 in China. Two reviewers independently screened the literature according to the inclusion and exclusion criteria and extracted data. We used the the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool (Canadian Institutes of Health Research, Ottawa, Canada) to evaluate the quality of the included guidelines, calculated the scores of each domain and evaluated the consistency among the assessors via use of the intragroup correlation coefficient. And then we compared the results with Chinese CPGs and international CPGs. We conducted a subgroup analysis based on different classification criteria and compared scores of each domain subgroup analyses. RESULTS:A total of 98 guidelines were identified. The correlation coefficient within the group was 0.93, suggesting that the consistency between the evaluators was good. The scores of the six domains of AGREE II were described in median (IQR) as follows: scope and purpose 53.7 (50.0-59.7), stakeholder involvement 31.5 (27.3-37.0), rigour of development 19.1 (15.3-22.2), clarity of presentation 59.3 (50.0-64.8), applicability 18.1 (13.9-25.7) and editorial independence 0.0 (0.0-0.0). The mean score in each domain of quality of Chinese diabetes CPGs was lower than that of CPGs published worldwide but higher than the mean score of Chinese guidelines of all topics. A funding source, the updated version, organisation and publishers of the guidelines and target fields are all the factors influencing the quality of CPGs to a certain degree. CONCLUSIONS:A large number of Chinese diabetes CPGs have been produced. Their quality remain unsatisfactorily low compared with CPGs worldwide, there is still room for improvement. Chinese guideline developers should pay more attention to the transparency of methodology, and use the AGREE II instrument to develop and report guidelines.

Project description:ObjectiveTo assess the quality of Clinical Practice Guidelines (CPG) related to the management of paediatric dental emergencies applicable to the COVID-19 pandemic, through the use of the measuring instrument AGREE II (Appraisal of Guidelines for Research and Evaluation in Europe).Sources and data collectionA rigurous online search of CPG was accomplished among the main CPG compilers: National Institute for Health and Care Excellence (NICE), National Guideline Clearinghouse, Agency for Healthcare, Research and Quality (AHRQ), Andalusian Health Technology Assessment Department (AETSA), American Academy of Family Physicians, Tripdatabase. Furthermore, because of the need to identify CPG that meet the inclusion criteria, a manual search, among the main national and international dental organizations as well as recognized web sites, was also accomplished.Selection of research studiesAll of the guides focused on paediatric dental emergencies, available in the database and "gray" literature, and published between 2000 and 2020 (applicable to COVID-19 pandemic) were included without any language restrictions. The CPG that did not contain the full paper or were addressed to adults or children with special needs, were excluded from the selection. The evaluation of the CPG, independently included, were achieved by four (04) experts by using AGREE II.ResultsFive (05) out of twenty-three (23) selected CPG, were classified as "acceptable" according to AGREE II. These five guides were evaluated to determine their "Recommendation degree". Only one (01) CPG "Guía Clínica AUGE de Urgencias Odontológicas Ambulatorias-Chile, 2011" reached a score of 75%, the highest among the other guides (5 domains with a score ≥ 60%, including the domain III "Rigour of Development") to be considered as a "highly recommended" CPG.ConclusionsAccording to the quality assessment and recommendation degrees criteria from AGREE II, high, middle and low quality CPG were identified. Only one CPG reached a score of 75%, to be classified as "highly recommended". Therefore, it is suggested that the existing CPG updates and future CPG use the available tools and methodologies during their elaboration, in order to guarantee their quality.Clinical significanceHigh quality CPG for the management of dental emergencies are designed to support dental health professionals in decision-making to adopt specific dental procedures in the current COVID-19 pandemic. As a matter of fact, these CPG might contribute to reduce the risk of transmission, in case of fresh outbreak of the illness. Likewise, they might help to determine which cases warrant medical attention in centres with special facilities for COVID-19.

Dataset Information

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

Background

Methods

Results

Conclusions

Publications

Quality assessment of clinical practice guidelines using the AGREE instrument in Japan: A time trend analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets