Dataset Information

Quality appraisal of clinical guidelines for surgical site infection prevention: A systematic review.

ABSTRACT:

Background

Surgical site infections (SSI) occur in up to 10% of surgeries. Wound care practices to prevent infections are guided by Clinical Practice Guidelines (CPGs), yet their contribution to improving patient outcomes relies on their quality and adoption in practice. We critically evaluated the quality of CPGs for SSI prevention during pre-, intra- and post-operative phases of care.

Methods

We systematically reviewed the literature from 1990-2018 using the Cochrane Library, CINAHL, EMBASE, MEDLINE, ProQuest databases and five guidelines repositories. We extracted characteristics of each guideline using purposely-developed data collection tools. We assessed overall quality using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool.

Results

Combined searches of databases and repositories yielded 5,910 citations. Of these, we reviewed 215 full text documents. The final sample included 15 documents: 6 complete CPGs, 3 CPG updates, and 6 supplementary documents. The overall %mean scores across AGREE II domains for CPGs were: 1) scope and purpose (%mean ± SD = 86.3±23.5); 2) stakeholder involvement (%mean ± SD = 64±31.0); 3) rigour of development (%mean ± SD = 68.7±30.6); 4) clarity and presentation (%mean ± SD = 88.5±16.7); 5) applicability (%mean ± SD = 44±30.2); and, 5) editorial independence (%mean ± SD = 61±37.6). Based on individual AGREE II domains and overall scores, we appraised 4 out of 6 CPGs (inclusive of updates) as "recommended" for use in practice. Overall agreement among appraisers was excellent (ICC 0.86 [95%CI 0.73-0.94] - 0.98 [95%CI 0.96-0.99]; p <0.001).

Discussion

International interest in CPG development has resulted in refinements to methodologies, which has led to improvements in the overall quality of the product.

Implications for translation

Given the domains that received the lowest scores, it is clear that we need more consumer involvement and better consideration of the implementation challenges with CPG uptake and sustainability.

SUBMITTER: Gillespie BM

PROVIDER: S-EPMC6136720 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Quality appraisal of clinical guidelines for surgical site infection prevention: A systematic review.

Gillespie Brigid M BM Bull Claudia C Walker Rachel R Lin Frances F Roberts Shelley S Chaboyer Wendy W

PloS one 20180913 9

<h4>Background</h4>Surgical site infections (SSI) occur in up to 10% of surgeries. Wound care practices to prevent infections are guided by Clinical Practice Guidelines (CPGs), yet their contribution to improving patient outcomes relies on their quality and adoption in practice. We critically evaluated the quality of CPGs for SSI prevention during pre-, intra- and post-operative phases of care.<h4>Methods</h4>We systematically reviewed the literature from 1990-2018 using the Cochrane Library, CI ...[more]

PMID: 30212487

Similar Datasets

Project description:OBJECTIVE:To determine the accessibility and currency of delirium guidelines, guideline summary papers and evaluation studies, and critically appraise guideline quality. DESIGN:Systematic literature search for formal guidelines (in English or French) with focus on delirium assessment and/or management in adults (≥18 years), guideline summary papers and evaluation studies.Full appraisal of delirium guidelines published between 2008 and 2013 and obtaining a 'Rigour of Development' domain screening score cut-off of >40% using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. DATA SOURCES:Multiple bibliographic databases, guideline organisation databases, complemented by a grey literature search. RESULTS:3327 database citations and 83 grey literature links were identified. A total of 118 retrieved delirium guidelines and related documents underwent full-text screening. A final 21 delirium guidelines (with 10 being >5 years old), 12 guideline summary papers and 3 evaluation studies were included. For 11 delirium guidelines published between 2008 and 2013, the screening AGREE II 'Rigour' scores ranged from 3% to 91%, with seven meeting the cut-off score of >40%. Overall, the highest rating AGREE II domains were 'Scope and Purpose' (mean 80.1%, range 64-100%) and 'Clarity and Presentation' (mean 76.7%, range 38-97%). The lowest rating domains were 'Applicability' (mean 48.7%, range 8-81%) and 'Editorial Independence' (mean 53%, range 2-90%). The three highest rating guidelines in the 'Applicability' domain incorporated monitoring criteria or audit and costing templates, and/or implementation strategies. CONCLUSIONS:Delirium guidelines are best sourced by a systematic grey literature search. Delirium guideline quality varied across all six AGREE II domains, demonstrating the importance of using a formal appraisal tool prior to guideline adaptation and implementation into clinical settings. Adding more knowledge translation resources to guidelines may improve their practical application and effective monitoring. More delirium guideline evaluation studies are needed to determine their effect on clinical practice.

Project description:IntroductionClinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools.MethodsAmong others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items.ResultsWe identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions "evaluation of evidence" (mentioned in 35 tools; 88%), "presentation of guideline content" (34 tools; 85%), "transferability" (33 tools; 83%), "independence" (32 tools; 80%), "scope" (30 tools; 75%), and "information retrieval" (29 tools; 73%). The quality dimensions "consideration of different perspectives" and "dissemination, implementation and evaluation of the guideline" were covered by only twenty (50%) and eighteen tools (45%) respectively.ConclusionsMost guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools.

Project description:ObjectivesTo systematically assess the quality of clinical practice guidelines (CPGs) for Helicobacter pylori (HP) infection and identify gaps that limit their development.Study design and settingCPGs for HP infection were systematically collected from PubMed, Embase, the Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature, and six online guideline repositories. Three researchers independently used the AGREE Ⅱ tool to evaluate the methodological quality of the eligible CPGs. In addition, the reporting and recommendation qualities were appraised by using the RIGHT and AGREE-REX tools, respectively. The distribution of the level of evidence and strength of recommendation among evidence-based CPGs was determined.ResultsA total of 7,019 records were identified, and 24 CPGs met the eligibility criteria. Of the eligible CPGs, 19 were evidence-based and 5 were consensus-based. The mean overall rating score of AGREE II was 50.7% (SD = 17.2%). Among six domains, the highest mean score was for scope and purpose (74.4%, SD = 17.7%) and the lowest mean score was for applicability (24.3%, SD = 8.9). Only three of 24 CPGs were high-quality. The mean overall score of recommendation quality was 35.5% (SD = 12.2%), and the mean scores in each domain of AGREE-REX and RIGHT were all ≤ 60%, with values and preferences scoring the lowest (16.6%, SD = 11.9%). A total of 505 recommendations were identified. Strong recommendations accounted for 64.1%, and only 34.3% of strong recommendations were based on high-quality evidence.ConclusionThe overall quality of CPGs for HP infection is poor, and CPG developers tend to neglect some domains, resulting in a wide variability in the quality of the CPGs. Additionally, CPGs for HP infection lack sufficient high-quality evidence, and the grading of recommendation strength should be based on the quality of evidence. The CPGs for HP infection have much room for improvement and further researches are required to minimize the evidence gap.

Project description:IntroductionVenous thromboembolism (VTE) occurs in up to 40%-80% of patients after hip and knee arthroplasty. Clinical decision-making aided by guidelines is the most effective strategy to reduce the burden of VTE. However, the quality of guidelines is dependent on the strength of their evidence base. The objective of this article is to critically evaluate the quality of VTE prevention guidelines and the strength of their recommendations in VTE prophylaxis in patients undergoing hip and knee arthroplasty.MethodsRelevant literature up to 16 March 2020 was systematically searched. We searched databases such as Web of Science, PubMed, EMBASE, Cumulative Index of Nursing and Allied Health Literature, China National Knowledge Infrastructure and WanFang and nine guidelines repositories. The identified guidelines were appraised by two reviewers using the Appraisal of Guidelines for Research and Evaluation II and appraised the strength of their recommendations independently. Following quality assessment, a predesigned data collection form was used to extract the characteristics of the included guideline.ResultsWe finally included 15 guidelines. Ten of the included guidelines were rated as 'recommended' or 'recommended with modifications'. The standardised scores were relatively high in the domains of Clarity of Presentation, and Scope and Purpose. The lowest average standardised scores were observed in the domains of Applicability and Stakeholder Involvement. In reference to the domains of Rigour of Development and Editorial Independence, the standardised scores varied greatly between the guidelines. The agreement between the two appraisers is almost perfect (intraclass correlation coefficients higher than 0.80). A considerable proportion of the recommendations is based on low-quality or very-low-quality evidence or is even based on working group expert opinion.ConclusionsIn summary, the majority of the recommendations are based on low-quality evidence, and further confirmation is needed. Furthermore, guideline developers should pay more attention to methodological quality, especially in the Stakeholder Involvement domain and the Applicability domain.

Project description:Background: The morbidity and mortality of coronavirus disease 2019 (COVID-19) are still increasing. This study aimed to assess the quality of relevant COVID-19 clinical practice guidelines (CPGs) and to compare the similarities and differences between recommendations. Methods: A comprehensive search was conducted using electronic databases (PubMed, Embase, and Web of Science) and representative guidelines repositories from December 1, 2019, to August 11, 2020 (updated to April 5, 2021), to obtain eligible CPGs. The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool was used to evaluate the quality of CPGs. Four authors extracted relevant information and completed data extraction forms. All data were analyzed using R version 3.6.0 software. Results: In total, 39 CPGs were identified and the quality was not encouragingly high. The median score (interquartile range, IQR) of every domain from AGREE II for evidence-based CPGs (EB-CPGs) versus (vs.) consensus-based CPG (CB-CPGs) was 81.94% (75.00-84.72) vs. 58.33% (52.78-68.06) in scope and purpose, 59.72% (38.89-75.00) vs. 36.11% (33.33-36.11) in stakeholder involvement, 64.58% (32.29-71.88) vs. 22.92% (16.67-26.56) in rigor of development, 75.00% (52.78-86.81) vs. 52.78% (50.00-63.89) in clarity of presentation, 40.63% (22.40-62.50) vs. 20.83% (13.54-25.00) in applicability, and 58.33% (50.00-100.00) vs. 50.00% (50.00-77.08) in editorial independence, respectively. The methodological quality of EB-CPGs were significantly superior to the CB-CPGs in the majority of domains (P < 0.05). There was no agreement on diagnosis criteria of COVID-19. But a few guidelines show Remdesivir may be beneficial for the patients, hydroxychloroquine +/- azithromycin may not, and there were more consistent suggestions regarding discharge management. For instance, after discharge, isolation management and health status monitoring may be continued. Conclusions: In general, the methodological quality of EB-CPGs is greater than CB-CPGs. However, it is still required to be further improved. Besides, the consistency of COVID-19 recommendations on topics such as diagnosis criteria is different. Of them, hydroxychloroquine +/- azithromycin may be not beneficial to treat patients with COVID-19, but remdesivir may be a favorable risk-benefit in severe COVID-19 infection; isolation management and health status monitoring after discharge may be still necessary. Chemoprophylaxis, including SARS-CoV 2 vaccines and antiviral drugs of COVID-19, still require more trials to confirm this.

Project description:ObjectivesTo appraise European guidelines for acute otitis media (AOM) in children, including methodological quality, level of evidence (LoE), astrength of recommendations (SoR), and consideration of antibiotic stewardship.DesignSystematic review of the literature.Data sourcesThree-pronged search of (1) databases: Medline, Embase, Cochrane library, Guidelines International Network and Trip Medical Database; (2) websites of European national paediatric associations and (3) contact of European experts. Data were collected between January 2017 and February 2018.Eligibility criteriaNational guidelines of European countries for the clinical management of AOM in children aged <16 years.Data extraction and synthesisData were extracted using tables constructed by the research team. Guidelines were graded using AGREE II criteria. LoE and SoR were compared. Guidelines were assessed for principles of antibiotic stewardship.ResultsAOM guidelines were obtained from 17 or the 32 countries in the European Union or European Free Trade Area. The mean AGREE II score was ≤41% across most domains. Diagnosis of AOM was based on similar signs and symptoms. The most common indication for antibiotics was tympanic membrane perforation/otorrhoea (14/15; 93%). The majority (15/17; 88%) recommended a watchful waiting approach to antibiotics. Amoxicillin was the most common first-line antibiotic (14/17; 82%). Recommended treatment duration varied from 5 to 10 days. Seven countries advocated high-dose (75-90 mg/kg/day) and five low-dose (30-60 mg/kg/day) amoxicillin. Less than 60% of guidelines used a national or international scale system to rate level of evidence to support recommendations. Under half of the guidelines (7/17; 41%) referred to country-specific microbiological and antibiotic resistance data.ConclusionsGuidelines for managing AOM were similar across European countries. Guideline quality was mostly weak, and it often did not refer to country-specific antibiotic resistance patterns. Coordinating efforts to produce a core guideline which can then be adapted by each country may help improve overall quality and contribute to tackling antibiotic resistance.

Dataset Information

Quality appraisal of clinical guidelines for surgical site infection prevention: A systematic review.

Background

Methods

Results

Discussion

Implications for translation

Publications

Quality appraisal of clinical guidelines for surgical site infection prevention: A systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets