What determines the quality of rehabilitation Clinical Practice Guidelines? An overview study.
Ontology highlight
ABSTRACT: Objective
To determine what factors determine the quality of rehabilitation Clinical Practice Guidelines (CPGs).Design
6 Databases were searched for papers that had applied the Appraisal of Guidelines for Research & Evaluation II (AGREE II) quality assessment tool to rehabilitation CPGs. The 573 de-duplicated abstracts were independently screened by two authors, resulting in 81 articles, the full texts of which were independently screened by two authors for AGREE II application to rehabilitation CPGs, resulting in a final selection of 40 reviews appraising 504 CPGs. Data were extracted from these by one author and checked by a second. Data on each CPG included the 6 AGREE II domain scores, as well as the two AGREE II global evaluations.Results
All six AGREE II domain scores were statistically significant predictors of Overall CPG quality rating; D3 (rigor of development) was the strongest and D1 (scope and purpose) the weakest; overall model p < 0.001; R = 0.53. Five of the 6 domain scores were significant predictors of the CPG use Recommendation, with D3 the strongest predictor and D5 (applicability) the weakest; overall model p < 0.001; pseudo R = 0.53.Conclusions
Quality of rehabilitation CPGs may be improved by addressing key domains such as Rigor of development.
SUBMITTER: Dijkers MP
PROVIDER: S-EPMC8265547 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundThere is a lack of a comprehensive evaluation for pediatric clinical practice guidelines (CPGs) published in recent years. Here, we assessed the quality of pediatric CPGs, considering factors that might affect their quality. The aim of the study is to promote a more coherent development and application of CPGs.MethodsPediatric CPGs published in PubMed, MedLive, Guidelines International Network, National Institute for Health and Care Excellence, and World Health Organization between 2017 and 2019 were searched and collected. Paired researchers conducted screening, data extraction, and quality assessment using the Appraisal of Guidelines for Research and Evaluation II (AGREE II). Linear regression analysis determined the factors affecting CPGs' quality.ResultsThe study included a total of 216 CPGs, which achieved a mean score of 4.26 out of 7 points (60.86%) in the AGREE II assessment. Only 6.48% of the CPGs reached the "recommend" level. The remaining 69.91% should have been modified before recommendation, while the other 23.61% did not reach the recommended level at all. The overall quality of recent pediatric CPGs was higher than previously, and the proportion of CPGs with low-quality decreased over time. However, there were still too few CPGs that reached a high-quality level. The "applicability" and "rigor of development" domains had generally low scores. CPGs formulated by developing countries or regions, those that are not under an organizations or groups responsibility, and those that used non-evidence-based methods were found to be associated with poorer quality in different domains as independent or combinational factors.ConclusionsThe quality of pediatric CPGs still needs to be improved. Specifically, a quality control before applying new CPGs should be essential to ensure their quality and applicability.
| S-EPMC8103635 | biostudies-literature
Project description:ObjectivesThe purpose of this study was to evaluate the quality of guidelines for rehabilitation of post-stroke aphasia using the Appraisal of Guidelines for Research and Evaluation (AGREE-II) instrument and identify consistency of different guidelines.MethodsA systematic search was undertaken from inception to October 2018. Two reviewers independently screened all titles and abstracts, and assessed eligible guidelines using the AGREE-II. Agreement among reviewers was measured by using intra-class correlation coefficient (ICC).ResultsFrom 5008 records screened, 8 guidelines met the inclusion criteria. The quality of guidelines was heterogeneous. Three guidelines were rated high (6.5) across; the highest rated domain was "scope and purpose' (median score 95.8%); the lowest rated domain was "rigor of development' (median score 67.2%). An overall high degree of agreement among reviewers to each domain was observed (ICC ranged from 0.60 to 0.99). The speech language therapy was recommended in 3 guidelines. Four guidelines described group treatment was beneficial for the continuum of care. However, other therapies for aphasia varied in the level of detail across guidelines.ConclusionsOur study indicated the quality of guidelines for post-stroke aphasia needed to be improved. Moreover, the treatment recommendations of aphasia existed discrepancy among the included guidelines. Therefore, it is suggested to pay more attention on the rigor of methodology and applicability during the process of the formulation of guideline. Future research should focus on the effectiveness, intensity, and duration of treatment measures.
| S-EPMC6709092 | biostudies-literature
Project description:OBJECTIVE:To determine the accessibility and currency of delirium guidelines, guideline summary papers and evaluation studies, and critically appraise guideline quality. DESIGN:Systematic literature search for formal guidelines (in English or French) with focus on delirium assessment and/or management in adults (≥18 years), guideline summary papers and evaluation studies.Full appraisal of delirium guidelines published between 2008 and 2013 and obtaining a 'Rigour of Development' domain screening score cut-off of >40% using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. DATA SOURCES:Multiple bibliographic databases, guideline organisation databases, complemented by a grey literature search. RESULTS:3327 database citations and 83 grey literature links were identified. A total of 118 retrieved delirium guidelines and related documents underwent full-text screening. A final 21 delirium guidelines (with 10 being >5 years old), 12 guideline summary papers and 3 evaluation studies were included. For 11 delirium guidelines published between 2008 and 2013, the screening AGREE II 'Rigour' scores ranged from 3% to 91%, with seven meeting the cut-off score of >40%. Overall, the highest rating AGREE II domains were 'Scope and Purpose' (mean 80.1%, range 64-100%) and 'Clarity and Presentation' (mean 76.7%, range 38-97%). The lowest rating domains were 'Applicability' (mean 48.7%, range 8-81%) and 'Editorial Independence' (mean 53%, range 2-90%). The three highest rating guidelines in the 'Applicability' domain incorporated monitoring criteria or audit and costing templates, and/or implementation strategies. CONCLUSIONS:Delirium guidelines are best sourced by a systematic grey literature search. Delirium guideline quality varied across all six AGREE II domains, demonstrating the importance of using a formal appraisal tool prior to guideline adaptation and implementation into clinical settings. Adding more knowledge translation resources to guidelines may improve their practical application and effective monitoring. More delirium guideline evaluation studies are needed to determine their effect on clinical practice.
| S-EPMC5353343 | biostudies-other
Project description:ObjectiveTo identify and summarize clinical practice guidelines for autism spectrum disorder (ASD) and intellectual disability (ID) for the Package of Interventions for Rehabilitation for the World Health Organization (WHO).Data sourcesAcademic databases, Google Scholar, guideline databases, and professional society websites were searched using the general criteria "ASD/ID" AND "rehabilitation" AND "guideline," restricted to English-only guidelines.Study selectionWork group members independently screened titles and abstracts (1952 ASD; 1027 ID) and excluded articles if not (1) a guideline; (2) about rehabilitation; (3) published since 2008; or (4) about ASD/ID. Full-text screening (29 ASD; 5 ID) involved 3 additional exclusion criteria: (1) contained conflict of interest; (2) lacked information on strength of recommendation; or (3) failed the Appraisal of Guidelines for Research and Evaluation II instrument. Six guidelines (4 ASD: 2 on youth, 1 on adults, 1 on all ages; 2 ID: 1 on challenging behaviors, 1 on mental health) resulted.Data extractionWork group members extracted 524 recommendations (386 ASD; 138 ID) from the guidelines including the level of evidence, diagnostic and age group, recommendation type (assessment, intervention, service), target, and valence.Data synthesisOf the 270 intervention recommendations (212 ASD; 58 ID), only 36 for ASD and 47 for ID were empirically based. Most comprised biomedical (23%), pharmacologic (29%), and psychosocial (21%) interventions for ASD and behavioral (14%), pharmacologic (29%), and psychological (14%) interventions for ID. Intervention recommendations primarily targeted coexisting conditions (56% ASD; 93% ID), whereas core symptoms received much less attention (26% ASD).ConclusionsClinical practice guidelines reviewed for ASD and ID primarily contained recommendations based on expert opinion, with the plurality of recommendations relating to pharmacologic treatment. Vital next steps include identifying relevant interventions for inclusion in the WHO Package and continuing to conduct rigorous intervention research, particularly on core symptoms of these conditions, to extend recommendations for high-quality guidelines.
| S-EPMC8463470 | biostudies-literature
Project description:OBJECTIVE:To evaluate the quality of clinical practice guidelines (CPGs) for otorhinolaryngology in China. MATERIALS AND METHODS:A systematic search of relevant literature databases (CBM, WANFANG, VIP, CNKI, China Guideline Clearinghouse) published between 1978 and March 2012 was undertaken to identify and select CPGs related to otorhinolaryngology. Four independent reviewers assessed the eligible guidelines using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Their degree of agreement was evaluated using the intraclass correlation coefficient (ICC). RESULT:From 170 citations, 21 relevant guidelines were included. The overall agreement among reviewers was moderate (ICC?=?0.87; 95% confidence interval [CI], 0.78-0.91). The scores for each of the AGREE domains were the following: "scope and purpose" (mean ± standard error [SE]?=?45.4±4.4; ICC?=?0.92), "stakeholder involvement" (mean ± SE?=?30.4±3.1; ICC?=?0.81), "rigor of development" (mean ± SE?=?20.9±2.8; ICC?=?0.87), "clarity of presentation" (mean ± SE?=?48.8±3.7; ICC?=?0.80), "applicability" (mean ± SE?=?12.6±1.7; ICC?=?0.72), and "editorial independence" (mean ± SE?=?6.2±0.8; ICC?=?0.76). Three guidelines (14%) mentioned updates, and the average update frequency was 7 years. None used the GRADE system. CONCLUSION:The quality of otorhinolaryngology guidelines in China is low. Greater efforts are needed to provide high-quality guidelines that serve as a useful and reliable tool for clinical decision-making in this field.
| S-EPMC3548820 | biostudies-literature
Project description:PurposeTo examine ophthalmologist use of an electronic health record (EHR)-based clinical decision support system (CDSS) to facilitate low vision rehabilitation (LVR) care referral.MethodsThe CDSS alert was designed to appear when best documented visual acuity was <20/40 or hemianopia or quadrantanopia diagnosis was identified during an ophthalmology encounter from November 6, 2017, to April 5, 2019. Fifteen ophthalmologists representing eight subspecialties from an academic medical center were required to respond to the referral recommendation (order, don't order). LVR referral rates and ophthalmologist user experience were assessed. Encounter characteristics associated with LVR referrals were explored using multilevel logistic regression analysis.ResultsThe alert appeared for 3625 (8.9%) of 40,931 eligible encounters. The referral rate was 14.8% (535/3625). Of the 3413 encounters that met the visual acuity criterion only, patients who were worse than 20/60 were more likely to be referred, and 32.4% of referred patients were between 20/40 and 20/60. Primary reasons for deferring referrals included active medical or surgical treatment, refractive-related issues, and previous connection to LVR services. Eleven of the 13 ophthalmologists agreed that the alert was useful in identifying candidates for LVR services.ConclusionsA CDSS for patient identification and referral offers an acceptable mechanism to apply practice guidelines and prompt ophthalmologists to facilitate LVR care. Further study is warranted to optimize ophthalmologist user experience while refining alert criteria beyond visual acuity.Translational relevanceThe CDSS provides the framework for multi-center research to assess the development of pragmatic algorithms and standards for facilitating LVR care.
| S-EPMC9547361 | biostudies-literature
Project description:ImportancePrimary care clinicians, who are increasingly responsible for caring for the growing population of cancer survivors, may be unfamiliar with appropriate cancer surveillance strategies. Clinical practice guidelines can inform cancer follow-up care and surveillance testing. Vague recommendations and inconsistencies among guidelines can lead to overuse and underuse of health care resources and have a negative impact on cost and quality of survivorship care.ObjectiveTo examine the specificity and consistency of recommendations for surveillance after active treatment across cancer guidelines.Design, setting, and participantsRetrospective cross-sectional analysis of national cancer guidelines from North America and Europe published since 2010 addressing posttreatment care for survivors of the 9 most common cancers. We categorized surveillance modalities into history and physical examinations, tumor markers, diagnostic procedures (eg, colonoscopy), and imaging. Within each guideline, we classified individual recommendations into 5 categories: (1) risk-based recommendation, (2) recommendation for surveillance, (3) addressed but no clear recommendation, (4) recommendation against surveillance, or (5) cases in which surveillance was not addressed. We reviewed each surveillance recommendation for frequency and a stop date, evaluated consistency among guidelines, and analyzed associations between the organizations proposing the guidelines and recommendation characteristics.Main outcomes and measuresDescription of guideline recommendations for cancer surveillance.ResultsWe identified 41 guidelines published between January 1, 2010, and March 1, 2016. Eighty-five percent of guidelines (35) were from professional organizations. Ambiguous recommendations (ie, modality not discussed or discussed without a clear recommendation) were present in 83% of guidelines (34), and 44% (18) recommended against at least 1 test. European guidelines were more likely than North American guidelines to contain ambiguous recommendations (100% vs 68%; P < .01). Recommendations commonly specified testing frequency (from 88% [14 of 16] for tumor markers to 92% [24 of 26] for procedures and/or imaging) but infrequently provided a definitive stop time. Cross-sectional imaging recommendations varied among guidelines for each cancer. For example, among breast cancer guidelines, surveillance computed tomographic scans were recommended against in 2, discussed without a clear recommendation in 1, and not addressed in 3 guidelines.Conclusions and relevanceGuidelines addressing the care of cancer survivors have low specificity and consistency. As guidelines continue to be revised, developers should clarify recommendations with simple, nonambiguous, definitive language for or against the use of specific tests to optimize care quality and resource utilization.
| S-EPMC5590752 | biostudies-literature
Project description:BackgroundGuidelines for pharmacy practitioners regarding various clinical pharmacy activities have been published in a number of countries. There is a need to review the guidelines and identify the scope of activities covered as a prelude to developing internationally acceptable common guidelines.AimTo review the scope of clinical pharmacy guidelines and assess the extent to which these guidelines conform to quality standards as per the AGREE II instrument.MethodMedline, Embase, Guideline Central, International Pharmaceutical Abstracts, Google Scholar and Google (for grey literature) were searched for the period 2010 to January 2023. Guidelines which focused on any health care setting and any clinical pharmacy activity were included. Data were extracted and quality assessed independently by two reviewers using the English version of the AGREE II instrument.ResultsThirty-eight guidelines were included, mostly originating from Australia (n = 10), Ireland (n = 8), UK (n = 7) and USA (n = 5). Areas covered included medication reconciliation, medicines optimisation, medication management and transition of care. As per the AGREE II assessment, the highest score was obtained for the scope and purpose domain and the lowest score for rigour of development, mainly due to non-consideration of literature/evidence to inform guideline development.ConclusionClinical pharmacy guidelines development processes need to focus on all quality domains and should take a systematic approach to guideline development. Guidelines need to further emphasise person-centred care and clinical communication. There is a scope to harmonise the guidelines internationally considering the diverse practices, standards and legislations across different geographies.
| S-EPMC10830799 | biostudies-literature
Project description:IntroductionThe American Dental Association (ADA) defines evidence-based dentistry (EBD) as "an approach to oral healthcare that requires the judicious integration of systematic assessments of clinically relevant scientific evidence, relating to the oral and medical condition and history, with the dentist's clinical expertise and the patient's treatment needs and preferences." Clinical practice guidelines (CPGs) are statements that include recommendations intended to optimize patient care that are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options. Therefore, ADA CPGs are the most rigorous examples of EBD to inform clinical practice. CPGs should be of the highest level of quality to ensure the appropriateness and timeliness of clinical recommendations.ObjectivesThe aim of this study was to measure the methodological rigor and transparency of the ADA CPGs.MethodsEach ADA CPG was appraised by 4 independent assessors using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Quantitative quality scores were obtained for 6 domains and overall quality. In addition, assessors provided a qualitative analysis by providing comments for each item and an appraisal of the full recommendation.ResultsA quality score of 75% was used as the threshold for high-quality guidelines. Using this metric, 6 of the current 10 current ADA CPGs were considered to be of high quality, 1 was slightly below the quality threshold, and 3 were considered marginal. Even among those evaluated to be high quality in overall assessment, certain domains did not reach the quality threshold of 75%.ConclusionOverall, the ADA CPGs collectively provide high-quality guidance for the clinician. While the AGREE appraisal guidelines have been used in CPG development since 2016, there is still room for improvement in certain domains (i.e., stakeholder involvement, rigor of development, applicability, and editorial independence).Knowledge transfer statementThe results of this study summarize the methodological rigor and transparency of the 10 current ADA clinical practice guidelines. Since adoption of AGREE standards (2016), CPGs have been uniformly of high quality. The quality of older CPGs was somewhat lower but overall deemed acceptable. Thus, ADA CPGs may be used with confidence to inform practitioners of treatment options supported by rigorous evidence-based dentistry standards. However, there is still room for improvement in methodological quality.
| S-EPMC10029135 | biostudies-literature
Project description:BackgroundAs a source of readily available evidence, rigorously synthesized and interpreted by expert clinicians and methodologists, clinical guidelines are part of an evidence-based practice toolkit, which, transformed into practice recommendations, have the potential to improve both the process of care and patient outcomes. In Brazil, the process of development and updating of the clinical guidelines for the Brazilian Unified Health System (Sistema Único de Saúde, SUS) is already well systematized by the Ministry of Health. However, the implementation process of those guidelines has not yet been discussed and well structured. Therefore, the first step of this project and the primary objective of this study was to summarize the evidence on the effectiveness of strategies used to promote clinical practice guideline implementation and dissemination.MethodsThis overview used systematic review methodology to locate and evaluate published systematic reviews regarding strategies for clinical practice guideline implementation and adhered to the PRISMA guidelines for systematic review (PRISMA).ResultsThis overview identified 36 systematic reviews regarding 30 strategies targeting healthcare organizations, healthcare providers and patients to promote guideline implementation. The most reported interventions were educational materials, educational meetings, reminders, academic detailing and audit and feedback. Care pathways-single intervention, educational meeting-single intervention, organizational culture, and audit and feedback-both strategies implemented in combination with others-were strategies categorized as generally effective from the systematic reviews. In the meta-analyses, when used alone, organizational culture, educational intervention and reminders proved to be effective in promoting physicians' adherence to the guidelines. When used in conjunction with other strategies, organizational culture also proved to be effective. For patient-related outcomes, education intervention showed effective results for disease target results at a short and long term.ConclusionThis overview provides a broad summary of the best evidence on guideline implementation. Even if the included literature highlights the various limitations related to the lack of standardization, the methodological quality of the studies, and especially the lack of conclusion about the superiority of one strategy over another, the summary of the results provided by this study provides information on strategies that have been most widely studied in the last few years and their effectiveness in the context in which they were applied. Therefore, this panorama can support strategy decision-making adequate for SUS and other health systems, seeking to positively impact on the appropriate use of guidelines, healthcare outcomes and the sustainability of the SUS.
| S-EPMC8785489 | biostudies-literature