Dataset Information

Systematic review of emergency medicine clinical practice guidelines: Implications for research and policy.

ABSTRACT:

Introduction

Over 25 years, emergency medicine in the United States has amassed a large evidence base that has been systematically assessed and interpreted through ACEP Clinical Policies. While not previously studied in emergency medicine, prior work has shown that nearly half of all recommendations in medical specialty practice guidelines may be based on limited or inconclusive evidence. We sought to describe the proportion of clinical practice guideline recommendations in Emergency Medicine that are based upon expert opinion and low level evidence.

Methods

Systematic review of clinical practice guidelines (Clinical Policies) published by the American College of Emergency Physicians from January 1990 to January 2016. Standardized data were abstracted from each Clinical Policy including the number and level of recommendations as well as the reported class of evidence. Primary outcomes were the proportion of Level C equivalent recommendations and Class III equivalent evidence. The primary analysis was limited to current Clinical Policies, while secondary analysis included all Clinical Policies.

Results

A total of 54 Clinical Policies including 421 recommendations and 2801 cited references, with an average of 7.8 recommendations and 52 references per guideline were included. Of 19 current Clinical Policies, 13 of 141 (9.2%) recommendations were Level A, 57 (40.4%) Level B, and 71 (50.4%) Level C. Of 845 references in current Clinical Policies, 67 (7.9%) were Class I, 272 (32.3%) Class II, and 506 (59.9%) Class III equivalent. Among all Clinical Policies, 200 (47.5%) recommendations were Level C equivalent, and 1371 (48.9%) of references were Class III equivalent.

Conclusions

Emergency medicine clinical practice guidelines are largely based on lower classes of evidence and a majority of recommendations are expert opinion based. Emergency medicine appears to suffer from an evidence gap that should be prioritized in the national research agenda and considered by policymakers prior to developing future quality standards.

SUBMITTER: Venkatesh AK

PROVIDER: S-EPMC5476239 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Systematic review of emergency medicine clinical practice guidelines: Implications for research and policy.

Venkatesh Arjun K AK Savage Dan D Sandefur Benjamin B Bernard Kenneth R KR Rothenberg Craig C Schuur Jeremiah D JD

PloS one 20170619 6

<h4>Introduction</h4>Over 25 years, emergency medicine in the United States has amassed a large evidence base that has been systematically assessed and interpreted through ACEP Clinical Policies. While not previously studied in emergency medicine, prior work has shown that nearly half of all recommendations in medical specialty practice guidelines may be based on limited or inconclusive evidence. We sought to describe the proportion of clinical practice guideline recommendations in Emergency Med ...[more]

PMID: 28628660

Similar Datasets

Project description:BACKGROUND:Clinical practice guidelines (CPGs) have been published by the American College of Emergency Physicians (ACEP) since 1990 to advance evidence-based emergency care. ACEP clinical policies have drawn anecdotal criticism for bias, yet the overall quality of these guidelines has not previously been quantified. We sought to examine ACEP clinical policies using a recognised, validated appraisal instrument: Appraisal of Guidelines for Research & Evaluation (AGREE II). METHODS:Systematic assessment of current ACEP clinical policies was conducted using the AGREE II instrument, which contains 23 appraisal items (scored on a 1-7 scale) in six domains and two overall assessments. Each policy was independently appraised by five trained appraisers. Primary outcomes were AGREE II ratings for each item, domain and "Overall Assessment," and scores were reported as standardised percentages from all five appraisers. Secondary analyses examined associations between AGREE II ratings and policy publication date, strength of underlying evidence and strength of recommendations. Additional analysis examined relationships between domain and "Overall Assessment" ratings. RESULTS:Twenty guidelines published from April 2007 to November 2017 were included. Of the six domains, "Scope and Purpose" scored highest (mean 90%) and "Applicability" scored lowest (mean 35%). The four remaining domains ("Stakeholder Involvement," "Rigor of Development," "Clarity of Presentation" and "Editorial Independence") had mean scores of 53%-78%. The mean "Overall Assessment" rating was 69% and was not associated with policy publication date, strength of underlying evidence or strength of recommendations. We found positive associations between "Overall Assessment" ratings and two domains: "Rigor of Development" (r = 0.70) and "Clarity of Presentation" (r = 0.70). CONCLUSIONS:Based on validated AGREE II criteria, ACEP clinical policies can be most improved by addressing their application in practice. ACEP clinical policies' overall quality did not improve over the assessed time period and is not explained by the quality of underlying evidence.

Project description:OBJECTIVES:The aims of this study were to investigate whether there is a gap between evidence of traditional medicine (TM) interventions in East-Asian countries from the current Clinical Practice Guidelines (CPGs) and evidence from current systematic reviews and meta-analyses (SR-MAs) and to analyze the impact of this gap on present CPGs. METHODS:We examined 5 representative TM interventions in the health care systems of East-Asian countries. We searched seven relevant databases for CPGs to identify whether core CPGs included evidence of TM interventions, and we searched 11 databases for SR-MAs to re-evaluate current evidence on TM interventions. We then compared the gap between the evidence from CPGs and SR-MAs. RESULTS:Thirteen CPGs and 22 SR-MAs met our inclusion criteria. Of the 13 CPGs, 7 CPGs (54%) mentioned TM interventions, and all were for acupuncture (only one was for both acupuncture and acupressure). However, the CPGs did not recommend acupuncture (or acupressure). Of 22 SR-MAs, 16 were for acupuncture, 5 for manual therapy, 1 for cupping, and none for moxibustion and herbal medicine. Comparing the evidence from CPGs and SR-MAs, an underestimation or omission of evidence for acupuncture, cupping, and manual therapy in current CPGs was detected. Thus, applying the results from the SR-MAs, we moderately recommend acupuncture for chronic LBP, but we inconclusively recommend acupuncture for (sub)acute LBP due to the limited current evidence. Furthermore, we weakly recommend cupping and manual therapy for both (sub)acute and chronic LBP. We cannot provide recommendations for moxibustion and herbal medicine due to a lack of evidence. CONCLUSIONS:The current CPGs did not fully reflect the evidence for TM interventions. As relevant studies such as SR-MAs are conducted and evidence increases, the current evidence on acupuncture, cupping, and manual therapy should be rigorously considered in the process of developing or updating the CPG system.

Project description:Background Up to 50% of individuals diagnosed with depression are known to use complementary and alternative medicine (CAM). The aim of this study was to identify the quantity and assess the quality of CAM recommendations in clinical practice guidelines for the treatment and/or management of depression in adults using the Appraisal of Guidelines, Research and Evaluation II (AGREE II) instrument. Methods A systematic review was conducted to identify depression guidelines. MEDLINE, EMBASE and CINAHL were searched from 2008 to 2018. The Guidelines International Network and the National Center for Complementary and Integrative Health websites were also searched. Eligible guidelines published by non-profit agencies on treatment of depression for adults were assessed with the AGREE II instrument twice, once for the overall guideline and once for the CAM sections. Results From 931 unique search results, 19 guidelines mentioned CAM, of which 16 made CAM recommendations. Scaled domain percentages from highest to lowest were as follows (overall, CAM section): clarity of presentation (87.0, 66.1%), scope and purpose (80.9, 77.6%), stakeholder involvement (62.0, 44.3%), editorial independence (61.6, 61.6%), rigour of development (58.0, 52.0%), and applicability (42.2, 25.4%). Quality varied within and across guidelines. Only 1 of 16 guidelines was recommended without modifications for both its overall and CAM sections by both appraisers. Conclusions There are multiple depression guidelines containing CAM recommendations available and there are a comprehensive set of CAM therapy options for depression. The quality of guidelines varied within and across guidelines and the quality of CAM recommendations was generally lower than the overall recommendations in the guidelines for all domains except editorial independence. Generally, characteristics of guidelines, including the year of publication and region of development varied across the guidelines irrespective of quality. Guidelines with higher AGREE II scores can serve as a guide to facilitate communication between patients and medical professionals regarding CAM use for depression, while guidelines with lower scores could be improved in future updates using the AGREE II instrument as a guide.

Project description:IntroductionClinical practice guidelines can improve healthcare processes and patient outcomes, but are often of low quality. Guideline appraisal tools aim to help potential guideline users in assessing guideline quality. We conducted a systematic review of publications describing guideline appraisal tools in order to identify and compare existing tools.MethodsAmong others we searched MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews from 1995 to May 2011 for relevant primary and secondary publications. We also handsearched the reference lists of relevant publications. On the basis of the available literature we firstly generated 34 items to be used in the comparison of appraisal tools and grouped them into thirteen quality dimensions. We then extracted formal characteristics as well as questions and statements of the appraisal tools and assigned them to the items.ResultsWe identified 40 different appraisal tools. They covered between three and thirteen of the thirteen possible quality dimensions and between three and 29 of the possible 34 items. The main focus of the appraisal tools were the quality dimensions "evaluation of evidence" (mentioned in 35 tools; 88%), "presentation of guideline content" (34 tools; 85%), "transferability" (33 tools; 83%), "independence" (32 tools; 80%), "scope" (30 tools; 75%), and "information retrieval" (29 tools; 73%). The quality dimensions "consideration of different perspectives" and "dissemination, implementation and evaluation of the guideline" were covered by only twenty (50%) and eighteen tools (45%) respectively.ConclusionsMost guideline appraisal tools assess whether the literature search and the evaluation, synthesis and presentation of the evidence in guidelines follow the principles of evidence-based medicine. Although conflicts of interest and norms and values of guideline developers, as well as patient involvement, affect the trustworthiness of guidelines, they are currently insufficiently considered. Greater focus should be placed on these issues in the further development of guideline appraisal tools.

Project description:BackgroundGlobally, 3 billion people suffer from either migraine or tension-type headache disorder over their lifetime. Approximately 50% of American adults suffering from headache or migraine have used complementary and alternative medicine (CAM), however, the quality and quantity of recommendations associated with such therapies across clinical practice guidelines (CPGs) for the treatment and/or management of these conditions are unknown. The purpose of this study was to identify the quantity and assess the quality of such CAM recommendations.MethodsMEDLINE, EMBASE and CINAHL were systematically searched from 2009 to April 2020; the Guidelines International Network and the National Center for Complementary and Integrative Health websites were also searched for eligible CPGs. CPGs were included if they provided any therapy recommendations. Eligible CPGs included those written for adult patients with headache and migraine; CPGs containing CAM recommendations were assessed twice for quality using the AGREE II instrument, once for the overall CPG and once for the CAM sections.ResultsOf 486 unique search results, 21 CPGs were eligible and quality assessed; fifteen CPGs mentioned CAM, of which 13 CPGs made CAM recommendations. The overall CPG assessment yielded higher scaled domain percentages than the CAM section across all domains. The results from highest to lowest were as follows (overall, CAM): clarity of presentation (66.7% vs. 50.0%), scope and purpose (63.9% vs. 61.1%), stakeholder involvement (22.2% vs. 13.9%), rigour of development (13.5% vs. 9.4%), applicability (6.3% vs. 0.0%), and editorial independence (0.0% vs. 0.0%).ConclusionsOf the eligible CPGs, the CAM sections were of lower quality compared to the overall recommendations across all domains of the AGREE II instrument. CPGs that scored well could serve as a framework for discussion between patients and healthcare professionals regarding use of CAM therapies in the context of headache and migraine.

Project description:BackgroundVenous thromboembolism (VTE) is a major global cause of morbidity and mortality. Low molecular weight heparin (LMWH) and fondaparinux (FDP) are frequently used to treat and prevent VTE and have a variety of safety and practical advantages over other anticoagulants, including use in outpatient settings. These medications are commonly listed on drug formularies, which act as a gateway for health plan prescription coverage by outlining the circumstances under which patients will be covered for specific drugs and drug products. Because patient access to medications is impacted by the nature of their listing on formularies, they must be rigorously reviewed and modernized as new evidence emerges.MethodsAs part of a broader drug class review team, we completed a systematic review of clinical practice guidelines to determine whether the recommendations they reported aligned with the indications listed for the coverage of LMWH and FDP in an outpatient drug formulary. Guideline quality was assessed using the Appraisal of Guidelines for Research & Evaluation (AGREE) II tool. Recommendation matrices were used to systematically compare, categorize, and summarize included recommendations.ResultsTwenty-seven guidelines were included from which 168 eligible recommendations were identified. Generally, AGREE II domains were adequately addressed; however, domain five (applicability) was poorly addressed. Most recommendations were based on moderate- to low-quality/limited evidence and reported on the use of LMWHs generally; few reported on specific agents.ConclusionsOur findings contributed to the recommendation that the formulary listing for LMWH and FDP be streamlined to include coverage for specific outpatient indications. The paucity of available evidence on the comparative efficacy of specific LMWH agents against each other and FDP limited agent-specific listing recommendations, highlighting the need for high-quality comparative studies on this topic.

Dataset Information

Systematic review of emergency medicine clinical practice guidelines: Implications for research and policy.

Introduction

Methods

Results

Conclusions

Publications

Systematic review of emergency medicine clinical practice guidelines: Implications for research and policy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure