Dataset Information

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review.

ABSTRACT:

Background

Electronic guideline-based decision support systems have been suggested to successfully deliver the knowledge embedded in clinical practice guidelines. A number of studies have already shown positive findings for decision support systems such as drug-dosing systems and computer-generated reminder systems for preventive care services.

Methods

A systematic literature search (1990 to December 2008) of the English literature indexed in the Medline database, Embase, the Cochrane Central Register of Controlled Trials, and CRD (DARE, HTA and NHS EED databases) was conducted to identify evaluation studies of electronic multi-step guideline implementation systems in ambulatory care settings. Important inclusion criterions were the multidimensionality of the guideline (the guideline needed to consist of several aspects or steps) and real-time interaction with the system during consultation. Clinical decision support systems such as one-time reminders for preventive care for which positive findings were shown in earlier reviews were excluded. Two comparisons were considered: electronic multidimensional guidelines versus usual care (comparison one) and electronic multidimensional guidelines versus other guideline implementation methods (comparison two).

Results

Twenty-seven publications were selected for analysis in this systematic review. Most designs were cluster randomized controlled trials investigating process outcomes more than patient outcomes. With success defined as at least 50% of the outcome variables being significant, none of the studies were successful in improving patient outcomes. Only seven of seventeen studies that investigated process outcomes showed improvements in process of care variables compared with the usual care group (comparison one). No incremental effect of the electronic implementation over the distribution of paper versions of the guideline was found, neither for the patient outcomes nor for the process outcomes (comparison two).

Conclusions

There is little evidence at the moment for the effectiveness of an increasingly used and commercialized instrument such as electronic multidimensional guidelines. After more than a decade of development of numerous electronic systems, research on the most effective implementation strategy for this kind of guideline-based decision support systems is still lacking. This conclusion implies a considerable risk towards inappropriate investments in ineffective implementation interventions and in suboptimal care.

SUBMITTER: Heselmans A

PROVIDER: S-EPMC2806389 | biostudies-literature | 2009 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review.

Heselmans Annemie A Van de Velde Stijn S Donceel Peter P Aertgeerts Bert B Ramaekers Dirk D

Implementation science : IS 20091230

<h4>Background</h4>Electronic guideline-based decision support systems have been suggested to successfully deliver the knowledge embedded in clinical practice guidelines. A number of studies have already shown positive findings for decision support systems such as drug-dosing systems and computer-generated reminder systems for preventive care services.<h4>Methods</h4>A systematic literature search (1990 to December 2008) of the English literature indexed in the Medline database, Embase, the Coch ...[more]

PMID: 20042070

Similar Datasets

Project description:ImportanceGuideline recommendations do not necessarily translate into changes in clinical practice behaviour or better patient outcomes.ObjectiveThis systematic review aims to identify recent clinical guideline implementation strategies in oncology and to determine their effect primarily on patient-relevant outcomes and secondarily on healthcare professionals' adherence.MethodsA systematic search of five electronic databases (PubMed, Web of Science, GIN, CENTRAL, CINAHL) was conducted on 16 december 2022. Randomized controlled trials (RCTs) and non-randomized studies of interventions (NRSIs) assessing the effectiveness of guideline implementation strategies on patient-relevant outcomes (overall survival, quality of life, adverse events) and healthcare professionals' adherence outcomes (screening, referral, prescribing, attitudes, knowledge) in the oncological setting were targeted. The Cochrane risk-of-bias tool and the ROBINS-I tool were used for assessing the risk of bias. Certainty in the evidence was evaluated according to GRADE recommendations. This review was prospectively registered in the International Prospective Register of Systematic Reviews (PROSPERO) with the identification number CRD42021268593.FindingsOf 1326 records identified, nine studies, five cluster RCTs and four controlled before-and after studies, were included in the narrative synthesis. All nine studies assess the effect of multi-component interventions in 3577 cancer patients and more than 450 oncologists, nurses and medical staff.Patient-levelEducational meetings combined with materials, opinion leaders, audit and feedback, a tailored intervention or academic detailing may have little to no effect on overall survival, quality of life and adverse events of cancer patients compared to no intervention, however, the evidence is either uncertain or very uncertain.Provider-levelMulti-component interventions may increase or slightly increase guideline adherence regarding screening, referral and prescribing behaviour of healthcare professionals according to guidelines, but the certainty in evidence is low. The interventions may have little to no effect on attitudes and knowledge of healthcare professionals, still, the evidence is very uncertain.Conclusions and relevanceKnowledge and skill accumulation through team-oriented or online educational training and dissemination of materials embedded in multi-component interventions seem to be the most frequently researched guideline implementation strategies in oncology recently. This systematic review provides an overview of recent guideline implementation strategies in oncology, encourages future implementation research in this area and informs policymakers and professional organisations on the development and adoption of implementation strategies.

Project description:BackgroundThe objective was to find evidence to substantiate assertions that electronic applications for medication management in ambulatory care (electronic prescribing, clinical decision support (CDSS), electronic health record, and computer generated paper prescriptions), while intended to reduce prescribing errors, can themselves result in errors that might harm patients or increase risks to patient safety.MethodsBecause a scoping search for adverse events in randomized controlled trials (RCTs) yielded few relevant results, we systematically searched nine databases, including MEDLINE, EMBASE, and The Cochrane Database of Systematic Reviews for systematic reviews and studies of a wide variety of designs that reported on implementation of the interventions. Studies that had safety and adverse events as outcomes, monitored for them, reported anecdotally adverse events or other events that might indicate a threat to patient safety were included.ResultsWe found no systematic reviews that examined adverse events or patient harm caused by organizational interventions. Of the 4056 titles and abstracts screened, 176 full-text articles were assessed for inclusion. Sixty-one studies with appropriate interventions, settings and participants but without patient safety, adverse event outcomes or monitoring for risks were excluded, along with 77 other non-eligible studies. Eighteen randomized controlled trials (RCTs), 5 non-randomized controlled trials (non-R,CTs) and 15 observational studies were included. The most common electronic intervention studied was CDSS and the most frequent clinical area was cardio-vascular, including anti-coagulants. No RCTS or non-R,CTS reported adverse event. Adverse events reported in observational studies occurred less frequently after implementation of CDSS. One RCT and one observational study reported an increase in problematic prescriptions with electronic prescribingConclusionsThe safety implications of electronic medication management in ambulatory care have not been established with results from studies included in this systematic review. Only a minority of studies that investigated these interventions included threats to patients' safety as outcomes or monitored for adverse events. It is therefore not surprising that we found little evidence to substantiate fears of new risks to patient safety with their implementation. More research is needed to focus on the draw-backs and negative outcomes that implementation of these interventions might introduce.

Project description:BackgroundGuideline implementation has been an ongoing challenge in the dental practice setting. Despite this, there are no reviews summarising the existing evidence regarding effective guideline implementation strategies in this setting. In order to address this, this systematic review examines the effectiveness of guideline implementation strategies in the dental practice setting.MethodsA systematic search was undertaken according to the PRISMA statement across nine electronic databases, targeting randomised controlled trials and quasi-experimental studies which evaluated the effectiveness of guideline implementation strategies in improving guideline adherence in the dental setting. All records were independently examined for relevance and appraised for study quality by two authors, with consensus achieved by a third author. Data were extracted from included studies using a standardised data extraction pro forma.ResultsA total of 15 records were eligible for inclusion in this review, which focused on the effects of audit and feedback, reminders, education, patient-mediated interventions, pay for performance and multifaceted interventions. Although there were some conflicting evidence, studies within each category of implementation strategy indicated a positive effect on guideline adherence.ConclusionsThis study has identified education, reminders and multifaceted interventions as effective implementation strategies for the dental practice setting. Although this is similar to research findings from other health sectors, there is some evidence to suggest patient-mediated interventions may be less effective and pay for performance may be more effective in the dental setting. These findings can inform policy makers, professional associations, colleges and organisations in the future adoption of clinical guidelines in the dental practice setting.Trial registrationThis systematic review was registered with the International Prospective Register of Systematic Reviews (PROSPERO), registration ID CRD42018093023.

Project description:BackgroundThere are limited data on the effectiveness of the vaccines against symptomatic coronavirus disease 2019 (Covid-19) currently authorized in the United States with respect to hospitalization, admission to an intensive care unit (ICU), or ambulatory care in an emergency department or urgent care clinic.MethodsWe conducted a study involving adults (≥50 years of age) with Covid-19-like illness who underwent molecular testing for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). We assessed 41,552 admissions to 187 hospitals and 21,522 visits to 221 emergency departments or urgent care clinics during the period from January 1 through June 22, 2021, in multiple states. The patients' vaccination status was documented in electronic health records and immunization registries. We used a test-negative design to estimate vaccine effectiveness by comparing the odds of a positive test for SARS-CoV-2 infection among vaccinated patients with those among unvaccinated patients. Vaccine effectiveness was adjusted with weights based on propensity-for-vaccination scores and according to age, geographic region, calendar time (days from January 1, 2021, to the index date for each medical visit), and local virus circulation.ResultsThe effectiveness of full messenger RNA (mRNA) vaccination (≥14 days after the second dose) was 89% (95% confidence interval [CI], 87 to 91) against laboratory-confirmed SARS-CoV-2 infection leading to hospitalization, 90% (95% CI, 86 to 93) against infection leading to an ICU admission, and 91% (95% CI, 89 to 93) against infection leading to an emergency department or urgent care clinic visit. The effectiveness of full vaccination with respect to a Covid-19-associated hospitalization or emergency department or urgent care clinic visit was similar with the BNT162b2 and mRNA-1273 vaccines and ranged from 81% to 95% among adults 85 years of age or older, persons with chronic medical conditions, and Black or Hispanic adults. The effectiveness of the Ad26.COV2.S vaccine was 68% (95% CI, 50 to 79) against laboratory-confirmed SARS-CoV-2 infection leading to hospitalization and 73% (95% CI, 59 to 82) against infection leading to an emergency department or urgent care clinic visit.ConclusionsCovid-19 vaccines in the United States were highly effective against SARS-CoV-2 infection requiring hospitalization, ICU admission, or an emergency department or urgent care clinic visit. This vaccine effectiveness extended to populations that are disproportionately affected by SARS-CoV-2 infection. (Funded by the Centers for Disease Control and Prevention.).

Project description:BACKGROUND:The uptake of guideline recommendations that improve heart failure (HF) outcomes remains suboptimal. We reviewed implementation interventions that improve physician adherence to these recommendations, and identified contextual factors associated with implementation success. METHODS:We searched databases from January 1990 to November 2017 for studies testing interventions to improve uptake of class I HF guidelines. We used the Cochrane Effective Practice and Organisation of Care and Process Redesign frameworks for data extraction. Primary outcomes included: proportion of eligible patients offered guideline-recommended pharmacotherapy, self-care education, left ventricular function assessment and/or intracardiac devices. We reported clinical outcomes when available. RESULTS:We included 38 studies. Provider-level interventions (n=13 studies) included audit and feedback, reminders and education. Organisation-level interventions (n=18) included medical records system changes, multidisciplinary teams, clinical pathways and continuity of care. System-level interventions (n=3) included provider/institutional incentives. Four studies assessed multi-level interventions. We could not perform meta-analyses due to statistical/conceptual heterogeneity. Thirty-two studies reported significant improvements in at least one primary outcome. Clinical pathways, multidisciplinary teams and multifaceted interventions were most consistently successful in increasing physician uptake of guidelines. Among randomised controlled trials (RCT) (n=10), pharmacist and nurse-led interventions improved target dose prescriptions. Eleven studies reported clinical outcomes; significant improvements were reported in three, including a clinical pathway, a multidisciplinary team and a multifaceted intervention. Baseline assessment of barriers, staff training, iterative intervention development, leadership commitment and policy/financial incentives were associated with intervention effectiveness. Most studies (n=20) had medium risk of bias; nine RCTs had low risk of bias. CONCLUSION:Our study is limited by the quality and heterogeneity of the primary studies. Clinical pathways, multidisciplinary teams and multifaceted interventions appear to be most consistent in increasing guideline uptake. However, improvements in process outcomes were rarely accompanied by improvements in clinical outcomes. Our work highlights the need for improved research methodology to reliably assess the effectiveness of implementation interventions.

Project description:BackgroundHealth care professionals (HCPs) use clinical practice guidelines (CPGs) to make evidence-informed decisions regarding patient care. Although a large number of cancer-related CPGs exist, it is unknown which CPG dissemination and implementation strategies are effective for improving HCP behaviour and patient outcomes in a cancer care context. This review aimed to determine the effectiveness of CPG dissemination and/or implementation strategies among HCPs in a cancer care context.MethodsA comprehensive search of five electronic databases was conducted. Studies were limited to the dissemination and/or implementation of a CPG targeting both medical and/or allied HCPs in cancer care. Two reviewers independently coded strategies using the Mazza taxonomy, extracted study findings, and assessed study quality.ResultsThe search strategy identified 33 studies targeting medical and/or allied HCPs. Across the 33 studies, 23 of a possible 49 strategies in the Mazza taxonomy were used, with a mean number of 3.25 (SD = 1.45) strategies per intervention. The number of strategies used per intervention was not associated with positive outcomes. Educational strategies (n = 24), feedback on guideline compliance (n = 11), and providing reminders (n = 10) were the most utilized strategies. When used independently, providing reminders and feedback on CPG compliance corresponded with positive significant changes in outcomes. Further, when used as part of multi-strategy interventions, group education and organizational strategies (e.g. creation of an implementation team) corresponded with positive significant changes in outcomes.ConclusionsFuture CPG dissemination and implementation interventions for cancer care HCPs may benefit from utilizing the identified strategies. Research in this area should aim for better alignment between study objectives, intervention design, and evaluation measures, and should seek to incorporate theory in intervention design, so that behavioural antecedents are considered and measured; doing so would enhance the field's understanding of the causal mechanisms by which interventions lead, or do not lead, to changes in outcomes at all levels.

Project description:The uptake of Clinical Practice Guideline (CPG) recommendations that improve outcomes in heart failure (HF) remains suboptimal. We will conduct a systematic review to identify implementation strategies that improve physician adherence to class I recommendations, those with clear evidence that benefits outweigh the risks. We will use American, Canadian and European HF guidelines as our reference.We will conduct a literature search in the databases of MEDLINE, EMBASE, HEALTHSTAR, CINAHL, Cochrane Library, Campbell Collaboration, Joanna Briggs Institute Evidence Based Practice, Centre for Reviews and Dissemination and Evidence Based Practice Centres. We will include prospective studies evaluating implementation interventions aimed at improving uptake of class I CPG recommendations in HF. We will extract data in duplicate. We will classify interventions according to their level of application (ie, provider, organisation, systems level) and common underlying characteristics (eg, education, decision-support, financial incentives) using the Cochrane Effective Practice and Organisation of Care Taxonomy. We will assess the impact of the intervention on adherence to the CPGs. Outcomes will include proportion of eligible patients who were: prescribed a CPG-recommended pharmacological treatment; referred for device consideration; provided self-care education at discharge; and provided left ventricular function assessment. We will include clinical outcomes such as hospitalisations, readmissions and mortality, if data is available. We will identify the common elements of successful and failing interventions, and examine the context in which they were applied, using the Process Redesign contextual framework. We will synthesise the results narratively and, if appropriate, will pool results for meta-analysis.In this review, we will assess the impact of implementation strategies and contextual factors on physician adherence to HF CPGs. We will explore why some interventions may succeed in one setting and fail in another. We will disseminate our findings through briefing reports, publications and presentations.CRD42015017155.

Dataset Information

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review.

Background

Methods

Results

Conclusions

Publications

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets