Dataset Information

Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success.

ABSTRACT: To identify features of clinical decision support systems critical for improving clinical practice.Systematic review of randomised controlled trials.Literature searches via Medline, CINAHL, and the Cochrane Controlled Trials Register up to 2003; and searches of reference lists of included studies and relevant reviews.Studies had to evaluate the ability of decision support systems to improve clinical practice.Studies were assessed for statistically and clinically significant improvement in clinical practice and for the presence of 15 decision support system features whose importance had been repeatedly suggested in the literature.Seventy studies were included. Decision support systems significantly improved clinical practice in 68% of trials. Univariate analyses revealed that, for five of the system features, interventions possessing the feature were significantly more likely to improve clinical practice than interventions lacking the feature. Multiple logistic regression analysis identified four features as independent predictors of improved clinical practice: automatic provision of decision support as part of clinician workflow (P < 0.00001), provision of recommendations rather than just assessments (P = 0.0187), provision of decision support at the time and location of decision making (P = 0.0263), and computer based decision support (P = 0.0294). Of 32 systems possessing all four features, 30 (94%) significantly improved clinical practice. Furthermore, direct experimental justification was found for providing periodic performance feedback, sharing recommendations with patients, and requesting documentation of reasons for not following recommendations.Several features were closely correlated with decision support systems' ability to improve patient care significantly. Clinicians and other stakeholders should implement clinical decision support systems that incorporate these features whenever feasible and appropriate.

SUBMITTER: Kawamoto K

PROVIDER: S-EPMC555881 | biostudies-other | 2005 Apr

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success.

Kawamoto Kensaku K Houlihan Caitlin A CA Balas E Andrew EA Lobach David F DF

BMJ (Clinical research ed.) 20050314 7494

<h4>Objective</h4>To identify features of clinical decision support systems critical for improving clinical practice.<h4>Design</h4>Systematic review of randomised controlled trials.<h4>Data sources</h4>Literature searches via Medline, CINAHL, and the Cochrane Controlled Trials Register up to 2003; and searches of reference lists of included studies and relevant reviews.<h4>Study selection</h4>Studies had to evaluate the ability of decision support systems to improve clinical practice.<h4>Data e ...[more]

PMID: 15767266

Similar Datasets

Project description:Computerised clinical decision support (CDS) can potentially better inform decisions, and it can help with the management of information overload. It is perceived to be a key component of a learning health care system. Despite its increasing implementation worldwide, it remains uncertain why the effect of CDS varies and which factors make CDS more effective.To examine which factors make CDS strategies more effective on a number of outcomes, including adherence to recommended practice, patient outcome measures, economic measures, provider or patient satisfaction, and medical decision quality.We identified randomised controlled trials, non-randomised trials, and controlled before-and-after studies that directly compared CDS implementation with a given factor to CDS without that factor by searching CENTRAL, MEDLINE, EMBASE, and CINAHL and checking reference lists of relevant studies. We considered CDS with any objective for any condition in any healthcare setting. We included CDS interventions that were either displayed on screen or provided on paper and that were directed at healthcare professionals or targeted at both professionals and patients. The reviewers screened the potentially relevant studies in duplicate. They extracted data and assessed risk of bias in independent pairs or individually followed by a double check by another reviewer. We summarised results using medians and interquartile ranges and rated our certainty in the evidence using the GRADE system.We identified 66 head-to-head trials that we synthesised across 14 comparisons of CDS intervention factors. Providing CDS automatically versus on demand led to large improvements in adherence. Displaying CDS on-screen versus on paper led to moderate improvements and making CDS more versus less patient-specific improved adherence modestly. When CDS interventions were combined with professional-oriented strategies, combined with patient-oriented strategies, or combined with staff-oriented strategies, then adherence improved slightly. Providing CDS to patients slightly increased adherence versus CDS aimed at the healthcare provider only. Making CDS advice more explicit and requiring users to respond to the advice made little or no difference. The CDS intervention factors made little or no difference to patient outcomes. The results for economic outcomes and satisfaction outcomes were sparse.Multiple factors may affect the success of CDS interventions. CDS may be more effective when the advice is provided automatically and displayed on-screen and when the suggestions are more patient-specific. CDS interventions combined with other strategies probably also improves adherence. Providing CDS directly to patients may also positively affect adherence. The certainty of the evidence was low to moderate for all factors.PROSPERO, CRD42016033738.

Project description:Importance: Early mobilization, out-of-bed activity, is a component of acute stroke unit care; however, stroke patient heterogeneity requires complex decision-making. Clinically credible and applicable CPGs are needed to support and optimize the delivery of care. In this study, we are specifically exploring the role of clinical practice guidelines to support individual patient-level decision-making by stroke clinicians about early mobilization post-stroke. Methods: Our study uses a novel, two-pronged approach. (1) A review of CPGs containing recommendations for early mobilization practices published after 2015 was appraised using purposely selected items from the Appraisal of Guidelines Research and Evaluation-Recommendations Excellence (AGREE-REX) tool relevant to decision-making for clinicians. (2) A cross-sectional study involving semi-structured interviews with Australian expert stroke clinicians representing content experts and CPG target users. Every CPG was independently assessed against the AGREE-REX standard by two reviewers. Expert stroke clinicians, invited via email, were recruited between June 2019 to March 2020.The main outcomes from the review was the proportion of criteria addressed for each AGREE-REX item by individual and all CPG(s). The main cross-sectional outcomes were the distributions of stroke clinicians' responses about the utility of CPGs, specific areas of uncertainty in early mobilization decision-making, and suggested parameters for inclusion in future early mobilization CPGs. Results: In 18 identified CPGs, many did not adequately address the "Evidence" and "Applicability to Patients" AGREE-REX items. Out of 30 expert stroke clinicians (11 physicians [37%], 11 physiotherapists [37%], 8 nurses [26%]; median [IQR] years of experience, 14 [10-25]), 47% found current CPGs "too broad or vague," while 40% rely on individual clinical judgement and interpretation of the evidence to select an evidence-based choice of action. The areas of uncertainty in decision-making revealed four key suggestions: (1) more granular descriptions of patient and stroke characteristics for appropriate tailoring of decisions, (2) clear statements about when clinical flexibility is appropriate, (3) detailed description of the intervention dose, and (4) physical assessment criteria including safety parameters. Conclusions: The lack of specificity, clinical applicability, and adaptability of current CPGs to effectively respond to the heterogeneous clinical stroke context has provided a clear direction for improvement.

Project description:BackgroundClinical decision support (CDS) is a valuable feature of electronic health records (EHRs) designed to improve quality and safety. However, due to the complexities of system design and inconsistent results, CDS tools may inadvertently increase alert fatigue and contribute to physician burnout. A/B testing, or rapid-cycle randomized tests, is a useful method that can be applied to the EHR in order to rapidly understand and iteratively improve design choices embedded within CDS tools.ObjectiveThis paper describes how rapid randomized controlled trials (RCTs) embedded within EHRs can be used to quickly ascertain the superiority of potential CDS design changes to improve their usability, reduce alert fatigue, and promote quality of care.MethodsA multistep process combining tools from user-centered design, A/B testing, and implementation science was used to understand, ideate, prototype, test, analyze, and improve each candidate CDS. CDS engagement metrics (alert views, acceptance rates) were used to evaluate which CDS version is superior.ResultsTo demonstrate the impact of the process, 2 experiments are highlighted. First, after multiple rounds of usability testing, a revised CDS influenza alert was tested against usual care CDS in a rapid (~6 weeks) RCT. The new alert text resulted in minimal impact on reducing firings per patients per day, but this failure triggered another round of review that identified key technical improvements (ie, removal of dismissal button and firings in procedural areas) that led to a dramatic decrease in firings per patient per day (23.1 to 7.3). In the second experiment, the process was used to test 3 versions (financial, quality, regulatory) of text supporting tobacco cessation alerts as well as 3 supporting images. Based on 3 rounds of RCTs, there was no significant difference in acceptance rates based on the framing of the messages or addition of images.ConclusionsThese experiments support the potential for this new process to rapidly develop, deploy, and rigorously evaluate CDS within an EHR. We also identified important considerations in applying these methods. This approach may be an important tool for improving the impact of and experience with CDS.Trial registrationFlu alert trial: ClinicalTrials.gov NCT03415425; https://clinicaltrials.gov/ct2/show/NCT03415425. Tobacco alert trial: ClinicalTrials.gov NCT03714191; https://clinicaltrials.gov/ct2/show/NCT03714191.

Dataset Information

Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success.

Publications

Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets