Dataset Information

Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials.

ABSTRACT:

Background

Computerized decision support systems (CDSS) are believed to have the potential to improve the quality of health care delivery, although results from high quality studies have been mixed. We conducted a systematic review to evaluate whether certain features of prescribing decision support systems (RxCDSS) predict successful implementation, change in provider behaviour, and change in patient outcomes.

Methods

A literature search of Medline, EMBASE, CINAHL and INSPEC databases (earliest entry to June 2008) was conducted to identify randomized controlled trials involving RxCDSS. Each citation was independently assessed by two reviewers for outcomes and 28 predefined system features. Statistical analysis of associations between system features and success of outcomes was planned.

Results

Of 4534 citations returned by the search, 41 met the inclusion criteria. Of these, 37 reported successful system implementations, 25 reported success at changing health care provider behaviour, and 5 noted improvements in patient outcomes. A mean of 17 features per study were mentioned. The statistical analysis could not be completed due primarily to the small number of studies and lack of diversity of outcomes. Descriptive analysis did not confirm any feature to be more prevalent in successful trials relative to unsuccessful ones for implementation, provider behaviour or patient outcomes.

Conclusion

While RxCDSSs have the potential to change health care provider behaviour, very few high quality studies show improvement in patient outcomes. Furthermore, the features of the RxCDSS associated with success (or failure) are poorly described, thus making it difficult for system design and implementation to improve.

SUBMITTER: Mollon B

PROVIDER: S-EPMC2667396 | biostudies-literature | 2009 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials.

Mollon Brent B Chong Jaron J Holbrook Anne M AM Sung Melani M Thabane Lehana L Foster Gary G

BMC medical informatics and decision making 20090211

<h4>Background</h4>Computerized decision support systems (CDSS) are believed to have the potential to improve the quality of health care delivery, although results from high quality studies have been mixed. We conducted a systematic review to evaluate whether certain features of prescribing decision support systems (RxCDSS) predict successful implementation, change in provider behaviour, and change in patient outcomes.<h4>Methods</h4>A literature search of Medline, EMBASE, CINAHL and INSPEC data ...[more]

PMID: 19210782

Similar Datasets

Project description:BackgroundClinical decision support (CDS) is a valuable feature of electronic health records (EHRs) designed to improve quality and safety. However, due to the complexities of system design and inconsistent results, CDS tools may inadvertently increase alert fatigue and contribute to physician burnout. A/B testing, or rapid-cycle randomized tests, is a useful method that can be applied to the EHR in order to rapidly understand and iteratively improve design choices embedded within CDS tools.ObjectiveThis paper describes how rapid randomized controlled trials (RCTs) embedded within EHRs can be used to quickly ascertain the superiority of potential CDS design changes to improve their usability, reduce alert fatigue, and promote quality of care.MethodsA multistep process combining tools from user-centered design, A/B testing, and implementation science was used to understand, ideate, prototype, test, analyze, and improve each candidate CDS. CDS engagement metrics (alert views, acceptance rates) were used to evaluate which CDS version is superior.ResultsTo demonstrate the impact of the process, 2 experiments are highlighted. First, after multiple rounds of usability testing, a revised CDS influenza alert was tested against usual care CDS in a rapid (~6 weeks) RCT. The new alert text resulted in minimal impact on reducing firings per patients per day, but this failure triggered another round of review that identified key technical improvements (ie, removal of dismissal button and firings in procedural areas) that led to a dramatic decrease in firings per patient per day (23.1 to 7.3). In the second experiment, the process was used to test 3 versions (financial, quality, regulatory) of text supporting tobacco cessation alerts as well as 3 supporting images. Based on 3 rounds of RCTs, there was no significant difference in acceptance rates based on the framing of the messages or addition of images.ConclusionsThese experiments support the potential for this new process to rapidly develop, deploy, and rigorously evaluate CDS within an EHR. We also identified important considerations in applying these methods. This approach may be an important tool for improving the impact of and experience with CDS.Trial registrationFlu alert trial: ClinicalTrials.gov NCT03415425; https://clinicaltrials.gov/ct2/show/NCT03415425. Tobacco alert trial: ClinicalTrials.gov NCT03714191; https://clinicaltrials.gov/ct2/show/NCT03714191.

Project description:ObjectiveTo identify features of clinical decision support systems critical for improving clinical practice.DesignSystematic review of randomised controlled trials.Data sourcesLiterature searches via Medline, CINAHL, and the Cochrane Controlled Trials Register up to 2003; and searches of reference lists of included studies and relevant reviews.Study selectionStudies had to evaluate the ability of decision support systems to improve clinical practice.Data extractionStudies were assessed for statistically and clinically significant improvement in clinical practice and for the presence of 15 decision support system features whose importance had been repeatedly suggested in the literature.ResultsSeventy studies were included. Decision support systems significantly improved clinical practice in 68% of trials. Univariate analyses revealed that, for five of the system features, interventions possessing the feature were significantly more likely to improve clinical practice than interventions lacking the feature. Multiple logistic regression analysis identified four features as independent predictors of improved clinical practice: automatic provision of decision support as part of clinician workflow (P < 0.00001), provision of recommendations rather than just assessments (P = 0.0187), provision of decision support at the time and location of decision making (P = 0.0263), and computer based decision support (P = 0.0294). Of 32 systems possessing all four features, 30 (94%) significantly improved clinical practice. Furthermore, direct experimental justification was found for providing periodic performance feedback, sharing recommendations with patients, and requesting documentation of reasons for not following recommendations.ConclusionsSeveral features were closely correlated with decision support systems' ability to improve patient care significantly. Clinicians and other stakeholders should implement clinical decision support systems that incorporate these features whenever feasible and appropriate.

Project description:ObjectiveTo evaluate the effectiveness of a contraceptive decision aid in reducing decisional conflict among women seeking reversible contraception.Study designWe conducted a randomized trial of a computer-based decision aid compared to a control group for women presenting for reversible contraception at two clinics affiliated with an academic medical center. The primary outcome was change in decisional conflict, measured before and after the healthcare visit using the validated Decisional Conflict Scale. We hypothesized the decision aid would reduce the decisional conflict score by 10 points on a 100-point scale (0 = no conflict, 100 = high conflict) compared to the control group. Secondary outcomes included contraceptive method chosen and satisfaction with the healthcare visit.ResultsWe enrolled and randomized 253 women, and 241 had complete data for our primary outcome. Overall, pre-visit decisional conflict scores were low, reflecting low levels of decisional conflict in our sample; median score 15 (range 0-80) in the decision aid and 10 (0-85) in the control group (p = 0.45). Both groups had a similar reduction in median decisional conflict after the healthcare visit: -10 (-80 to 25) and -10 (-60 to 5) in the decision aid and control groups respectively (p = 0.99). Choice of contraception (p = 0.23) and satisfaction with healthcare provider (p = 0.79) also did not differ by study group.ConclusionsDecisional conflict around contraception was low in both groups at baseline. Use of a computerized contraceptive decision aid did not reduce decisional conflict, alter method choice, or impact satisfaction compared to the control group among women choosing reversible contraception.ImplicationsUse of a computerized contraceptive decision aid did not reduce decisional conflict or alter method choice compared to the control group among women choosing reversible contraception. Future studies could focus on testing the decision aid in different clinical settings, especially where barriers to providing comprehensive contraceptive counseling exist.

Project description:Computerized clinical decision support systems can help to provide objective, standardized, and timely dementia diagnosis. However, current computerized systems are mainly based on group analysis, discrete classification of disease stages, or expensive and not readily accessible biomarkers, while current clinical practice relies relatively heavily on cognitive and functional assessments (CFA). In this study, we developed a computational framework using a suite of machine learning tools for identifying key markers in predicting the severity of Alzheimer's disease (AD) from a large set of biological and clinical measures. Six machine learning approaches, namely Kernel Ridge Regression (KRR), Support Vector Regression, and k-Nearest Neighbor for regression and Support Vector Machine (SVM), Random Forest, and k-Nearest Neighbor for classification, were used for the development of predictive models. We demonstrated high predictive power of CFA. Predictive performance of models incorporating CFA was shown to consistently have higher accuracy than those based solely on biomarker modalities. We found that KRR and SVM were the best performing regression and classification methods respectively. The optimal SVM performance was observed for a set of four CFA test scores (FAQ, ADAS13, MoCA, MMSE) with multi-class classification accuracy of 83.0%, 95%CI = (72.1%, 93.8%) while the best performance of the KRR model was reported with combined CFA and MRI neuroimaging data, i.e., R 2 = 0.874, 95%CI = (0.827, 0.922). Given the high predictive power of CFA and their widespread use in clinical practice, we then designed a data-driven and self-adaptive computerized clinical decision support system (CDSS) prototype for evaluating the severity of AD of an individual on a continuous spectrum. The system implemented an automated computational approach for data pre-processing, modelling, and validation and used exclusively the scores of selected cognitive measures as data entries. Taken together, we have developed an objective and practical CDSS to aid AD diagnosis.

Project description:BackgroundThe EBMeDS system is the computerized clinical decision support (CCDS) system of EBPNet, a national computerized point-of-care information service in Belgium. There is no clear evidence of more complex CCDS systems to manage chronic diseases in primary care practices (PCPs). The objective of this study was to assess the effectiveness of EBMeDS use in improving diabetes care.MethodsA cluster-randomized trial with before-and-after measurements was performed in Belgian PCPs over 1 year, from May 2017 to May 2018. We randomly assigned 51 practices to either the intervention group (IG), to receive the EBMeDS system, or to the control group (CG), to receive usual care. Primary and secondary outcomes were the 1-year pre- to post-implementation change in HbA1c, LDL cholesterol, and systolic and diastolic blood pressure. Composite patient and process scores were calculated. A process evaluation was added to the analysis. Results were analyzed at 6 and 12 months. Linear mixed models and logistic regression models based on generalized estimating equations were used where appropriate.ResultsOf the 51 PCPs that were enrolled and randomly assigned (26 PCPs in the CG and 25 in the IG), 29 practices (3815 patients) were analyzed in the study: 2464 patients in the CG and 1351 patients in the IG. No change differences existed between groups in primary or secondary outcomes. Change difference between CG and IG after 1-year follow-up was - 0.09 (95% CI - 0.18; 0.01, p-value = 0.06) for HbA1c; 1.76 (95% CI - 0.46; 3.98, p-value = 0.12) for LDL cholesterol; and 0.13 (95% CI - 0.91; 1.16, p-value = 0.81) and 0.12 (95% CI - 1.25;1.49, p-value = 0.86) for systolic and diastolic blood pressure respectively. The odds ratio of the IG versus the CG for the probability of no worsening and improvement was 1.09 (95% CI 0.73; 1.63, p-value = 0.67) for the process composite score and 0.74 (95% CI 0.49; 1.12, p-value = 0.16) for the composite patient score. All but one physician was satisfied with the EBMeDS system.ConclusionsThe CCDS system EBMeDS did not improve diabetes care in Belgian primary care. The lack of improvement was mainly caused by imperfections in the organizational context of Belgian primary care for chronic disease management and shortcomings in the system requirements for the correct use of the EBMeDS system (e.g., complete structured records). These shortcomings probably caused low-use rates of the system.Trial registrationClinicalTrials.gov, NCT01830569, Registered 12 April 2013.

Project description:BACKGROUND:Computerised clinical decision support (CDS) can potentially better inform decisions, and it can help with the management of information overload. It is perceived to be a key component of a learning health care system. Despite its increasing implementation worldwide, it remains uncertain why the effect of CDS varies and which factors make CDS more effective. OBJECTIVE:To examine which factors make CDS strategies more effective on a number of outcomes, including adherence to recommended practice, patient outcome measures, economic measures, provider or patient satisfaction, and medical decision quality. METHODS:We identified randomised controlled trials, non-randomised trials, and controlled before-and-after studies that directly compared CDS implementation with a given factor to CDS without that factor by searching CENTRAL, MEDLINE, EMBASE, and CINAHL and checking reference lists of relevant studies. We considered CDS with any objective for any condition in any healthcare setting. We included CDS interventions that were either displayed on screen or provided on paper and that were directed at healthcare professionals or targeted at both professionals and patients. The reviewers screened the potentially relevant studies in duplicate. They extracted data and assessed risk of bias in independent pairs or individually followed by a double check by another reviewer. We summarised results using medians and interquartile ranges and rated our certainty in the evidence using the GRADE system. RESULTS:We identified 66 head-to-head trials that we synthesised across 14 comparisons of CDS intervention factors. Providing CDS automatically versus on demand led to large improvements in adherence. Displaying CDS on-screen versus on paper led to moderate improvements and making CDS more versus less patient-specific improved adherence modestly. When CDS interventions were combined with professional-oriented strategies, combined with patient-oriented strategies, or combined with staff-oriented strategies, then adherence improved slightly. Providing CDS to patients slightly increased adherence versus CDS aimed at the healthcare provider only. Making CDS advice more explicit and requiring users to respond to the advice made little or no difference. The CDS intervention factors made little or no difference to patient outcomes. The results for economic outcomes and satisfaction outcomes were sparse. CONCLUSION:Multiple factors may affect the success of CDS interventions. CDS may be more effective when the advice is provided automatically and displayed on-screen and when the suggestions are more patient-specific. CDS interventions combined with other strategies probably also improves adherence. Providing CDS directly to patients may also positively affect adherence. The certainty of the evidence was low to moderate for all factors. TRIAL REGISTRATION:PROSPERO, CRD42016033738.

Dataset Information

Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials.

Background

Methods

Results

Conclusion

Publications

Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets