Optimizing clinical decision support alerts in electronic medical records: a systematic review of reported strategies adopted by hospitals.
Ontology highlight
ABSTRACT: Objective
To identify and summarize the current internal governance processes adopted by hospitals, as reported in the literature, for selecting, optimizing, and evaluating clinical decision support (CDS) alerts in order to identify effective approaches.Materials and methods
Databases (Medline, Embase, CINAHL, Scopus, Web of Science, IEEE Xplore Digital Library, CADTH, and WorldCat) were searched to identify relevant papers published from January 2010 to April 2020. All paper types published in English that reported governance processes for selecting and/or optimizing CDS alerts in hospitals were included.Results
Eight papers were included in the review. Seven papers focused specifically on medication-related CDS alerts. All papers described the use of a multidisciplinary committee to optimize alerts. Other strategies included the use of clinician feedback, alert data, literature and drug references, and a visual dashboard. Six of the 8 papers reported evaluations of their CDS alert modifications following the adoption of optimization strategies, and of these, 5 reported a reduction in alert rate.Conclusions
A multidisciplinary committee, often in combination with other approaches, was the most frequent strategy reported by hospitals to optimize their CDS alerts. Due to the limited number of published processes, variation in system changes, and evaluation results, we were unable to compare the effectiveness of different strategies, although employing multiple strategies appears to be an effective approach for reducing CDS alert numbers. We recommend hospitals report on descriptions and evaluations of governance processes to enable identification of effective strategies for optimization of CDS alerts in hospitals.
SUBMITTER: Van Dort BA
PROVIDER: S-EPMC7810441 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Current guidelines for treatment decision making largely rely on data from randomized controlled trials (RCTs) studying average treatment effects. They may be inadequate to make individualized treatment decisions in real-world settings. Large-scale electronic health records (EHR) provide opportunities to fulfill the goals of personalized medicine and learn individualized treatment rules (ITRs) depending on patient-specific characteristics from real-world patient data. In this work, we tackle challenges with EHRs and propose a machine learning approach based on matching (M-learning) to estimate optimal ITRs from EHRs. This new learning method performs matching instead of inverse probability weighting as commonly used in many existing methods for estimating ITRs to more accurately assess individuals' treatment responses to alternative treatments and alleviate confounding. Matching-based value functions are proposed to compare matched pairs under a unified framework, where various types of outcomes for measuring treatment response (including continuous, ordinal, and discrete outcomes) can easily be accommodated. We establish the Fisher consistency and convergence rate of M-learning. Through extensive simulation studies, we show that M-learning outperforms existing methods when propensity scores are misspecified or when unmeasured confounders are present in certain scenarios. Lastly, we apply M-learning to estimate optimal personalized second-line treatments for type 2 diabetes patients to achieve better glycemic control or reduce major complications using EHRs from New York Presbyterian Hospital.
| S-EPMC7539620 | biostudies-literature
Project description:ObjectivesTo determine the frequency of clinical decision support system (CDSS) medication-related alerts generated, accepted, or overridden, to assess appropriateness of alert display and overrides, and to characterise the documentation of clinician justification for these overrides in an academic medical centre in Saudi Arabia.Materials and methodsSystem-generated CDSS reports for the period June 2015 to December 2017 were retrospectively reviewed and analysed. Alerts were classified into different types, and rates of alert overrides calculated as percentages of all generated alerts. A subset of 307 overridden alerts was assessed for appropriateness of display and override by two clinical pharmacists. Physician documentation of reasons for overriding alerts were categorised.ResultsA total of 4,446,730 medication-related alerts were generated from both inpatient and outpatient settings, and 4,231,743 (95.2%) were overridden. The most common alert type was 'duplicate drug', accounting for 3,549,736 (79.8%) of alerts. Of 307 alerts assessed for appropriateness, 246 (80%) were judged to be appropriately displayed and 244 (79%) were overridden appropriately. New drug allergy and drug allergy alerts had the highest percentage of being judged as inappropriately overridden. For 1,594,313 alerts (37.7%), 'no overridden reason selected' was chosen from the drop-down menu.ConclusionsThe alert generation and override rate were higher than reported previously in the literature. The small sample size of 307 alerts assessed for appropriateness of alert display and override is a potential limitation. Revision of the CDSS rules for alerts (focusing on specificity and relevance for the local context) is now recommended. Future research should prospectively assess providers' perspectives, and determine patient harm associated with overridden alerts.
| S-EPMC9012024 | biostudies-literature
Project description:BACKGROUND:Unnecessary healthcare utilization, non-adherence to current clinical guidelines, or insufficient personalized care are perpetual challenges and remain potential major cost-drivers for healthcare systems around the world. Implementing decision support systems into clinical care is promised to improve quality of care and thereby yield substantial effects on reducing healthcare expenditure. In this article, we evaluate the economic impact of clinical decision support (CDS) interventions based on electronic health records (EHR). METHODS:We searched for studies published after 2014 using MEDLINE, CENTRAL, WEB OF SCIENCE, EBSCO, and TUFTS CEA registry databases that encompass an economic evaluation or consider cost outcome measures of EHR based CDS interventions. Thereupon, we identified best practice application areas and categorized the investigated interventions according to an existing taxonomy of front-end CDS tools. RESULTS AND DISCUSSION:Twenty-seven studies are investigated in this review. Of those, twenty-two studies indicate a reduction of healthcare expenditure after implementing an EHR based CDS system, especially towards prevalent application areas, such as unnecessary laboratory testing, duplicate order entry, efficient transfusion practice, or reduction of antibiotic prescriptions. On the contrary, order facilitators and undiscovered malfunctions revealed to be threats and could lead to new cost drivers in healthcare. While high upfront and maintenance costs of CDS systems are a worldwide implementation barrier, most studies do not consider implementation cost. Finally, four included economic evaluation studies report mixed monetary outcome results and thus highlight the importance of further high-quality economic evaluations for these CDS systems. CONCLUSION:Current research studies lack consideration of comparative cost-outcome metrics as well as detailed cost components in their analyses. Nonetheless, the positive economic impact of EHR based CDS interventions is highly promising, especially with regard to reducing waste in healthcare.
| S-EPMC7491136 | biostudies-literature
Project description:ObjectiveInfobuttons appear as small icons adjacent to electronic health record (EHR) data (e.g., medications, diagnoses, or test results) that, when clicked, access online knowledge resources tailored to the patient, care setting, or task. Infobuttons are required for "Meaningful Use" certification of US EHRs. We sought to evaluate infobuttons' impact on clinical practice and identify features associated with improved outcomes.MethodsWe conducted a systematic review, searching MEDLINE, EMBASE, and other databases from inception to July 6, 2015. We included and cataloged all original research in any language describing implementation of infobuttons or other context-sensitive links. Studies evaluating clinical implementations with outcomes of usage or impact were reviewed in greater detail. Reviewers worked in duplicate to select articles, evaluate quality, and abstract information.ResultsOf 599 potential articles, 77 described infobutton implementation. The 17 studies meriting detailed review, including 3 randomized trials, yielded the following findings. Infobutton usage frequency ranged from 0.3 to 7.4 uses per month per potential user. Usage appeared to be influenced by EHR task. Five studies found that infobuttons are used less often than non-context-sensitive links (proportionate usage 0.20-0.34). In 3 studies, users answered their clinical question in > 69% of infobutton sessions. Seven studies evaluated alternative approaches to infobutton design and implementation. No studies isolated the impact of infobuttons on objectively measured patient outcomes.ConclusionsWeak evidence suggests that infobuttons can help providers answer clinical questions. Research on optimal infobutton design and implementation, and on the impact on patient outcomes and provider behaviors, is needed.
| S-EPMC6080678 | biostudies-literature
Project description:BACKGROUND:Electronic health records (EHRs) with embedded clinical decision support systems (CDSSs) have the potential to improve healthcare delivery. This study was conducted to explore merits, features, and desiderata to be considered when planning for, designing, developing, implementing, piloting, evaluating, maintaining, upgrading, and/or using EHRs with CDSSs. METHODS:A mixed-method combining the Delphi technique and Analytic Hierarchy Process was used. Potentially important items were collected after a thorough search of the literature and from interviews with key contact experts (n?=?19). Opinions and views of the 76 panelists on the use of EHRs were also explored. Iterative Delphi rounds were conducted to achieve consensus on 122 potentially important items by a panel of 76 participants. Items on which consensus was achieved were ranked in the order of their importance using the Analytic Hierarchy Process. RESULTS:Of the 122 potentially important items presented to the panelists in the Delphi rounds, consensus was achieved on 110 (90.2%) items. Of these, 16 (14.5%) items were related to the demographic characteristics of the patient, 16 (14.5%) were related to prescribing medications, 16 (14.5%) were related to checking prescriptions and alerts, 14 (12.7%) items were related to the patient's identity, 13 (11.8%) items were related to patient assessment, 12 (10.9%) items were related to the quality of alerts, 11 (10%) items were related to admission and discharge of the patient, 9 (8.2%) items were general features, and 3 (2.7%) items were related to diseases and making diagnosis. CONCLUSIONS:In this study, merits, features, and desiderata to be considered when planning for, designing, developing, implementing, piloting, evaluating, maintaining, upgrading, and/or using EHRs with CDSSs were explored. Considering items on which consensus was achieved might promote congruence and safe use of EHRs. Further studies are still needed to determine if these recommendations can improve patient safety and outcomes in Palestinian hospitals.
| S-EPMC6842153 | biostudies-literature
Project description:Electronic prescribing is increasingly used, in part because of government incentives for its use. Many of its benefits come from clinical decision support (CDS), but often too many alerts are displayed, resulting in alert fatigue.To characterize the override rates for medication-related CDS alerts in the outpatient setting, the reasons cited for overrides at the time of prescribing, and the appropriateness of overrides.We measured CDS alert override rates and the coded reasons for overrides cited by providers at the time of prescribing. Our primary outcome was the rate of CDS alert overrides; our secondary outcomes were the rate of overrides by alert type, reasons cited for overrides at the time of prescribing, and override appropriateness for a subset of 600 alert overrides. Through detailed chart reviews of alert override cases, and selective literature review, we developed appropriateness criteria for each alert type, which were modified iteratively as necessary until consensus was reached on all criteria.We reviewed 157,483 CDS alerts (7.9% alert rate) on 2,004,069 medication orders during the study period. 82,889 (52.6%) of alerts were overridden. The most common alerts were duplicate drug (33.1%), patient allergy (16.8%), and drug-drug interactions (15.8%). The most likely alerts to be overridden were formulary substitutions (85.0%), age-based recommendations (79.0%), renal recommendations (78.0%), and patient allergies (77.4%). An average of 53% of overrides were classified as appropriate, and rates of appropriateness varied by alert type (p<0.0001) from 12% for renal recommendations to 92% for patient allergies.About half of CDS alerts were overridden by providers and about half of the overrides were classified as appropriate, but the likelihood of overriding an alert varied widely by alert type. Refinement of these alerts has the potential to improve the relevance of alerts and reduce alert fatigue.
| S-EPMC3994856 | biostudies-other
Project description:Objective The aim of the study is to identify and prioritize early intervention (EI) stakeholders' perspectives of supports and barriers to implementing the Young Children's Participation and Environment Measure (YC-PEM), an electronic patient-reported outcome (e-PRO) tool, for scaling its implementation across multiple local and state EI programs.Methods An explanatory sequential (quan > QUAL) mixed-methods study was conducted with EI families (n = 6), service coordinators (n = 9), and program leadership (n = 7). Semi-structured interviews and focus groups were used to share select quantitative pragmatic trial results (e.g., percentages for perceived helpfulness of implementation strategies) and elicit stakeholder perspectives to contextualize these results. Three study staff deductively coded transcripts to constructs in the Consolidated Framework for Implementation Research (CFIR). Data within CFIR constructs were inductively analyzed to generate themes that were rated by national early childhood advisors for their relevance to longer term implementation.Results All three stakeholder groups (i.e., families, service coordinators, program leadership) identified thematic supports and barriers across multiple constructs within each of four CFIR domains: (1) Six themes for "intervention characteristics," (2) Six themes for "process," (3) three themes for "inner setting," and (4) four themes for "outer setting." For example, all stakeholder groups described the value of the YC-PEM e-PRO in forging connections and eliciting meaningful information about family priorities for efficient service plan development ("intervention characteristics"). Stakeholders prioritized reaching families with diverse linguistic preferences and user navigation needs, further tailoring its interface with automated data capture and exchange processes ("process"); and fostering a positive implementation climate ("inner setting"). Service coordinators and program leadership further articulated the value of YC-PEM e-PRO results for improving EI access ("outer setting").Conclusion Results demonstrate the YC-PEM e-PRO is an evidence-based intervention that is viable for implementation. Optimizations to its interface are needed before undertaking hybrid type-2 and 3 multisite trials to test these implementation strategies across state and local EI programs with electronic data capture capabilities and diverse levels of organizational readiness and resources for implementation.
| S-EPMC9891850 | biostudies-literature
Project description:OBJECTIVE:The study sought to determine availability and use of structured override reasons for drug-drug interaction (DDI) alerts in electronic health records. MATERIALS AND METHODS:We collected data on DDI alerts and override reasons from 10 clinical sites across the United States using a variety of electronic health records. We used a multistage iterative card sort method to categorize the override reasons from all sites and identified best practices. RESULTS:Our methodology established 177 unique override reasons across the 10 sites. The number of coded override reasons at each site ranged from 3 to 100. Many sites offered override reasons not relevant to DDIs. Twelve categories of override reasons were identified. Three categories accounted for 78% of all overrides: "will monitor or take precautions," "not clinically significant," and "benefit outweighs risk." DISCUSSION:We found wide variability in override reasons between sites and many opportunities to improve alerts. Some override reasons were irrelevant to DDIs. Many override reasons attested to a future action (eg, decreasing a dose or ordering monitoring tests), which requires an additional step after the alert is overridden, unless the alert is made actionable. Some override reasons deferred to another party, although override reasons often are not visible to other users. Many override reasons stated that the alert was inaccurate, suggesting that specificity of alerts could be improved. CONCLUSIONS:Organizations should improve the options available to providers who choose to override DDI alerts. DDI alerting systems should be actionable and alerts should be tailored to the patient and drug pairs.
| S-EPMC6748816 | biostudies-literature
Project description:Thoughtful integration of interruptive clinical decision support (CDS) alerts within the electronic health record is essential to guide clinicians on the application of pharmacogenomic results at point of care. St. Jude Children's Research Hospital implemented a preemptive pharmacogenomic testing program in 2011 in a multidisciplinary effort involving extensive education to clinicians about pharmacogenomic implications. We conducted a retrospective analysis of clinicians' adherence to 4783 pharmacogenomically guided CDS alerts that triggered for 12 genes and 60 drugs. Clinicians adhered to the therapeutic recommendations provided in 4392 alerts (92%). In our population of pediatric patients with catastrophic illnesses, the most frequently presented gene/drug CDS alerts were TPMT/NUDT15 and thiopurines (n = 3850), CYP2D6 and ondansetron (n = 667), CYP2D6 and oxycodone (n = 99), G6PD and G6PD high-risk medications (n = 51), and CYP2C19 and proton pump inhibitors (omeprazole and pantoprazole; n = 50). The high adherence rate was facilitated by our team approach to prescribing and our collaborative CDS design and delivery.
| S-EPMC9748527 | biostudies-literature
Project description:BackgroundHigh override rates for drug-drug interaction (DDI) alerts in electronic health records (EHRs) result in the potentially dangerous consequence of providers ignoring clinically significant alerts. Lack of uniformity of criteria for determining the severity or validity of these interactions often results in discrepancies in how these are evaluated. The purpose of this study was to identify a set of criteria for assessing DDIs that should be used for the generation of clinical decision support (CDS) alerts in EHRs.MethodsWe conducted a 20-year systematic literature review of MEDLINE and EMBASE to identify characteristics of high-priority DDIs. These criteria were validated by an expert panel consisting of medication knowledge base vendors, EHR vendors, in-house knowledge base developers from academic medical centers, and both federal and private agencies involved in the regulation of medication use.ResultsForty-four articles met the inclusion criteria for assessing characteristics of high-priority DDIs. The panel considered five criteria to be most important when assessing an interaction- Severity, Probability, Clinical Implications of the interaction, Patient characteristics, and the Evidence supporting the interaction. In addition, the panel identified barriers and considerations for being able to utilize these criteria in medication knowledge bases used by EHRs.ConclusionsA multi-dimensional approach is needed to understanding the importance of an interaction for inclusion in medication knowledge bases for the purpose of CDS alerting. The criteria identified in this study can serve as a first step towards a uniform approach in assessing which interactions are critical and warrant interruption of a provider's workflow.
| S-EPMC3706355 | biostudies-literature