Dataset Information

Accuracy and Effects of Clinical Decision Support Systems Integrated With BMJ Best Practice-Aided Diagnosis: Interrupted Time Series Study.

ABSTRACT: BACKGROUND:Clinical decision support systems (CDSS) are an integral component of health information technologies and can assist disease interpretation, diagnosis, treatment, and prognosis. However, the utility of CDSS in the clinic remains controversial. OBJECTIVE:The aim is to assess the effects of CDSS integrated with British Medical Journal (BMJ) Best Practice-aided diagnosis in real-world research. METHODS:This was a retrospective, longitudinal observational study using routinely collected clinical diagnosis data from electronic medical records. A total of 34,113 hospitalized patient records were successively selected from December 2016 to February 2019 in six clinical departments. The diagnostic accuracy of the CDSS was verified before its implementation. A self-controlled comparison was then applied to detect the effects of CDSS implementation. Multivariable logistic regression and single-group interrupted time series analysis were used to explore the effects of CDSS. The sensitivity analysis was conducted using the subgroup data from January 2018 to February 2019. RESULTS:The total accuracy rates of the recommended diagnosis from CDSS were 75.46% in the first-rank diagnosis, 83.94% in the top-2 diagnosis, and 87.53% in the top-3 diagnosis in the data before CDSS implementation. Higher consistency was observed between admission and discharge diagnoses, shorter confirmed diagnosis times, and shorter hospitalization days after the CDSS implementation (all P<.001). Multivariable logistic regression analysis showed that the consistency rates after CDSS implementation (OR 1.078, 95% CI 1.015-1.144) and the proportion of hospitalization time 7 days or less (OR 1.688, 95% CI 1.592-1.789) both increased. The interrupted time series analysis showed that the consistency rates significantly increased by 6.722% (95% CI 2.433%-11.012%, P=.002) after CDSS implementation. The proportion of hospitalization time 7 days or less significantly increased by 7.837% (95% CI 1.798%-13.876%, P=.01). Similar results were obtained in the subgroup analysis. CONCLUSIONS:The CDSS integrated with BMJ Best Practice improved the accuracy of clinicians' diagnoses. Shorter confirmed diagnosis times and hospitalization days were also found to be associated with CDSS implementation in retrospective real-world studies. These findings highlight the utility of artificial intelligence-based CDSS to improve diagnosis efficiency, but these results require confirmation in future randomized controlled trials.

SUBMITTER: Tao L

PROVIDER: S-EPMC6997922 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesAdoption of emergency department (ED) initiation of buprenorphine (BUP) for opioid use disorder (OUD) into routine emergency care has been slow, partly due to clinicians' unfamiliarity with this practice and perceptions that it is complicated and time-consuming. To address these barriers and guide emergency clinicians through the process of BUP initiation, we implemented a user-centered computerized clinical decision support system (CDS). This study was conducted to assess the feasibility of implementation and to evaluate the preliminary efficacy of the intervention to increase the rate of ED-initiated BUP.MethodsAn interrupted time series study was conducted in an urban, academic ED from April 2018 to February 2019 (preimplementation phase), March 2019 to August 2019 (implementation phase), and September 2019 to December 2019 (maintenance phase) to study the effect of the intervention on adult ED patients identified by a validated electronic health record (EHR)-based computable phenotype consisting of structured data consistent with potential cases of OUD who would benefit from BUP treatment. The intervention offers flexible CDS for identification of OUD, assessment of opioid withdrawal, and motivation of readiness to start treatment and automates EHR activities related to ED initiation of BUP (including documentation, orders, prescribing, and referral). The primary outcome was the rate of ED-initiated BUP. Secondary outcomes were launch of the intervention, prescription for naloxone at ED discharge, and referral for ongoing addiction treatment.ResultsOf the 141,041 unique patients presenting to the ED over the preimplementation and implementation phases (i.e., the phases used in primary analysis), 906 (574 preimplementation and 332 implementation) met OUD phenotype and inclusion criteria. The rate of BUP initiation increased from 3.5% (20/574) in the preimplementation phase to 6.6% (22/332) in the implementation phase (p = 0.03). After the temporal trend of the number of physician's with X-waiver training and other covariates were adjusted for, the relative risk of BUP initiation rate was 2.73 (95% confidence interval [CI] = 0.62 to 12.0, p = 0.18). Similarly, the number of unique attendings who initiated BUP increased modestly 7/53 (13.0%) to 13/57 (22.8%, p = 0.10) after offering just-in-time training during the implementation period. The rate of naloxone prescribed at discharge also increased (6.5% preimplementation and 11.5% implementation; p < 0.01). The intervention received a system usability scale score of 82.0 (95% CI = 76.7 to 87.2).ConclusionImplementation of user-centered CDS at a single ED was feasible, acceptable, and associated with increased rates of ED-initiated BUP and naloxone prescribing in patients with OUD and a doubling of the number of unique physicians adopting the practice. We have implemented this intervention across several health systems in an ongoing trial to assess its effectiveness, scalability, and generalizability.

Project description:BACKGROUND:To effectively impact the significant population burden of injury, we completed a situational assessment of injury prevention practice within a provincial public health system to identify system-wide priorities for capacity-building to advance injury prevention in public health. METHODS:A descriptive qualitative study was used to collect data on the current practice, challenges and needs of support for injury prevention. Data was collected through semi-structured interviews (n = 20) and focus groups (n = 19). Participants included a cross-section of injury prevention practitioners and leadership from public health units reflecting different population sizes and geographic characteristics, in addition to public health researchers and experts from academia, public health and not-for-profit organizations. Thematic analysis was used to code all of the data by one reviewer, followed by a second independent reviewer who coded a random selection of interview notes. Major codes and sub codes were identified and final themes were decided through iterations of coding comparisons and categorization. Once data were analysed, we confirmed the findings with the field, in addition to participating in a prioritization exercise to surface the top three needs for support. RESULTS:Major themes that were identified from the data included: current public health practice challenges; capacity and resource constraints, and; injury as a low priority area. Overall, injury prevention is a broad, complex topic that competes with other areas of public health. Best practices are challenged by system-wide factors related to resources, direction, coordination, collaboration, and emerging injury public health issues. Injury is a reportedly under prioritized and under resourced public health area of practice. Practitioners believe that increasing access to data and evidence, and improving collaboration and networking is required to promote best practice. CONCLUSIONS:The results of this study suggest that there are several system level needs to support best practice in public health injury prevention in Ontario including reducing research to practice gaps and supporting opportunities for collaboration. Our research contributes to the literature of the complexity of public health practice, and presents several mechanisms of support to increase capacity at a system level to improve injury prevention practice, and eventually lessen the population burden of injury.

Project description:BackgroundClinical decision support systems (CDSSs) embedded in electronic medical records (EMRs), also called electronic health records, have the potential to improve the adoption of clinical guidelines. The University of Alberta Inflammatory Bowel Disease (IBD) Group developed a CDSS for patients with IBD who might be experiencing disease flare and deployed it within a clinical information system in 2 continuous time periods.ObjectiveThis study aims to evaluate the impact of the IBD CDSS on the adherence of health care providers (ie, physicians and nurses) to institutionally agreed clinical management protocols.MethodsA 2-period interrupted time series (ITS) design, comparing adherence to a clinical flare management protocol during outpatient visits before and after the CDSS implementation, was used. Each interruption was initiated with user training and a memo with instructions for use. A group of 7 physicians, 1 nurse practitioner, and 4 nurses were invited to use the CDSS. In total, 31,726 flare encounters were extracted from the clinical information system database, and 9217 of them were manually screened for inclusion. Each data point in the ITS analysis corresponded to 1 month of individual patient encounters, with a total of 18 months of data (9 before and 9 after interruption) for each period. The study was designed in accordance with the Statement on Reporting of Evaluation Studies in Health Informatics (STARE-HI) guidelines for health informatics evaluations.ResultsFollowing manual screening, 623 flare encounters were confirmed and designated for ITS analysis. The CDSS was activated in 198 of 623 encounters, most commonly in cases where the primary visit reason was a suspected IBD flare. In Implementation Period 1, before-and-after analysis demonstrates an increase in documentation of clinical scores from 3.5% to 24.1% (P<.001), with a statistically significant level change in ITS analysis (P=.03). In Implementation Period 2, the before-and-after analysis showed further increases in the ordering of acute disease flare lab tests (47.6% to 65.8%; P<.001), including the biomarker fecal calprotectin (27.9% to 37.3%; P=.03) and stool culture testing (54.6% to 66.9%; P=.005); the latter is a test used to distinguish a flare from an infectious disease. There were no significant slope or level changes in ITS analyses in Implementation Period 2. The overall provider adoption rate was moderate at approximately 25%, with greater adoption by nurse providers (used in 30.5% of flare encounters) compared to physicians (used in 6.7% of flare encounters).ConclusionsThis is one of the first studies to investigate the implementation of a CDSS for IBD, designed with a leading EMR software (Epic Systems), providing initial evidence of an improvement over routine care. Several areas for future research were identified, notably the effect of CDSSs on outcomes and how to design a CDSS with greater utility for physicians. CDSSs for IBD should also be evaluated on a larger scale; this can be facilitated by regional and national centralized EMR systems.

Dataset Information

Accuracy and Effects of Clinical Decision Support Systems Integrated With BMJ Best Practice-Aided Diagnosis: Interrupted Time Series Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets