Dataset Information

Coronavirus Disease 2019 (COVID-19) Diagnostic Clinical Decision Support: A Pre-Post Implementation Study of CORAL (COvid Risk cALculator).

ABSTRACT:

Background

Isolation of hospitalized persons under investigation (PUIs) for coronavirus disease 2019 (COVID-19) reduces nosocomial transmission risk. Efficient evaluation of PUIs is needed to preserve scarce healthcare resources. We describe the development, implementation, and outcomes of an inpatient diagnostic algorithm and clinical decision support system (CDSS) to evaluate PUIs.

Methods

We conducted a pre-post study of CORAL (COvid Risk cALculator), a CDSS that guides frontline clinicians through a risk-stratified COVID-19 diagnostic workup, removes transmission-based precautions when workup is complete and negative, and triages complex cases to infectious diseases (ID) physician review. Before CORAL, ID physicians reviewed all PUI records to guide workup and precautions. After CORAL, frontline clinicians evaluated PUIs directly using CORAL. We compared pre- and post-CORAL frequency of repeated severe acute respiratory syndrome coronavirus 2 nucleic acid amplification tests (NAATs), time from NAAT result to PUI status discontinuation, total duration of PUI status, and ID physician work hours, using linear and logistic regression, adjusted for COVID-19 incidence.

Results

Fewer PUIs underwent repeated testing after an initial negative NAAT after CORAL than before CORAL (54% vs 67%, respectively; adjusted odd ratio, 0.53 [95% confidence interval, .44-.63]; P < .01). CORAL significantly reduced average time to PUI status discontinuation (adjusted difference [standard error], -7.4 [0.8] hours per patient), total duration of PUI status (-19.5 [1.9] hours per patient), and average ID physician work-hours (-57.4 [2.0] hours per day) (all P < .01). No patients had a positive NAAT result within 7 days after discontinuation of precautions via CORAL.

Conclusions

CORAL is an efficient and effective CDSS to guide frontline clinicians through the diagnostic evaluation of PUIs and safe discontinuation of precautions.

SUBMITTER: Dugdale CM

PROVIDER: S-EPMC7929052 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundCancer is a leading cause of death in the United States. Primary care providers (PCPs) juggle patient cancer prevention and screening along with managing acute and chronic health problems. However, clinical decision support (CDS) may assist PCPs in addressing patients' cancer prevention and screening needs during short clinic visits. In this paper, we describe pre-implementation study design and cancer screening and prevention CDS changes made to maximize utilization and better fit a healthcare system's goals and culture. We employed the Consolidated Framework for Implementation Research (CFIR), useful for evaluating the implementation of CDS interventions in primary care settings, in understanding barriers and facilitators that led to those changes.MethodsIn a three-arm, pragmatic, 36 clinic cluster-randomized control trial, we integrated cancer screening and prevention CDS and shared decision-making tools (SDMT) into an existing electronic medical record-linked cardiovascular risk management CDS system. The integrated CDS is currently being tested within a predominately rural upper Midwestern healthcare system. Prior to CDS implementation, we catalogued pre-implementation changes made from 2016 to 2018 based on: pre-implementation site engagement; key informant interviews with healthcare system rooming staff, providers, and leadership; and pilot testing. We identified influential barriers, facilitators, and changes made in response through qualitative content analysis of meeting minutes and supportive documents. We then coded pre-implementation changes made and associated barriers and facilitators using the CFIR.ResultsBased on our findings from system-wide pre-implementation engagement, pilot testing, and key informant interviews, we made changes to accommodate the needs of the healthcare system based on barriers and facilitators that fell within the Intervention Characteristics, Inner Setting, and Outer Setting CFIR domains. Changes included replacing the expansion of medical assistant roles in one intervention arm with targeted SDMT, as well as altering cancer prevention CDS and study design elements.ConclusionsPre-implementation changes to CDS may help meet healthcare systems' evolving needs and optimize the intervention by being responsive to real-world implementation barriers and facilitators. Frameworks like the CFIR are useful tools for identifying areas where pre-implementation barriers and facilitators may result in design changes, both to research studies and CDS systems.Trial registrationNCT02986230.

Project description:BackgroundDiagnostic errors pose significant health risks and contribute to patient mortality. With the growing accessibility of electronic health records, machine learning models offer a promising avenue for enhancing diagnosis quality. Current research has primarily focused on a limited set of diseases with ample training data, neglecting diagnostic scenarios with limited data availability.ObjectiveThis study aims to develop an information retrieval (IR)-based framework that accommodates data sparsity to facilitate broader diagnostic decision support.MethodsWe introduced an IR-based diagnostic decision support framework called CliniqIR. It uses clinical text records, the Unified Medical Language System Metathesaurus, and 33 million PubMed abstracts to classify a broad spectrum of diagnoses independent of training data availability. CliniqIR is designed to be compatible with any IR framework. Therefore, we implemented it using both dense and sparse retrieval approaches. We compared CliniqIR's performance to that of pretrained clinical transformer models such as Clinical Bidirectional Encoder Representations from Transformers (ClinicalBERT) in supervised and zero-shot settings. Subsequently, we combined the strength of supervised fine-tuned ClinicalBERT and CliniqIR to build an ensemble framework that delivers state-of-the-art diagnostic predictions.ResultsOn a complex diagnosis data set (DC3) without any training data, CliniqIR models returned the correct diagnosis within their top 3 predictions. On the Medical Information Mart for Intensive Care III data set, CliniqIR models surpassed ClinicalBERT in predicting diagnoses with <5 training samples by an average difference in mean reciprocal rank of 0.10. In a zero-shot setting where models received no disease-specific training, CliniqIR still outperformed the pretrained transformer models with a greater mean reciprocal rank of at least 0.10. Furthermore, in most conditions, our ensemble framework surpassed the performance of its individual components, demonstrating its enhanced ability to make precise diagnostic predictions.ConclusionsOur experiments highlight the importance of IR in leveraging unstructured knowledge resources to identify infrequently encountered diagnoses. In addition, our ensemble framework benefits from combining the complementary strengths of the supervised and retrieval-based models to diagnose a broad spectrum of diseases.