Dataset Information

COVID-19 Pandemic-Associated Changes in the Acuity of Brain MRI Findings: A Secondary Analysis of Reports Using Natural Language Processing.

ABSTRACT:

Rationale and objectives

We aimed to assess early COVID-19 pandemic-associated changes in brain MRI examination frequency and acuity of imaging findings acuity.

Methods

Using a natural language processing model, we retrospectively categorized reported findings of 12,346 brain MRI examinations performed during 6-month pre-pandemic and early pandemic time periods across a large metropolitan health system into 3 acuity levels: (1) normal or near normal; (2) incidental or chronic findings not requiring a management change; and (3) new or progressive findings requiring a management change. Brain MRI frequency and imaging finding acuity level were compared over time.

Results

Between March and August of 2019 (pre-pandemic) and 2020 (early pandemic), our health system brain MRI examination volumes decreased 17.0% (6745 vs 5601). Comparing calendar-matched 6-month periods, the proportion of higher acuity findings increased significantly (P< 0.001) from pre-pandemic (22.5%, 43.6% and 34.0% in acuity level 1, 2, and 3, respectively) to early pandemic periods (19.1%, 40.9%, and 40.1%). During the second 3 months of the early pandemic period, as MRI volumes recovered to near baseline, the proportion of higher acuity findings remained high (42.6% vs 34.1%) compared with a similar pre-pandemic period. In a multivariable analysis, Black (B coefficient, 0.16) and underinsured population (B coefficient, 0.33) presented with higher acuity findings (P< 0.05).

Conclusions

As the volume of brain MRI examinations decreased during the early COVID-19 pandemic, the relative proportion of examinations with higher acuity findings increased significantly. Pandemic-related changes in patient outcomes related to reduced imaging access merits further attention.

SUBMITTER: Min TL

PROVIDER: S-EPMC8636309 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Accurate, automated extraction of clinical stroke information from unstructured text has several important applications. ICD-9/10 codes can misclassify ischemic stroke events and do not distinguish acuity or location. Expeditious, accurate data extraction could provide considerable improvement in identifying stroke in large datasets, triaging critical clinical reports, and quality improvement efforts. In this study, we developed and report a comprehensive framework studying the performance of simple and complex stroke-specific Natural Language Processing (NLP) and Machine Learning (ML) methods to determine presence, location, and acuity of ischemic stroke from radiographic text. We collected 60,564 Computed Tomography and Magnetic Resonance Imaging Radiology reports from 17,864 patients from two large academic medical centers. We used standard techniques to featurize unstructured text and developed neurovascular specific word GloVe embeddings. We trained various binary classification algorithms to identify stroke presence, location, and acuity using 75% of 1,359 expert-labeled reports. We validated our methods internally on the remaining 25% of reports and externally on 500 radiology reports from an entirely separate academic institution. In our internal population, GloVe word embeddings paired with deep learning (Recurrent Neural Networks) had the best discrimination of all methods for our three tasks (AUCs of 0.96, 0.98, 0.93 respectively). Simpler NLP approaches (Bag of Words) performed best with interpretable algorithms (Logistic Regression) for identifying ischemic stroke (AUC of 0.95), MCA location (AUC 0.96), and acuity (AUC of 0.90). Similarly, GloVe and Recurrent Neural Networks (AUC 0.92, 0.89, 0.93) generalized better in our external test set than BOW and Logistic Regression for stroke presence, location and acuity, respectively (AUC 0.89, 0.86, 0.80). Our study demonstrates a comprehensive assessment of NLP techniques for unstructured radiographic text. Our findings are suggestive that NLP/ML methods can be used to discriminate stroke features from large data cohorts for both clinical and research-related investigations.

Project description:BackgroundNatural language processing (NLP) has a significant role in advancing healthcare and has been found to be key in extracting structured information from radiology reports. Understanding recent developments in NLP application to radiology is of significance but recent reviews on this are limited. This study systematically assesses and quantifies recent literature in NLP applied to radiology reports.MethodsWe conduct an automated literature search yielding 4836 results using automated filtering, metadata enriching steps and citation search combined with manual review. Our analysis is based on 21 variables including radiology characteristics, NLP methodology, performance, study, and clinical application characteristics.ResultsWe present a comprehensive analysis of the 164 publications retrieved with publications in 2019 almost triple those in 2015. Each publication is categorised into one of 6 clinical application categories. Deep learning use increases in the period but conventional machine learning approaches are still prevalent. Deep learning remains challenged when data is scarce and there is little evidence of adoption into clinical practice. Despite 17% of studies reporting greater than 0.85 F1 scores, it is hard to comparatively evaluate these approaches given that most of them use different datasets. Only 14 studies made their data and 15 their code available with 10 externally validating results.ConclusionsAutomated understanding of clinical narratives of the radiology reports has the potential to enhance the healthcare process and we show that research in this field continues to grow. Reproducibility and explainability of models are important if the domain is to move applications into clinical use. More could be done to share code enabling validation of methods on different institutional data and to reduce heterogeneity in reporting of study properties allowing inter-study comparisons. Our results have significance for researchers in the field providing a systematic synthesis of existing work to build on, identify gaps, opportunities for collaboration and avoid duplication.