Artificial intelligence for the detection of COVID-19 pneumonia on chest CT using multinational datasets.
Ontology highlight
ABSTRACT:
SUBMITTER: Harmon SA
PROVIDER: S-EPMC7429815 | biostudies-literature | 2020 Aug
REPOSITORIES: biostudies-literature
Publications
Artificial intelligence for the detection of COVID-19 pneumonia on chest CT using multinational datasets.
Harmon Stephanie A SA Sanford Thomas H TH Xu Sheng S Turkbey Evrim B EB Roth Holger H Xu Ziyue Z Yang Dong D Myronenko Andriy A Anderson Victoria V Amalou Amel A Blain Maxime M Kassin Michael M Long Dilara D Varble Nicole N Walker Stephanie M SM Bagci Ulas U Ierardi Anna Maria AM Stellato Elvira E Plensich Guido Giovanni GG Franceschelli Giuseppe G Girlando Cristiano C Irmici Giovanni G Labella Dominic D Hammoud Dima D Malayeri Ashkan A Jones Elizabeth E Summers Ronald M RM Choyke Peter L PL Xu Daguang D Flores Mona M Tamura Kaku K Obinata Hirofumi H Mori Hitoshi H Patella Francesca F Cariati Maurizio M Carrafiello Gianpaolo G An Peng P Wood Bradford J BJ Turkbey Baris B
Nature communications 20200814 1
Chest CT is emerging as a valuable diagnostic tool for clinical management of COVID-19 associated lung disease. Artificial intelligence (AI) has the potential to aid in rapid evaluation of CT scans for differentiation of COVID-19 findings from other clinical entities. Here we show that a series of deep learning algorithms, trained in a diverse multinational cohort of 1280 patients to localize parietal pleura/lung parenchyma followed by classification of COVID-19 pneumonia, can achieve up to 90.8 ...[more]
Similar Datasets
Project description:Recent studies show the potential of artificial intelligence (AI) as a screening tool to detect COVID-19 pneumonia based on chest x-ray (CXR) images. However, issues on the datasets and study designs from medical and technical perspectives, as well as questions on the vulnerability and robustness of AI algorithms have emerged. In this study, we address these issues with a more realistic development of AI-driven COVID-19 pneumonia detection models by generating our own data through a retrospective clinical study to augment the dataset aggregated from external sources. We optimized five deep learning architectures, implemented development strategies by manipulating data distribution to quantitatively compare study designs, and introduced several detection scenarios to evaluate the robustness and diagnostic performance of the models. At the current level of data availability, the performance of the detection model depends on the hyperparameter tuning and has less dependency on the quantity of data. InceptionV3 attained the highest performance in distinguishing pneumonia from normal CXR in two-class detection scenario with sensitivity (Sn), specificity (Sp), and positive predictive value (PPV) of 96%. The models attained higher general performance of 91-96% Sn, 94-98% Sp, and 90-96% PPV in three-class compared to four-class detection scenario. InceptionV3 has the highest general performance with accuracy, F1-score, and g-mean of 96% in the three-class detection scenario. For COVID-19 pneumonia detection, InceptionV3 attained the highest performance with 86% Sn, 99% Sp, and 91% PPV with an AUC of 0.99 in distinguishing pneumonia from normal CXR. Its capability of differentiating COVID-19 pneumonia from normal and non-COVID-19 pneumonia attained 0.98 AUC and a micro-average of 0.99 for other classes.
| S-EPMC8516252 | biostudies-literature
Project description:PurposeTo investigate the diagnostic performance of an Artificial Intelligence (AI) system for detection of COVID-19 in chest radiographs (CXR), and compare results to those of physicians working alone, or with AI support.Materials and methodsAn AI system was fine-tuned to discriminate confirmed COVID-19 pneumonia, from other viral and bacterial pneumonia and non-pneumonia patients and used to review 302 CXR images from adult patients retrospectively sourced from nine different databases. Fifty-four physicians blind to diagnosis, were invited to interpret images under identical conditions in a test set, and randomly assigned either to receive or not receive support from the AI system. Comparisons were then made between diagnostic performance of physicians working with and without AI support. AI system performance was evaluated using the area under the receiver operating characteristic (AUROC), and sensitivity and specificity of physician performance compared to that of the AI system.ResultsDiscrimination by the AI system of COVID-19 pneumonia showed an AUROC curve of 0.96 in the validation and 0.83 in the external test set, respectively. The AI system outperformed physicians in the AUROC overall (70% increase in sensitivity and 1% increase in specificity, p < 0.0001). When working with AI support, physicians increased their diagnostic sensitivity from 47% to 61% (p < 0.001), although specificity decreased from 79% to 75% (p = 0.007).ConclusionsOur results suggest interpreting chest radiographs (CXR) supported by AI, increases physician diagnostic sensitivity for COVID-19 detection. This approach involving a human-machine partnership may help expedite triaging efforts and improve resource allocation in the current crisis.
| S-EPMC7674009 | biostudies-literature
Project description:ObjectivesAn artificial intelligence model was adopted to identify mild COVID-19 pneumonia from computed tomography (CT) volumes, and its diagnostic performance was then evaluated.MethodsIn this retrospective multicenter study, an atrous convolution-based deep learning model was established for the computer-assisted diagnosis of mild COVID-19 pneumonia. The dataset included 2087 chest CT exams collected from four hospitals between 1 January 2019 and 31 May 2020. The true positive rate, true negative rate, receiver operating characteristic curve, area under the curve (AUC) and convolutional feature map were used to evaluate the model.ResultsThe proposed deep learning model was trained on 1538 patients and tested on an independent testing cohort of 549 patients. The overall sensitivity was 91.5% (195/213; p < 0.001, 95% CI: 89.2-93.9%), the overall specificity was 90.5% (304/336; p < 0.001, 95% CI: 88.0-92.9%) and the general AUC value was 0.955 (p < 0.001).ConclusionsA deep learning model can accurately detect COVID-19 and serve as an important supplement to the COVID-19 reverse transcription-polymerase chain reaction (RT-PCR) test.Key points• The implementation of a deep learning model to identify mild COVID-19 pneumonia was confirmed to be effective and feasible. • The strategy of using a binary code instead of the region of interest label to identify mild COVID-19 pneumonia was verified. • This AI model can assist in the early screening of COVID-19 without interfering with normal clinical examinations.
| S-EPMC7971359 | biostudies-literature
Project description:Background The role and performance of chest CT in the diagnosis of the coronavirus disease 2019 (COVID-19) pandemic remains under active investigation. Purpose To evaluate the French national experience using Chest CT for COVID-19, results of chest CT and RT-PCR were compared together and with the final discharge diagnosis used as reference standard. Materials and Methods A structured CT scan survey (NCT04339686) was sent to 26 hospital radiology departments in France between March 2 and April 24 2020. These dates correspond to the peak of the national COVID-19 epidemic. Radiology departments were selected to reflect the estimated geographical prevalence heterogeneities of the epidemic. All symptomatic patients suspected of having a COVID-19 pneumonia who underwent within 48 hours both initial chest CT and at least one RT-PCR testing were included. The final discharge diagnosis, based on multiparametric items, was recorded. Data for each center were prospectively collected and gathered each week. Test efficacy was determined by using Mann-Whitney Test, Student's t-test, Chi-square test and Pearson's correlation. A p value <.05 determined statistical significance. Results Twenty-six of 26 hospital radiology departments responded to the survey with 7500 patients entered; 2652 did not have RT-PCR results or had unknown or excess delay between RT-PCR and CT. After exclusions, 4824 patients (mean age 64, ± 19 yrs, 2669 males) were included. Using final diagnosis as the reference, 2564 of the 4824 patients were positive for COVID-19 (53%). Sensitivity, specificity, NPV and PPV of chest CT for diagnosing COVID-19 were 2319/2564 (90%, 95% confidence interval [CI]: 89, 91), 2056/2260 (91%, 95%CI: 91, 92%), 2056/2300 (89%, 95%CI; 87, 90%) and 2319/2524 (92%, 95%CI 91, 93%) respectively. There was no significant difference for chest CT efficacy among the 26 geographically separate sites, each with varying amounts of disease prevalence. Conclusion Use of chest CT for the initial diagnosis and triage of suspected COVID-19 patients was successful.
| S-EPMC7465292 | biostudies-literature
Project description:ObjectivesTo study whether a trained convolutional neural network (CNN) can be of assistance to radiologists in differentiating Coronavirus disease (COVID)-positive from COVID-negative patients using chest X-ray (CXR) through an ambispective clinical study. To identify subgroups of patients where artificial intelligence (AI) can be of particular value and analyse what imaging features may have contributed to the performance of AI by means of visualisation techniques.MethodsCXR of 487 patients were classified into [4] categories-normal, classical COVID, indeterminate, and non-COVID by consensus opinion of 2 radiologists. CXR which were classified as "normal" and "indeterminate" were then subjected to analysis by AI, and final categorisation provided as guided by prediction of the network. Precision and recall of the radiologist alone and radiologist assisted by AI were calculated in comparison to reverse transcriptase-polymerase chain reaction (RT-PCR) as the gold standard. Attention maps of the CNN were analysed to understand regions in the CXR important to the AI algorithm in making a prediction.ResultsThe precision of radiologists improved from 65.9 to 81.9% and recall improved from 17.5 to 71.75 when assistance with AI was provided. AI showed 92% accuracy in classifying "normal" CXR into COVID or non-COVID. Analysis of attention maps revealed attention on the cardiac shadow in these "normal" radiographs.ConclusionThis study shows how deployment of an AI algorithm can complement a human expert in the determination of COVID status. Analysis of the detected features suggests possible subtle cardiac changes, laying ground for further investigative studies into possible cardiac changes.Key points• Through an ambispective clinical study, we show how assistance with an AI algorithm can improve recall (sensitivity) and precision (positive predictive value) of radiologists in assessing CXR for possible COVID in comparison to RT-PCR. • We show that AI achieves the best results in images classified as "normal" by radiologists. We conjecture that possible subtle cardiac in the CXR, imperceptible to the human eye, may have contributed to this prediction. • The reported results may pave the way for a human computer collaboration whereby the expert with some help from the AI algorithm achieves higher accuracy in predicting COVID status on CXR than previously thought possible when considering either alone.
| S-EPMC7816060 | biostudies-literature
Project description:The global pandemic of coronavirus disease (COVID-19) has caused millions of deaths and affected the livelihood of many more people. Early and rapid detection of COVID-19 is a challenging task for the medical community, but it is also crucial in stopping the spread of the SARS-CoV-2 virus. Prior substantiation of artificial intelligence (AI) in various fields of science has encouraged researchers to further address this problem. Various medical imaging modalities including X-ray, computed tomography (CT) and ultrasound (US) using AI techniques have greatly helped to curb the COVID-19 outbreak by assisting with early diagnosis. We carried out a systematic review on state-of-the-art AI techniques applied with X-ray, CT, and US images to detect COVID-19. In this paper, we discuss approaches used by various authors and the significance of these research efforts, the potential challenges, and future trends related to the implementation of an AI system for disease detection during the COVID-19 pandemic.
| S-EPMC8659534 | biostudies-literature
Project description:ObjectivesGround-glass opacity and consolidation are recognized typical features of Coronavirus disease-19 (COVID-19) pneumonia on Chest CT, yet ancillary findings have not been fully described. We aimed to describe ancillary findings of COVID-19 pneumonia on CT, to define their prevalence, and investigate their association with clinical data.MethodsWe retrospectively reviewed our CT chest cases with coupled reverse transcriptase polymerase chain reaction (rt-PCR). Patients with negative rt-PCR or without admission chest CT were excluded. Ancillary findings included: vessel enlargement, subpleural curvilinear lines, dependent subpleural atelectasis, centrilobular solid nodules, pleural and/or pericardial effusions, enlarged mediastinal lymph nodes. Continuous data were expressed as median and 95% confidence interval (95% CI) and tested by Mann-Whitney U test.ResultsAncillary findings were represented by 106/252 (42.1%, 36.1 to 48.2) vessel enlargement, 50/252 (19.8%, 15.4 to 25.2) subpleural curvilinear lines, 26/252 (10.1%, 7.1 to 14.7) dependent subpleural atelectasis, 15/252 (5.9%, 3.6 to 9.6) pleural effusion, 15/252 (5.9%, 3.6 to 9.6) mediastinal lymph nodes enlargement, 13/252 (5.2%, 3 to 8.6) centrilobular solid nodules, and 6/252 (2.4%, 1.1 to 5.1) pericardial effusion. Air space disease was more extensive in patients with vessel enlargement or centrilobular solid nodules (p < 0.001). Vessel enlargement was associated with longer history of fever (p = 0.035) and lower admission oxygen saturation (p = 0.014); dependent subpleural atelectasis with lower oxygen saturation (p < 0.001) and higher respiratory rate (p < 0.001); mediastinal lymph nodes with shorter history of cough (p = 0.046); centrilobular solid nodules with lower prevalence of cough (p = 0.023), lower oxygen saturation (p < 0.001), and higher respiratory rate (p = 0.032), and pericardial effusion with shorter history of cough (p = 0.015). Ancillary findings associated with longer hospital stay were subpleural curvilinear lines (p = 0.02), whereas centrilobular solid nodules were associated with higher rate of intensive care unit admission (p = 0.01).ConclusionTypical high-resolution CT findings of COVID-19 pneumonia are frequently associated with ancillary findings that variably associate with disease extent, clinical parameters, and disease severity.Advances in knowledgeAncillary findings might reflect the broad range of heterogeneous mechanisms in severe acute respiratory syndrome from viral pneumonia, and potentially help disease phenotyping.
| S-EPMC7934290 | biostudies-literature
Project description:Even with over 80% of the population being vaccinated against COVID-19, the disease continues to claim victims. Therefore, it is crucial to have a secure Computer-Aided Diagnostic system that can assist in identifying COVID-19 and determining the necessary level of care. This is especially important in the Intensive Care Unit to monitor disease progression or regression in the fight against this epidemic. To accomplish this, we merged public datasets from the literature to train lung and lesion segmentation models with five different distributions. We then trained eight CNN models for COVID-19 and Common-Acquired Pneumonia classification. If the examination was classified as COVID-19, we quantified the lesions and assessed the severity of the full CT scan. To validate the system, we used Resnetxt101 Unet++ and Mobilenet Unet for lung and lesion segmentation, respectively, achieving accuracy of 98.05%, F1-score of 98.70%, precision of 98.7%, recall of 98.7%, and specificity of 96.05%. This was accomplished in just 19.70 s per full CT scan, with external validation on the SPGC dataset. Finally, when classifying these detected lesions, we used Densenet201 and achieved accuracy of 90.47%, F1-score of 93.85%, precision of 88.42%, recall of 100.0%, and specificity of 65.07%. The results demonstrate that our pipeline can correctly detect and segment lesions due to COVID-19 and Common-Acquired Pneumonia in CT scans. It can differentiate these two classes from normal exams, indicating that our system is efficient and effective in identifying the disease and assessing the severity of the condition.
| S-EPMC10215490 | biostudies-literature
Project description:ObjectiveThe chest X-ray (CXR) is the most readily available and common imaging modality for the assessment of pneumonia. However, detecting pneumonia from chest radiography is a challenging task, even for experienced radiologists. An artificial intelligence (AI) model might help to diagnose pneumonia from CXR more quickly and accurately. We aim to develop an AI model for pneumonia from CXR images and to evaluate diagnostic performance with external dataset.MethodsTo train the pneumonia model, a total of 157,016 CXR images from the National Institutes of Health (NIH) and the Korean National Tuberculosis Association (KNTA) were used (normal vs. pneumonia = 120,722 vs.36,294). An ensemble model of two neural networks with DenseNet classifies each CXR image into pneumonia or not. To test the accuracy of the models, a separate external dataset of pneumonia CXR images (n = 212) from a tertiary university hospital (Gachon University Gil Medical Center GUGMC, Incheon, South Korea) was used; the diagnosis of pneumonia was based on both the chest CT findings and clinical information, and the performance evaluated using the area under the receiver operating characteristic curve (AUC). Moreover, we tested the change of the AI probability score for pneumonia using the follow-up CXR images (7 days after the diagnosis of pneumonia, n = 100).ResultsWhen the probability scores of the models that have a threshold of 0.5 for pneumonia, two models (models 1 and 4) having different pre-processing parameters on the histogram equalization distribution showed best AUC performances of 0.973 and 0.960, respectively. As expected, the ensemble model of these two models performed better than each of the classification models with 0.983 AUC. Furthermore, the AI probability score change for pneumonia showed a significant difference between improved cases and aggravated cases (Δ = -0.06 ± 0.14 vs. 0.06 ± 0.09, for 85 improved cases and 15 aggravated cases, respectively, P = 0.001) for CXR taken as a 7-day follow-up.ConclusionsThe ensemble model combined two different classification models for pneumonia that performed at 0.983 AUC for an external test dataset from a completely different data source. Furthermore, AI probability scores showed significant changes between cases of different clinical prognosis, which suggest the possibility of increased efficiency and performance of the CXR reading at the diagnosis and follow-up evaluation for pneumonia.
| S-EPMC8049482 | biostudies-literature
Project description:Background Despite its high sensitivity in diagnosing coronavirus disease 2019 (COVID-19) in a screening population, the chest CT appearance of COVID-19 pneumonia is thought to be nonspecific. Purpose To assess the performance of radiologists in the United States and China in differentiating COVID-19 from viral pneumonia at chest CT. Materials and Methods In this study, 219 patients with positive COVID-19, as determined with reverse-transcription polymerase chain reaction (RT-PCR) and abnormal chest CT findings, were retrospectively identified from seven Chinese hospitals in Hunan Province, China, from January 6 to February 20, 2020. Two hundred five patients with positive respiratory pathogen panel results for viral pneumonia and CT findings consistent with or highly suspicious for pneumonia, according to original radiologic interpretation within 7 days of each other, were identified from Rhode Island Hospital in Providence, RI. Three radiologists from China reviewed all chest CT scans (n = 424) blinded to RT-PCR findings to differentiate COVID-19 from viral pneumonia. A sample of 58 age-matched patients was randomly selected and evaluated by four radiologists from the United States in a similar fashion. Different CT features were recorded and compared between the two groups. Results For all chest CT scans (n = 424), the accuracy of the three radiologists from China in differentiating COVID-19 from non-COVID-19 viral pneumonia was 83% (350 of 424), 80% (338 of 424), and 60% (255 of 424). In the randomly selected sample (n = 58), the sensitivities of three radiologists from China and four radiologists from the United States were 80%, 67%, 97%, 93%, 83%, 73%, and 70%, respectively. The corresponding specificities of the same readers were 100%, 93%, 7%, 100%, 93%, 93%, and 100%, respectively. Compared with non-COVID-19 pneumonia, COVID-19 pneumonia was more likely to have a peripheral distribution (80% vs 57%, P < .001), ground-glass opacity (91% vs 68%, P < .001), fine reticular opacity (56% vs 22%, P < .001), and vascular thickening (59% vs 22%, P < .001), but it was less likely to have a central and peripheral distribution (14% vs 35%, P < .001), pleural effusion (4% vs 39%, P < .001), or lymphadenopathy (3% vs 10%, P = .002). Conclusion Radiologists in China and in the United States distinguished coronavirus disease 2019 from viral pneumonia at chest CT with moderate to high accuracy. © RSNA, 2020 Online supplemental material is available for this article. A translation of this abstract in Farsi is available in the supplement. ترجمه چکیده این مقاله به فارسی، در ضمیمه موجود است.
| S-EPMC7233414 | biostudies-literature