Dataset Information

Automated detection of lung nodules and coronary artery calcium using artificial intelligence on low-dose CT scans for lung cancer screening: accuracy and prognostic value.

ABSTRACT:

Background

Artificial intelligence (AI) in diagnostic radiology is undergoing rapid development. Its potential utility to improve diagnostic performance for cardiopulmonary events is widely recognized, but the accuracy and precision have yet to be demonstrated in the context of current screening modalities. Here, we present findings on the performance of an AI convolutional neural network (CNN) prototype (AI-RAD Companion, Siemens Healthineers) that automatically detects pulmonary nodules and quantifies coronary artery calcium volume (CACV) on low-dose chest CT (LDCT), and compare results to expert radiologists. We also correlate AI findings with adverse cardiopulmonary outcomes in a retrospective cohort of 117 patients who underwent LDCT.

Methods

A total of 117 patients were enrolled in this study. Two CNNs were used to identify lung nodules and CACV on LDCT scans. All subjects were used for lung nodule analysis, and 96 subjects met the criteria for coronary artery calcium volume analysis. Interobserver concordance was measured using ICC and Cohen's kappa. Multivariate logistic regression and partial least squares regression were used for outcomes analysis.

Results

Agreement of the AI findings with experts was excellent (CACV ICC?=?0.904, lung nodules Cohen's kappa?=?0.846) with high sensitivity and specificity (CACV: sensitivity?=?.929, specificity?=?.960; lung nodules: sensitivity?=?1, specificity?=?0.708). The AI findings improved the prediction of major cardiopulmonary outcomes at 1-year follow-up including major adverse cardiac events and lung cancer (AUC_MACE?=?0.911, AUC_{Lung Cancer}?=?0.942).

Conclusion

We conclude the AI prototype rapidly and accurately identifies significant risk factors for cardiopulmonary disease on standard screening low-dose chest CT. This information can be used to improve diagnostic ability, facilitate intervention, improve morbidity and mortality, and decrease healthcare costs. There is also potential application in countries with limited numbers of cardiothoracic radiologists.

SUBMITTER: Chamberlin J

PROVIDER: S-EPMC7931546 | biostudies-literature | 2021 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Automated detection of lung nodules and coronary artery calcium using artificial intelligence on low-dose CT scans for lung cancer screening: accuracy and prognostic value.

Chamberlin Jordan J Kocher Madison R MR Waltz Jeffrey J Snoddy Madalyn M Stringer Natalie F C NFC Stephenson Joseph J Sahbaee Pooyan P Sharma Puneet P Rapaka Saikiran S Schoepf U Joseph UJ Abadia Andres F AF Sperl Jonathan J Hoelzer Phillip P Mercer Megan M Somayaji Nayana N Aquino Gilberto G Burt Jeremy R JR

BMC medicine 20210304 1

<h4>Background</h4>Artificial intelligence (AI) in diagnostic radiology is undergoing rapid development. Its potential utility to improve diagnostic performance for cardiopulmonary events is widely recognized, but the accuracy and precision have yet to be demonstrated in the context of current screening modalities. Here, we present findings on the performance of an AI convolutional neural network (CNN) prototype (AI-RAD Companion, Siemens Healthineers) that automatically detects pulmonary nodule ...[more]

PMID: 33658025

Similar Datasets

Project description:BackgroundThe coronary artery calcium score (CACS) has been shown to be an independent predictor of cardiovascular events. The traditional coronary artery calcium scoring algorithm has been optimized for electrocardiogram (ECG)-gated images, which are acquired with specific settings and timing. Therefore, if the artificial intelligence-based coronary artery calcium score (AI-CACS) could be calculated from a chest low-dose computed tomography (LDCT) examination, it could be valuable in assessing the risk of coronary artery disease (CAD) in advance, and it could potentially reduce the occurrence of cardiovascular events in patients. This study aimed to assess the performance of an AI-CACS algorithm in non-gated chest scans with three different slice thicknesses (1, 3, and 5 mm).MethodsA total of 135 patients who underwent both LDCT of the chest and ECG-gated non-contrast enhanced cardiac CT were prospectively included in this study. The Agatston scores were automatically derived from chest CT images reconstructed at slice thicknesses of 1, 3, and 5 mm using the AI-CACS software. These scores were then compared to those obtained from the ECG-gated cardiac CT data using a conventional semi-automatic method that served as the reference. The correlations between the AI-CACS and electrocardiogram-gated coronary artery calcium score (ECG-CACS) were analyzed, and Bland-Altman plots were used to assess agreement. Risk stratification was based on the calculated CACS, and the concordance rate was determined.ResultsA total of 112 patients were included in the final analysis. The correlations between the AI-CACS at three different thicknesses (1, 3, and 5 mm) and the ECG-CACS were 0.973, 0.941, and 0.834 (all P<0.01), respectively. The Bland-Altman plots showed mean differences in the AI-CACS for the three thicknesses of -6.5, 15.4, and 53.1, respectively. The risk category agreement for the three AI-CACS groups was 0.868, 0.772, and 0.412 (all P<0.01), respectively. While the concordance rates were 91%, 84.8%, and 62.5%, respectively.ConclusionsThe AI-based algorithm successfully calculated the CACS from LDCT scans of the chest, demonstrating its utility in risk categorization. Furthermore, the CACS derived from images with a slice thickness of 1 mm was more accurate than those obtained from images with slice thicknesses of 3 and 5 mm.

Project description:BackgroundAlthough lung ultrasound has been reported to be a portable, cost-effective, and accurate method to detect pneumonia, it has not been widely used because of the difficulty in its interpretation. Here, we aimed to investigate the effectiveness of a novel artificial intelligence-based automated pneumonia detection method using point-of-care lung ultrasound (AI-POCUS) for the coronavirus disease 2019 (COVID-19).MethodsWe enrolled consecutive patients admitted with COVID-19 who underwent computed tomography (CT) in August and September 2021. A 12-zone AI-POCUS was performed by a novice observer using a pocket-size device within 24 h of the CT scan. Fifteen control subjects were also scanned. Additionally, the accuracy of the simplified 8-zone scan excluding the dorsal chest, was assessed. More than three B-lines detected in one lung zone were considered zone-level positive, and the presence of positive AI-POCUS in any lung zone was considered patient-level positive. The sample size calculation was not performed given the retrospective all-comer nature of the study.ResultsA total of 577 lung zones from 56 subjects (59.4 ± 14.8 years, 23% female) were evaluated using AI-POCUS. The mean number of days from disease onset was 9, and 14% of patients were under mechanical ventilation. The CT-validated pneumonia was seen in 71.4% of patients at total 577 lung zones (53.3%). The 12-zone AI-POCUS for detecting CT-validated pneumonia in the patient-level showed the accuracy of 94.5% (85.1%- 98.1%), sensitivity of 92.3% (79.7%- 97.3%), specificity of 100% (80.6%- 100%), positive predictive value of 95.0% (89.6% - 97.7%), and Kappa of 0.33 (0.27-0.40). When simplified with 8-zone scan, the accuracy, sensitivity, and sensitivity were 83.9% (72.2%- 91.3%), 77.5% (62.5%- 87.7%), and 100% (80.6%- 100%), respectively. The zone-level accuracy, sensitivity, and specificity of AI-POCUS were 65.3% (61.4%- 69.1%), 37.2% (32.0%- 42.7%), and 97.8% (95.2%- 99.0%), respectively.InterpretationAI-POCUS using the novel pocket-size ultrasound system showed excellent agreement with CT-validated COVID-19 pneumonia, even when used by a novice observer.

Project description:BackgroundThe integration of artificial intelligence (AI) into medicine is growing, with some experts predicting its standalone use soon. However, skepticism remains due to limited positive outcomes from independent validations. This research evaluates AI software's effectiveness in analyzing chest X-rays (CXR) to identify lung nodules, a possible lung cancer indicator.MethodsThis retrospective study analyzed 7,670,212 record pairs from radiological exams conducted between 2020 and 2022 during the Moscow Computer Vision Experiment, focusing on CXR and computed tomography (CT) scans. All images were acquired during clinical routine. The final dataset comprised 100 CXR images (50 with lung nodules, 50 without), selected consecutively and based on inclusion and exclusion criteria, to evaluate the performance of all five AI-based solutions, participating in the Moscow Computer Vision Experiment and analyzing CXR. The evaluation was performed in 3 stages. In the first stage, the probability of a nodule in the lung obtained from AI services was compared with the Ground Truth (1-there is a nodule, 0-there is no nodule). In the second stage, 3 radiologists evaluated the segmentation of nodules performed by the AI services (1-nodule correctly segmented, 0-nodule incorrectly segmented or not segmented at all). In the third stage, the same radiologists additionally evaluated the classification of the nodules (1-nodule correctly segmented and classified, 0-all other cases). The results obtained in stages 2 and 3 were compared with Ground Truth, which was common to all three stages. For each stage, diagnostic accuracy metrics were calculated for each AI service.ResultsThree software solutions (Celsus, Lunit INSIGHT CXR, and qXR) demonstrated diagnostic metrics that matched or surpassed the vendor specifications, and achieved the highest area under the receiver operating characteristic curve (AUC) of 0.956 [95% confidence interval (CI): 0.918 to 0.994]. However, when evaluated by three radiologists for accurate nodule segmentation and classification, all solutions performed below the vendor-declared metrics, with the highest AUC reaching 0.812 (95% CI: 0.744 to 0.879). Meanwhile, all AI services demonstrated 100% specificity at stages 2 and 3 of the study.ConclusionsTo ensure the reliability and applicability of AI-based software, it is crucial to validate performance metrics using high-quality datasets and engage radiologists in the evaluation process. Developers are recommended to improve the accuracy of the underlying models before allowing the standalone use of the software for lung nodule detection. The dataset created during the study may be accessed at https://mosmed.ai/datasets/mosmeddatargogksnalichiemiotsutstviemlegochnihuzlovtipvii/.

Project description:BackgroundArtificial intelligence (AI)-aided analysis of chest CT expedites the quantification of abnormalities and may facilitate the diagnosis and assessment of the prognosis of subjects with COVID-19.ObjectivesThis study investigates the performance of an AI-aided quantification model in predicting the clinical outcomes of hospitalized subjects with COVID-19 and compares it with radiologists' performance.Subjects and methodsA total of 90 subjects with COVID-19 (men, n = 59 [65.6%]; age, 52.9±16.7 years) were recruited in this cross-sectional study. Quantification of the total and compromised lung parenchyma was performed by two expert radiologists using a volumetric image analysis software and compared against an AI-assisted package consisting of a modified U-Net model for segmenting COVID-19 lesions and an off-the-shelf U-Net model augmented with COVID-19 data for segmenting lung volume. The fraction of compromised lung parenchyma (%CL) was calculated. Based on clinical results, the subjects were divided into two categories: critical (n = 45) and noncritical (n = 45). All admission data were compared between the two groups.ResultsThere was an excellent agreement between the radiologist-obtained and AI-assisted measurements (intraclass correlation coefficient = 0.88, P < 0.001). Both the AI-assisted and radiologist-obtained %CLs were significantly higher in the critical subjects (P = 0.009 and 0.02, respectively) than in the noncritical subjects. In the multivariate logistic regression analysis to distinguish the critical subjects, an AI-assisted %CL ≥35% (odds ratio [OR] = 17.0), oxygen saturation level of <88% (OR = 33.6), immunocompromised condition (OR = 8.1), and other comorbidities (OR = 15.2) independently remained as significant variables in the models. Our proposed model obtained an accuracy of 83.9%, a sensitivity of 79.1%, and a specificity of 88.6% in predicting critical outcomes.ConclusionsAI-assisted measurements are similar to quantitative radiologist-obtained measurements in determining lung involvement in COVID-19 subjects.

Project description:Breast ultrasound provides a first-line evaluation for breast masses, but the majority of the world lacks access to any form of diagnostic imaging. In this pilot study, we assessed the combination of artificial intelligence (Samsung S-Detect for Breast) with volume sweep imaging (VSI) ultrasound scans to evaluate the possibility of inexpensive, fully automated breast ultrasound acquisition and preliminary interpretation without an experienced sonographer or radiologist. This study was conducted using examinations from a curated data set from a previously published clinical study of breast VSI. Examinations in this data set were obtained by medical students without prior ultrasound experience who performed VSI using a portable Butterfly iQ ultrasound probe. Standard of care ultrasound exams were performed concurrently by an experienced sonographer using a high-end ultrasound machine. Expert-selected VSI images and standard of care images were input into S-Detect which output mass features and classification as "possibly benign" and "possibly malignant." Subsequent comparison of the S-Detect VSI report was made between 1) the standard of care ultrasound report by an expert radiologist, 2) the standard of care ultrasound S-Detect report, 3) the VSI report by an expert radiologist, and 4) the pathological diagnosis. There were 115 masses analyzed by S-Detect from the curated data set. There was substantial agreement of the S-Detect interpretation of VSI among cancers, cysts, fibroadenomas, and lipomas to the expert standard of care ultrasound report (Cohen's κ = 0.73 (0.57-0.9 95% CI), p<0.0001), the standard of care ultrasound S-Detect interpretation (Cohen's κ = 0.79 (0.65-0.94 95% CI), p<0.0001), the expert VSI ultrasound report (Cohen's κ = 0.73 (0.57-0.9 95% CI), p<0.0001), and the pathological diagnosis (Cohen's κ = 0.80 (0.64-0.95 95% CI), p<0.0001). All pathologically proven cancers (n = 20) were designated as "possibly malignant" by S-Detect with a sensitivity of 100% and specificity of 86%. Integration of artificial intelligence and VSI could allow both acquisition and interpretation of ultrasound images without a sonographer and radiologist. This approach holds potential for increasing access to ultrasound imaging and therefore improving outcomes related to breast cancer in low- and middle- income countries.

Dataset Information

Automated detection of lung nodules and coronary artery calcium using artificial intelligence on low-dose CT scans for lung cancer screening: accuracy and prognostic value.

Background

Methods

Results

Conclusion

Publications

Automated detection of lung nodules and coronary artery calcium using artificial intelligence on low-dose CT scans for lung cancer screening: accuracy and prognostic value.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets