Development of automatic generation system for lung nodule finding descriptions.
Ontology highlight
ABSTRACT:
SUBMITTER: Momoki Y
PROVIDER: S-EPMC10956853 | biostudies-literature | 2024
REPOSITORIES: biostudies-literature
Publications
Development of automatic generation system for lung nodule finding descriptions.
Momoki Yohei Y Ichinose Akimichi A Nakamura Keigo K Iwano Shingo S Kamiya Shinichiro S Yamada Keiichiro K Naganawa Shinji S
PloS one 20240321 3
Worldwide, lung cancer is the leading cause of cancer-related deaths. To manage lung nodules, radiologists observe computed tomography images, review various imaging findings, and record these in radiology reports. The report contents should be of high quality and uniform regardless of the radiologist. Here, we propose an artificial intelligence system that automatically generates descriptions related to lung nodules in computed tomography images. Our system consists of an image recognition meth ...[more]
Similar Datasets
Project description:MotivationBiomedical visualizations are key to accessing biomedical knowledge and detecting new patterns in large datasets. Interactive visualizations are essential for biomedical data scientists and are omnipresent in data analysis software and data portals. Without appropriate descriptions, these visualizations are not accessible to all people with blindness and low vision, who often rely on screen reader accessibility technologies to access visual information on digital devices. Screen readers require descriptions to convey image content. However, many images lack informative descriptions due to unawareness and difficulty writing such descriptions. Describing complex and interactive visualizations, like genomics data visualizations, is even more challenging. Automatic generation of descriptions could be beneficial, yet current alt text generating models are limited to basic visualizations and cannot be used for genomics.ResultsWe present AltGosling, an automated description generation tool focused on interactive data visualizations of genome-mapped data, created with the grammar-based genomics toolkit Gosling. The logic-based algorithm of AltGosling creates various descriptions including a tree-structured navigable panel. We co-designed AltGosling with a blind screen reader user (co-author). We show that AltGosling outperforms state-of-the-art large language models and common image-based neural networks for alt text generation of genomics data visualizations. As a first of its kind in genomic research, we lay the groundwork to increase accessibility in the field.Availability and implementationThe source code, examples, and interactive demo are accessible under the MIT License at https://github.com/gosling-lang/altgosling. The package is available at https://www.npmjs.com/package/altgosling.
| S-EPMC11630506 | biostudies-literature
Project description:BackgroundLung cancer is the leading cause of cancer-related deaths throughout the world. Chest computed tomography (CT) is now widely used in the screening and diagnosis of lung cancer due to its effectiveness. Radiologists must identify each small nodule shadow from 3D volume images, which is very burdensome and often results in missed nodules. To address these challenges, we developed a computer-aided detection (CAD) system that automatically detects lung nodules in CT images.MethodsA total of 1997 chest CT scans were collected for algorithm development. The algorithm was designed using deep learning technology. In addition to evaluating detection performance on various public datasets, its robustness to changes in radiation dose was assessed by a phantom study. To investigate the clinical usefulness of the CAD system, a reader study was conducted with 10 doctors, including inexperienced and expert readers. This study investigated whether the use of the CAD as a second reader could prevent nodular lesions in lungs that require follow-up examinations from being overlooked. Analysis was performed using the Jackknife Free-Response Receiver-Operating Characteristic (JAFROC).ResultsThe CAD system achieved sensitivity of 0.98/0.96 at 3.1/7.25 false positives per case on two public datasets. Sensitivity did not change within the range of practical doses for a study using a phantom. A second reader study showed that the use of this system significantly improved the detection ability of nodules that could be picked up clinically (p = 0.026).ConclusionsWe developed a deep learning-based CAD system that is robust to imaging conditions. Using this system as a second reader increased detection performance.
| S-EPMC9682774 | biostudies-literature
Project description:The introduction of lung cancer screening programs will produce an unprecedented amount of chest CT scans in the near future, which radiologists will have to read in order to decide on a patient follow-up strategy. According to the current guidelines, the workup of screen-detected nodules strongly relies on nodule size and nodule type. In this paper, we present a deep learning system based on multi-stream multi-scale convolutional networks, which automatically classifies all nodule types relevant for nodule workup. The system processes raw CT data containing a nodule without the need for any additional information such as nodule segmentation or nodule size and learns a representation of 3D data by analyzing an arbitrary number of 2D views of a given nodule. The deep learning system was trained with data from the Italian MILD screening trial and validated on an independent set of data from the Danish DLCST screening trial. We analyze the advantage of processing nodules at multiple scales with a multi-stream convolutional network architecture, and we show that the proposed deep learning system achieves performance at classifying nodule type that surpasses the one of classical machine learning approaches and is within the inter-observer variability among four experienced human observers.
| S-EPMC5395959 | biostudies-literature
Project description:BackgroundIn the process of video-assisted thoracoscopic surgery (VATS) for lung nodule resection, lung is leaded to atelectasis. However, preoperative computed tomography (CT) images are taken during inspiration, which means they differ significantly from the lung status observed during surgery. Consequently, this discrepancy can make the localization of small or subsolid nodules challenging during the operation. This study aimed to develop a CT-based virtual atelectasis simulation system for noninvasive lung nodule localization. By accurately simulating atelectasis, this study aimed to improve the precision of presurgical planning from lung nodule resections.MethodsThis study retrospectively examined 20 patients who had either subsolid nodules or small nodules less than 3 cm in size, selected from a cohort of 279 patients who underwent VATS surgery for lung nodules in Korea University Ansan Hospital between June 28, 2021, and January 22, 2024. Chest CT images of the lungs of 20 patients were acquired, and image data were converted three-dimensional models. The mesh points extracted from these lung models were manipulated to simulate the effects of gravity, by adjusting the lung shapes and nodule locations to align with the respective surgical postures of the patients. Subsequently, we assessed the similarity of the simulation by comparing the resulting deformed lung shapes and nodule locations with the corresponding perspectives observed in the surgical videos.ResultsThe average volume of the entire lung among the patients was 2,336 cm3 (±588). After atelectasis simulation, the average lung shrinkage rate was 48.6% (±12.9%). Evaluations of an average of 15 pairs of images per case revealed significant conformity between atelectasis simulation images and surgical video snapshots, with average Dice and Jaccard similarity coefficient values of 90.27 and 88.25, respectively. Furthermore, the alignment of nodule locations between the simulations and surgical anticipation demonstrated notable accuracy, with an average Hausdorff distance of 6.39 mm.ConclusionsWe successfully developed a simulation of lung atelectasis based on preoperative CT scans that closely resembled actual surgical videos. The integration of this presurgical atelectasis simulation is anticipated to enhance the accuracy of nodule locations, thus contributing to more efficient and precise surgical planning.
| S-EPMC11635236 | biostudies-literature
Project description:BackgroundsConventional ultrasound manual scanning and artificial diagnosis approaches in breast are considered to be operator-dependence, slight slow and error-prone. In this study, we used Automated Breast Ultrasound (ABUS) machine for the scanning, and deep convolutional neural network (CNN) technology, a kind of Deep Learning (DL) algorithm, for the detection and classification of breast nodules, aiming to achieve the automatic and accurate diagnosis of breast nodules.MethodsTwo hundred and ninety-three lesions from 194 patients with definite pathological diagnosis results (117 benign and 176 malignancy) were recruited as case group. Another 70 patients without breast diseases were enrolled as control group. All the breast scans were carried out by an ABUS machine and then randomly divided into training set, verification set and test set, with a proportion of 7:1:2. In the training set, we constructed a detection model by a three-dimensionally U-shaped convolutional neural network (3D U-Net) architecture for the purpose of segment the nodules from background breast images. Processes such as residual block, attention connections, and hard mining were used to optimize the model while strategies of random cropping, flipping and rotation for data augmentation. In the test phase, the current model was compared with those in previously reported studies. In the verification set, the detection effectiveness of detection model was evaluated. In the classification phase, multiple convolutional layers and fully-connected layers were applied to set up a classification model, aiming to identify whether the nodule was malignancy.ResultsOur detection model yielded a sensitivity of 91% and 1.92 false positive subjects per automatically scanned imaging. The classification model achieved a sensitivity of 87.0%, a specificity of 88.0% and an accuracy of 87.5%.ConclusionsDeep CNN combined with ABUS maybe a promising tool for easy detection and accurate diagnosis of breast nodule.
| S-EPMC7578508 | biostudies-literature
Project description:Audio descriptions (AD) make videos accessible to those who cannot see them. But many videos lack AD and remain inaccessible as traditional approaches involve expensive professional production. We aim to lower production costs by involving novices in this process. We present an AD authoring system that supports novices to write scene descriptions (SD)-textual descriptions of video scenes-and convert them into AD via text-to-speech. The system combines video scene recognition and natural language processing to review novice-written SD and feeds back what to mention automatically. To assess the effectiveness of this automatic feedback in supporting novices, we recruited 60 participants to author SD with no feedback, human feedback, and automatic feedback. Our study shows that automatic feedback improves SD's descriptiveness, objectiveness, and learning quality, without affecting qualities like sufficiency and clarity. Though human feedback remains more effective, automatic feedback can reduce production costs by 45%.
| S-EPMC11872226 | biostudies-literature
Project description:BackgroundPreoperative percutaneous computed tomography (CT)-guided localization of pulmonary nodules plays a pivotal role in the diagnosis and treatment of early-stage lung cancer. However, conventional manual localization techniques have inherent limitations in achieving a high degree of accuracy. Consequently, a novel robotic-assisted navigation system was developed to attain precise localization of small lung nodules. This study aims to investigate the accuracy and safety of this system in clinical applications.MethodsPatients with peripheral solitary pulmonary nodules measuring less than 20 mm were enrolled. The robotic-assisted navigation system generated a three-dimensional (3D) model based on the patient's CT images, determining the optimal puncture path. The robotic arm then accurately located the nodule and, following percutaneous puncture, indocyanine green (ICG) was injected. The primary outcome measure was the accuracy of pulmonary nodule localization, while secondary outcomes included the complication rate, procedural duration, and total radiation exposure.ResultsA total of 33 nodules were successfully localized using the robotic-assisted navigation system and resected through video-assisted thoracoscopic surgery (VATS). The first-pass success rate was 100%, with a median deviation of 6.1 mm [interquartile range (IQR), 2.5-7.2 mm] between the localizer and the nodule. The median localization time was 25.0 minutes, and the single and cumulative exam dose-length products (DLP) were 534.0 and 1491.0 mGy·cm, respectively. Notably, no observable complications were reported during the procedures.ConclusionsThe innovative robotic-assisted navigation system demonstrated satisfactory accuracy and holds promise for improving the percutaneous localization of lung nodules. This method represents a safe and viable alternative to traditional CT-guided manual localization techniques.
| S-EPMC10713270 | biostudies-literature
Project description:We aimed to describe the development of an inference model for computer-aided diagnosis of lung nodules that could provide valid reasoning for any inferences, thereby improving the interpretability and performance of the system. An automatic construction method was used that considered explanation adequacy and inference accuracy. In addition, we evaluated the usefulness of prior experts' (radiologists') knowledge while constructing the models. In total, 179 patients with lung nodules were included and divided into 79 and 100 cases for training and test data, respectively. F-measure and accuracy were used to assess explanation adequacy and inference accuracy, respectively. For F-measure, reasons were defined as proper subsets of Evidence that had a strong influence on the inference result. The inference models were automatically constructed using the Bayesian network and Markov chain Monte Carlo methods, selecting only those models that met the predefined criteria. During model constructions, we examined the effect of including radiologist's knowledge in the initial Bayesian network models. Performance of the best models in terms of F-measure, accuracy, and evaluation metric were as follows: 0.411, 72.0%, and 0.566, respectively, with prior knowledge, and 0.274, 65.0%, and 0.462, respectively, without prior knowledge. The best models with prior knowledge were then subjectively and independently evaluated by two radiologists using a 5-point scale, with 5, 3, and 1 representing beneficial, appropriate, and detrimental, respectively. The average scores by the two radiologists were 3.97 and 3.76 for the test data, indicating that the proposed computer-aided diagnosis system was acceptable to them. In conclusion, the proposed method incorporating radiologists' knowledge could help in eliminating radiologists' distrust of computer-aided diagnosis and improving its performance.
| S-EPMC6239329 | biostudies-literature
Project description:BackgroundLow-dose computed tomography (LDCT) has been shown useful in early lung cancer detection. This study aimed to develop a novel deep learning model for detecting pulmonary nodules on chest LDCT images.MethodsIn this secondary analysis, three lung nodule datasets, including Lung Nodule Analysis 2016 (LUNA16), Lung Nodule Received Operation (LNOP), and Lung Nodule in Health Examination (LNHE), were used to train and test deep learning models. The 3D region proposal network (RPN) was modified via a series of pruning experiments for better predictive performance. The performance of each modified deep leaning model was evaluated based on sensitivity and competition performance metric (CPM). Furthermore, the performance of the modified 3D RPN trained on three datasets was evaluated by 10-fold cross validation. Temporal validation was conducted to assess the reliability of the modified 3D RPN for detecting lung nodules.ResultsThe results of pruning experiments indicated that the modified 3D RPN composed of the Cross Stage Partial Network (CSPNet) approach to Residual Network (ResNet) Xt (CSP-ResNeXt) module, feature pyramid network (FPN), nearest anchor method, and post-processing masking, had the optimal predictive performance with a CPM of 92.2%. The modified 3D RPN trained on the LUNA16 dataset had the highest CPM (90.1%), followed by the LNOP dataset (CPM: 74.1%) and the LNHE dataset (CPM: 70.2%). When the modified 3D RPN trained and tested on the same datasets, the sensitivities were 94.6%, 84.8%, and 79.7% for LUNA16, LNOP, and LNHE, respectively. The temporal validation analysis revealed that the modified 3D RPN tested on LNOP test set achieved a CPM of 71.6% and a sensitivity of 85.7%, and the modified 3D RPN tested on LNHE test set had a CPM of 71.7% and a sensitivity of 83.5%.ConclusionA modified 3D RPN for detecting lung nodules on LDCT scans was designed and validated, which may serve as a computer-aided diagnosis system to facilitate lung nodule detection and lung cancer diagnosis.
| S-EPMC10953193 | biostudies-literature
Project description:PurposeTo prospectively evaluate whether Lung-RADS classification and volumetric nodule assessment were feasible with ultralow-dose (ULD) chest CT scans with deep learning image reconstruction (DLIR).MethodsThe institutional review board approved this prospective study. This study included 40 patients (mean age, 66±12 years; 21 women). Participants sequentially underwent LDCT and ULDCT (CTDIvol, 0.96±0.15 mGy and 0.12±0.01 mGy) scans reconstructed with the adaptive statistical iterative reconstruction-V 50% (ASIR-V50) and DLIR. CT image quality was compared subjectively and objectively. The pulmonary nodules were assessed visually by two readers using the Lung-RADS 1.1 and automatically using a computerized assisted tool.ResultsDLIR provided a significantly higher signal-to-noise ratio for LDCT and ULDCT images than ASIR-V50 (all P < .001). In general, DLIR showed superior subjective image quality for ULDCT images (P < .001) and comparable quality for LDCT images compared to ASIR-V50 (P = .01-1). The per-nodule sensitivities of observers for Lung-RADS category 3-4 nodules were 70.6-88.2% and 64.7-82.4% for DLIR-LDCT and DLIR-ULDCT images (P = 1) and categories were mostly concordant within observers. The per-nodule sensitivities of the computer-assisted detection for nodules ≥4 mm were 72.1% and 67.4% on DLIR-LDCT and ULDCT images (P = .50). The 95% limits of agreement for nodule volume differences between DLIR-LDCT and ULDCT images (-85.6 to 78.7 mm3) was similar to the within-scan nodule volume differences between DLIR- and ASIR-V50-LDCT images (-63.9 to 78.5 mm3), with volume differences smaller than 25% in 88.5% and 92.3% of nodules, respectively (P = .65).ConclusionDLIR enabled comparable Lung-RADS and volumetric nodule assessments on ULDCT images to LDCT images.
| S-EPMC10883577 | biostudies-literature