Dataset Information

A Novel Approach for Fully Automatic Intra-Tumor Segmentation With 3D U-Net Architecture for Gliomas.

ABSTRACT: Purpose: Gliomas are the most common primary brain malignancies, with varying degrees of aggressiveness and prognosis. Understanding of tumor biology and intra-tumor heterogeneity is necessary for planning personalized therapy and predicting response to therapy. Accurate tumoral and intra-tumoral segmentation on MRI is the first step toward understanding the tumor biology through computational methods. The purpose of this study was to design a segmentation algorithm and evaluate its performance on pre-treatment brain MRIs obtained from patients with gliomas. Materials and Methods: In this study, we have designed a novel 3D U-Net architecture that segments various radiologically identifiable sub-regions like edema, enhancing tumor, and necrosis. Weighted patch extraction scheme from the tumor border regions is proposed to address the problem of class imbalance between tumor and non-tumorous patches. The architecture consists of a contracting path to capture context and the symmetric expanding path that enables precise localization. The Deep Convolutional Neural Network (DCNN) based architecture is trained on 285 patients, validated on 66 patients and tested on 191 patients with Glioma from Brain Tumor Segmentation (BraTS) 2018 challenge dataset. Three dimensional patches are extracted from multi-channel BraTS training dataset to train 3D U-Net architecture. The efficacy of the proposed approach is also tested on an independent dataset of 40 patients with High Grade Glioma from our tertiary cancer center. Segmentation results are assessed in terms of Dice Score, Sensitivity, Specificity, and Hausdorff 95 distance (ITCN intra-tumoral classification network). Result: Our proposed architecture achieved Dice scores of 0.88, 0.83, and 0.75 for the whole tumor, tumor core and enhancing tumor, respectively, on BraTS validation dataset and 0.85, 0.77, 0.67 on test dataset. The results were similar on the independent patients' dataset from our hospital, achieving Dice scores of 0.92, 0.90, and 0.81 for the whole tumor, tumor core and enhancing tumor, respectively. Conclusion: The results of this study show the potential of patch-based 3D U-Net for the accurate intra-tumor segmentation. From experiments, it is observed that the weighted patch-based segmentation approach gives comparable performance with the pixel-based approach when there is a thin boundary between tumor subparts.

SUBMITTER: Baid U

PROVIDER: S-EPMC7041417 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Novel Approach for Fully Automatic Intra-Tumor Segmentation With 3D U-Net Architecture for Gliomas.

Baid Ujjwal U Talbar Sanjay S Rane Swapnil S Gupta Sudeep S Thakur Meenakshi H MH Moiyadi Aliasgar A Sable Nilesh N Akolkar Mayuresh M Mahajan Abhishek A

Frontiers in computational neuroscience 20200218

<b>Purpose:</b> Gliomas are the most common primary brain malignancies, with varying degrees of aggressiveness and prognosis. Understanding of tumor biology and intra-tumor heterogeneity is necessary for planning personalized therapy and predicting response to therapy. Accurate tumoral and intra-tumoral segmentation on MRI is the first step toward understanding the tumor biology through computational methods. The purpose of this study was to design a segmentation algorithm and evaluate its perfo ...[more]

PMID: 32132913

Similar Datasets

Project description:IntroductionBladder magnetic resonance imaging (MRI) has been recently integrated in the diagnosis pathway of bladder cancer. However, automatic recognition of suspicious lesions is still challenging. Thus, development of a solution for proper delimitation of the tumor and its separation from the healthy tissue is of primordial importance. As a solution to this unmet medical need, we aimed to develop an artificial intelligence-based decision support system, which automatically segments the bladder wall and the tumor as well as any suspect area from the 3D MRI images.MaterialsWe retrospectively assessed all patients diagnosed with bladder cancer, who underwent MRI at our department (n=33). All examinations were performed using a 1.5 Tesla MRI scanner. All images were reviewed by two radiologists, who performed manual segmentation of the bladder wall and all lesions. First, the performance of our fully automated end-to-end segmentation model based on a 3D U-Net architecture (by considering various depths of 4, 5 or 6 blocks) trained in two data augmentation scenarios (on 5 and 10 augmentation datasets per original data, respectively) was tested. Second, two learning setups were analyzed by training the segmentation algorithm with 7 and 14 MRI original volumes, respectively.ResultsWe obtained a Dice-based performance over 0.878 for automatic segmentation of bladder wall and tumors, as compared to manual segmentation. A larger training dataset using 10 augmentations for 7 patients could further improve the results of the U-Net-5 model (0.902 Dice coefficient at image level). This model performed best in terms of automated segmentation of bladder, as compared to U-Net-4 and U-Net-6. However, in this case increased time for learning was needed as compared to U-Net-4. We observed that an extended dataset for training led to significantly improved segmentation of the bladder wall, but not of the tumor.ConclusionWe developed an intelligent system for bladder tumors automated diagnostic, that uses a deep learning model to segment both the bladder wall and the tumor. As a conclusion, low complexity networks, with less than five-layers U-Net architecture are feasible and show good performance for automatic 3D MRI image segmentation in patients with bladder tumors.

Project description:IntroductionAmino-acids positron emission tomography (PET) is increasingly used in the diagnostic workup of patients with gliomas, including differential diagnosis, evaluation of tumor extension, treatment planning and follow-up. Recently, progresses of computer vision and machine learning have been translated for medical imaging. Aim was to demonstrate the feasibility of an automated 18F-fluoro-ethyl-tyrosine (18F-FET) PET lesion detection and segmentation relying on a full 3D U-Net Convolutional Neural Network (CNN).MethodsAll dynamic 18F-FET PET brain image volumes were temporally realigned to the first dynamic acquisition, coregistered and spatially normalized onto the Montreal Neurological Institute template. Ground truth segmentations were obtained using manual delineation and thresholding (1.3 x background). The volumetric CNN was implemented based on a modified Keras implementation of a U-Net library with 3 layers for the encoding and decoding paths. Dice similarity coefficient (DSC) was used as an accuracy measure of segmentation.ResultsThirty-seven patients were included (26 [70%] in the training set and 11 [30%] in the validation set). All 11 lesions were accurately detected with no false positive, resulting in a sensitivity and a specificity for the detection at the tumor level of 100%. After 150 epochs, DSC reached 0.7924 in the training set and 0.7911 in the validation set. After morphological dilatation and fixed thresholding of the predicted U-Net mask a substantial improvement of the DSC to 0.8231 (+ 4.1%) was noted. At the voxel level, this segmentation led to a 0.88 sensitivity [95% CI, 87.1 to, 88.2%] a 0.99 specificity [99.9 to 99.9%], a 0.78 positive predictive value: [76.9 to 78.3%], and a 0.99 negative predictive value [99.9 to 99.9%].ConclusionsWith relatively high performance, it was proposed the first full 3D automated procedure for segmentation of 18F-FET PET brain images of patients with different gliomas using a U-Net CNN architecture.

Project description:ObjectiveTo determine whether volumetric CT texture analysis (CTTA) using fully automatic tumor segmentation can help predict recurrence-free survival (RFS) in patients with intrahepatic mass-forming cholangiocarcinomas (IMCCs) after surgical resection.Materials and methodsThis retrospective study analyzed the preoperative CT scans of 89 patients with IMCCs (64 male; 25 female; mean age, 62.1 years; range, 38-78 years) who underwent surgical resection between January 2005 and December 2016. Volumetric CTTA of IMCCs was performed in late arterial phase images using both fully automatic and semi-automatic liver tumor segmentation techniques. The time spent on segmentation and texture analysis was compared, and the first-order and second-order texture parameters and shape features were extracted. The reliability of CTTA parameters between the techniques was evaluated using intraclass correlation coefficients (ICCs). Intra- and interobserver reproducibility of volumetric CTTAs were also obtained using ICCs. Cox proportional hazard regression were used to predict RFS using CTTA parameters and clinicopathological parameters.ResultsThe time spent on fully automatic tumor segmentation and CTTA was significantly shorter than that for semi-automatic segmentation: mean ± standard deviation of 1 minutes 37 seconds ± 50 seconds vs. 10 minutes 48 seconds ± 13 minutes 44 seconds (p < 0.001). ICCs of the texture features between the two techniques ranged from 0.215 to 0.980. ICCs for the intraobserver and interobserver reproducibility using fully automatic segmentation were 0.601-0.997 and 0.177-0.984, respectively. Multivariable analysis identified lower first-order mean (hazard ratio [HR], 0.982; p = 0.010), larger pathologic tumor size (HR, 1.171; p < 0.001), and positive lymph node involvement (HR, 2.193; p = 0.014) as significant parameters for shorter RFS using fully automatic segmentation.ConclusionVolumetric CTTA parameters obtained using fully automatic segmentation could be utilized as prognostic markers in patients with IMCC, with comparable reproducibility in significantly less time compared with semi-automatic segmentation.

Project description:BackgroundEndometrial thickness is an essential factor affecting female fertility. Clinically, ultrasound imaging is the first choice for the examination of uterine and endometrial-related diseases. However, the boundary of some endometrial is challenging to distinguish due to the effects of image resolution and noise. In addition, the irregular shape of the endometrium makes it more difficult for doctors to measure its thickness. Through the automatic segmentation and extraction of the endometrium, the maximum thickness of the endometrium can be measured automatically and accurately. This provides a quantitative index for doctors to use diagnostically.MethodsIn this study, 85 cases of three-dimensional transvaginal ultrasound (3D TVUS) images were collected retrospectively, including 75 cases of endometrial adhesion and 10 cases of non-adhesion. Firstly, the ultrasound images were filtered by block-matching and 3D filtering and speckle reducing anisotropic diffusion (SRAD). These two kinds of filtered images were combined with the original image to construct a three-channel image. Then, the augmented images were sent to 3D U-Net to realize endometrium segmentation. The performance of the segmentation models was evaluated using the Dice similarity coefficient (DSC), Jaccard, sensitivity, and 95th percentile Hausdorff distance (HD95). Finally, the medial axis transform was used to extract the endometrial centerline, based on which the endometrial thickness could be automatically measured.ResultsThe endometrium segmentation method proposed in this paper achieved 90.83% in Dice, 83.35% in Jaccard, 90.85% in sensitivity, and 12.75 mm in HD95 in the testing set. Taking the doctor's manual measurement as the gold standard, 94.20% of the automatic endometrial thickness measurements based on the segmentation results were within the allowable error range of clinical diagnosis.ConclusionsThis paper presents an automatic endometrium segmentation and thickness measurement method for 3D TVUS images. The experimental results show that this method has high segmentation accuracy to recognize endometrial adhesion images. Furthermore, the thickness measurement based on the segmentation results has high reliability and repeatability, and the accuracy can meet clinical diagnosis needs.

Project description:External-beam radiotherapy followed by high dose rate (HDR) brachytherapy is the standard-of-care for treating gynecologic cancers. The enhanced soft-tissue contrast provided by magnetic resonance imaging (MRI) makes it a valuable imaging modality for diagnosing and treating these cancers. However, in contrast to computed tomography (CT) imaging, the appearance of the brachytherapy catheters, through which radiation sources are inserted to reach the cancerous tissue later on, is often variable across images. This paper reports, for the first time, a new deep-learning-based method for fully automatic segmentation of multiple closely spaced brachytherapy catheters in intraoperative MRI. Represented in the data are 50 gynecologic cancer patients treated by MRI-guided HDR brachytherapy. For each patient, a single intraoperative MRI was used. 826 catheters in the images were manually segmented by an expert radiation physicist who is also a trained radiation oncologist. The number of catheters in a patient ranged between 10 and 35. A deep 3D convolutional neural network (CNN) model was developed and trained. In order to make the learning process more robust, the network was trained 5 times, each time using a different combination of shown patients. Finally, each test case was processed by the five networks and the final segmentation was generated by voting on the obtained five candidate segmentations. 4-fold validation was executed and all the patients were segmented. An average distance error of 2.0??±??3.4?mm was achieved. False positive and false negative catheters were 6.7% and 1.5% respectively. Average Dice score was equal to 0.60??±??0.17. The algorithm is available for use in the open source software platform 3D Slicer allowing for wide scale testing and research discussion. In conclusion, to the best of our knowledge, fully automatic segmentation of multiple closely spaced catheters from intraoperative MR images was achieved for the first time in gynecological brachytherapy.

Dataset Information

A Novel Approach for Fully Automatic Intra-Tumor Segmentation With 3D U-Net Architecture for Gliomas.

Publications

A Novel Approach for Fully Automatic Intra-Tumor Segmentation With 3D U-Net Architecture for Gliomas.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets