Dataset Information

Differentiation of low and high grade renal cell carcinoma on routine MRI with an externally validated automatic machine learning algorithm.

ABSTRACT: Pre-treatment determination of renal cell carcinoma aggressiveness may help guide clinical decision-making. We aimed to differentiate low-grade (Fuhrman I-II) from high-grade (Fuhrman III-IV) renal cell carcinoma using radiomics features extracted from routine MRI. 482 pathologically confirmed renal cell carcinoma lesions from 2008 to 2019 in a multicenter cohort were retrospectively identified. 439 lesions with information on Fuhrman grade from 4 institutions were divided into training and test sets with an 8:2 split for model development and internal validation. Another 43 lesions from a separate institution were set aside for independent external validation. The performance of TPOT (Tree-Based Pipeline Optimization Tool), an automatic machine learning pipeline optimizer, was compared to hand-optimized machine learning pipeline. The best-performing hand-optimized pipeline was a Bayesian classifier with Fischer Score feature selection, achieving an external validation ROC AUC of 0.59 (95% CI 0.49-0.68), accuracy of 0.77 (95% CI 0.68-0.84), sensitivity of 0.38 (95% CI 0.29-0.48), and specificity of 0.86 (95% CI 0.78-0.92). The best-performing TPOT pipeline achieved an external validation ROC AUC of 0.60 (95% CI 0.50-0.69), accuracy of 0.81 (95% CI 0.72-0.88), sensitivity of 0.12 (95% CI 0.14-0.30), and specificity of 0.97 (95% CI 0.87-0.97). Automated machine learning pipelines can perform equivalent to or better than hand-optimized pipeline on an external validation test non-invasively predicting Fuhrman grade of renal cell carcinoma using conventional MRI.

SUBMITTER: Purkayastha S

PROVIDER: S-EPMC7658976 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Differentiation of low and high grade renal cell carcinoma on routine MRI with an externally validated automatic machine learning algorithm.

Purkayastha Subhanik S Zhao Yijun Y Wu Jing J Hu Rong R McGirr Aidan A Singh Sukhdeep S Chang Ken K Huang Raymond Y RY Zhang Paul J PJ Silva Alvin A Soulen Michael C MC Stavropoulos S William SW Zhang Zishu Z Bai Harrison X HX

Scientific reports 20201111 1

Pre-treatment determination of renal cell carcinoma aggressiveness may help guide clinical decision-making. We aimed to differentiate low-grade (Fuhrman I-II) from high-grade (Fuhrman III-IV) renal cell carcinoma using radiomics features extracted from routine MRI. 482 pathologically confirmed renal cell carcinoma lesions from 2008 to 2019 in a multicenter cohort were retrospectively identified. 439 lesions with information on Fuhrman grade from 4 institutions were divided into training and test ...[more]

PMID: 33177576

Similar Datasets

Project description:BackgroundParkinson's disease (PD) is the second most common neurodegenerative disease. An objective diagnosis method is urgently needed in clinical practice. In this study, deep learning and radiomics techniques were studied to automatically diagnose PD from healthy controls (HCs).Methods155 PD patients and 154 HCs were randomly divided into a training set (246 patients) and a testing set (63 patients). The brain subregions identification and segmentation were automatically performed with a VB-net, and radiomics features of billateral thalamus, caudatum, putamen and pallidum were extracted. Five independent machine learning classifiers [Support Vector Machine (SVM), Stochastic gradient descent (SGD), random forest (RF), quadratic discriminant analysis (QDA) and decision tree (DT)] were trained on the training set, and validated on the testing. Delong test was used to compare the performance of different models.ResultsOur VB-net could automatically identify and segment the brain into 109 regions. 2,264 radiomics features were automatically extracted from the billateral thalamus, caudatum, putamen or pallidum of each patient. After four step of features dimensionality reduction, Delong tests showed that the SVM model based on combined features had the best performance, with AUCs of 0.988 (95% CI: 0.979 ~ 0.998, specificity = 91.1%, sensitivity =100%, accuracy = 89.4% and precision = 88.2%) and 0.976 (95% CI: 0.942 ~ 1.000, specificity = 100%, sensitivity = 87.1%, accuracy = 93.5% and precision = 88.6%) in the training set and testing set, respectively. Decision curve analysis showed that the clinical benefit of the line graph model was high.ConclusionThe SVM model based on combined features could be used to diagnose PD with high accuracy. Our fully automatic model could rapidly process the MRI data and distinguish PD and HCs in one minute. It greatly improved the diagnostic efficiency and has a great potential value in clinical practice to help the early diagnosis of PD.

Project description:X-ray computed tomography (CT) imaging of the brain is commonly used in diagnostic settings. Although CT scans are primarily used in clinical practice, they are increasingly used in research. A fundamental processing step in brain imaging research is brain extraction - the process of separating the brain tissue from all other tissues. Methods for brain extraction have either been 1) validated but not fully automated, or 2) fully automated and informally proposed, but never formally validated.To systematically analyze and validate the performance of FSL's brain extraction tool (BET) on head CT images of patients with intracranial hemorrhage. This was done by comparing the manual gold standard with the results of several versions of automatic brain extraction and by estimating the reliability of automated segmentation of longitudinal scans. The effects of the choice of BET parameters and data smoothing is studied and reported.All images were thresholded using a 0-100 Hounsfield unit (HU) range. In one variant of the pipeline, data were smoothed using a 3-dimensional Gaussian kernel (?=1mm(3)) and re-thresholded to 0-100HU; in the other, data were not smoothed. BET was applied using 1 of 3 fractional intensity (FI) thresholds: 0.01, 0.1, or 0.35 and any holes in the brain mask were filled. For validation against a manual segmentation, 36 images from patients with intracranial hemorrhage were selected from 19 different centers from the MISTIE (Minimally Invasive Surgery plus recombinant-tissue plasminogen activator for Intracerebral Evacuation) stroke trial. Intracranial masks of the brain were manually created by one expert CT reader. The resulting brain tissue masks were quantitatively compared to the manual segmentations using sensitivity, specificity, accuracy, and the Dice Similarity Index (DSI). Brain extraction performance across smoothing and FI thresholds was compared using the Wilcoxon signed-rank test. The intracranial volume (ICV) of each scan was estimated by multiplying the number of voxels in the brain mask by the dimensions of each voxel for that scan. From this, we calculated the ICV ratio comparing manual and automated segmentation: ICVautomated/ICVmanual. To estimate the performance in a large number of scans, brain masks were generated from the 6 BET pipelines for 1095 longitudinal scans from 129 patients. Failure rates were estimated from visual inspection. ICV of each scan was estimated and an intraclass correlation (ICC) was estimated using a one-way ANOVA.Smoothing images improves brain extraction results using BET for all measures except specificity (all p<0.01, uncorrected), irrespective of the FI threshold. Using an FI of 0.01 or 0.1 performed better than 0.35. Thus, all reported results refer only to smoothed data using an FI of 0.01 or 0.1. Using an FI of 0.01 had a higher median sensitivity (0.9901) than an FI of 0.1 (0.9884, median difference: 0.0014, p<0.001), accuracy (0.9971 vs. 0.9971; median difference: 0.0001, p<0.001), and DSI (0.9895 vs. 0.9894; median difference: 0.0004, p<0.001) and lower specificity (0.9981 vs. 0.9982; median difference: -0.0001, p<0.001). These measures are all very high indicating that a range of FI values may produce visually indistinguishable brain extractions. Using smoothed data and an FI of 0.01, the mean (SD) ICV ratio was 1.002 (0.008); the mean being close to 1 indicates the ICV estimates are similar for automated and manual segmentation. In the 1095 longitudinal scans, this pipeline had a low failure rate (5.2%) and the ICC estimate was high (0.929, 95% CI: 0.91, 0.945) for successfully extracted brains.BET performs well at brain extraction on thresholded, 1mm(3) smoothed CT images with an FI of 0.01 or 0.1. Smoothing before applying BET is an important step not previously discussed in the literature. Analysis code is provided.

Project description:BackgroundEnd stage renal disease (ESRD) describes the most severe stage of chronic kidney disease (CKD), when patients need dialysis or renal transplant. There is often a delay in recognizing, diagnosing, and treating the various etiologies of CKD. The objective of the present study was to employ machine learning algorithms to develop a prediction model for progression to ESRD based on a large-scale multidimensional database.MethodsThis study analyzed 10,000,000 medical insurance claims from 550,000 patient records using a commercial health insurance database. Inclusion criteria were patients over the age of 18 diagnosed with CKD Stages 1-4. We compiled 240 predictor candidates, divided into six feature groups: demographics, chronic conditions, diagnosis and procedure features, medication features, medical costs, and episode counts. We used a feature embedding method based on implementation of the Word2Vec algorithm to further capture temporal information for the three main components of the data: diagnosis, procedures, and medications. For the analysis, we used the gradient boosting tree algorithm (XGBoost implementation).ResultsThe C-statistic for the model was 0.93 [(0.916-0.943) 95% confidence interval], with a sensitivity of 0.715 and specificity of 0.958. Positive Predictive Value (PPV) was 0.517, and Negative Predictive Value (NPV) was 0.981. For the top 1 percentile of patients identified by our model, the PPV was 1.0. In addition, for the top 5 percentile of patients identified by our model, the PPV was 0.71. All the results above were tested on the test data only, and the threshold used to obtain these results was 0.1. Notable features contributing to the model were chronic heart and ischemic heart disease as a comorbidity, patient age, and number of hypertensive crisis events.ConclusionsWhen a patient is approaching the threshold of ESRD risk, a warning message can be sent electronically to the physician, who will initiate a referral for a nephrology consultation to ensure an investigation to hasten the establishment of a diagnosis and initiate management and therapy when appropriate.

Dataset Information

Differentiation of low and high grade renal cell carcinoma on routine MRI with an externally validated automatic machine learning algorithm.

Publications

Differentiation of low and high grade renal cell carcinoma on routine MRI with an externally validated automatic machine learning algorithm.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets