Effect of machine learning methods on predicting NSCLC overall survival time based on Radiomics analysis.
Ontology highlight
ABSTRACT: Background
To investigate the effect of machine learning methods on predicting the Overall Survival (OS) for non-small cell lung cancer based on radiomics features analysis.Methods
A total of 339 radiomic features were extracted from the segmented tumor volumes of pretreatment computed tomography (CT) images. These radiomic features quantify the tumor phenotypic characteristics on the medical images using tumor shape and size, the intensity statistics and the textures. The performance of 5 feature selection methods and 8 machine learning methods were investigated for OS prediction. The predicted performance was evaluated with concordance index between predicted and true OS for the non-small cell lung cancer patients. The survival curves were evaluated by the Kaplan-Meier algorithm and compared by the log-rank tests.Results
The gradient boosting linear models based on Cox's partial likelihood method using the concordance index feature selection method obtained the best performance (Concordance Index: 0.68, 95% Confidence Interval: 0.62~ 0.74).Conclusions
The preliminary results demonstrated that certain machine learning and radiomics analysis method could predict OS of non-small cell lung cancer accuracy.
SUBMITTER: Sun W
PROVIDER: S-EPMC6173915 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Radiomics applies machine learning algorithms to quantitative imaging data to characterise the tumour phenotype and predict clinical outcome. For the development of radiomics risk models, a variety of different algorithms is available and it is not clear which one gives optimal results. Therefore, we assessed the performance of 11 machine learning algorithms combined with 12 feature selection methods by the concordance index (C-Index), to predict loco-regional tumour control (LRC) and overall survival for patients with head and neck squamous cell carcinoma. The considered algorithms are able to deal with continuous time-to-event survival data. Feature selection and model building were performed on a multicentre cohort (213 patients) and validated using an independent cohort (80 patients). We found several combinations of machine learning algorithms and feature selection methods which achieve similar results, e.g., msr-rfC-Index = 0.71 and BT-COX: C-Index = 0.70 in combination with Spearman feature selection. Using the best performing models, patients were stratified into groups of low and high risk of recurrence. Significant differences in LRC were obtained between both groups on the validation cohort. Based on the presented analysis, we identified a subset of algorithms which should be considered in future radiomics studies to develop stable and clinically relevant predictive models for time-to-event endpoints.
| S-EPMC5643429 | biostudies-literature
Project description:In this study, we tested and compared radiomics and deep learning-based approaches on the public LUNG1 dataset, for the prediction of 2-year overall survival (OS) in non-small cell lung cancer patients. Radiomic features were extracted from the gross tumor volume using Pyradiomics, while deep features were extracted from bi-dimensional tumor slices by convolutional autoencoder. Both radiomic and deep features were fed to 24 different pipelines formed by the combination of four feature selection/reduction methods and six classifiers. Direct classification through convolutional neural networks (CNNs) was also performed. Each approach was investigated with and without the inclusion of clinical parameters. The maximum area under the receiver operating characteristic on the test set improved from 0.59, obtained for the baseline clinical model, to 0.67 ± 0.03, 0.63 ± 0.03 and 0.67 ± 0.02 for models based on radiomic features, deep features, and their combination, and to 0.64 ± 0.04 for direct CNN classification. Despite the high number of pipelines and approaches tested, results were comparable and in line with previous works, hence confirming that it is challenging to extract further imaging-based information from the LUNG1 dataset for the prediction of 2-year OS.
| S-EPMC9391464 | biostudies-literature
Project description:Objective The goal of this study was to evaluate the efficacy of machine learning (ML) techniques in predicting survival for chordoma patients in comparison with the standard Cox proportional hazards (CoxPH) model. Methods Using a Surveillance, Epidemiology, and End Results database of consecutive newly diagnosed chordoma cases between January 2000 and December 2018, we created and validated three ML survival models as well as a traditional CoxPH model in this population-based cohort study. Randomly, the dataset was divided into training and validation datasets. Tuning hyperparameters on the training dataset involved a 1000-iteration random search with fivefold cross-validation. Concordance index (C-index), Brier score, and integrated Brier score were used to evaluate the performance of the model. The receiver operating characteristic (ROC) curves, calibration curves, and area under the ROC curves (AUC) were used to assess the reliability of the models by predicting 5- and 10-year survival probabilities. Results A total of 724 chordoma patients were divided into training (n = 508) and validation (n = 216) cohorts. Cox regression identified nine significant prognostic factors (p < 0.05). ML models showed superior performance over CoxPH model, with DeepSurv having the highest C-index (0.795) and the best discrimination for 5- and 10-year survival (AUC 0.84 and 0.88). Calibration curves revealed strong correlation between DeepSurv predictions and actual survival. Risk stratification by DeepSurv model effectively discriminated high- and low-risk groups (p < 0.01). The optimized DeepSurv model was implemented into a web application for clinical use that can be found at https://hust-chengp-ml-chordoma-app-19rjyr.streamlitapp.com/. Conclusion ML algorithms based on time-to-event results are effective in chordoma prediction, with DeepSurv having the best discrimination performance and calibration. Supplementary Information The online version contains supplementary material available at 10.1186/s13018-023-04105-9.
| S-EPMC10474690 | biostudies-literature
Project description:Purpose/objectivesMalignant pleural mesothelioma (MPM) is a rare but aggressive cancer arising from the cells of the thoracic pleura with a poor prognosis. We aimed to develop a model, via interpretable machine learning (ML) methods, predicting overall survival for MPM following radiotherapy based on dosimetric metrics as well as patient characteristics.Materials/methodsSixty MPM (37 right, 23 left) patients treated on a Tomotherapy unit between 2013 and 2018 were retrospectively analyzed. All patients received 45 Gy (25 fractions). The multivariable Cox regression (Cox PH) model and Survival Support Vector Machine (sSVM) were applied to build predictive models of overall survival (OS) based on clinical, dosimetric, and combined variables.ResultsSignificant differences in dosimetric endpoints for critical structures, i.e., the lung, heart, liver, kidney, and stomach, were observed according to target laterality. The OS was found to be insignificantly different (p = 0.18) between MPM patients who tested left- and right-sided, with 1-year OS of 77.3% and 75.0%, respectively. With Cox PH regression, considering dosimetric variables for right-sided patients alone, an increase in PTV_Min, Total_Lung_PTV_Mean, Contra_Lung_Volume, Contra_Lung_V20, Esophagus_Mean, and Heart_Volume had a greater hazard to all-cause death, while an increase in Total_Lung_PTV_V20, Contra_Lung_V5, and Esophagus_Max had a lower hazard to all-cause death. Considering clinical variables alone, males and increases in N stage had greater hazard to all-cause death; considering both clinical and dosimetric variables, increases in N stage, PTV_Mean, PTV_Min, and esophagus_Mean had greater hazard to all-cause death, while increases in T stage and Heart_V30 had lower hazard to all-cause-death. In terms of C-index, the Cox PH model and sSVM performed similarly and fairly well when considering clinical and dosimetric variables independently or jointly.ConclusionsClinical and dosimetric variables may predict the overall survival of mesothelioma patients, which could guide personalized treatment planning towards a better treatment response. The identified predictors and their impact on survival offered additional value for translational application in clinical practice.
| S-EPMC10416916 | biostudies-literature
Project description:Background: To develop machine-learning based models to predict the progression-free survival (PFS) and overall survival (OS) in patients with gliomas and explore the effect of different feature selection methods on the prediction. Methods: We included 505 patients (training cohort, n = 354; validation cohort, n = 151) with gliomas between January 1, 2011 and December 31, 2016. The clinical, neuroimaging, and molecular genetic data of patients were retrospectively collected. The multi-causes discovering with structure learning (McDSL) algorithm, least absolute shrinkage and selection operator regression (LASSO), and Cox proportional hazards regression model were employed to discover the predictors for 3-year PFS and OS, respectively. Eight machine learning classifiers with 5-fold cross-validation were developed to predict 3-year PFS and OS. The area under the curve (AUC) was used to evaluate the prognostic performance of classifiers. Results: McDSL identified four causal factors (tumor location, WHO grade, histologic type, and molecular genetic group) for 3-year PFS and OS, whereas LASSO and Cox identified wide-range number of factors associated with 3-year PFS and OS. The performance of each machine learning classifier based on McDSL, LASSO, and Cox was not significantly different. Logistic regression yielded the optimal performance in predicting 3-year PFS based on the McDSL (AUC, 0.872, 95% confidence interval [CI]: 0.828-0.916) and 3-year OS based on the LASSO (AUC, 0.901, 95% CI: 0.861-0.940). Conclusions: McDSL is more reproducible than LASSO and Cox model in the feature selection process. Logistic regression model may have the highest performance in predicting 3-year PFS and OS of gliomas.
| S-EPMC7890310 | biostudies-literature
Project description:This retrospective study aimed to predict the injury time of rib fractures in distinguishing fresh (30 days) or old (90 days) rib fractures. We enrolled 111 patients with chest trauma who had been scanned for rib fractures at our hospital between January 2018 and December 2018 using gemstone spectral imaging (GSI). The volume of interest of each broken end of the rib fractures was segmented using calcium-based material decomposition images derived from the GSI scans. The training and testing sets were randomly assigned in a 7:3 ratio. All cases were divided into groups distinguishing the injury time at 30 and 90 days. We constructed radiomics-based models to predict the injury time of rib fractures. The model performance was assessed by the area under the curve (AUC) obtained by the receiver operating characteristic analysis. We included 54 patients with 259 rib fracture segmentations (34 men; mean age, 52 years ± 12.02; and range, 19-72 years). Nine features were excluded by the least absolute shrinkage and selection operator logistic regression to build the radiomics signature. For distinguishing the injury time at 30 days, the Support Vector Machine (SVM) model and human-model collaboration resulted in an accuracy and AUC of 0.85 and 0.871 and 0.91 and 0.912, respectively, and 0.81 and 0.804 and 0.83 and 0.85, respectively, at 90 days in the testing set. The radiomics-based model displayed good accuracy in differentiating between the injury time of rib fractures at 30 and 90 days, and the human-model collaboration generated more accurate outcomes, which may help to add value to clinical practice and distinguish artificial injury in forensic medicine.
| S-EPMC9855073 | biostudies-literature
Project description:Background Ameloblastoma is a locally invasive and aggressive epithelial odontogenic neoplasm. The BRAF-V600E gene mutation is a prevalent genetic alteration found in this tumor and is considered to have a crucial role in its pathogenesis. The objective of this study is to develop and validate a radiomics-based machine learning method for the identification of BRAF-V600E gene mutations in ameloblastoma patients. Methods In this retrospective study, data from 103 patients diagnosed with ameloblastoma who underwent BRAF-V600E mutation testing were collected. Of these patients, 72 were included in the training cohort, while 31 were included in the validation cohort. To address class imbalance, synthetic minority over-sampling technique (SMOTE) is applied in our study. Radiomics features were extracted from preprocessed CT images, and the most relevant features, including both radiomics and clinical data, were selected for analysis. Machine learning methods were utilized to construct models. The performance of these models in distinguishing between patients with and without BRAF-V600E gene mutations was evaluated using the receiver operating characteristic (ROC) curve. Results When the analysis was based on radiomics signature, Random Forest performed better than the others, with the area under the ROC curve (AUC) of 0.87 (95%CI, 0.68-1.00). The performance of XGBoost model is slightly lower than that of Random Forest, and its AUC is 0.83 (95% CI, 0.60-1.00). The nomogram evident that among younger women, the affected region primarily lies within the mandible, and patients with larger tumor diameters exhibit a heightened risk. Additionally, patients with higher radiomics signature scores are more susceptible to the BRAF-V600E gene mutations. Conclusions Our study presents a comprehensive radiomics-based machine learning model using five different methods to accurately detect BRAF-V600E gene mutations in patients diagnosed with ameloblastoma. The Random Forest model’s high predictive performance, with AUC of 0.87, demonstrates its potential for facilitating a convenient and cost-effective way of identifying patients with the mutation without the need for invasive tumor sampling for molecular testing. This non-invasive approach has the potential to guide preoperative or postoperative drug treatment for affected individuals, thereby improving outcomes.
| S-EPMC10461083 | biostudies-literature
Project description:Approximately 30% of medulloblastoma (MB) patients exhibit metastasis at initial diagnosis, which often leads to a poor prognosis. Here, by using univariate Cox regression analysis, two machine learning methods (Lasso-penalized Cox regression and random survival forest-variable hunting (RSF-VH)), and multivariate Cox regression analysis, we established two metastasis-related prognostic models, including the 47-mRNA-based model based on the Lasso method and the 21-mRNA-based model based on the RSF-VH method. In terms of the results of the receiver operating characteristic (ROC) curve analyses, we selected the 47-mRNA metastasis-associated model with the higher area under the curve (AUC). The 47-mRNA-based prognostic model could classify MB patients into two subgroups with different prognoses. The ROC analyses also suggested that the 47-mRNA metastasis-associated model may have a better predictive ability than MB subgroup. Multivariable Cox regression analysis demonstrated that the 47-mRNA-based model was independent of other clinical characteristics. In addition, a nomogram comprising the 47-mRNA-based model was built. The results of ROC analyses suggested that the nomogram had good discrimination ability. Our 47-mRNA metastasis-related prognostic model and nomogram might be an efficient and valuable tool for overall survival (OS) prediction and provide information for individualized treatment decisions in patients with MB.
| S-EPMC7695392 | biostudies-literature
Project description:PURPOSE:This study aimed to investigate the effectiveness of using delta-radiomics to predict overall survival (OS) for patients with recurrent malignant gliomas treated by concurrent stereotactic radiosurgery and bevacizumab, and to investigate the effectiveness of machine learning methods for delta-radiomics feature selection and building classification models. METHODS:The pre-treatment, one-week post-treatment, and two-month post-treatment T1 and T2 fluid-attenuated inversion recovery (FLAIR) MRI were acquired. 61 radiomic features (intensity histogram-based, morphological, and texture features) were extracted from the gross tumor volume in each image. Delta-radiomics were calculated between the pre-treatment and post-treatment features. Univariate Cox regression and 3 multivariate machine learning methods (L1-regularized logistic regression [L1-LR], random forest [RF] or neural networks [NN]) were used to select a reduced number of features, and 7 machine learning methods (L1-LR, L2-LR, RF, NN, kernel support vector machine [KSVM], linear support vector machine [LSVM], or naïve bayes [NB]) was used to build classification models for predicting OS. The performances of the total 21 model combinations built based on single-time-point radiomics (pre-treatment, one-week post-treatment, and two-month post-treatment) and delta-radiomics were evaluated by the area under the receiver operating characteristic curve (AUC). RESULTS:For a small cohort of 12 patients, delta-radiomics resulted in significantly higher AUC than pre-treatment radiomics (p-value<0.01). One-week/two-month delta-features resulted in significantly higher AUC (p-value<0.01) than the one-week/two-month post-treatment features, respectively. 18/21 model combinations were with higher AUC from one-week delta-features than two-month delta-features. With one-week delta-features, RF feature selector + KSVM classifier and RF feature selector + NN classifier showed the highest AUC of 0.889. CONCLUSIONS:The results indicated that delta-features could potentially provide better treatment assessment than single-time-point features. The treatment assessment is substantially affected by the time point for computing the delta-features and the combination of machine learning methods for feature selection and classification.
| S-EPMC6910670 | biostudies-literature
Project description:PurposeTo construct machine learning models for predicting progression free survival (PFS) and overall survival (OS) with esophageal squamous cell carcinoma (ESCC) patients.Methods204 ESCC patients were randomly divided into training cohort (n = 143) and test cohort (n = 61) according to the ratio of 7:3. Two radiomics models were constructed by radiomics features, which were selected by LASSO Cox model to predict PFS and OS, respectively. Clinical features were selected by univariate and multivariate Cox proportional hazards model (p < 0.05). Combined radiomics and clinical model was developed by selected clinical and radiomics features. The receiver operating characteristic curve, Kaplan Meier curve and nomogram were used to display the capability of constructed models.ResultsThere were 944 radiomics features extracted based on volume of interest in CT images. There were six radiomics features and seven clinical features for PFS prediction and three radiomics features and three clinical features for OS prediction; The radiomics models showed general performance in training cohort and test cohort for prediction for prediction PFS (AUC, 0.664, 0.676. C-index, 0.65, 0.64) and OS (AUC, 0.634, 0.646.C-index, 0.64, 0.65). The combined models displayed high performance in training cohort and test cohort for prediction PFS (AUC, 0.856, 0.833. C-index, 0.81, 0.79) and OS (AUC, 0.742, 0.768. C-index, 0.72, 0.71).ConclusionWe developed combined radiomics and clinical machine learning models with better performance than radiomics or clinical alone, which were used to accurate predict 3 years PFS and OS of non-surgical ESCC patients. The prediction results could provide a reference for clinical decision.
| S-EPMC9795769 | biostudies-literature