Dataset Information

Challenges and caveats of a multi-center retrospective radiomics study: an example of early treatment response assessment for NSCLC patients using FDG-PET/CT radiomics.

ABSTRACT: BACKGROUND:Prognostic models based on individual patient characteristics can improve treatment decisions and outcome in the future. In many (radiomic) studies, small size and heterogeneity of datasets is a challenge that often limits performance and potential clinical applicability of these models. The current study is example of a retrospective multi-centric study with challenges and caveats. To highlight common issues and emphasize potential pitfalls, we aimed for an extensive analysis of these multi-center pre-treatment datasets, with an additional 18F-fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET/CT) scan acquired during treatment. METHODS:The dataset consisted of 138 stage II-IV non-small cell lung cancer (NSCLC) patients from four different cohorts acquired from three different institutes. The differences between the cohorts were compared in terms of clinical characteristics and using the so-called 'cohort differences model' approach. Moreover, the potential prognostic performances for overall survival of radiomic features extracted from CT or FDG-PET, or relative or absolute differences between the scans at the two time points, were assessed using the LASSO regression method. Furthermore, the performances of five different classifiers were evaluated for all image sets. RESULTS:The individual cohorts substantially differed in terms of patient characteristics. Moreover, the cohort differences model indicated statistically significant differences between the cohorts. Neither LASSO nor any of the tested classifiers resulted in a clinical relevant prognostic model that could be validated on the available datasets. CONCLUSION:The results imply that the study might have been influenced by a limited sample size, heterogeneous patient characteristics, and inconsistent imaging parameters. No prognostic performance of FDG-PET or CT based radiomics models can be reported. This study highlights the necessity of extensive evaluations of cohorts and of validation datasets, especially in retrospective multi-centric datasets.

SUBMITTER: van Timmeren JE

PROVIDER: S-EPMC6546238 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Challenges and caveats of a multi-center retrospective radiomics study: an example of early treatment response assessment for NSCLC patients using FDG-PET/CT radiomics.

van Timmeren Janna E JE Carvalho Sara S Leijenaar Ralph T H RTH Troost Esther G C EGC van Elmpt Wouter W de Ruysscher Dirk D Muratet Jean-Pierre JP Denis Fabrice F Schimek-Jasch Tanja T Nestle Ursula U Jochems Arthur A Woodruff Henry C HC Oberije Cary C Lambin Philippe P

PloS one 20190603 6

<h4>Background</h4>Prognostic models based on individual patient characteristics can improve treatment decisions and outcome in the future. In many (radiomic) studies, small size and heterogeneity of datasets is a challenge that often limits performance and potential clinical applicability of these models. The current study is example of a retrospective multi-centric study with challenges and caveats. To highlight common issues and emphasize potential pitfalls, we aimed for an extensive analysis ...[more]

PMID: 31158263

Similar Datasets

Project description:IntroductionImmunotherapy has improved outcomes for patients with non-small cell lung cancer (NSCLC), yet durable clinical benefit (DCB) is experienced in only a fraction of patients. Here, we test the hypothesis that radiomics features from baseline pretreatment 18F-FDG PET/CT scans can predict clinical outcomes of NSCLC patients treated with checkpoint blockade immunotherapy.MethodsThis study included 194 patients with histologically confirmed stage IIIB-IV NSCLC with pretreatment PET/CT images. Radiomics features were extracted from PET, CT, and PET+CT fusion images based on minimum Kullback-Leibler divergence (KLD) criteria. The radiomics features from 99 retrospective patients were used to train a multiparametric radiomics signature (mpRS) to predict DCB using an improved least absolute shrinkage and selection operator (LASSO) method, which was subsequently validated in both retrospective (N = 47) and prospective test cohorts (N = 48). Using these cohorts, the mpRS was also used to predict progression-free survival (PFS) and overall survival (OS) by training nomogram models using multivariable Cox regression analyses with additional clinical characteristics incorporated.ResultsThe mpRS could predict patients who will receive DCB, with areas under receiver operating characteristic curves (AUCs) of 0.86 (95%CI 0.79-0.94), 0.83 (95%CI 0.71-0.94), and 0.81 (95%CI 0.68-0.92) in the training, retrospective test, and prospective test cohorts, respectively. In the same three cohorts, respectively, nomogram models achieved C-indices of 0.74 (95%CI 0.68-0.80), 0.74 (95%CI 0.66-0.82), and 0.77 (95%CI 0.69-0.84) to predict PFS and C-indices of 0.83 (95%CI 0.77-0.88), 0.83 (95%CI 0.71-0.94), and 0.80 (95%CI 0.69-0.91) to predict OS.ConclusionPET/CT-based signature can be used prior to initiation of immunotherapy to identify NSCLC patients most likely to benefit from immunotherapy. As such, these data may be leveraged to improve more precise and individualized decision support in the treatment of patients with advanced NSCLC.

Project description:Purpose: This study aimed to compare the performance of radiomics and deep learning in predicting EGFR mutation status in patients with lung cancer based on PET/CT images, and tried to explore a model with excellent prediction performance to accurately predict EGFR mutation status in patients with non-small cell lung cancer (NSCLC). Method: PET/CT images of 194 NSCLC patients from Xijing Hospital were collected and divided into a training set and a validation set according to the ratio of 7:3. Statistics were made on patients' clinical characteristics, and a large number of features were extracted based on their PET/CT images (4306 radiomics features and 2048 deep learning features per person) with the pyradiomics toolkit and 3D convolutional neural network. Then a radiomics model (RM), a deep learning model (DLM), and a hybrid model (HM) were established. The performance of the three models was compared by receiver operating characteristic (ROC) curves, sensitivity, specificity, accuracy, calibration curves, and decision curves. In addition, a nomogram based on a deep learning score (DS) and the most significant clinical characteristic was plotted. Result: In the training set composed of 138 patients (64 with EGFR mutation and 74 without EGFR mutation), the area under the ROC curve (AUC) of HM (0.91, 95% CI: 0.86-0.96) was higher than that of RM (0.82, 95% CI: 0.75-0.89) and DLM (0.90, 95% CI: 0.85-0.95). In the validation set composed of 57 patients (32 with EGFR mutation and 25 without EGFR mutation), the AUC of HM (0.85, 95% CI: 0.77-0.93) was also higher than that of RM (0.68, 95% CI: 0.52-0.84) and DLM (0.79, 95% CI: 0.67-0.91). In all, HM achieved better diagnostic performance in predicting EGFR mutation status in NSCLC patients than two other models. Conclusion: Our study showed that the deep learning model based on PET/CT images had better performance than radiomics model in diagnosing EGFR mutation status of NSCLC patients based on PET/CT images. Combined with the most statistically significant clinical characteristic (smoking) and deep learning features, our hybrid model had better performance in predicting EGFR mutation types of patients than two other models, which could enable NSCLC patients to choose more personalized treatment schemes.

Dataset Information

Challenges and caveats of a multi-center retrospective radiomics study: an example of early treatment response assessment for NSCLC patients using FDG-PET/CT radiomics.

Publications

Challenges and caveats of a multi-center retrospective radiomics study: an example of early treatment response assessment for NSCLC patients using FDG-PET/CT radiomics.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets