Dataset Information

Developing a clinical utility framework to evaluate prediction models in radiogenomics.

ABSTRACT: Combining imaging and genetic information to predict disease presence and behavior is being codified into an emerging discipline called "radiogenomics." Optimal evaluation methodologies for radiogenomics techniques have not been established. We aim to develop a clinical decision framework based on utility analysis to assess prediction models for breast cancer. Our data comes from a retrospective case-control study, collecting Gail model risk factors, genetic variants (single nucleotide polymorphisms-SNPs), and mammographic features in Breast Imaging Reporting and Data System (BI-RADS) lexicon. We first constructed three logistic regression models built on different sets of predictive features: (1) Gail, (2) Gail+SNP, and (3) Gail+SNP+BI-RADS. Then, we generated ROC curves for three models. After we assigned utility values for each category of findings (true negative, false positive, false negative and true positive), we pursued optimal operating points on ROC curves to achieve maximum expected utility (MEU) of breast cancer diagnosis. We used McNemar's test to compare the predictive performance of the three models. We found that SNPs and BI-RADS features augmented the baseline Gail model in terms of the area under ROC curve (AUC) and MEU. SNPs improved sensitivity of the Gail model (0.276 vs. 0.147) and reduced specificity (0.855 vs. 0.912). When additional mammographic features were added, sensitivity increased to 0.457 and specificity to 0.872. SNPs and mammographic features played a significant role in breast cancer risk estimation (p-value < 0.001). Our decision framework comprising utility analysis and McNemar's test provides a novel framework to evaluate prediction models in the realm of radiogenomics.

SUBMITTER: Wu Y

PROVIDER: S-EPMC4834184 | biostudies-literature | 2015 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing a clinical utility framework to evaluate prediction models in radiogenomics.

Wu Yirong Y Liu Jie J Del Rio Alejandro Munoz AM Page David C DC Alagoz Oguzhan O Peissig Peggy P Onitilo Adedayo A AA Burnside Elizabeth S ES

Proceedings of SPIE--the International Society for Optical Engineering 20150201

Combining imaging and genetic information to predict disease presence and behavior is being codified into an emerging discipline called "radiogenomics." Optimal evaluation methodologies for radiogenomics techniques have not been established. We aim to develop a clinical decision framework based on utility analysis to assess prediction models for breast cancer. Our data comes from a retrospective case-control study, collecting Gail model risk factors, genetic variants (single nucleotide polymorph ...[more]

PMID: 27095854

Similar Datasets

Project description:Objectives: To evaluate whether incorporating the radiomics, genomics, and clinical features allows prediction of metastasis in colorectal cancer (CRC) and to develop a preoperative nomogram for predicting metastasis. Methods: We retrospectively analyzed radiomics features of computed tomography (CT) images in 134 patients (62 in the primary cohort, 28 in the validation cohort, and 44 in the independent-test cohort) clinicopathologically diagnosed with CRC at Dazhou Central Hospital from February 2018 to October 2019. Tumor tissues were collected from all patients for RNA sequencing, and clinical data were obtained from medical records. A total of 854 radiomics features were extracted from enhanced venous-phase CT of CRC. Least absolute shrinkage and selection operator regression analysis was utilized for data dimension reduction, feature screen, and radiomics signature development. Multivariable logistic regression analysis was performed to build a multiscale predicting model incorporating the radiomics, genomics, and clinical features. The receiver operating characteristic curve, calibration curve, and decision curve were conducted to evaluate the performance of the nomogram. Results: The radiomics signature based on 16 selected radiomics features showed good performance in metastasis assessment in both primary [area under the curve (AUC) = 0.945, 95% confidence interval (CI) 0.892-0.998] and validation cohorts (AUC = 0.754, 95% CI 0.570-0.938). The multiscale nomogram model contained radiomics features signatures, four-gene expression related to cell cycle pathway, and CA 19-9 level. The multiscale model showed good discrimination performance in the primary cohort (AUC = 0.981, 95% CI 0.953-1.000), the validation cohort (AUC = 0.822, 95% CI 0.635-1.000), and the independent-test cohort (AUC = 0.752, 95% CI 0.608-0.896) and good calibration. Decision curve analysis confirmed the clinical application value of the multiscale model. Conclusion: This study presented a multiscale model that incorporated the radiological eigenvalues, genomics features, and CA 19-9, which could be conveniently utilized to facilitate the individualized preoperatively assessing metastasis in CRC patients.

Dataset Information

Developing a clinical utility framework to evaluate prediction models in radiogenomics.

Publications

Developing a clinical utility framework to evaluate prediction models in radiogenomics.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets