Dataset Information

Quality Reporting of Radiomics Analysis in Mild Cognitive Impairment and Alzheimer's Disease: A Roadmap for Moving Forward.

ABSTRACT: Objective: To evaluate radiomics analysis in studies on mild cognitive impairment (MCI) and Alzheimer's disease (AD) using a radiomics quality score (RQS) system to establish a roadmap for further improvement in clinical use.

Materials and methods: PubMed MEDLINE and EMBASE were searched using the terms 'cognitive impairment' or 'Alzheimer' or 'dementia' and 'radiomic' or 'texture' or 'radiogenomic' for articles published until March 2020. From 258 articles, 26 relevant original research articles were selected. Two neuroradiologists assessed the quality of the methodology according to the RQS. Adherence rates for the following six key domains were evaluated: image protocol and reproducibility, feature reduction and validation, biologic/clinical utility, performance index, high level of evidence, and open science.

Results: The hippocampus was the most frequently analyzed (46.2%) anatomical structure. Of the 26 studies, 16 (61.5%) used an open source database (14 from Alzheimer's Disease Neuroimaging Initiative and 2 from Open Access Series of Imaging Studies). The mean RQS was 3.6 out of 36 (9.9%), and the basic adherence rate was 27.6%. Only one study (3.8%) performed external validation. The adherence rate was relatively high for reporting the imaging protocol (96.2%), multiple segmentation (76.9%), discrimination statistics (69.2%), and open science and data (65.4%) but low for conducting test-retest analysis (7.7%) and biologic correlation (3.8%). None of the studies stated potential clinical utility, conducted a phantom study, performed cut-off analysis or calibration statistics, was a prospective study, or conducted cost-effectiveness analysis, resulting in a low level of evidence.

Conclusion: The quality of radiomics reporting in MCI and AD studies is suboptimal. Validation is necessary using external dataset, and improvements need to be made to feature reproducibility, feature selection, clinical utility, model performance index, and pursuits of a higher level of evidence.

SUBMITTER: Won SY

PROVIDER: S-EPMC7689149 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Quality Reporting of Radiomics Analysis in Mild Cognitive Impairment and Alzheimer's Disease: A Roadmap for Moving Forward.

Won So Yeon SY Park Yae Won YW Park Mina M Ahn Sung Soo SS Kim Jinna J Lee Seung Koo SK

Korean journal of radiology 20201030 12

<h4>Objective</h4>To evaluate radiomics analysis in studies on mild cognitive impairment (MCI) and Alzheimer's disease (AD) using a radiomics quality score (RQS) system to establish a roadmap for further improvement in clinical use.<h4>Materials and methods</h4>PubMed MEDLINE and EMBASE were searched using the terms 'cognitive impairment' or 'Alzheimer' or 'dementia' and 'radiomic' or 'texture' or 'radiogenomic' for articles published until March 2020. From 258 articles, 26 relevant original res ...[more]

PMID: 33169553

Similar Datasets

Project description:ObjectiveThis study aimed to build and validate a radiomics-integrated model with whole-brain magnetic resonance imaging (MRI) to predict the progression of mild cognitive impairment (MCI) to Alzheimer's disease (AD).Methods357 patients with MCI were selected from the ADNI database, which is an open-source database for AD with multicentre cooperation, of which 154 progressed to AD during the 48-month follow-up period. Subjects were divided into a training and test group. For each patient, the baseline T1WI MR images were automatically segmented into white matter, gray matter and cerebrospinal fluid (CSF), and radiomics features were extracted from each tissue. Based on the data from the training group, a radiomics signature was built using logistic regression after dimensionality reduction. The radiomics signatures, in combination with the apolipoprotein E4 (APOE4) and baseline neuropsychological scales, were used to build an integrated model using machine learning. The receiver operating characteristics (ROC) curve and data of the test group were used to evaluate the diagnostic accuracy and reliability of the model, respectively. In addition, the clinical prognostic efficacy of the model was evaluated based on the time of progression from MCI to AD.ResultsStepwise logistic regression analysis showed that the APOE4, clinical dementia rating, AD assessment scale, and radiomics signature were independent predictors of MCI progression to AD. The integrated model was constructed based on independent predictors using machine learning. The ROC curve showed that the accuracy of the model in the training and the test sets was 0.814 and 0.807, with a specificity of 0.671 and 0.738, and a sensitivity of 0.822 and 0.745, respectively. In addition, the model had the most significant diagnostic efficacy in predicting MCI progression to AD within 12 months, with an AUC of 0.814, sensitivity of 0.726, and specificity of 0.798.ConclusionThe integrated model based on whole-brain radiomics can accurately identify and predict the high-risk population of MCI patients who may progress to AD. Radiomics biomarkers are practical in the precursory stage of such disease.

Project description:Alzheimer's Disease (AD) and Mild Cognitive Impairment (MCI) are closely associated with Tau proteins accumulation. In this study, we aimed to implement radiomics analysis to discover high-order features from pathological biomarker and improve the classification accuracy based on Tau PET images. Two cross-racial independent cohorts from the ADNI database (121 AD patients, 197 MCI patients and 211 normal control (NC) subjects) and Huashan hospital (44 AD patients, 33 MCI patients and 36 NC subjects) were enrolled. The radiomics features of Tau PET imaging of AD related brain regions were computed for classification using a support vector machine (SVM) model. The radiomics model was trained and validated in the ADNI cohort and tested in the Huashan hospital cohort. The standard uptake value ratio (SUVR) and clinical scores model were also performed to compared with radiomics analysis. Additionally, we explored the possibility of using Tau PET radiomics features as a good biomarker to make binary identification of Tau-negative MCI versus Tau-positive MCI or apolipoprotein E (ApoE) ε4 carrier versus ApoE ε4 non-carrier. We found that the radiomics model demonstrated best classification performance in differentiating AD/MCI patients and NC in comparison to SUVR and clinical scores models, with an accuracy of 84.8 ± 4.5%, 73.1 ± 3.6% in the ANDI cohort. Moreover, the radiomics model also demonstrated greater performance in diagnosing AD than other methods in the Huashan hospital cohort, with an accuracy of 81.9 ± 6.1%. In addition, the radiomics model also showed the satisfactory classification performance in the MCI-tau subgroup experiment (72.3 ± 3.5%, 71.9 ± 3.6% and 63.7 ± 5.9%) and in the MCI-ApoE subgroup experiment (73.5 ± 4.3%, 70.1 ± 3.9% and 62.5 ± 5.4%). In conclusion, our study showed that based on Tau PET radiomics analysis has the potential to guide and facilitate clinical diagnosis, further providing evidence for identifying the risk factors in MCI patients.

Project description:Effective and accurate diagnosis of Alzheimer's disease (AD), as well as its prodromal stage (i.e., mild cognitive impairment (MCI)), has attracted more and more attention recently. So far, multiple biomarkers have been shown to be sensitive to the diagnosis of AD and MCI, i.e., structural MR imaging (MRI) for brain atrophy measurement, functional imaging (e.g., FDG-PET) for hypometabolism quantification, and cerebrospinal fluid (CSF) for quantification of specific proteins. However, most existing research focuses on only a single modality of biomarkers for diagnosis of AD and MCI, although recent studies have shown that different biomarkers may provide complementary information for the diagnosis of AD and MCI. In this paper, we propose to combine three modalities of biomarkers, i.e., MRI, FDG-PET, and CSF biomarkers, to discriminate between AD (or MCI) and healthy controls, using a kernel combination method. Specifically, ADNI baseline MRI, FDG-PET, and CSF data from 51AD patients, 99 MCI patients (including 43 MCI converters who had converted to AD within 18 months and 56 MCI non-converters who had not converted to AD within 18 months), and 52 healthy controls are used for development and validation of our proposed multimodal classification method. In particular, for each MR or FDG-PET image, 93 volumetric features are extracted from the 93 regions of interest (ROIs), automatically labeled by an atlas warping algorithm. For CSF biomarkers, their original values are directly used as features. Then, a linear support vector machine (SVM) is adopted to evaluate the classification accuracy, using a 10-fold cross-validation. As a result, for classifying AD from healthy controls, we achieve a classification accuracy of 93.2% (with a sensitivity of 93% and a specificity of 93.3%) when combining all three modalities of biomarkers, and only 86.5% when using even the best individual modality of biomarkers. Similarly, for classifying MCI from healthy controls, we achieve a classification accuracy of 76.4% (with a sensitivity of 81.8% and a specificity of 66%) for our combined method, and only 72% even using the best individual modality of biomarkers. Further analysis on MCI sensitivity of our combined method indicates that 91.5% of MCI converters and 73.4% of MCI non-converters are correctly classified. Moreover, we also evaluate the classification performance when employing a feature selection method to select the most discriminative MR and FDG-PET features. Again, our combined method shows considerably better performance, compared to the case of using an individual modality of biomarkers.

Dataset Information

Quality Reporting of Radiomics Analysis in Mild Cognitive Impairment and Alzheimer's Disease: A Roadmap for Moving Forward.

Publications

Quality Reporting of Radiomics Analysis in Mild Cognitive Impairment and Alzheimer's Disease: A Roadmap for Moving Forward.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets