Dataset Information

Risk stratification of papillary thyroid cancers using multidimensional machine learning.

ABSTRACT:

Background

Papillary thyroid cancer (PTC) is one of the most common endocrine malignancies with different risk levels. However, preoperative risk assessment of PTC is still a challenge in the worldwide. Here, we first report a Preoperative Risk Assessment Classifier for PTC (PRAC-PTC) by multidimensional features including clinical indicators, immune indices, genetic feature, and proteomics.

Materials and methods

The 558 patients collected from June 2013 to November 2020 were allocated to three groups: discovery set (274 patients, 274 FFPE), retrospective test set (166 patients, 166 FFPE) and prospective test set (118 patients, 118 FNA). Proteomic profiling was conducted by formalin-fixed paraffin-embedded (FFPE) and fine-needle aspiration (FNA) tissues from the patients. Preoperative clinical information and blood immunological indices were collected. The BRAFV600E mutation were detected by the amplification refractory mutation system (ARMS).

Results

We developed a machine learning model of 17 variables based on multidimensional features of 274 PTC patients from a retrospective cohort. The PRAC-PTC achieved areas under the curve (AUC) of 0.925 in the discovery set and validated externally by blinded analyses in a retrospective cohort of 166 PTC patients (0.787 AUC) and a prospective cohort of 118 PTC patients (0.799 AUC) from two independent clinical centres. Meanwhile, the preoperative predictive risk effectiveness of clinicians was improved with the assistance of PRAC-PTC, and the accuracies reached at 84.4% (95% CI 82.9-84.4) and 83.5% (95% CI 82.2-84.2) in the retrospective and prospective test sets, respectively.

Conclusion

This study demonstrated that the PRAC-PTC that integrating clinical data, gene mutation information, immune indices, high-throughput proteomics and machine learning technology in multi-centre retrospective and prospective clinical cohorts can effectively stratify the preoperative risk of PTC and may decrease unnecessary surgery or overtreatment.

SUBMITTER: Li Y

PROVIDER: S-EPMC10793787 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Risk stratification of papillary thyroid cancers using multidimensional machine learning.

Li Yuanhui Y Wu Fan F Ge Weigang W Zhang Yu Y Hu Yifan Y Zhao Lingqian L Gou Wanglong W Shi Jingjing J Ni Yeqin Y Li Lu L Fu Wenxin W Lin Xiangfeng X Yu Yunxian Y Han Zhijiang Z Chen Chuanghua C Xu Rujun R Zhang Shirong S Zhou Li L Pan Gang G Peng You Y Mao Linlin L Zhou Tianhan T Zheng Jusheng J Zheng Haitao H Sun Yaoting Y Guo Tiannan T Luo Dingcun D

International journal of surgery (London, England) 20240101 1

<h4>Background</h4>Papillary thyroid cancer (PTC) is one of the most common endocrine malignancies with different risk levels. However, preoperative risk assessment of PTC is still a challenge in the worldwide. Here, the authors first report a Preoperative Risk Assessment Classifier for PTC (PRAC-PTC) by multidimensional features including clinical indicators, immune indices, genetic feature, and proteomics.<h4>Materials and methods</h4>The 558 patients collected from June 2013 to November 2020 ...[more]

PMID: 37916932

Similar Datasets

Project description:Importance:Thyroid nodules are common incidental findings. Ultrasonography and molecular testing can be used to assess risk of malignant neoplasm. Objective:To examine whether a model developed through automated machine learning can stratify thyroid nodules as high or low genetic risk by ultrasonography imaging alone compared with stratification by molecular testing for high- and low-risk mutations. Design, Setting, and Participants:This diagnostic study was conducted at a single tertiary care urban academic institution and included patients (n?=?121) who underwent ultrasonography and molecular testing for thyroid nodules from January 1, 2017, through August 1, 2018. Nodules were classified as high risk or low risk on the basis of results of an institutional molecular testing panel for thyroid risk genes. All thyroid nodules that underwent genetic sequencing for cytological results with Bethesda System categories III and IV were reviewed. Patients without diagnostic ultrasonographic images within 6 months of fine-needle aspiration or who received definitive treatment at an outside medical center were excluded. Main Outcomes and Measures:Thyroid nodules were categorized by the model as high risk or low risk using ultrasonographic images. Results were compared using genetic testing. Results:Among the 134 lesions identified in 121 patients (mean [SD] age, 55.7 [14.2] years; 102 women [84.3%]), 683 diagnostic ultrasonographic images were selected. Of the 683 images, 556 (81.4%) were used for training the model, 74 (10.8%) for validation, and 53 (7.8%) for testing. Most nodules had no mutation (75 [56.0%]), whereas 43 nodules (32.1%) had a high-risk mutation and 16 (11.9%) had an unknown or a low-risk mutation (?2?=?39.060; P?<?.001). In total, 228 images (33.4%) were of nodules classified as genetically high risk (n?=?43), and 455 (66.6%) were of low-risk nodules (n?=?91). The model performed with a sensitivity of 45% (95% CI,?23.1%-68.5%), a specificity of 97% (95% CI,?84.2%-99.9%), a positive predictive value of 90% (95% CI,?55.2%-98.5%), a negative predictive value of 74.4% (95% CI,?66.1%-81.3%), and an overall accuracy of 77.4% (95% CI,?63.8%-97.7%). Conclusions and Relevance:The study found that the model developed through automated machine learning could produce high specificity for identifying nodules with high-risk mutations on molecular testing. This finding shows promise for the diagnostic applications of machine learning interpretation of sonographic imaging of indeterminate thyroid nodules.

Project description:BackgroundAlthough papillary thyroid cancer (PTC) patients are known to have an excellent prognosis, up to 30% of patients experience disease recurrence after initial treatment. Accurately predicting disease prognosis remains a challenge given that the predictive value of several predictors remains controversial. Thus, we investigated whether machine learning (ML) approaches based on comprehensive predictors can predict the risk of structural recurrence for PTC patients.MethodsA total of 2244 patients treated with thyroid surgery and radioiodine were included. Twenty-nine perioperative variables consisting of four dimensions (demographic characteristics and comorbidities, tumor-related variables, lymph node (LN)-related variables, and metabolic and inflammatory markers) were analyzed. We applied five ML algorithms-logistic regression (LR), support vector machine (SVM), extreme gradient boosting (XGBoost), random forest (RF), and neural network (NN)-to develop the models. The area under the receiver operating characteristic (AUC-ROC) curve, calibration curve, and variable importance were used to evaluate the models' performance.ResultsDuring a median follow-up of 45.5 months, 179 patients (8.0%) experienced structural recurrence. The non-stimulated thyroglobulin, LN dissection, number of LNs dissected, lymph node metastasis ratio, N stage, comorbidity of hypertension, comorbidity of diabetes, body mass index, and low-density lipoprotein were used to develop the models. All models showed a greater AUC (AUC = 0.738 to 0.767) than did the ATA risk stratification (AUC = 0.620, DeLong test: P < 0.01). The SVM, XGBoost, and RF model showed greater sensitivity (0.568, 0.595, 0.676), specificity (0.903, 0.857, 0.784), accuracy (0.875, 0.835, 0.775), positive predictive value (PPV) (0.344, 0.272, 0.219), negative predictive value (NPV) (0.959, 0.959, 0.964), and F1 score (0.429, 0.373, 0.331) than did the ATA risk stratification (sensitivity = 0.432, specificity = 0.770, accuracy = 0.742, PPV = 0.144, NPV = 0.938, F1 score = 0.216). The RF model had generally consistent calibration compared with the other models. The Tg and the LNR were the top 2 important variables in all the models, the N stage was the top 5 important variables in all the models.ConclusionsThe RF model achieved the expected prediction performance with generally good discrimination, calibration and interpretability in this study. This study sheds light on the potential of ML approaches for improving the accuracy of risk stratification for PTC patients.Trial registrationRetrospectively registered at www.chictr.org.cn (trial registration number: ChiCTR2300075574, date of registration: 2023-09-08).

Project description:Diabetes mellitus is a group of metabolic diseases in which blood sugar levels are too high. About 8.8% of the world was diabetic in 2017. It is projected that this will reach nearly 10% by 2045. The major challenge is that when machine learning-based classifiers are applied to such data sets for risk stratification, leads to lower performance. Thus, our objective is to develop an optimized and robust machine learning (ML) system under the assumption that missing values or outliers if replaced by a median configuration will yield higher risk stratification accuracy. This ML-based risk stratification is designed, optimized and evaluated, where: (i) the features are extracted and optimized from the six feature selection techniques (random forest, logistic regression, mutual information, principal component analysis, analysis of variance, and Fisher discriminant ratio) and combined with ten different types of classifiers (linear discriminant analysis, quadratic discriminant analysis, naïve Bayes, Gaussian process classification, support vector machine, artificial neural network, Adaboost, logistic regression, decision tree, and random forest) under the hypothesis that both missing values and outliers when replaced by computed medians will improve the risk stratification accuracy. Pima Indian diabetic dataset (768 patients: 268 diabetic and 500 controls) was used. Our results demonstrate that on replacing the missing values and outliers by group median and median values, respectively and further using the combination of random forest feature selection and random forest classification technique yields an accuracy, sensitivity, specificity, positive predictive value, negative predictive value and area under the curve as: 92.26%, 95.96%, 79.72%, 91.14%, 91.20%, and 0.93, respectively. This is an improvement of 10% over previously developed techniques published in literature. The system was validated for its stability and reliability. RF-based model showed the best performance when outliers are replaced by median values.

Project description:BackgroundPrecise risk stratification-based treatment of solitary intrathyroidal papillary thyroid cancer (SI-PTC) that is larger than 1.0 cm and 4.0 cm or less is undefined.MethodsA genetic-clinical risk study was performed on BRAF V600E in 955 patients (768 women and 187 men) with SI-PTC, with median age of 46 years and median clinical follow-up time of 64 months at 11 medical centers in six countries. The chi-square test or, for analyses with small numbers, Fisher's exact test was performed to compare recurrence rates. Recurrence-free probability was estimated by Kaplan-Meier (KM) analysis, and the independent effect of BRAF mutation on the recurrence was analyzed by Cox regression and Cox proportional hazard analyses. All statistical tests were two-sided.ResultsRecurrence of SI-PTC larger than 1.0 cm and 4.0 cm or less was 9.5% (21/221) vs 3.4% (11/319) in BRAF mutation vs wild-type BRAF patients, with a hazard ratio (HR) of 3.03 (95% confidence interval [CI] = 1.46 to 6.30) and a patient age- and sex-adjusted hazard ratio of 3.10 (95% CI = 1.49 to 6.45, P = .002). Recurrence rates of SI-PTC larger than 2.0 cm and 4.0 cm or less were 16.5% (13/79) vs 3.6% (5/139) in mutation vs wild-type patients (HR = 5.44, 95% CI = 1.93 to 15.34; and adjusted HR = 5.58, 95% CI = 1.96 to 15.85, P = .001). Recurrence rates of SI-PTC larger than 3.0 cm and 4 cm or less were 30.0% (6/20) vs 1.9% (1/54) in mutation vs wild-type patients (HR = 18.40, 95% CI = 2.21 to 152.98; and adjusted HR = 14.73, 95% CI = 1.74 to 124.80, P = .01). Recurrences of mutation-positive SI-PTC were comparable with those of counterpart invasive solitary PTC, around 20% to 30%, in tumors larger than 2.0 cm to 3.0 cm. BRAF mutation was associated with a statistically significant decrease in recurrence-free patient survival on KM analysis, particularly in SI-PTC larger than 2.0 cm and 4.0 cm or less. Similar results were obtained in conventional SI-PTC. The negative predictive values of BRAF mutation for recurrence were 97.8% (95% CI = 96.3% to 98.8%) for general SI-PTC and 98.2% (95% CI = 96.3% to 99.3%) for conventional SI-PTC.ConclusionsBRAF V600E identifies a subgroup of SI-PTC larger than 1.0 cm and 4.0 cm or less, particularly tumors larger than 2.0 cm and 4.0 cm or less, that has high risk for recurrence comparable with that of invasive solitary PTC, making more aggressive treatment reasonable.

Dataset Information

Risk stratification of papillary thyroid cancers using multidimensional machine learning.

Background

Materials and methods

Results

Conclusion

Publications

Risk stratification of papillary thyroid cancers using multidimensional machine learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets