Dataset Information

Comparison and development of machine learning tools in the prediction of chronic kidney disease progression.

ABSTRACT:

Background

Urinary protein quantification is critical for assessing the severity of chronic kidney disease (CKD). However, the current procedure for determining the severity of CKD is completed through evaluating 24-h urinary protein, which is inconvenient during follow-up.

Objective

To quickly predict the severity of CKD using more easily available demographic and blood biochemical features during follow-up, we developed and compared several predictive models using statistical, machine learning and neural network approaches.

Methods

The clinical and blood biochemical results from 551 patients with proteinuria were collected. Thirteen blood-derived tests and 5 demographic features were used as non-urinary clinical variables to predict the 24-h urinary protein outcome response. Nine predictive models were established and compared, including logistic regression, Elastic Net, lasso regression, ridge regression, support vector machine, random forest, XGBoost, neural network and k-nearest neighbor. The AU-ROC, sensitivity (recall), specificity, accuracy, log-loss and precision of each of the models were evaluated. The effect sizes of each variable were analysed and ranked.

Results

The linear models including Elastic Net, lasso regression, ridge regression and logistic regression showed the highest overall predictive power, with an average AUC and a precision above 0.87 and 0.8, respectively. Logistic regression ranked first, reaching an AUC of 0.873, with a sensitivity and specificity of 0.83 and 0.82, respectively. The model with the highest sensitivity was Elastic Net (0.85), while XGBoost showed the highest specificity (0.83). In the effect size analyses, we identified that ALB, Scr, TG, LDL and EGFR had important impacts on the predictability of the models, while other predictors such as CRP, HDL and SNA were less important.

Conclusions

Blood-derived tests could be applied as non-urinary predictors during outpatient follow-up. Features in routine blood tests, including ALB, Scr, TG, LDL and EGFR levels, showed predictive ability for CKD severity. The developed online tool can facilitate the prediction of proteinuria progress during follow-up in clinical practice.

SUBMITTER: Xiao J

PROVIDER: S-EPMC6458616 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparison and development of machine learning tools in the prediction of chronic kidney disease progression.

Xiao Jing J Ding Ruifeng R Xu Xiulin X Guan Haochen H Feng Xinhui X Sun Tao T Zhu Sibo S Ye Zhibin Z

Journal of translational medicine 20190411 1

<h4>Background</h4>Urinary protein quantification is critical for assessing the severity of chronic kidney disease (CKD). However, the current procedure for determining the severity of CKD is completed through evaluating 24-h urinary protein, which is inconvenient during follow-up.<h4>Objective</h4>To quickly predict the severity of CKD using more easily available demographic and blood biochemical features during follow-up, we developed and compared several predictive models using statistical, m ...[more]

PMID: 30971285

Similar Datasets

Project description:BACKGROUND:Chronic obstructive pulmonary disease (COPD) is a major public health problem and cause of mortality worldwide. However, COPD in the early stage is usually not recognized and diagnosed. It is necessary to establish a risk model to predict COPD development. METHODS:A total of 441 COPD patients and 192 control subjects were recruited, and 101 single-nucleotide polymorphisms (SNPs) were determined using the MassArray assay. With 5 clinical features as well as SNPs, 6 predictive models were established and evaluated in the training set and test set by the confusion matrix AU-ROC, AU-PRC, sensitivity (recall), specificity, accuracy, F1 score, MCC, PPV (precision) and NPV. The selected features were ranked. RESULTS:Nine SNPs were significantly associated with COPD. Among them, 6 SNPs (rs1007052, OR?=?1.671, P?=?0.010; rs2910164, OR?=?1.416, P?<?0.037; rs473892, OR?=?1.473, P?<?0.044; rs161976, OR?=?1.594, P?<?0.044; rs159497, OR?=?1.445, P?<?0.045; and rs9296092, OR?=?1.832, P?<?0.045) were risk factors for COPD, while 3 SNPs (rs8192288, OR?=?0.593, P?<?0.015; rs20541, OR?=?0.669, P?<?0.018; and rs12922394, OR?=?0.651, P?<?0.022) were protective factors for COPD development. In the training set, KNN, LR, SVM, DT and XGboost obtained AU-ROC values above 0.82 and AU-PRC values above 0.92. Among these models, XGboost obtained the highest AU-ROC (0.94), AU-PRC (0.97), accuracy (0.91), precision (0.95), F1 score (0.94), MCC (0.77) and specificity (0.85), while MLP obtained the highest sensitivity (recall) (0.99) and NPV (0.87). In the validation set, KNN, LR and XGboost obtained AU-ROC and AU-PRC values above 0.80 and 0.85, respectively. KNN had the highest precision (0.82), both KNN and LR obtained the same highest accuracy (0.81), and KNN and LR had the same highest F1 score (0.86). Both DT and MLP obtained sensitivity (recall) and NPV values above 0.94 and 0.84, respectively. In the feature importance analyses, we identified that AQCI, age, and BMI had the greatest impact on the predictive abilities of the models, while SNPs, sex and smoking were less important. CONCLUSIONS:The KNN, LR and XGboost models showed excellent overall predictive power, and the use of machine learning tools combining both clinical and SNP features was suitable for predicting the risk of COPD development.

Project description:Chronic kidney disease (CKD) patients have high risks of end-stage kidney disease (ESKD) and pre-ESKD death. Therefore, accurately predicting these outcomes is useful among CKD patients, especially in those who are at high risk. Thus, we evaluated whether a machine-learning system can predict accurately these risks in CKD patients and attempted its application by developing a Web-based risk-prediction system. We developed 16 risk-prediction machine-learning models using Random Forest (RF), Gradient Boosting Decision Tree, and eXtreme Gradient Boosting with 22 variables or selected variables for the prediction of the primary outcome (ESKD or death) on the basis of repeatedly measured data of CKD patients (n = 3,714; repeatedly measured data, n = 66,981) in their electronic-medical records. The performances of the models were evaluated using data from a cohort study of CKD patients carried out over 3 years (n = 26,906). One RF model with 22 variables and another RF model with 8 variables of time-series data showed high accuracies of the prediction of the outcomes and were selected for use in a risk-prediction system. In the validation, the 22- and 8-variable RF models showed high C-statistics for the prediction of the outcomes: 0.932 (95% CI 0.916, 0.948) and 0.93 (0.915, 0.945), respectively. Cox proportional hazards models using splines showed a highly significant relationship between the high probability and high risk of an outcome (p<0.0001). Moreover, the risks of patients with high probabilities were higher than those with low probabilities: 22-variable model, hazard ratio of 104.9 (95% CI 70.81, 155.3); 8-variable model, 90.9 (95% CI 62.29, 132.7). Then, a Web-based risk-prediction system was actually developed for the implementation of the models in clinical practice. This study showed that a machine-learning-based Web system is a useful tool for the risk prediction and treatment of CKD patients. Author summary Chronic kidney disease (CKD) patients have high risks of end-stage kidney disease (ESKD) and pre-ESKD death. Although the development of a new artificial intelligence (AI) model is expected to be useful for screening CKD patients at high risk, none of the models developed so far have yet been put into practical use. There are many reasons for the difficulties in developing and applying AI models to clinical settings: (1) AI models often have too many variables, some of which are uncommon, to input in busy clinical settings. (2) The accuracy of AI models to predict risks is not always high when evaluating nontarget patients’ prognoses. (3) The codes of AI models do not always match electronic medical records of different hospitals. Therefore, in this study, AI models with a small number of commonly used variables were developed. Then, their performances were rigorously evaluated on subgroups of CKD patients classified on the basis of kidney function, age, and diabetes mellitus. Moreover, we developed and opened a Web-based risk-prediction system using the selected AI models that showed the highest accuracies for clinical practice: http://160.16.88.112:8000/. Our study fills the gap between AI development in research and AI in clinical practice.

Dataset Information

Comparison and development of machine learning tools in the prediction of chronic kidney disease progression.

Background

Objective

Methods

Results

Conclusions

Publications

Comparison and development of machine learning tools in the prediction of chronic kidney disease progression.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets