Dataset Information

Survival prediction models since liver transplantation - comparisons between Cox models and machine learning techniques.

ABSTRACT:

Background

Predicting survival of recipients after liver transplantation is regarded as one of the most important challenges in contemporary medicine. Hence, improving on current prediction models is of great interest.Nowadays, there is a strong discussion in the medical field about machine learning (ML) and whether it has greater potential than traditional regression models when dealing with complex data. Criticism to ML is related to unsuitable performance measures and lack of interpretability which is important for clinicians.

Methods

In this paper, ML techniques such as random forests and neural networks are applied to large data of 62294 patients from the United States with 97 predictors selected on clinical/statistical grounds, over more than 600, to predict survival from transplantation. Of particular interest is also the identification of potential risk factors. A comparison is performed between 3 different Cox models (with all variables, backward selection and LASSO) and 3 machine learning techniques: a random survival forest and 2 partial logistic artificial neural networks (PLANNs). For PLANNs, novel extensions to their original specification are tested. Emphasis is given on the advantages and pitfalls of each method and on the interpretability of the ML techniques.

Results

Well-established predictive measures are employed from the survival field (C-index, Brier score and Integrated Brier Score) and the strongest prognostic factors are identified for each model. Clinical endpoint is overall graft-survival defined as the time between transplantation and the date of graft-failure or death. The random survival forest shows slightly better predictive performance than Cox models based on the C-index. Neural networks show better performance than both Cox models and random survival forest based on the Integrated Brier Score at 10 years.

Conclusion

In this work, it is shown that machine learning techniques can be a useful tool for both prediction and interpretation in the survival context. From the ML techniques examined here, PLANN with 1 hidden layer predicts survival probabilities the most accurately, being as calibrated as the Cox model with all variables.

Trial registration

Retrospective data were provided by the Scientific Registry of Transplant Recipients under Data Use Agreement number 9477 for analysis of risk factors after liver transplantation.

SUBMITTER: Kantidakis G

PROVIDER: S-EPMC7667810 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Survival prediction models since liver transplantation - comparisons between Cox models and machine learning techniques.

Kantidakis Georgios G Putter Hein H Lancia Carlo C Boer Jacob de J Braat Andries E AE Fiocco Marta M

BMC medical research methodology 20201116 1

<h4>Background</h4>Predicting survival of recipients after liver transplantation is regarded as one of the most important challenges in contemporary medicine. Hence, improving on current prediction models is of great interest.Nowadays, there is a strong discussion in the medical field about machine learning (ML) and whether it has greater potential than traditional regression models when dealing with complex data. Criticism to ML is related to unsuitable performance measures and lack of interpre ...[more]

PMID: 33198650

Similar Datasets

Project description:BackgroundHistorically, the Cox proportional hazard regression model has been the mainstay for survival analyses in oncologic research. The Cox proportional hazard regression model generally is used based on an assumption of linear association. However, it is likely that, in reality, there are many clinicopathologic features that exhibit a nonlinear association in biomedicine.ObjectiveThe purpose of this study was to compare the deep-learning neural network model and the Cox proportional hazard regression model in the prediction of survival in women with cervical cancer.Study designThis was a retrospective pilot study of consecutive cases of newly diagnosed stage I-IV cervical cancer from 2000-2014. A total of 40 features that included patient demographics, vital signs, laboratory test results, tumor characteristics, and treatment types were assessed for analysis and grouped into 3 feature sets. The deep-learning neural network model was compared with the Cox proportional hazard regression model and 3 other survival analysis models for progression-free survival and overall survival. Mean absolute error and concordance index were used to assess the performance of these 5 models.ResultsThere were 768 women included in the analysis. The median age was 49 years, and the majority were Hispanic (71.7%). The majority of tumors were squamous (75.3%) and stage I (48.7%). The median follow-up time was 40.2 months; there were 241 events for recurrence and progression and 170 deaths during the follow-up period. The deep-learning model showed promising results in the prediction of progression-free survival when compared with the Cox proportional hazard regression model (mean absolute error, 29.3 vs 316.2). The deep-learning model also outperformed all the other models, including the Cox proportional hazard regression model, for overall survival (mean absolute error, Cox proportional hazard regression vs deep-learning, 43.6 vs 30.7). The performance of the deep-learning model further improved when more features were included (concordance index for progression-free survival: 0.695 for 20 features, 0.787 for 36 features, and 0.795 for 40 features). There were 10 features for progression-free survival and 3 features for overall survival that demonstrated significance only in the deep-learning model, but not in the Cox proportional hazard regression model. There were no features for progression-free survival and 3 features for overall survival that demonstrated significance only in the Cox proportional hazard regression model, but not in the deep-learning model.ConclusionOur study suggests that the deep-learning neural network model may be a useful analytic tool for survival prediction in women with cervical cancer because it exhibited superior performance compared with the Cox proportional hazard regression model. This novel analytic approach may provide clinicians with meaningful survival information that potentially could be integrated into treatment decision-making and planning. Further validation studies are necessary to support this pilot study.

Project description:BackgroundThe variations in outcome and frequent occurrence of kidney allograft failure continue to pose important clinical and research challenges despite recent advances in kidney transplantation. The aim of this systematic review was to examine the current application of machine learning models in kidney transplantation and perform a meta-analysis of these models in the prediction of graft survival.MethodsThis review was registered with the PROSPERO database (CRD42021247469) and all peer-reviewed original articles that reported machine learning model-based prediction of graft survival were included. Quality assessment was performed by the criteria defined by Qiao and risk-of-bias assessment was performed using the PROBAST tool. The diagnostic performance of the meta-analysis was assessed by a meta-analysis of the area under the receiver operating characteristic curve and a hierarchical summary receiver operating characteristic plot.ResultsA total of 31 studies met the inclusion criteria for the review and 27 studies were included in the meta-analysis. Twenty-nine different machine learning models were used to predict graft survival in the included studies. Nine studies compared the predictive performance of machine learning models with traditional regression methods. Five studies had a high risk of bias and three studies had an unclear risk of bias. The area under the hierarchical summary receiver operating characteristic curve was 0.82 and the summary sensitivity and specificity of machine learning-based models were 0.81 (95 per cent c.i. 0.76 to 0.86) and 0.81 (95 per cent c.i. 0.74 to 0.86) respectively for the overall model. The diagnostic odds ratio for the overall model was 18.24 (95 per cent c.i. 11.00 to 30.16) and 29.27 (95 per cent c.i. 13.22 to 44.46) based on the sensitivity analyses.ConclusionPrediction models using machine learning methods may improve the prediction of outcomes after kidney transplantation by the integration of the vast amounts of non-linear data.

Project description:Background: A mechanism to predict graft failure before the actual kidney transplantation occurs is crucial to clinical management of chronic kidney disease patients. Several kidney graft outcome prediction models, developed using machine learning methods, are available in the literature. However, most of those models used small datasets and none of the machine learning-based prediction models available in the medical literature modelled time-to-event (survival) information, but instead used the binary outcome of failure or not. The objective of this study is to develop two separate machine learning-based predictive models to predict graft failure following live and deceased donor kidney transplant, using time-to-event data in a large national dataset from Australia. Methods: The dataset provided by the Australia and New Zealand Dialysis and Transplant Registry will be used for the analysis. This retrospective dataset contains the cohort of patients who underwent a kidney transplant in Australia from January 1 st, 2007, to December 31 st, 2017. This included 3,758 live donor transplants and 7,365 deceased donor transplants. Three machine learning methods (survival tree, random survival forest and survival support vector machine) and one traditional regression method, Cox proportional regression, will be used to develop the two predictive models (for live donor and deceased donor transplants). The best predictive model will be selected based on the model's performance. Discussion: This protocol describes the development of two separate machine learning-based predictive models to predict graft failure following live and deceased donor kidney transplant, using a large national dataset from Australia. Furthermore, these two models will be the most comprehensive kidney graft failure predictive models that have used survival data to model using machine learning techniques. Thus, these models are expected to provide valuable insight into the complex interactions between graft failure and donor and recipient characteristics.

Dataset Information

Survival prediction models since liver transplantation - comparisons between Cox models and machine learning techniques.

Background

Methods

Results

Conclusion

Trial registration

Publications

Survival prediction models since liver transplantation - comparisons between Cox models and machine learning techniques.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets