Dataset Information

Machine learning-based mortality prediction of patients undergoing cardiac resynchronization therapy: the SEMMELWEIS-CRT score.

ABSTRACT:

Aims

Our aim was to develop a machine learning (ML)-based risk stratification system to predict 1-, 2-, 3-, 4-, and 5-year all-cause mortality from pre-implant parameters of patients undergoing cardiac resynchronization therapy (CRT).

Methods and results

Multiple ML models were trained on a retrospective database of 1510 patients undergoing CRT implantation to predict 1- to 5-year all-cause mortality. Thirty-three pre-implant clinical features were selected to train the models. The best performing model [SEMMELWEIS-CRT score (perSonalizEd assessMent of estiMatEd risk of mortaLity With machinE learnIng in patientS undergoing CRT implantation)], along with pre-existing scores (Seattle Heart Failure Model, VALID-CRT, EAARN, ScREEN, and CRT-score), was tested on an independent cohort of 158 patients. There were 805 (53%) deaths in the training cohort and 80 (51%) deaths in the test cohort during the 5-year follow-up period. Among the trained classifiers, random forest demonstrated the best performance. For the prediction of 1-, 2-, 3-, 4-, and 5-year mortality, the areas under the receiver operating characteristic curves of the SEMMELWEIS-CRT score were 0.768 (95% CI: 0.674-0.861; P < 0.001), 0.793 (95% CI: 0.718-0.867; P < 0.001), 0.785 (95% CI: 0.711-0.859; P < 0.001), 0.776 (95% CI: 0.703-0.849; P < 0.001), and 0.803 (95% CI: 0.733-0.872; P < 0.001), respectively. The discriminative ability of our model was superior to other evaluated scores.

Conclusion

The SEMMELWEIS-CRT score (available at semmelweiscrtscore.com) exhibited good discriminative capabilities for the prediction of all-cause death in CRT patients and outperformed the already existing risk scores. By capturing the non-linear association of predictors, the utilization of ML approaches may facilitate optimal candidate selection and prognostication of patients undergoing CRT implantation.

SUBMITTER: Tokodi M

PROVIDER: S-EPMC7205468 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundCardiac resynchronization therapy (CRT) has significant nonresponse rates. We assessed whether machine learning (ML) could predict CRT response beyond current guidelines.MethodsWe analyzed CRT patients from Cleveland Clinic and Johns Hopkins. A training cohort was created from all Johns Hopkins patients and an equal number of randomly sampled Cleveland Clinic patients. All remaining patients comprised the testing cohort. Response was defined as ≥10% increase in left ventricular ejection fraction. ML models were developed to predict CRT response using different combinations of classification algorithms and clinical variable sets on the training cohort. The model with the highest area under the curve was evaluated on the testing cohort. Probability of response was used to predict survival free from a composite end point of death, heart transplant, or placement of left ventricular assist device. Predictions were compared with current guidelines.ResultsNine hundred twenty-five patients were included. On the training cohort (n=470: 235, Johns Hopkins; 235, Cleveland Clinic), the best ML model was a naive Bayes classifier including 9 variables (QRS morphology, QRS duration, New York Heart Association classification, left ventricular ejection fraction and end-diastolic diameter, sex, ischemic cardiomyopathy, atrial fibrillation, and epicardial left ventricular lead). On the testing cohort (n=455, Cleveland Clinic), ML demonstrated better response prediction than guidelines (area under the curve, 0.70 versus 0.65; P=0.012) and greater discrimination of event-free survival (concordance index, 0.61 versus 0.56; P<0.001). The fourth quartile of the ML model had the greatest risk of reaching the composite end point, whereas the first quartile had the least (hazard ratio, 0.34; P<0.001).ConclusionsML with 9 variables incrementally improved prediction of echocardiographic CRT response and survival beyond guidelines. Performance was not improved by incorporating more variables. The model offers potential for improved shared decision-making in CRT (online calculator: http://riskcalc.org:3838/CRTResponseScore ). Significant remaining limitations confirm the need to identify better variables to predict CRT response.

Project description:BackgroundMitral valve surgery (MVS) is an effective treatment for mitral valve diseases. There is a lack of reliable personalized risk prediction models for mortality in patients undergoing mitral valve surgery. Our aim was to develop a risk stratification system to predict all-cause mortality in patients after mitral valve surgery.MethodsDifferent machine learning models for the prediction of all-cause mortality were trained on a derivation cohort of 1,883 patients undergoing mitral valve surgery [split into a training cohort (70%) and internal validation cohort (30%)] to predict all-cause mortality. Forty-five clinical variables routinely evaluated at discharge were used to train the models. The best performance model (PRIME score) was tested in an externally validated cohort of 220 patients undergoing mitral valve surgery. The model performance was evaluated according to the area under the curve (AUC). Net reclassification improvement (NRI) and integrated discrimination improvement (IDI) were compared with existing risk strategies.ResultsAfter a median follow-up of 2 years, there were 133 (7.063%) deaths in the derivation cohort and 17 (7.727%) deaths in the validation cohort. The PRIME score showed an AUC of 0.902 (95% confidence interval [CI], 0.849-0.956) in the internal validation cohort and 0.873 (95% CI: 0.769-0.977) in the external validation cohort. In the external validation cohort, the performance of the PRIME score was significantly improved compared with that of the existing EuroSCORE II (NRI = 0.550, [95% CI 0.001-1.099], P = 0.049, IDI = 0.485, [95% CI 0.230-0.741], P < 0.001).ConclusionMachine learning-based model (the PRIME score) that integrate clinical, demographic, imaging, and laboratory features demonstrated superior performance for the prediction of mortality patients after mitral valve surgery compared with the traditional risk model EuroSCORE II.Clinical trial registration[http://www.clinicaltrials.gov], identifier [NCT05141292].