Dataset Information

Machine learning-based mortality prediction of patients undergoing cardiac resynchronization therapy: the SEMMELWEIS-CRT score.

ABSTRACT:

Aims

Our aim was to develop a machine learning (ML)-based risk stratification system to predict 1-, 2-, 3-, 4-, and 5-year all-cause mortality from pre-implant parameters of patients undergoing cardiac resynchronization therapy (CRT).

Methods and results

Multiple ML models were trained on a retrospective database of 1510 patients undergoing CRT implantation to predict 1- to 5-year all-cause mortality. Thirty-three pre-implant clinical features were selected to train the models. The best performing model [SEMMELWEIS-CRT score (perSonalizEd assessMent of estiMatEd risk of mortaLity With machinE learnIng in patientS undergoing CRT implantation)], along with pre-existing scores (Seattle Heart Failure Model, VALID-CRT, EAARN, ScREEN, and CRT-score), was tested on an independent cohort of 158 patients. There were 805 (53%) deaths in the training cohort and 80 (51%) deaths in the test cohort during the 5-year follow-up period. Among the trained classifiers, random forest demonstrated the best performance. For the prediction of 1-, 2-, 3-, 4-, and 5-year mortality, the areas under the receiver operating characteristic curves of the SEMMELWEIS-CRT score were 0.768 (95% CI: 0.674-0.861; P < 0.001), 0.793 (95% CI: 0.718-0.867; P < 0.001), 0.785 (95% CI: 0.711-0.859; P < 0.001), 0.776 (95% CI: 0.703-0.849; P < 0.001), and 0.803 (95% CI: 0.733-0.872; P < 0.001), respectively. The discriminative ability of our model was superior to other evaluated scores.

Conclusion

The SEMMELWEIS-CRT score (available at semmelweiscrtscore.com) exhibited good discriminative capabilities for the prediction of all-cause death in CRT patients and outperformed the already existing risk scores. By capturing the non-linear association of predictors, the utilization of ML approaches may facilitate optimal candidate selection and prognostication of patients undergoing CRT implantation.

SUBMITTER: Tokodi M

PROVIDER: S-EPMC7205468 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundCardiac resynchronization therapy (CRT) has significant nonresponse rates. We assessed whether machine learning (ML) could predict CRT response beyond current guidelines.MethodsWe analyzed CRT patients from Cleveland Clinic and Johns Hopkins. A training cohort was created from all Johns Hopkins patients and an equal number of randomly sampled Cleveland Clinic patients. All remaining patients comprised the testing cohort. Response was defined as ≥10% increase in left ventricular ejection fraction. ML models were developed to predict CRT response using different combinations of classification algorithms and clinical variable sets on the training cohort. The model with the highest area under the curve was evaluated on the testing cohort. Probability of response was used to predict survival free from a composite end point of death, heart transplant, or placement of left ventricular assist device. Predictions were compared with current guidelines.ResultsNine hundred twenty-five patients were included. On the training cohort (n=470: 235, Johns Hopkins; 235, Cleveland Clinic), the best ML model was a naive Bayes classifier including 9 variables (QRS morphology, QRS duration, New York Heart Association classification, left ventricular ejection fraction and end-diastolic diameter, sex, ischemic cardiomyopathy, atrial fibrillation, and epicardial left ventricular lead). On the testing cohort (n=455, Cleveland Clinic), ML demonstrated better response prediction than guidelines (area under the curve, 0.70 versus 0.65; P=0.012) and greater discrimination of event-free survival (concordance index, 0.61 versus 0.56; P<0.001). The fourth quartile of the ML model had the greatest risk of reaching the composite end point, whereas the first quartile had the least (hazard ratio, 0.34; P<0.001).ConclusionsML with 9 variables incrementally improved prediction of echocardiographic CRT response and survival beyond guidelines. Performance was not improved by incorporating more variables. The model offers potential for improved shared decision-making in CRT (online calculator: http://riskcalc.org:3838/CRTResponseScore ). Significant remaining limitations confirm the need to identify better variables to predict CRT response.

Project description:ObjectivesThis study aimed to apply machine learning (ML) to develop a prediction model for short-term cardiac resynchronization therapy (CRT) response to identifying CRT candidates for early multidisciplinary CRT heart failure (HF) care.BackgroundMultidisciplinary optimization of cardiac resynchronization therapy (CRT) delivery can improve long-term CRT outcomes but requires substantial staff resources.MethodsParticipants from the SMART-AV (SmartDelay-Determined AV Optimization: Comparison of AV Optimization Methods Used in Cardiac Resynchronization Therapy [CRT]) trial (n = 741; age: 66 ± 11 years; 33% female; 100% New York Heart Association HF functional class III-IV; 100% ejection fraction ≤35%) were randomly split into training/testing (80%; n = 593) and validation (20%; n = 148) samples. Baseline clinical, electrocardiographic, echocardiographic, and biomarker characteristics, and left ventricular (LV) lead position (43 variables) were included in 8 ML models (random forests, convolutional neural network, lasso, adaptive lasso, plugin lasso, elastic net, ridge, and logistic regression). A composite of freedom from death and HF hospitalization and a >15% reduction in LV end-systolic volume index at 6 months after CRT was the end point.ResultsThe primary end point was met by 337 patients (45.5%). The adaptive lasso model was the most more accurate (area under the receiver operating characteristic curve: 0.759; 95% CI: 0.678-0.840), well calibrated, and parsimonious (19 predictors; nearly half potentially modifiable). Participants in the 5th quintile compared with those in the 1st quintile of the prediction model had 14-fold higher odds of composite CRT response (odds ratio: 14.0; 95% CI: 8.0-14.4). The model predicted CRT response with 70% accuracy, 70% sensitivity, and 70% specificity, and should be further validated in prospective studies.ConclusionsML predicts short-term CRT response and thus may help with CRT procedure and early post-CRT care planning. (SmartDelay-Determined AV Optimization: A Comparison of AV Optimization Methods Used in Cardiac Resynchronization Therapy [CRT] [SMART-AV]; NCT00677014).