Dataset Information

Prediction of Outcome and Endovascular Treatment Benefit: Validation and Update of the MR PREDICTS Decision Tool.

ABSTRACT:

Background and purpose

Benefit of early endovascular treatment (EVT) for ischemic stroke varies considerably among patients. The MR PREDICTS decision tool, derived from MR CLEAN (Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands), predicts outcome and treatment benefit based on baseline characteristics. Our aim was to externally validate and update MR PREDICTS with data from international trials and daily clinical practice.

Methods

We used individual patient data from 6 randomized controlled trials within the HERMES (Highly Effective Reperfusion Evaluated in Multiple Endovascular Stroke Trials) collaboration to validate the original model. Then, we updated the model and performed a second validation with data from the observational MR CLEAN Registry. Primary outcome was functional independence (defined as modified Rankin Scale score 0-2) 3 months after stroke. Treatment benefit was defined as the difference between the probability of functional independence with and without EVT. Discriminative performance was evaluated using a concordance (C) statistic.

Results

We included 1242 patients from HERMES (633 assigned to EVT, 609 assigned to control) and 3156 patients from the MR CLEAN Registry (all of whom underwent EVT within 6.5 hours). The C-statistic for functional independence was 0.74 (95% CI, 0.72-0.77) in HERMES and, after model updating, 0.80 (0.78-0.82) in the Registry. Median predicted treatment benefit of routinely treated patients (Registry) was 10.3% (interquartile range, 5.8%-14.4%). Patients with low (<1%) predicted treatment benefit (n=135/3156 [4.3%]) had low rates of functional independence, irrespective of reperfusion status, suggesting potential absence of treatment benefit. The updated model was made available online for clinicians and researchers at www.mrpredicts.com.

Conclusions

Because of the substantial treatment effect and small potential harm of EVT, most patients arriving within 6 hours at an endovascular-capable center should be treated regardless of their clinical characteristics. MR PREDICTS can be used to support clinical judgement when there is uncertainty about the treatment indication, when resources are limited, or before a patient is to be transferred to an endovascular-capable center.

SUBMITTER: Venema E

PROVIDER: S-EPMC8378416 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background and purposePrediction models for outcome of patients with acute ischemic stroke who will undergo endovascular treatment have been developed to improve patient management. The aim of the current study is to provide an overview of preintervention models for functional outcome after endovascular treatment and to validate these models with data from daily clinical practice.MethodsWe systematically searched within Medline, Embase, Cochrane, Web of Science, to include prediction models. Models identified from the search were validated in the MR CLEAN (Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands) registry, which includes all patients treated with endovascular treatment within 6.5 hours after stroke onset in the Netherlands between March 2014 and November 2017. Predictive performance was evaluated according to discrimination (area under the curve) and calibration (slope and intercept of the calibration curve). Good functional outcome was defined as a score of 0-2 or 0-3 on the modified Rankin Scale depending on the model.ResultsAfter screening 3468 publications, 19 models were included in this validation. Variables included in the models mainly addressed clinical and imaging characteristics at baseline. In the validation cohort of 3156 patients, discriminative performance ranged from 0.61 (SPAN-100 [Stroke Prognostication Using Age and NIH Stroke Scale]) to 0.80 (MR PREDICTS). Best-calibrated models were THRIVE (The Totaled Health Risks in Vascular Events; intercept -0.06 [95% CI, -0.14 to 0.02]; slope 0.84 [95% CI, 0.75-0.95]), THRIVE-c (intercept 0.08 [95% CI, -0.02 to 0.17]; slope 0.71 [95% CI, 0.65-0.77]), Stroke Checkerboard score (intercept -0.05 [95% CI, -0.13 to 0.03]; slope 0.97 [95% CI, 0.88-1.08]), and MR PREDICTS (intercept 0.43 [95% CI, 0.33-0.52]; slope 0.93 [95% CI, 0.85-1.01]).ConclusionsThe THRIVE-c score and MR PREDICTS both showed a good combination of discrimination and calibration and were, therefore, superior in predicting functional outcome for patients with ischemic stroke after endovascular treatment within 6.5 hours. Since models used different predictors and several models had relatively good predictive performance, the decision on which model to use in practice may also depend on simplicity of the model, data availability, and the comparability of the population and setting.

Project description:BACKGROUND AND PURPOSE:This study aims to describe the relationship between computed tomographic (CT) perfusion (CTP)-to-reperfusion time and clinical and radiological outcomes, in a cohort of patients who achieve successful reperfusion for acute ischemic stroke. METHODS:We included data from the CRISP (Computed Tomographic Perfusion to Predict Response in Ischemic Stroke Project) in which all patients underwent a baseline CTP scan before endovascular therapy. Patients were included if they had a mismatch on their baseline CTP scan and achieved successful endovascular reperfusion. Patients with mismatch were categorized into target mismatch and malignant mismatch profiles, according to the volume of their Tmax >10s lesion volume (target mismatch, <100 mL; malignant mismatch, >100 mL). We investigated the impact of CTP-to-reperfusion times on probability of achieving functional independence (modified Rankin Scale, 0-2) at day 90 and radiographic outcomes at day 5. RESULTS:Of 156 included patients, 108 (59%) had the target mismatch profile, and 48 (26%) had the malignant mismatch profile. In patients with the target mismatch profile, CTP-to-reperfusion time showed no association with functional independence (P=0.84), whereas in patients with malignant mismatch profile, CTP-to-reperfusion time was strongly associated with lower probability of functional independence (odds ratio, 0.08; P=0.003). Compared with patients with target mismatch, those with the malignant mismatch profile had significantly more infarct growth (90 [49-166] versus 43 [18-81] mL; P=0.006) and larger final infarct volumes (110 [61-155] versus 48 [21-99] mL; P=0.001). CONCLUSIONS:Compared with target mismatch patients, those with the malignant profile experience faster infarct growth and a steeper decline in the odds of functional independence, with longer delays between baseline imaging and reperfusion. However, this does not exclude the possibility of treatment benefit in patients with a malignant profile.

Project description:BackgroundIn patients with aneurysmal subarachnoid hemorrhage suitable for endovascular coiling and neurosurgical clip-reconstruction, the aneurysm treatment decision-making process could be improved by considering heterogeneity of treatment effect and durability of treatment. We aimed to develop and validate a tool to predict individualized treatment benefit of endovascular coiling compared to neurosurgical clip-reconstruction.MethodsWe used randomized data (International Subarachnoid Aneurysm Trial, n = 2143) to develop models to predict 2-month functional outcome and to predict time-to-rebleed-or-retreatment. We modeled for heterogeneity of treatment effect by adding interaction terms of treatment with prespecified predictors and with baseline risk of the outcome. We predicted outcome with both treatments and calculated absolute treatment benefit. We described the patient characteristics of patients with ≥ 5% point difference in the predicted probability of favorable functional outcome (modified Rankin Score 0-2) and of no rebleed or retreatment within 10 years. Model performance was expressed with the c-statistic and calibration plots. We performed bootstrapping and leave-one-cluster-out cross-validation and pooled cluster-specific c-statistics with random effects meta-analysis.ResultsThe pooled c-statistics were 0.72 (95% CI: 0.69-0.75) for the prediction of 2-month favorable functional outcome and 0.67 (95% CI: 0.63-0.71) for prediction of no rebleed or retreatment within 10 years. We found no significant interaction between predictors and treatment. The average predicted benefit in favorable functional outcome was 6% (95% CI: 3-10%) in favor of coiling, but 11% (95% CI: 9-13%) for no rebleed or retreatment in favor of clip-reconstruction. 134 patients (6%), young and in favorable clinical condition, had negligible functional outcome benefit of coiling but had a ≥ 5% point benefit of clip-reconstruction in terms of durability of treatment.ConclusionsWe show that young patients in favorable clinical condition and without extensive vasospasm have a negligible benefit in functional outcome of endovascular coiling - compared to neurosurgical clip-reconstruction - while at the same time having a substantially lower probability of retreatment or rebleeding from neurosurgical clip-reconstruction - compared to endovascular coiling. The SHARP prediction tool ( https://sharpmodels.shinyapps.io/sharpmodels/ ) could support and incentivize a multidisciplinary discussion about aneurysm treatment decision-making by providing individualized treatment benefit estimates.

Project description:BACKGROUND:In clinical practice, it is often difficult to predict which patients with cognitive complaints or impairment will progress or remain stable. We assessed the impact of using a clinical decision support system, the PredictND tool, to predict progression in patients with subjective cognitive decline (SCD) and mild cognitive impairment (MCI) in memory clinics. METHODS:In this prospective multicenter study, we included 429 patients with SCD (n = 230) and MCI (n = 199) (female 54%, age 67 ± 9, MMSE 28 ± 2) and followed them for at least 12 months. Based on all available patient baseline data (demographics, cognitive tests, cerebrospinal fluid biomarkers, and MRI), the PredictND tool provides a comprehensive overview of the data and a classification defining the likelihood of progression. At baseline, a clinician defined an expected follow-up diagnosis and estimated the level of confidence in their prediction using a visual analogue scale (VAS, 0-100%), first without and subsequently with the PredictND tool. As outcome measure, we defined clinical progression as progression from SCD to MCI or dementia, and from MCI to dementia. Correspondence between the expected and the actual clinical progression at follow-up defined the prognostic accuracy. RESULTS:After a mean follow-up time of 1.7 ± 0.4 years, 21 (9%) SCD and 63 (32%) MCI had progressed. When using the PredictND tool, the overall prognostic accuracy was unaffected (0.4%, 95%CI - 3.0%; + 3.9%; p = 0.79). However, restricting the analysis to patients with more certain classifications (n = 203), we found an increase of 3% in the accuracy (95%CI - 0.6%; + 6.5%; p = 0.11). Furthermore, for this subgroup, the tool alone showed a statistically significant increase in the prognostic accuracy compared to the evaluation without tool (6.4%, 95%CI 2.1%; 10.7%; p = 0.004). Specifically, the negative predictive value was high. Moreover, confidence in the prediction increased significantly (∆VAS = 4%, p < .0001). CONCLUSIONS:Adding the PredictND tool to the clinical evaluation increased clinicians' confidence. Furthermore, the results indicate that the tool has the potential to improve prediction of progression for patients with more certain classifications.

Project description:Background and objectivesThe International IgA Nephropathy Network recently developed and externally validated two models to predict the risk of progression of IgA nephropathy: full models without and with race. This study sought to externally validate the International IgA Nephropathy Prediction Tool in a large, independent, and contemporary cohort in China.Design, setting, participants, & measurementsWe included 1373 patients with biopsy-confirmed primary IgA nephropathy from The First Affiliated Hospital of Zhengzhou University from January 2012 to May 2018 and calculated predicted risks for each patient. The outcomes of interest were a 50% decline in eGFR or kidney failure. We assessed the performance of both models using discrimination (concordance statistics and Kaplan-Meier curves between subgroups), calibration (calibration plots), reclassification (net reclassification improvement and integrated discrimination improvement), and clinical utility (decision curve analysis).ResultsThe median follow-up was 29 months (interquartile range, 21-43 months; range, 1-95 months), and 186 (14%) patients reached the kidney outcomes of interest. Both models showed excellent discrimination (concordance statistics >0.85 and well separated survival curves). Overall, the full model without race generally underestimated the risk of primary outcome, whereas the full model with race was well calibrated for predicting 5-year risk. Compared with the full model without race, the full model with race had significant improvement in reclassification, as assessed by the net reclassification improvement (0.49; 95% confidence interval, 0.41 to 0.59) and integrated discrimination improvement (0.06; 95% confidence interval, 0.04 to 0.08). Decision curve analysis showed that both full models had a higher net benefit than default strategies, and the model with race performed better.ConclusionsIn this study, both full models demonstrated remarkable discrimination, acceptable calibration, and satisfactory clinical utility. The relatively short follow-up time may have limited the validation of these models.