Dataset Information

External Validation of the International IgA Nephropathy Prediction Tool.

ABSTRACT:

Background and objectives

The International IgA Nephropathy Network recently developed and externally validated two models to predict the risk of progression of IgA nephropathy: full models without and with race. This study sought to externally validate the International IgA Nephropathy Prediction Tool in a large, independent, and contemporary cohort in China.

Design, setting, participants, & measurements

We included 1373 patients with biopsy-confirmed primary IgA nephropathy from The First Affiliated Hospital of Zhengzhou University from January 2012 to May 2018 and calculated predicted risks for each patient. The outcomes of interest were a 50% decline in eGFR or kidney failure. We assessed the performance of both models using discrimination (concordance statistics and Kaplan-Meier curves between subgroups), calibration (calibration plots), reclassification (net reclassification improvement and integrated discrimination improvement), and clinical utility (decision curve analysis).

Results

The median follow-up was 29 months (interquartile range, 21-43 months; range, 1-95 months), and 186 (14%) patients reached the kidney outcomes of interest. Both models showed excellent discrimination (concordance statistics >0.85 and well separated survival curves). Overall, the full model without race generally underestimated the risk of primary outcome, whereas the full model with race was well calibrated for predicting 5-year risk. Compared with the full model without race, the full model with race had significant improvement in reclassification, as assessed by the net reclassification improvement (0.49; 95% confidence interval, 0.41 to 0.59) and integrated discrimination improvement (0.06; 95% confidence interval, 0.04 to 0.08). Decision curve analysis showed that both full models had a higher net benefit than default strategies, and the model with race performed better.

Conclusions

In this study, both full models demonstrated remarkable discrimination, acceptable calibration, and satisfactory clinical utility. The relatively short follow-up time may have limited the validation of these models.

SUBMITTER: Zhang J

PROVIDER: S-EPMC7409753 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundImmunoglobulin A nephropathy (IgAN) is among the commonest glomerulonephritides in Greece and an important cause of end-stage kidney disease (ESKD) with an insidious chronic course. Thus, the recently published International IgAN prediction tool could potentially provide valuable risk stratification and guide the appropriate treatment module. This study aimed to externally validate this prediction tool using a patient cohort from the IgAN registry of the Greek Society of Nephrology.MethodsWe validated the predictive performance of the two full models (with or without race) derived from the International IgAN Prediction Tool study in the Greek Society of Nephrology registry of patients with IgAN using external validation of survival prediction models (Royston and Altman). The discrimination and calibration of the models were tested using the C-statistics and stratified analysis, coefficient of determination ( RD2 ) for model fit, and the regression coefficient of the linear predictor (βPI), respectively.ResultsThe study included 264 patients with a median age of 39 (30-51) years where 65.2% are men. All patients were of Caucasian origin. The 5-year risk of the primary outcome (50% reduction in estimated glomerular filtration rate or ESKD) was 8%. The RD2 for the full models with and without race when applied to our cohort was 39 and 35%, respectively, and both were higher than the reported RD2 for the models applied to the original validation cohorts (26.3, 25.3, and 35.3%, respectively). Harrel's C statistic for the full model with race was 0.71, and for the model without race was 0.70. Renal survival curves in the subgroups (<16th, ~16 to <50th, ~50 to <84th, and >84th percentiles of linear predictor) showed adequate separation. However, the calibration proved not to be acceptable for both the models, and the risk probability was overestimated by the model.ConclusionsThe two full models with or without race were shown to accurately distinguish the highest and higher risk patients from patients with low and intermediate risk for disease progression in the Greek registry of IgAN.

Project description:ImportanceAlthough IgA nephropathy (IgAN) is the most common glomerulonephritis in the world, there is no validated tool to predict disease progression. This limits patient-specific risk stratification and treatment decisions, clinical trial recruitment, and biomarker validation.ObjectiveTo derive and externally validate a prediction model for disease progression in IgAN that can be applied at the time of kidney biopsy in multiple ethnic groups worldwide.Design, setting, and participantsWe derived and externally validated a prediction model using clinical and histologic risk factors that are readily available in clinical practice. Large, multi-ethnic cohorts of adults with biopsy-proven IgAN were included from Europe, North America, China, and Japan.Main outcomes and measuresCox proportional hazards models were used to analyze the risk of a 50% decline in estimated glomerular filtration rate (eGFR) or end-stage kidney disease, and were evaluated using the R2D measure, Akaike information criterion (AIC), C statistic, continuous net reclassification improvement (NRI), integrated discrimination improvement (IDI), and calibration plots.ResultsThe study included 3927 patients; mean age, 35.4 (interquartile range, 28.0-45.4) years; and 2173 (55.3%) were men. The following prediction models were created in a derivation cohort of 2781 patients: a clinical model that included eGFR, blood pressure, and proteinuria at biopsy; and 2 full models that also contained the MEST histologic score, age, medication use, and either racial/ethnic characteristics (white, Japanese, or Chinese) or no racial/ethnic characteristics, to allow application in other ethnic groups. Compared with the clinical model, the full models with and without race/ethnicity had better R2D (26.3% and 25.3%, respectively, vs 20.3%) and AIC (6338 and 6379, respectively, vs 6485), significant increases in C statistic from 0.78 to 0.82 and 0.81, respectively (ΔC, 0.04; 95% CI, 0.03-0.04 and ΔC, 0.03; 95% CI, 0.02-0.03, respectively), and significant improvement in reclassification as assessed by the NRI (0.18; 95% CI, 0.07-0.29 and 0.51; 95% CI, 0.39-0.62, respectively) and IDI (0.07; 95% CI, 0.06-0.08 and 0.06; 95% CI, 0.05-0.06, respectively). External validation was performed in a cohort of 1146 patients. For both full models, the C statistics (0.82; 95% CI, 0.81-0.83 with race/ethnicity; 0.81; 95% CI, 0.80-0.82 without race/ethnicity) and R2D (both 35.3%) were similar or better than in the validation cohort, with excellent calibration.Conclusions and relevanceIn this study, the 2 full prediction models were shown to be accurate and validated methods for predicting disease progression and patient risk stratification in IgAN in multi-ethnic cohorts, with additional applications to clinical trial design and biomarker research.

Project description:Background and objectivesThe risk assessment for developing ESRD remains limited in patients with IgA nephropathy (IgAN). The aim of this study was to develop and validate a prediction rule for estimating the individual risk of ESRD in patients with IgAN.Design, setting, participants, & measurementsA total of 698 patients with IgAN diagnosed by renal biopsy at Kyushu University Hospital (derivation cohort) between 1982 and 2010 were retrospectively followed. The Oxford classification was used to evaluate the pathologic lesions. The risk factors for developing ESRD were evaluated using a Cox proportional hazard model with a stepwise backward elimination method. The prediction rule was verified using data from 702 patients diagnosed at Japanese Red Cross Fukuoka Hospital (validation cohort) between 1979 and 2002.ResultsIn the derivation cohort, 73 patients developed ESRD during the median 4.7-year follow-up. The final prediction model included proteinuria (hazard ratio [HR], 1.30; 95% confidence interval [95% CI], 1.16 to 1.45, every 1 g/24 hours), estimated GFR (HR, 0.84; 95% CI, 0.74 to 0.96, every 10 ml/min per 1.73 m(2)), mesangial proliferation (HR, 1.85; 95% CI, 1.10 to 3.11), segmental sclerosis (HR, 3.21; 95% CI, 1.37 to 7.51), and interstitial fibrosis/tubular atrophy (T1: HR, 5.30; 95% CI, 2.63 to 10.7; T2: HR, 20.5; 95% CI, 9.05 to 46.5) as independent risk factors for developing ESRD. To create a prediction rule, the score for each variable was weighted by the regression coefficients calculated using the relevant Cox model. The incidence of ESRD increased linearly with increases in the total risk scores (P for trend <0.001). Furthermore, the prediction rule demonstrated good discrimination (c-statistic=0.89) and calibration (Hosmer-Lemeshow test, P=0.78) in the validation cohort.ConclusionsThis study developed and validated a new prediction rule using clinical measures and the Oxford classification for developing ESRD in patients with IgAN.