Dataset Information

External Validation of International Risk-Prediction Models of IgA Nephropathy in an Asian-Caucasian Cohort.

ABSTRACT:

Introduction

Two prediction models for IgA nephropathy (IgAN) using clinical variables and the Oxford MEST scores were developed and validated in 2 multiethnic cohorts. Additional external validation is required.

Methods

Biopsy-proven Chinese and Argentinian patients with IgAN were included. The primary outcome was defined as a 50% decline in estimated glomerular filtration rate (eGFR) or end-stage renal disease. C-statistics and stratified analyses were used for model discrimination, coefficient of determination (R² _D) for model fit, and calibration plots for model calibration. Baseline survival function was also evaluated.

Results

A total of 1275 patients were enrolled, with a mean age of 34 (interquartile range: 27-42) years, 50% of whom (638 of 1275) were men. Use of renin-angiotensin system blockers was higher than in previously reported cohorts, whereas other variables were comparable. The C-statistic of the models was 0.81, and R² _D was higher than reported. Survival curves in the subgroups (<16th, ∼16th to <50th, ∼50th to <84th, and ≥84th percentiles of linear predictor) were well separated. Most of the predictor variables, including hazard ratio, predicted 5-year risk, and eGFR decline slope, were worse with risk increasing. The baseline survival function was comparable in our cohort and the reported cohorts. The calibration was acceptable for the full model without race. However, the risk probability over 3 years was overestimated in the full model with race included.

Conclusion

The prediction models showed good performance on personalized risk assessment, which may be used as drug-specific, precision-medicine approaches to treatment decisionmaking.

SUBMITTER: Zhang Y

PROVIDER: S-EPMC7572322 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background and objectivesThe International IgA Nephropathy Network recently developed and externally validated two models to predict the risk of progression of IgA nephropathy: full models without and with race. This study sought to externally validate the International IgA Nephropathy Prediction Tool in a large, independent, and contemporary cohort in China.Design, setting, participants, & measurementsWe included 1373 patients with biopsy-confirmed primary IgA nephropathy from The First Affiliated Hospital of Zhengzhou University from January 2012 to May 2018 and calculated predicted risks for each patient. The outcomes of interest were a 50% decline in eGFR or kidney failure. We assessed the performance of both models using discrimination (concordance statistics and Kaplan-Meier curves between subgroups), calibration (calibration plots), reclassification (net reclassification improvement and integrated discrimination improvement), and clinical utility (decision curve analysis).ResultsThe median follow-up was 29 months (interquartile range, 21-43 months; range, 1-95 months), and 186 (14%) patients reached the kidney outcomes of interest. Both models showed excellent discrimination (concordance statistics >0.85 and well separated survival curves). Overall, the full model without race generally underestimated the risk of primary outcome, whereas the full model with race was well calibrated for predicting 5-year risk. Compared with the full model without race, the full model with race had significant improvement in reclassification, as assessed by the net reclassification improvement (0.49; 95% confidence interval, 0.41 to 0.59) and integrated discrimination improvement (0.06; 95% confidence interval, 0.04 to 0.08). Decision curve analysis showed that both full models had a higher net benefit than default strategies, and the model with race performed better.ConclusionsIn this study, both full models demonstrated remarkable discrimination, acceptable calibration, and satisfactory clinical utility. The relatively short follow-up time may have limited the validation of these models.

Project description:BackgroundImmunoglobulin A nephropathy (IgAN) is among the commonest glomerulonephritides in Greece and an important cause of end-stage kidney disease (ESKD) with an insidious chronic course. Thus, the recently published International IgAN prediction tool could potentially provide valuable risk stratification and guide the appropriate treatment module. This study aimed to externally validate this prediction tool using a patient cohort from the IgAN registry of the Greek Society of Nephrology.MethodsWe validated the predictive performance of the two full models (with or without race) derived from the International IgAN Prediction Tool study in the Greek Society of Nephrology registry of patients with IgAN using external validation of survival prediction models (Royston and Altman). The discrimination and calibration of the models were tested using the C-statistics and stratified analysis, coefficient of determination ( RD2 ) for model fit, and the regression coefficient of the linear predictor (βPI), respectively.ResultsThe study included 264 patients with a median age of 39 (30-51) years where 65.2% are men. All patients were of Caucasian origin. The 5-year risk of the primary outcome (50% reduction in estimated glomerular filtration rate or ESKD) was 8%. The RD2 for the full models with and without race when applied to our cohort was 39 and 35%, respectively, and both were higher than the reported RD2 for the models applied to the original validation cohorts (26.3, 25.3, and 35.3%, respectively). Harrel's C statistic for the full model with race was 0.71, and for the model without race was 0.70. Renal survival curves in the subgroups (<16th, ~16 to <50th, ~50 to <84th, and >84th percentiles of linear predictor) showed adequate separation. However, the calibration proved not to be acceptable for both the models, and the risk probability was overestimated by the model.ConclusionsThe two full models with or without race were shown to accurately distinguish the highest and higher risk patients from patients with low and intermediate risk for disease progression in the Greek registry of IgAN.

Project description:ImportanceAlthough IgA nephropathy (IgAN) is the most common glomerulonephritis in the world, there is no validated tool to predict disease progression. This limits patient-specific risk stratification and treatment decisions, clinical trial recruitment, and biomarker validation.ObjectiveTo derive and externally validate a prediction model for disease progression in IgAN that can be applied at the time of kidney biopsy in multiple ethnic groups worldwide.Design, setting, and participantsWe derived and externally validated a prediction model using clinical and histologic risk factors that are readily available in clinical practice. Large, multi-ethnic cohorts of adults with biopsy-proven IgAN were included from Europe, North America, China, and Japan.Main outcomes and measuresCox proportional hazards models were used to analyze the risk of a 50% decline in estimated glomerular filtration rate (eGFR) or end-stage kidney disease, and were evaluated using the R2D measure, Akaike information criterion (AIC), C statistic, continuous net reclassification improvement (NRI), integrated discrimination improvement (IDI), and calibration plots.ResultsThe study included 3927 patients; mean age, 35.4 (interquartile range, 28.0-45.4) years; and 2173 (55.3%) were men. The following prediction models were created in a derivation cohort of 2781 patients: a clinical model that included eGFR, blood pressure, and proteinuria at biopsy; and 2 full models that also contained the MEST histologic score, age, medication use, and either racial/ethnic characteristics (white, Japanese, or Chinese) or no racial/ethnic characteristics, to allow application in other ethnic groups. Compared with the clinical model, the full models with and without race/ethnicity had better R2D (26.3% and 25.3%, respectively, vs 20.3%) and AIC (6338 and 6379, respectively, vs 6485), significant increases in C statistic from 0.78 to 0.82 and 0.81, respectively (ΔC, 0.04; 95% CI, 0.03-0.04 and ΔC, 0.03; 95% CI, 0.02-0.03, respectively), and significant improvement in reclassification as assessed by the NRI (0.18; 95% CI, 0.07-0.29 and 0.51; 95% CI, 0.39-0.62, respectively) and IDI (0.07; 95% CI, 0.06-0.08 and 0.06; 95% CI, 0.05-0.06, respectively). External validation was performed in a cohort of 1146 patients. For both full models, the C statistics (0.82; 95% CI, 0.81-0.83 with race/ethnicity; 0.81; 95% CI, 0.80-0.82 without race/ethnicity) and R2D (both 35.3%) were similar or better than in the validation cohort, with excellent calibration.Conclusions and relevanceIn this study, the 2 full prediction models were shown to be accurate and validated methods for predicting disease progression and patient risk stratification in IgAN in multi-ethnic cohorts, with additional applications to clinical trial design and biomarker research.

Project description:ObjectivesTo identify and assess the quality and accuracy of prognostic models for nephropathy and to validate these models in external cohorts of people with type 2 diabetes.DesignSystematic review and external validation.Data sourcesPubMed and Embase.Eligibility criteriaStudies describing the development of a model to predict the risk of nephropathy, applicable to people with type 2 diabetes.MethodsScreening, data extraction, and risk of bias assessment were done in duplicate. Eligible models were externally validated in the Hoorn Diabetes Care System (DCS) cohort (n=11 450) for the same outcomes for which they were developed. Risks of nephropathy were calculated and compared with observed risk over 2, 5, and 10 years of follow-up. Model performance was assessed based on intercept adjusted calibration and discrimination (Harrell's C statistic).Results41 studies included in the systematic review reported 64 models, 46 of which were developed in a population with diabetes and 18 in the general population including diabetes as a predictor. The predicted outcomes included albuminuria, diabetic kidney disease, chronic kidney disease (general population), and end stage renal disease. The reported apparent discrimination of the 46 models varied considerably across the different predicted outcomes, from 0.60 (95% confidence interval 0.56 to 0.64) to 0.99 (not available) for the models developed in a diabetes population and from 0.59 (not available) to 0.96 (0.95 to 0.97) for the models developed in the general population. Calibration was reported in 31 of the 41 studies, and the models were generally well calibrated. 21 of the 64 retrieved models were externally validated in the Hoorn DCS cohort for predicting risk of albuminuria, diabetic kidney disease, and chronic kidney disease, with considerable variation in performance across prediction horizons and models. For all three outcomes, however, at least two models had C statistics >0.8, indicating excellent discrimination. In a secondary external validation in GoDARTS (Genetics of Diabetes Audit and Research in Tayside Scotland), models developed for diabetic kidney disease outperformed those for chronic kidney disease. Models were generally well calibrated across all three prediction horizons.ConclusionsThis study identified multiple prediction models to predict albuminuria, diabetic kidney disease, chronic kidney disease, and end stage renal disease. In the external validation, discrimination and calibration for albuminuria, diabetic kidney disease, and chronic kidney disease varied considerably across prediction horizons and models. For each outcome, however, specific models showed good discrimination and calibration across the three prediction horizons, with clinically accessible predictors, making them applicable in a clinical setting.Systematic review registrationPROSPERO CRD42020192831.