Dataset Information

External validation of the international prediction tool in Korean patients with immunoglobulin A nephropathy.

ABSTRACT:

Background

The International IgA Nephropathy Prediction Tool has been recently developed to estimate the progression risk of immunoglobulin A nephropathy (IgAN). This study aimed to evaluate the clinical performance of this prediction tool in a large IgAN cohort in Korea.

Methods

The study cohort was comprised of 2,064 patients with biopsy-proven IgAN from four medical centers between March 2012 and September 2021. We calculated the predicted risk for each patient. The primary outcome was occurrence of a 50% decline in estimated glomerular filtration rate (eGFR) from the time of biopsy or end-stage kidney disease. The model performance was evaluated for discrimination, calibration, and reclassification. We also constructed and tested an additional model with a new coefficient for the Korean race.

Results

During a median follow-up period of 3.8 years (interquartile range, 1.8-6.6 years), 363 patients developed the primary outcome. The two prediction models exhibited good discrimination power, with a C-statistic of 0.81. The two models generally underestimated the risk of the primary outcome, with lesser underestimation for the model with race. The model with race showed better performance in reclassification compared to the model without race (net reclassification index, 0.13). The updated model with the Korean coefficient showed good agreement between predicted risk and observed outcome.

Conclusion

In Korean IgAN patients, International IgA Nephropathy Prediction Tool had good discrimination power but underestimated the risk of progression. The updated model with the Korean coefficient showed acceptable calibration and warrants external validation.

SUBMITTER: Joo YS

PROVIDER: S-EPMC9576458 | biostudies-literature | 2022 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

External validation of the international prediction tool in Korean patients with immunoglobulin A nephropathy.

Joo Young Su YS Kim Hyung Woo HW Baek Chung Hee CH Park Jung Tak JT Lee Hajeong H Lim Beom Jin BJ Yoo Tae-Hyun TH Moon Kyung Chul KC Chin Ho Jun HJ Kang Shin-Wook SW Han Seung Hyeok SH

Kidney research and clinical practice 20220504 5

<h4>Background</h4>The International IgA Nephropathy Prediction Tool has been recently developed to estimate the progression risk of immunoglobulin A nephropathy (IgAN). This study aimed to evaluate the clinical performance of this prediction tool in a large IgAN cohort in Korea.<h4>Methods</h4>The study cohort was comprised of 2,064 patients with biopsy-proven IgAN from four medical centers between March 2012 and September 2021. We calculated the predicted risk for each patient. The primary out ...[more]

PMID: 35545218

Similar Datasets

Project description:Background and objectivesThe International IgA Nephropathy Network recently developed and externally validated two models to predict the risk of progression of IgA nephropathy: full models without and with race. This study sought to externally validate the International IgA Nephropathy Prediction Tool in a large, independent, and contemporary cohort in China.Design, setting, participants, & measurementsWe included 1373 patients with biopsy-confirmed primary IgA nephropathy from The First Affiliated Hospital of Zhengzhou University from January 2012 to May 2018 and calculated predicted risks for each patient. The outcomes of interest were a 50% decline in eGFR or kidney failure. We assessed the performance of both models using discrimination (concordance statistics and Kaplan-Meier curves between subgroups), calibration (calibration plots), reclassification (net reclassification improvement and integrated discrimination improvement), and clinical utility (decision curve analysis).ResultsThe median follow-up was 29 months (interquartile range, 21-43 months; range, 1-95 months), and 186 (14%) patients reached the kidney outcomes of interest. Both models showed excellent discrimination (concordance statistics >0.85 and well separated survival curves). Overall, the full model without race generally underestimated the risk of primary outcome, whereas the full model with race was well calibrated for predicting 5-year risk. Compared with the full model without race, the full model with race had significant improvement in reclassification, as assessed by the net reclassification improvement (0.49; 95% confidence interval, 0.41 to 0.59) and integrated discrimination improvement (0.06; 95% confidence interval, 0.04 to 0.08). Decision curve analysis showed that both full models had a higher net benefit than default strategies, and the model with race performed better.ConclusionsIn this study, both full models demonstrated remarkable discrimination, acceptable calibration, and satisfactory clinical utility. The relatively short follow-up time may have limited the validation of these models.

Project description:BackgroundImmunoglobulin A nephropathy (IgAN) is among the commonest glomerulonephritides in Greece and an important cause of end-stage kidney disease (ESKD) with an insidious chronic course. Thus, the recently published International IgAN prediction tool could potentially provide valuable risk stratification and guide the appropriate treatment module. This study aimed to externally validate this prediction tool using a patient cohort from the IgAN registry of the Greek Society of Nephrology.MethodsWe validated the predictive performance of the two full models (with or without race) derived from the International IgAN Prediction Tool study in the Greek Society of Nephrology registry of patients with IgAN using external validation of survival prediction models (Royston and Altman). The discrimination and calibration of the models were tested using the C-statistics and stratified analysis, coefficient of determination ( RD2 ) for model fit, and the regression coefficient of the linear predictor (βPI), respectively.ResultsThe study included 264 patients with a median age of 39 (30-51) years where 65.2% are men. All patients were of Caucasian origin. The 5-year risk of the primary outcome (50% reduction in estimated glomerular filtration rate or ESKD) was 8%. The RD2 for the full models with and without race when applied to our cohort was 39 and 35%, respectively, and both were higher than the reported RD2 for the models applied to the original validation cohorts (26.3, 25.3, and 35.3%, respectively). Harrel's C statistic for the full model with race was 0.71, and for the model without race was 0.70. Renal survival curves in the subgroups (<16th, ~16 to <50th, ~50 to <84th, and >84th percentiles of linear predictor) showed adequate separation. However, the calibration proved not to be acceptable for both the models, and the risk probability was overestimated by the model.ConclusionsThe two full models with or without race were shown to accurately distinguish the highest and higher risk patients from patients with low and intermediate risk for disease progression in the Greek registry of IgAN.

Project description:BackgroundImmunoglobulin A nephropathy (IgAN) is one of the most common kidney diseases leading to renal injury. Of pediatric cases, 25%-30% progress into end-stage kidney disease (ESKD) in 20-25 years. Therefore, predicting and intervening in IgAN at an early stage is crucial. The purpose of this study was to validate the availability of an international predictive tool for childhood IgAN in a cohort of children with IgAN treated at a regional medical centre.MethodsAn external validation cohort of children with IgAN from medical centers in Southwest China was formed to validate the predictive performance of the two full models with and without race differences by comparing four measures: area under the curve (AUC), the regression coefficient of linear prediction (PI), survival analysis curves for different risk groups, and R2D.ResultsA total of 210 Chinese children, including 129 males, with an overall mean age of 9.43 ± 2.71 years, were incorporated from this regional medical center. In total, 11.43% (24/210) of patients achieved an outcome with a GFR decrease of more than 30% or reached ESKD. The AUC of the full model with race was 0.685 (95% CI: 0.570-0.800) and the AUC of the full model without race was 0.640 (95% CI: 0.517-0.764). The PI of the full model with race and without race was 0.816 (SE = 0.006, P < 0.001) and 0.751 (SE = 0.005, P < 0.001), respectively. The results of the survival curve analysis suggested the two models could not well distinguish between the low-risk and high-risk groups (P = 0.359 and P = 0.452), respectively, no matter the race difference. The evaluation of model fit for the full model with race was 66.5% and without race was 56.2%.ConclusionsThe international IgAN prediction tool has risk factors chosen based on adult data, and the validation cohort did not fully align with the derivation cohort in terms of demographic characteristics, clinical baseline levels, and pathological presentation, so the tool may not be highly applicable to children. We need to build IgAN prediction models that are more applicable to Chinese children based on their particular data.

Project description:ImportanceAlthough IgA nephropathy (IgAN) is the most common glomerulonephritis in the world, there is no validated tool to predict disease progression. This limits patient-specific risk stratification and treatment decisions, clinical trial recruitment, and biomarker validation.ObjectiveTo derive and externally validate a prediction model for disease progression in IgAN that can be applied at the time of kidney biopsy in multiple ethnic groups worldwide.Design, setting, and participantsWe derived and externally validated a prediction model using clinical and histologic risk factors that are readily available in clinical practice. Large, multi-ethnic cohorts of adults with biopsy-proven IgAN were included from Europe, North America, China, and Japan.Main outcomes and measuresCox proportional hazards models were used to analyze the risk of a 50% decline in estimated glomerular filtration rate (eGFR) or end-stage kidney disease, and were evaluated using the R2D measure, Akaike information criterion (AIC), C statistic, continuous net reclassification improvement (NRI), integrated discrimination improvement (IDI), and calibration plots.ResultsThe study included 3927 patients; mean age, 35.4 (interquartile range, 28.0-45.4) years; and 2173 (55.3%) were men. The following prediction models were created in a derivation cohort of 2781 patients: a clinical model that included eGFR, blood pressure, and proteinuria at biopsy; and 2 full models that also contained the MEST histologic score, age, medication use, and either racial/ethnic characteristics (white, Japanese, or Chinese) or no racial/ethnic characteristics, to allow application in other ethnic groups. Compared with the clinical model, the full models with and without race/ethnicity had better R2D (26.3% and 25.3%, respectively, vs 20.3%) and AIC (6338 and 6379, respectively, vs 6485), significant increases in C statistic from 0.78 to 0.82 and 0.81, respectively (ΔC, 0.04; 95% CI, 0.03-0.04 and ΔC, 0.03; 95% CI, 0.02-0.03, respectively), and significant improvement in reclassification as assessed by the NRI (0.18; 95% CI, 0.07-0.29 and 0.51; 95% CI, 0.39-0.62, respectively) and IDI (0.07; 95% CI, 0.06-0.08 and 0.06; 95% CI, 0.05-0.06, respectively). External validation was performed in a cohort of 1146 patients. For both full models, the C statistics (0.82; 95% CI, 0.81-0.83 with race/ethnicity; 0.81; 95% CI, 0.80-0.82 without race/ethnicity) and R2D (both 35.3%) were similar or better than in the validation cohort, with excellent calibration.Conclusions and relevanceIn this study, the 2 full prediction models were shown to be accurate and validated methods for predicting disease progression and patient risk stratification in IgAN in multi-ethnic cohorts, with additional applications to clinical trial design and biomarker research.

Project description:BackgroundPrediction of lifetime cardiovascular disease (CVD) risk is recommended in many clinical guidelines, but lifetime risk models are rarely externally validated. The aim of this study was to externally validate the QRiskLifetime incident CVD risk prediction tool.MethodsIndependent external validation of QRiskLifetime using Clinical Practice Research Datalink data, examining discrimination and calibration in the whole population and stratified by age, and reclassification compared to QRISK3. Since lifetime CVD risk is unobservable, performance was evaluated at 10-years' follow-up, and lifetime performance inferred in terms of performance for in the different age-groups from which lifetime predictions are derived.ResultsOne million, two hundreds sixty thousand and three hundreds twenty nine women and 1,223,265 men were included in the analysis. Discrimination was excellent in the whole population (Harrell's-C = 0.844 in women, 0.808 in men), but moderate to poor stratified by age-group (Harrell's C in people aged 30-44 0.714 for both men and women, in people aged 75-84 0.578 in women and 0.556 in men). Ten-year CVD risk was under-predicted in the whole population, and in all age-groups except women aged 45-64, with worse under-prediction in older age-groups. Compared to those at highest QRISK3 estimated 10-year risk, those with highest lifetime risk were younger (mean age: women 50.5 vs. 71.3 years; men 46.3 vs. 63.8 years) and had lower systolic blood pressure and prevalence of treated hypertension, but had more family history of premature CVD, and were more commonly minority ethnic. Over 10-years, the estimated number needed to treat (NNT) with a statin to prevent one CVD event in people with QRISK3 ≥ 10% was 34 in women and 37 in men, compared to 99 and 100 for those at highest lifetime risk.ConclusionsQRiskLifetime underpredicts 10-year CVD risk in nearly all age-groups, so is likely to also underpredict lifetime risk. Treatment based on lifetime risk has considerably lower medium-term benefit than treatment based on 10-year risk.

Dataset Information

External validation of the international prediction tool in Korean patients with immunoglobulin A nephropathy.

Background

Methods

Results

Conclusion

Publications

External validation of the international prediction tool in Korean patients with immunoglobulin A nephropathy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets