Dataset Information

A Novel Tool to Evaluate the Accuracy of Predicting Survival and Guiding Lung Transplantation in Cystic Fibrosis.

ABSTRACT: Background:Effective transplantation recommendations in cystic fibrosis (CF) require accurate survival predictions, so that high-risk patients may be prioritized for transplantation. In practice, decisions about transplantation are made dynamically, using routinely updated assessments. We present a novel tool for evaluating risk prediction models that, unlike traditional methods, captures classification accuracy in identifying high-risk patients in a dynamic fashion. Methods:Predicted risk is used as a score to rank incident deaths versus patients who survive, with the goal of ranking the deaths higher. The mean rank across deaths at a given time measures time-specific predictive accuracy; when assessed over time, it reflects time-varying accuracy. Results:Applying this approach to CF Registry data on patients followed from 1993-2011, we show that traditional methods do not capture the performance of models used dynamically in the clinical setting. Previously proposed multivariate risk scores perform no better than forced expiratory volume in 1 second as a percentage of predicted normal (FEV1%) alone. Despite its value for survival prediction, FEV1% has a low sensitivity of 45% over time (for fixed specificity of 95%), leaving room for improvement in prediction. Finally, prediction accuracy with annually-updated FEV1% shows minor differences compared to FEV1% updated every 2 years, which may have clinical implications regarding the optimal frequency of updating clinical information. Conclusions:It is imperative to continue to develop models that accurately predict survival in CF. Our proposed approach can serve as the basis for evaluating the predictive ability of these models by better accounting for their dynamic clinical use.

SUBMITTER: Bansal A

PROVIDER: S-EPMC6743328 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Novel Tool to Evaluate the Accuracy of Predicting Survival and Guiding Lung Transplantation in Cystic Fibrosis.

Bansal Aasthaa A Mayer-Hamblett Nicole N Goss Christopher H CH Chan Lingtak N LN Heagerty Patrick J PJ

Epidemiology (Sunnyvale, Calif.) 20190617 2

<h4>Background</h4>Effective transplantation recommendations in cystic fibrosis (CF) require accurate survival predictions, so that high-risk patients may be prioritized for transplantation. In practice, decisions about transplantation are made dynamically, using routinely updated assessments. We present a novel tool for evaluating risk prediction models that, unlike traditional methods, captures classification accuracy in identifying high-risk patients in a dynamic fashion.<h4>Methods</h4>Predi ...[more]

PMID: 31523488

Similar Datasets

Project description:The effects of lung transplantation on the survival and quality of life in children with cystic fibrosis are uncertain.We used data from the U.S. Cystic Fibrosis Foundation Patient Registry and from the Organ Procurement and Transplantation Network to identify children with cystic fibrosis who were on the waiting list for lung transplantation during the period from 1992 through 2002. We performed proportional-hazards survival modeling, using multiple clinically relevant covariates that were available before the children were on the waiting list and the interactions of these covariates with lung transplantation as a time-dependent covariate. The data were insufficient in quality and quantity for a retrospective quality-of-life analysis.A total of 248 of the 514 children on the waiting list underwent lung transplantation in the United States during the period from 1992 through 2002. Proportional-hazards modeling identified four variables besides transplantation that were associated with changes in survival. Burkholderia cepacia infection was associated with a trend toward decreased survival, regardless of whether the patient underwent transplantation. A diagnosis of diabetes before the patient was placed on the waiting list decreased survival while the patient was on the waiting list but did not decrease survival after transplantation, whereas older age did not affect waiting-list survival but decreased post-transplantation survival. Staphylococcus aureus infection increased waiting-list survival but decreased post-transplantation survival. Using age, diabetes status, and S. aureus infection status as covariates, we estimated the effect of transplantation on survival for each patient group, expressed as a hazard factor of less than 1 for a benefit and more than 1 for a risk of harm. Five patients had a significant estimated benefit, 283 patients had a significant risk of harm, 102 patients had an insignificant benefit, and 124 patients had an insignificant risk of harm associated with lung transplantation.Our analyses estimated clearly improved survival for only 5 of 514 patients on the waiting list for lung transplantation. Prolongation of life by means of lung transplantation should not be expected in children with cystic fibrosis. A prospective, randomized trial is needed to clarify whether and when patients derive a survival and quality-of-life benefit from lung transplantation.

Project description:BackgroundThe effects of lung transplantation on the survival and quality of life in children with cystic fibrosis are uncertain.MethodsWe used data from the U.S. Cystic Fibrosis Foundation Patient Registry and from the Organ Procurement and Transplantation Network to identify children with cystic fibrosis who were on the waiting list for lung transplantation during the period from 1992 through 2002. We performed proportional-hazards survival modeling, using multiple clinically relevant covariates that were available before the children were on the waiting list and the interactions of these covariates with lung transplantation as a time-dependent covariate. The data were insufficient in quality and quantity for a retrospective quality-of-life analysis.ResultsA total of 248 of the 514 children on the waiting list underwent lung transplantation in the United States during the period from 1992 through 2002. Proportional-hazards modeling identified four variables besides transplantation that were associated with changes in survival. Burkholderia cepacia infection was associated with a trend toward decreased survival, regardless of whether the patient underwent transplantation [corrected]. A diagnosis of diabetes before the patient was placed on the waiting list decreased survival while the patient was on the waiting list but did not decrease survival after transplantation, whereas older age did not affect waiting-list survival but decreased post-transplantation survival. Staphylococcus aureus infection increased waiting-list survival but decreased post-transplantation survival. Using age, diabetes status, and S. aureus infection status as covariates, we estimated the effect of transplantation on survival for each patient group, expressed as a hazard factor of less than 1 for a benefit and more than 1 for a risk of harm. Five patients had a significant estimated benefit, 283 patients had a significant risk of harm, 102 patients had an insignificant benefit, and 124 patients had an insignificant risk of harm associated with lung transplantation [corrected].ConclusionsOur analyses estimated clearly improved survival for only 5 of 514 patients on the waiting list for lung transplantation. Prolongation of life by means of lung transplantation should not be expected in children with cystic fibrosis. A prospective, randomized trial is needed to clarify whether and when patients derive a survival and quality-of-life benefit from lung transplantation.

Dataset Information

A Novel Tool to Evaluate the Accuracy of Predicting Survival and Guiding Lung Transplantation in Cystic Fibrosis.

Publications

A Novel Tool to Evaluate the Accuracy of Predicting Survival and Guiding Lung Transplantation in Cystic Fibrosis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets