Dataset Information

Testing the proportional hazards assumption in cox regression and dealing with possible non-proportionality in total joint arthroplasty research: methodological perspectives and review.

ABSTRACT:

Background

Survival analysis and effect of covariates on survival time is a central research interest. Cox proportional hazards regression remains as a gold standard in the survival analysis. The Cox model relies on the assumption of proportional hazards (PH) across different covariates. PH assumptions should be assessed and handled if violated. Our aim was to investigate the reporting of the Cox regression model details and testing of the PH assumption in survival analysis in total joint arthroplasty (TJA) studies.

Methods

We conducted a review in the PubMed database on 28th August 2019. A total of 1154 studies were identified. The abstracts of these studies were screened for words "cox and "hazard*" and if either was found the abstract was read. The abstract had to fulfill the following criteria to be included in the full-text phase: topic was knee or hip TJA surgery; survival analysis was used, and hazard ratio reported. If all the presented criteria were met, the full-text version of the article was then read. The full-text was included if Cox method was used to analyze TJA survival. After accessing the full-texts 318 articles were included in final analysis.

Results

The PH assumption was mentioned in 114 of the included studies (36%). KM analysis was used in 281 (88%) studies and the KM curves were presented graphically in 243 of these (87%). In 110 (45%) studies, the KM survival curves crossed in at least one of the presented figures. The most common way to test the PH assumption was to inspect the log-minus-log plots (n = 59). The time-axis division method was the most used corrected model (n = 30) in cox analysis. Of the 318 included studies only 63 (20%) met the following criteria: PH assumption mentioned, PH assumption tested, testing method of the PH assumption named, the result of the testing mentioned, and the Cox regression model corrected, if required.

Conclusions

Reporting and testing of the PH assumption and dealing with non-proportionality in hip and knee TJA studies was limited. More awareness and education regarding the assumptions behind the used statistical models among researchers, reviewers and editors are needed to improve the quality of TJA research. This could be achieved by better collaboration with methodologists and statisticians and introducing more specific reporting guidelines for TJA studies. Neglecting obvious non-proportionality undermines the overall research efforts since causes of non-proportionality, such as possible underlying pathomechanisms, are not considered and discussed.

SUBMITTER: Kuitunen I

PROVIDER: S-EPMC8161573 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundClinical prediction rules (CPRs) should be externally validated by independent researchers. Although there are many cardiovascular CPRs, most have not been externally validated. It is not known why some CPRs are externally validated by independent researchers and others are not.MethodsWe analyzed cardiovascular risk CPRs included in a systematic review. Independent external validations were identified by forward citation searches of derivation studies. Time between the publication of a cardiovascular CPR and the first independent external validation was calculated. We assessed Kaplan-Meier estimates of the probability to have an independent external validation. Using univariable Cox regression, we explored whether characteristics of derivation (design, location, sample size, number of predictors, presentation format, validation in derivation), reporting (participants, predictors, outcomes, performance measure, information for risk calculation), and publication (journal impact factor) are associated with time to the first independent external validation.ResultsOf 125 cardiovascular risk CPRs, 29 had an independent external validation. The median follow-up was 118 months (95% CI, 99-130). The 25th percentile of event time was 122 months (95% CI, 91-299). Cardiovascular risk CPRs from the USA were 4.15 times (95% CI, 1.89-9.13) more likely to have an independent external validation. Increasing the sample size of derivation by ten times was associated with a 2.32-fold (95% CI, 1.37-3.91) increase in the probability of having an independent external validation. CPRs presented with an internal validation tend to get an independent external validation sooner (HR = 1.73, 95% CI, 0.77-3.93). CPRs reporting all the information necessary for calculating individual risk were 2.65 (95% CI, 1.01-6.96) times more likely to have an independent external validation. Publishing a cardiovascular risk CPR in a journal that has one unit higher impact factor was associated with a 6% (95% CI, 3-9) higher likelihood of an independent external validation.ConclusionsThe probability for cardiovascular risk CPRs to get an independent external validation was low even many years after their derivations. Authors of new cardiovascular risk CPRs should consider using adequate sample size, conducting an internal validation, and reporting all the information needed for risk calculation as these features were associated with an independent external validation.

Project description:From March through August 2015, nearly 60 teams from around the world participated in the Prostate Cancer Dream Challenge (PCDC). Participating teams were faced with the task of developing prediction models for patient survival and treatment discontinuation using baseline clinical variables collected on metastatic castrate-resistant prostate cancer (mCRPC) patients in the comparator arm of four phase III clinical trials. In total, over 2,000 mCRPC patients treated with first-line docetaxel comprised the training and testing data sets used in this challenge. In this paper we describe: (a) the sub-challenges comprising the PCDC, (b) the statistical metrics used to benchmark prediction performance, (c) our analytical approach, and finally (d) our team's overall performance in this challenge. Specifically, we discuss our curated, ad-hoc, feature selection (CAFS) strategy for identifying clinically important risk-predictors, the ensemble-based Cox proportional hazards regression framework used in our final submission, and the adaptation of our modeling framework based on the results from the intermittent leaderboard rounds. Strong predictors of patient survival were successfully identified utilizing our model building approach. Several of the identified predictors were new features created by our team via strategically merging collections of weak predictors. In each of the three intermittent leaderboard rounds, our prediction models scored among the top four models across all participating teams and our final submission ranked 9 th place overall with an integrated area under the curve (iAUC) of 0.7711 computed in an independent test set. While the prediction performance of teams placing between 2 nd- 10 th (iAUC: 0.7710-0.7789) was better than the current gold-standard prediction model for prostate cancer survival, the top-performing team, FIMM-UTU significantly outperformed all other contestants with an iAUC of 0.7915. In summary, our ensemble-based Cox regression framework with CAFS resulted in strong overall performance for predicting prostate cancer survival and represents a promising approach for future prediction problems.