Dataset Information

Controlling Confounding in a Study of Oral Anticoagulants: Comparing Disease Risk Scores Developed Using Different Follow-Up Approaches.

ABSTRACT: Purpose:Little is known about how disease risk score (DRS) development should proceed under different pharmacoepidemiologic follow-up strategies. In an analysis of dabigatran vs. warfarin and risk of major bleeding, we compared the results of DRS adjustment when models were developed under "intention-to-treat" (ITT) and "as-treated" (AT) approaches. Methods:We assessed DRS model discrimination, calibration, and ability to induce prognostic balance via the "dry run analysis". AT treatment effects stratified on each DRS were compared with each other and with a propensity score (PS) stratified reference estimate. Bootstrap resampling of the historical cohort at 10 percent-90 percent sample size was performed to assess the impact of sample size on DRS estimation. Results:Historically-derived DRS models fit under AT showed greater decrements in discrimination and calibration than those fit under ITT when applied to the concurrent study population. Prognostic balance was approximately equal across DRS models (-6 percent to -7 percent "pseudo-bias" on the hazard ratio scale). Hazard ratios were between 0.76 and 0.78 with all methods of DRS adjustment, while the PS stratified hazard ratio was 0.83. In resampling, AT DRS models showed more overfitting and worse prognostic balance, and led to hazard ratios further from the reference estimate than did ITT DRSs, across sample sizes. Conclusions:In a study of anticoagulant safety, DRSs developed under an AT principle showed signs of overfitting and reduced confounding control. More research is needed to determine if development of DRSs under ITT is a viable solution to overfitting in other settings.

SUBMITTER: Bohn J

PROVIDER: S-EPMC6640656 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Controlling Confounding in a Study of Oral Anticoagulants: Comparing Disease Risk Scores Developed Using Different Follow-Up Approaches.

Bohn Justin J Schneeweiss Sebastian S Glynn Robert J RJ Toh Sengwee S Wyss Richard R Desai Rishi R Gagne Joshua J JJ

EGEMS (Washington, DC) 20190715 1

<h4>Purpose</h4>Little is known about how disease risk score (DRS) development should proceed under different pharmacoepidemiologic follow-up strategies. In an analysis of dabigatran vs. warfarin and risk of major bleeding, we compared the results of DRS adjustment when models were developed under "intention-to-treat" (ITT) and "as-treated" (AT) approaches.<h4>Methods</h4>We assessed DRS model discrimination, calibration, and ability to induce prognostic balance via the "dry run analysis". AT tr ...[more]

PMID: 31346542

Similar Datasets

Project description:BackgroundDespite direct oral anticoagulants (DOACs) being safer than warfarin for stroke prevention in atrial fibrillation (AF), major bleeding concerns persist. Most bleeding risk scores predate DOAC approval.ObjectivesThis study aimed to compare the Age, history of Bleeding, and non-bleeding related Hospitalisation [ABH] score's performance-derived for DOAC-treated patients-with those of 5 other scores (Anticoagulation and Risk Factors in Atrial Fibrillation [ATRIA], Hypertension, Abnormal renal/liver function, Stroke, Bleeding history or predisposition, Labile international normalized ratio, Elderly [>65 years], Drugs/alcohol concomitantly [HAS-BLED], Hepatic, Hepatic or Renal Disease, Ethanol Abuse, Malignancy, Older Age, Reduced Platelet Count or Function, Re-Bleeding, Hypertension, Anemia, Genetic Factors, Excessive Fall Risk and Stroke [HEMORR2HAGES], Outcomes Registry for Better Informed Treatment of Atrial Fibrillation [ORBIT-AF], and Congestive heart failure, Hypertension, Age ≥75 [doubled], Diabetes, Stroke [doubled]-Vascular disease, Age 65-74, Sex category [CHA2DS2-VASc]) in predicting DOAC-related major bleeding in patients with AF.MethodsIn this retrospective study of 2364 patients with nonvalvular AF on rivaroxaban or apixaban (median age, 68.3 years; 32.1% women), International Society on Thrombosis and Haemostasis-defined major bleeding (incidence, 4.1%; n = 97) was analyzed. C-statistics from time-dependent receiver operating characteristic (ROC) curves for continuous risk scores were the primary comparison metric, but other metrics, such as decision curves, were also compared.ResultsAt 100 days, C-statistics were highest for ORBIT-AF and ATRIA (0.62 and 0.61, respectively, with other scores having an area under the ROC curve of <0.60); some significant differences favored ORBIT-AF. At 1100 days, C-statistics remained highest for ORBIT-AF and ATRIA (0.62 and 0.61, respectively, with other scores having an area under the ROC curve of <0.60 again), and ORBIT-AF had significantly higher C-statistics than those for all other risk scores (P < .05), except for ATRIA. At 2100 days, all C-statistics were <0.60 with no significant differences. Decision curves showed the greatest net benefit for ORBIT-AF and ATRIA at 100 days and for ATRIA at 1100 days, with no discernible net benefit for any of the scores at 2100 days.ConclusionORBIT-AF and ATRIA provided the best bleeding risk prediction within the first 1100 days. None of the 6 bleeding risk scores provided predictive benefit over 2100 days of DOAC treatment.

Dataset Information

Controlling Confounding in a Study of Oral Anticoagulants: Comparing Disease Risk Scores Developed Using Different Follow-Up Approaches.

Publications

Controlling Confounding in a Study of Oral Anticoagulants: Comparing Disease Risk Scores Developed Using Different Follow-Up Approaches.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets