Dataset Information

Intention-to-treat analysis may be more conservative than per protocol analysis in antibiotic non-inferiority trials: a systematic review.

ABSTRACT:

Background

In non-inferiority trials, there is a concern that intention-to-treat (ITT) analysis, by including participants who did not receive the planned interventions, may bias towards making the treatment and control arms look similar and lead to mistaken claims of non-inferiority. In contrast, per protocol (PP) analysis is viewed as less likely to make this mistake and therefore preferable in non-inferiority trials. In a systematic review of antibiotic non-inferiority trials, we compared ITT and PP analyses to determine which analysis was more conservative.

Methods

In a secondary analysis of a systematic review, we included non-inferiority trials that compared different antibiotic regimens, used absolute risk reduction (ARR) as the main outcome and reported both ITT and PP analyses. All estimates and confidence intervals (CIs) were oriented so that a negative ARR favored the control arm, and a positive ARR favored the treatment arm. We compared ITT to PP analyses results. The more conservative analysis between ITT and PP analyses was defined as the one having a more negative lower CI limit.

Results

The analysis included 164 comparisons from 154 studies. In terms of the ARR, ITT analysis yielded the more conservative point estimate and lower CI limit in 83 (50.6%) and 92 (56.1%) comparisons respectively. The lower CI limits in ITT analysis favored the control arm more than in PP analysis (median of - 7.5% vs. -6.9%, p = 0.0402). CIs were slightly wider in ITT analyses than in PP analyses (median of 13.3% vs. 12.4%, p < 0.0001). The median success rate was 89% (interquartile range IQR 82 to 93%) in the PP population and 44% (IQR 23 to 60%) in the patients who were included in the ITT population but excluded from the PP population (p < 0.0001).

Conclusions

Contrary to common belief, ITT analysis was more conservative than PP analysis in the majority of antibiotic non-inferiority trials. The lower treatment success rate in the ITT analysis led to a larger variance and wider CI, resulting in a more conservative lower CI limit. ITT analysis should be mandatory and considered as either the primary or co-primary analysis for non-inferiority trials.

Trial registration

PROSPERO registration number CRD42020165040 .

SUBMITTER: Bai AD

PROVIDER: S-EPMC8054385 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND: The risk of malignancies on TNF-? antagonists is controversial. The aim of this survey was to assess cancer risk on TNF-? antagonists in adult rheumatoid arthritis patients, including the five marketed drugs (infliximab, etanercept, adalimumab, golimumab and certolizumab) used in line with the New Drug Application. Furthermore, the relative interest of modified intention to treat or per protocol analyses to assess such sparse events remains unknown. METHODOLOGY/PRINCIPAL FINDINGS: Data sources were MEDLINE, CENTRAL, ISI Web of Science, ACR and EULAR meeting abstracts, scientific evaluation of the drugs leading to their marketing approval, and clinicaltrials.gov, until 31 December 2012.We selected double-blind randomized controlled trials in adult rheumatoid arthritis patients, including at least one treatment arm in line with New Drug Application. We performed random effect meta-analysis, with modified intention to treat and per protocol analyses. Thirty-three trials were included. There was no excess risk of malignancies on anti-TNF-? administered in line with New Drug Application in the per protocol model (OR, 0.93 95%CI[0.59-1.44]), as well as in the modified intention to treat model (OR, 1.27 95%CI[0.82-1.98]). There was a non-significant tendency for an excess non-melanoma skin cancer risk in both models (respectively, 1.37 [0.71-2.66] and 1.90 [0.98-3.67]). With fixed effect Peto model restricting to trials during at least 52 weeks, the overall cancer risk was respectively 1.60 [0.97-2.64] and 1.22 [0.72-2.08]. Whatever the model, modified intention to treat analysis led to higher estimations than per protocol analysis. The later may underestimate the treatment effect when assessing very sparse events and when many patients dropped out in placebo arms. In metaregression, there was no differential risk among the five drugs. CONCLUSIONS/SIGNIFICANCE: This study did not find any evidence for an excess cancer risk on TNF-? antagonists in adult rheumatoid arthritis patients, but an excess cancer risk after several years of exposure cannot be ruled out. Both modified intention to treat and per protocol analyses should be presented in such safety analyses.

Project description:ObjectivesTo determine the incidence and characteristics of randomised controlled trials that report using the modified intention to treat approach, and how the approach is described.DesignSystematic review.Data sourcesPubMed, Embase, Cochrane central register of controlled trials, ISI Web of Knowledge, Ovid, HighWire Press, Science-Direct, Ingenta, Medscape, BioMed Central, Springer, and Wiley, from inception to December 2006.Main outcome measuresIncidence of trials in which use of modified intention to treat was reported, and how the approach was described (classified according to the type and number of deviations from the intention to treat approach).Results475 randomised controlled trials reported use of a modified intention to treat analysis. Of these, 76 (16%) were published in five highly cited general medical journals. The incidence of all trials that reported use of modified intention to treat published in journals indexed in Medline increased from 0.006% in 1982-6 to 0.5% in 2002-6 (P<0.001 for linear trend). When the description of the modified intention to treat was examined in each trial, 192 (40%) reported one type of deviation from the intention to treat approach, 261 (55%) reported two or more types, and 22 (5%) did not describe any type. In 266 (56%) of the trials the deviation was related to the treatment received, in 196 (41%) to a post baseline assessment, in 118 (25%) to a baseline assessment, in 108 (23%) to a target condition, and in 23 (5%) to follow-up. Post-randomisation exclusions occurred in 380 (80%) trials. The results reported by 270 of the 352 (77%) superiority trials favoured the drug under investigation. All of the 123 trials using equivalence or non-inferiority methods to investigate interventions reported results that favoured their assumptions.ConclusionsRandomised controlled trials that report using a modified intention to treat are increasingly being published in the medical literature. The descriptions of such an approach were ambiguous, and may cover any type of descriptions for exclusion, such as missing data and deviation from protocol. Explicit statements about post-randomisation exclusions should replace the ambiguous terminology of modified intention to treat.

Project description:ObjectiveTo examine whether deviation from the standard intention to treat analysis has an influence on treatment effect estimates of randomised trials.DesignMeta-epidemiological study.Data sourcesMedline, via PubMed, searched between 2006 and 2010; 43 systematic reviews of interventions and 310 randomised trials were included.Eligibility criteria for selecting studiesFrom each year searched, random selection of 5% of intervention reviews with a meta-analysis that included at least one trial that deviated from the standard intention to treat approach. Basic characteristics of the systematic reviews and randomised trials were extracted. Information on the reporting of intention to treat analysis, outcome data, risk of bias items, post-randomisation exclusions, and funding were extracted from each trial. Trials were classified as: ITT (reporting the standard intention to treat approach), mITT (reporting a deviation from the standard approach), and no ITT (reporting no approach). Within each meta-analysis, treatment effects were compared between mITT and ITT trials, and between mITT and no ITT trials. The ratio of odds ratios was calculated (value <1 indicated larger treatment effects in mITT trials than in other trial categories).Results50 meta-analyses and 322 comparisons of randomised trials (from 84 ITT trials, 118 mITT trials, and 108 no ITT trials; 12 trials contributed twice to the analysis) were examined. Compared with ITT trials, mITT trials showed a larger intervention effect (pooled ratio of odds ratios 0.83 (95% confidence interval 0.71 to 0.96), P=0.01; between meta-analyses variance τ(2)=0.13). Adjustments for sample size, type of centre, funding, items of risk of bias, post-randomisation exclusions, and variance of log odds ratio yielded consistent results (0.80 (0.69 to 0.94), P=0.005; τ(2)=0.08). After exclusion of five influential studies, results remained consistent (0.85 (0.75 to 0.98); τ(2)=0.08). The comparison between mITT trials and no ITT trials showed no statistical difference between the two groups (adjusted ratio of odds ratios 0.92 (0.70 to 1.23); τ(2)=0.57).ConclusionsTrials that deviated from the intention to treat analysis showed larger intervention effects than trials that reported the standard approach. Where an intention to treat analysis is impossible to perform, authors should clearly report who is included in the analysis and attempt to perform multiple imputations.