Dataset Information

Adding new experimental arms to randomised clinical trials: Impact on error rates.

ABSTRACT:

Background

Experimental treatments pass through various stages of development. If a treatment passes through early-phase experiments, the investigators may want to assess it in a late-phase randomised controlled trial. An efficient way to do this is adding it as a new research arm to an ongoing trial while the existing research arms continue, a so-called multi-arm platform trial. The familywise type I error rate is often a key quantity of interest in any multi-arm platform trial. We set out to clarify how it should be calculated when new arms are added to a trial some time after it has started.

Methods

We show how the familywise type I error rate, any-pair and all-pairs powers can be calculated when a new arm is added to a platform trial. We extend the Dunnett probability and derive analytical formulae for the correlation between the test statistics of the existing pairwise comparison and that of the newly added arm. We also verify our analytical derivation via simulations.

Results

Our results indicate that the familywise type I error rate depends on the shared control arm information (i.e. individuals in continuous and binary outcomes and primary outcome events in time-to-event outcomes) from the common control arm patients and the allocation ratio. The familywise type I error rate is driven more by the number of pairwise comparisons and the corresponding (pairwise) type I error rates than by the timing of the addition of the new arms. The familywise type I error rate can be estimated using Šidák's correction if the correlation between the test statistics of pairwise comparisons is less than 0.30.

Conclusions

The findings we present in this article can be used to design trials with pre-planned deferred arms or to add new pairwise comparisons within an ongoing platform trial where control of the pairwise error rate or familywise type I error rate (for a subset of pairwise comparisons) is required.

SUBMITTER: Choodari-Oskooei B

PROVIDER: S-EPMC7263043 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Adding new experimental arms to randomised clinical trials: Impact on error rates.

Choodari-Oskooei Babak B Bratton Daniel J DJ Gannon Melissa R MR Meade Angela M AM Sydes Matthew R MR Parmar Mahesh Kb MK

Clinical trials (London, England) 20200217 3

<h4>Background</h4>Experimental treatments pass through various stages of development. If a treatment passes through early-phase experiments, the investigators may want to assess it in a late-phase randomised controlled trial. An efficient way to do this is adding it as a new research arm to an ongoing trial while the existing research arms continue, a so-called multi-arm platform trial. The familywise type I error rate is often a key quantity of interest in any multi-arm platform trial. We set ...[more]

PMID: 32063029

Similar Datasets

Project description:INTRODUCTION:Participation in mammographic screening for breast cancer in Australia is approximately 54% among the general population, but screening among women from some culturally and linguistically diverse (CALD) backgrounds is lower. BreastScreen Victoria apply strategies to increase screening including reminder letters and phone calls; however, these are usually provided in English. Using intervention strategies generated from the Ophelia (OPtimise HEalth LIteracy and Access) community co-design process, translated mammography reminder letters and in-language phone calls were tested within two randomised control trials (RCTs). METHODS AND ANALYSIS:Women aged 50-75 years who were due for their 2-yearly screening mammography (for RCT#1) or were under-screened, i.e. ?27 months since last screen (for RCT#2) were randomised into intervention or control groups. RCT#1 compared sending women routine reminder letters (English only) with translated (Arabic or Italian) letters. RCT#2 compared reminder telephone calls to women in their preferred language (Arabic or Italian) to no telephone call. The primary outcome for each trial was screening booking rates within 14-days. Primary outcomes were tested using Pearson's chi-square test. Rates within language group (incidence ratio: IR) were compared using the Cochran-Mantel-Haenszel test. RESULTS:For RCT#1 (letters) 1,032 women were randomised into the intervention arm or to usual care. Uptake of screening bookings was similar between both groups, with no differences observed by language group. For RCT#2 (phone calls), 195 women were randomised to the intervention group or to usual care. Overall, 64.2% of women in the intervention arm and 6% in the control arm booked a screening appointment within 14 days (p<0.0001). The IR (95%CI) of booking was 10.1 (3.9, 26.3) times higher among Italian women, and 11.6 (2.9, 46.5) times higher among Arabic women in the intervention compared to usual care groups. DISCUSSION AND CONCLUSION:A service improvement initiative derived from community members and breast screen providers was found to be highly effective. This evidence informed the service provider, BreastScreen Victoria, who have implemented these improvements into routine practice to improve screening among CALD groups and reduce health inequalities.

Project description:ObjectivesTo study the impact of blinding on estimated treatment effects, and their variation between trials; differentiating between blinding of patients, healthcare providers, and observers; detection bias and performance bias; and types of outcome (the MetaBLIND study).DesignMeta-epidemiological study.Data sourceCochrane Database of Systematic Reviews (2013-14).Eligibility criteria for selecting studiesMeta-analyses with both blinded and non-blinded trials on any topic.Review methodsBlinding status was retrieved from trial publications and authors, and results retrieved automatically from the Cochrane Database of Systematic Reviews. Bayesian hierarchical models estimated the average ratio of odds ratios (ROR), and estimated the increases in heterogeneity between trials, for non-blinded trials (or of unclear status) versus blinded trials. Secondary analyses adjusted for adequacy of concealment of allocation, attrition, and trial size, and explored the association between outcome subjectivity (high, moderate, low) and average bias. An ROR lower than 1 indicated exaggerated effect estimates in trials without blinding.ResultsThe study included 142 meta-analyses (1153 trials). The ROR for lack of blinding of patients was 0.91 (95% credible interval 0.61 to 1.34) in 18 meta-analyses with patient reported outcomes, and 0.98 (0.69 to 1.39) in 14 meta-analyses with outcomes reported by blinded observers. The ROR for lack of blinding of healthcare providers was 1.01 (0.84 to 1.19) in 29 meta-analyses with healthcare provider decision outcomes (eg, readmissions), and 0.97 (0.64 to 1.45) in 13 meta-analyses with outcomes reported by blinded patients or observers. The ROR for lack of blinding of observers was 1.01 (0.86 to 1.18) in 46 meta-analyses with subjective observer reported outcomes, with no clear impact of degree of subjectivity. Information was insufficient to determine whether lack of blinding was associated with increased heterogeneity between trials. The ROR for trials not reported as double blind versus those that were double blind was 1.02 (0.90 to 1.13) in 74 meta-analyses.ConclusionNo evidence was found for an average difference in estimated treatment effect between trials with and without blinded patients, healthcare providers, or outcome assessors. These results could reflect that blinding is less important than often believed or meta-epidemiological study limitations, such as residual confounding or imprecision. At this stage, replication of this study is suggested and blinding should remain a methodological safeguard in trials.

Project description:Background:There is debate in the literature as to whether inclusion of a placebo arm may alter characteristics of antidepressant trials. However, previous research has focused on response rates of various antidepressants on average only, ignoring potential differences among drugs or other aspects of trial findings. Little is known about the impact of a placebo arm on all-cause dropout and dropout due to adverse events. Methods:We carried out a systematic review of published and unpublished double-blind randomized controlled trials (RCTs) for the acute treatment of unipolar major depression (update: January 2016). The probability of being allocated to placebo (?) was the exposure of interest, and we examined its influence on responders (efficacy), all-cause dropouts (acceptability) and dropouts due to adverse events (tolerability), while accounting for differences in drugs, trials and patient characteristics in multivariate random effects meta-regression. Results:We included 421 studies (68 305 participants) comparing 16 antidepressants or placebo; ? ranged from 20% to 50%. Response rate was lower [risk ratio (RR) 0.87; 95% confidence interval (CI) 0.83, 0.92] and all-cause dropout rate higher (RR 1.19; 95% CI 1.08, 1.31) for the same antidepressants in placebo-controlled trials compared with head-to-head trials. The probability of responding decreased by 3% (95% CI 2-5%) for every 10% increase in ?, whereas the risk of all-cause dropout increased by 4% (95% CI 1-7%). Tolerability was unaffected by ?. Response rate was inversely correlated with dropouts due to any cause (correlation coefficient -0.48; 95% CI -0.58, -0.36) and due to adverse events (-0.34; 95% CI -0.44, -0.23). Conclusions:For the same antidepressant, response rate was on average smaller and dropouts higher when placebo was included; however, no association was found with dropouts due to adverse events. Decreased patient expectations, larger dropout rates and use of inappropriate statistical methods to impute missing data may explain this phenomenon. The findings call for caution in the integration of randomized evidence involving placebo arms.

Dataset Information

Adding new experimental arms to randomised clinical trials: Impact on error rates.

Background

Methods

Results

Conclusions

Publications

Adding new experimental arms to randomised clinical trials: Impact on error rates.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets