An optimised multi-arm multi-stage clinical trial design for unknown variance.
Ontology highlight
ABSTRACT:
SUBMITTER: Grayling MJ
PROVIDER: S-EPMC5886309 | biostudies-literature | 2018 Apr
REPOSITORIES: biostudies-literature
Publications
An optimised multi-arm multi-stage clinical trial design for unknown variance.
Grayling Michael J MJ Wason James M S JMS Mander Adrian P AP
Contemporary clinical trials 20180221
Multi-arm multi-stage trial designs can bring notable gains in efficiency to the drug development process. However, for normally distributed endpoints, the determination of a design typically depends on the assumption that the patient variance in response is known. In practice, this will not usually be the case. To allow for unknown variance, previous research explored the performance of t-test statistics, coupled with a quantile substitution procedure for modifying the stopping boundaries, at c ...[more]
Similar Datasets
Project description:Randomised controlled trials are becoming increasingly costly and time-consuming. In 2011, Royston and colleagues proposed a particular class of multi-arm multi-stage (MAMS) designs intended to speed up the evaluation of new treatments in phase II and III clinical trials. Their design, which controls the type I error rate and power for each pairwise comparison, discontinues randomisation to poorly performing arms at interim analyses if they fail to show a pre-specified level of benefit over the control arm. Arms in which randomisation is continued to the final stage of the trial are compared against the control on a definitive time-to-event outcome measure. To increase efficiency, interim comparisons can be made on an intermediate time-to-event outcome which is on the causal pathway to the definitive outcome.We adapt Royston's MAMS design to binary outcomes observed at the end of a fixed follow-up period and analysed using an absolute difference in proportions. We apply the design to tuberculosis (TB), an area where many new drugs are in development, and demonstrate how it can greatly accelerate the evaluation of new TB regimens. We use simulations to support the extensions to the methodology and to investigate the amount of bias in the estimated treatment effects of arms in which randomisation is ceased at the first interim analysis and arms which continue to the final stage of the trial.The proposed seamless phase II/III TB trial designs are shown to greatly reduce sample size requirements and trial duration compared to conducting separate phase II and III trials. The bias in the estimated treatment effects for the definitive outcome is shown to be small, especially when treatment selection is based on an intermediate outcome or when a reanalysis is performed at the planned end of the trial after all recruited patients have completed follow-up.The proposed designs are practical and could be used in a variety of disease areas. They hold considerable promise for speeding up the evaluation of new treatments particularly in TB where many new regimens will soon be available for testing in phase II and phase III trials.
| S-EPMC3840569 | biostudies-literature
Project description:BackgroundIn recent years, the popularity of multi-arm multi-stage, seamless adaptive, and platform trials has increased. However, many design-related questions and questions regarding which operating characteristics should be evaluated to determine the potential performance of a specific trial design remain and are often further complicated by the complexity of such trial designs.MethodsA systematic search was conducted to review existing software for the design of platform trials, whereby multi-arm multi-stage trials were also included. The results of this search are reported both on the literature level and the software level, highlighting the software judged to be particularly useful.ResultsIn recent years, many highly specialized software packages targeting single design elements on platform studies have been released. Only a few of the developed software packages provide extensive design flexibility, at the cost of limited access due to being commercial or not being usable as out-of-the-box solutions.ConclusionsWe believe that both an open-source modular software similar to OCTOPUS and a collaborative effort will be necessary to create software that takes advantage of and investigates the impact of all the flexibility that platform trials potentially provide.
| S-EPMC7931508 | biostudies-literature
Project description:Multi-arm multi-stage designs, in which multiple active treatments are compared to a control and accumulated information from interim data are used to add or remove arms from the trial, may reduce development costs and shorten the drug development timeline. As such, this adaptive update is a natural complement to Bayesian methodology in which the prior clinical belief is sequentially updated using the observed probability of success. Simulation is often required for planning clinical trials to accommodate the complexity of the design and to optimize key design characteristics. This paper addresses two key limiting factors in simulations, namely the computational burden and the time needed to obtain results. We first introduce a generic process for simulating Bayesian multi-arm multi-stage designs with binary endpoints. Then, to address the computational burden and time, we optimize the method for calculating the posterior probability and posterior predictive probability of success.
| S-EPMC7751063 | biostudies-literature
Project description:To speed up the evaluation of new therapies, the multi-arm, multi-stage trial design was suggested previously by the authors.In this paper, we evaluate the performance of the two-stage, multi-arm design using four cancer trials conducted at the MRC CTU. The performance of the design at fictitious interim analyses is assessed using a conditional bootstrap approach.Two main aims are addressed: the error rate of correctly carrying on/stopping the trial at an interim analysis as well as quantifying the gains in terms of resources by employing this design. Furthermore, we make suggestions for the best timing of this interim analysis.Multi-arm, multi-stage trials are an effective way of speeding up the therapy evaluation process. The design performs well in terms of the type I and II error rates.
| S-EPMC2680399 | biostudies-other
Project description:BACKGROUND:Multi-arm designs provide an effective means of evaluating several treatments within the same clinical trial. Given the large number of treatments now available for testing in many disease areas, it has been argued that their utilisation should increase. However, for any given clinical trial there are numerous possible multi-arm designs that could be used, and choosing between them can be a difficult task. This task is complicated further by a lack of available easy-to-use software for designing multi-arm trials. RESULTS:To aid the wider implementation of multi-arm clinical trial designs, we have developed a web application for sample size calculation when using a variety of popular multiple comparison corrections. Furthermore, the application supports sample size calculation to control several varieties of power, as well as the determination of optimised arm-wise allocation ratios. It is built using the Shiny package in the R programming language, is free to access on any device with an internet browser, and requires no programming knowledge to use. It incorporates a variety of features to make it easier to use, including help boxes and warning messages. Using design parameters motivated by a recently completed phase II oncology trial, we demonstrate that the application can effectively determine and evaluate complex multi-arm trial designs. CONCLUSIONS:The application provides the core information required by statisticians and clinicians to review the operating characteristics of a chosen multi-arm clinical trial design. The range of designs supported by the application is broader than other currently available software solutions. Its primary limitation, particularly from a regulatory agency point of view, is its lack of validation. However, we present an approach to efficiently confirming its results via simulation.
| S-EPMC6995188 | biostudies-literature
Project description:Multi-arm clinical trials that compare several active treatments to a common control have been proposed as an efficient means of making an informed decision about which of several treatments should be evaluated further in a confirmatory study. Additional efficiency is gained by incorporating interim analyses and, in particular, seamless Phase II/III designs have been the focus of recent research. Common to much of this work is the constraint that selection and formal testing should be based on a single efficacy endpoint, despite the fact that in practice, safety considerations will often play a central role in determining selection decisions. Here, we develop a multi-arm multi-stage design for a trial with an efficacy and safety endpoint. The safety endpoint is explicitly considered in the formulation of the problem, selection of experimental arm and hypothesis testing. The design extends group-sequential ideas and considers the scenario where a minimal safety requirement is to be fulfilled and the treatment yielding the best combined safety and efficacy trade-off satisfying this constraint is selected for further testing. The treatment with the best trade-off is selected at the first interim analysis, while the whole trial is allowed to compose of J analyses. We show that the design controls the familywise error rate in the strong sense and illustrate the method through an example and simulation. We find that the design is robust to misspecification of the correlation between the endpoints and requires similar numbers of subjects to a trial based on efficacy alone for moderately correlated endpoints.
| S-EPMC4950037 | biostudies-literature
Project description:BACKGROUND:Gehan's two-stage design was historically the design of choice for phase II oncology trials. One of the reasons it is less frequently used today is that it does not allow for a formal test of treatment efficacy, and therefore does not control conventional type-I and type-II error-rates. METHODS:We describe how recently developed methodology for flexible two-stage single-arm trials can be used to incorporate the hypothesis test commonly associated with phase II trials in to Gehan's design. We additionally detail how this hypothesis test can be optimised in order to maximise its power, and describe how the second stage sample sizes can be chosen to more readily provide the operating characteristics that were originally envisioned by Gehan. Finally, we contrast our modified Gehan designs to Simon's designs, based on two examples motivated by real clinical trials. RESULTS:Gehan's original designs are often greatly under- or over-powered when compared to type-II error-rates typically used in phase II. However, we demonstrate that the control parameters of his design can be chosen to resolve this problem. With this, though, the modified Gehan designs have operating characteristics similar to the more familiar Simon designs. CONCLUSIONS:The trial design settings in which Gehan's design will be preferable over Simon's designs are likely limited. Provided the second stage sample sizes are chosen carefully, however, one scenario of potential utility is when the trial's primary goal is to ascertain the treatment response rate to a certain precision.
| S-EPMC6350340 | biostudies-literature
Project description:BackgroundTuberculosis is the world's leading infectious disease killer. We aimed to identify shorter, safer drug regimens for the treatment of tuberculosis.MethodsWe did a randomised controlled, open-label trial with a multi-arm, multi-stage design. The trial was done in seven sites in South Africa and Tanzania, including hospitals, health centres, and clinical trial centres. Patients with newly diagnosed, rifampicin-sensitive, previously untreated pulmonary tuberculosis were randomly assigned in a 1:1:1:1:2 ratio to receive (all orally) either 35 mg/kg rifampicin per day with 15-20 mg/kg ethambutol, 20 mg/kg rifampicin per day with 400 mg moxifloxacin, 20 mg/kg rifampicin per day with 300 mg SQ109, 10 mg/kg rifampicin per day with 300 mg SQ109, or a daily standard control regimen (10 mg/kg rifampicin, 5 mg/kg isoniazid, 25 mg/kg pyrazinamide, and 15-20 mg/kg ethambutol). Experimental treatments were given with oral 5 mg/kg isoniazid and 25 mg/kg pyrazinamide per day for 12 weeks, followed by 14 weeks of 5 mg/kg isoniazid and 10 mg/kg rifampicin per day. Because of the orange discoloration of body fluids with higher doses of rifampicin it was not possible to mask patients and clinicians to treatment allocation. The primary endpoint was time to culture conversion in liquid media within 12 weeks. Patients without evidence of rifampicin resistance on phenotypic test who took at least one dose of study treatment and had one positive culture on liquid or solid media before or within the first 2 weeks of treatment were included in the primary analysis (modified intention to treat). Time-to-event data were analysed using a Cox proportional-hazards regression model and adjusted for minimisation variables. The proportional hazard assumption was tested using Schoelfeld residuals, with threshold p<0·05 for non-proportionality. The trial is registered with ClinicalTrials.gov (NCT01785186).FindingsBetween May 7, 2013, and March 25, 2014, we enrolled and randomly assigned 365 patients to different treatment arms (63 to rifampicin 35 mg/kg, isoniazid, pyrazinamide, and ethambutol; 59 to rifampicin 10 mg/kg, isoniazid, pyrazinamide, SQ109; 57 to rifampicin 20 mg/kg, isoniazid, pyrazinamide, and SQ109; 63 to rifampicin 10 mg/kg, isoniazid, pyrazinamide, and moxifloxacin; and 123 to the control arm). Recruitment was stopped early in the arms containing SQ109 since prespecified efficacy thresholds were not met at the planned interim analysis. Time to stable culture conversion in liquid media was faster in the 35 mg/kg rifampicin group than in the control group (median 48 days vs 62 days, adjusted hazard ratio 1·78; 95% CI 1·22-2·58, p=0·003), but not in other experimental arms. There was no difference in any of the groups in time to culture conversion on solid media. 11 patients had treatment failure or recurrent disease during post-treatment follow-up: one in the 35 mg/kg rifampicin arm and none in the moxifloxacin arm. 45 (12%) of 365 patients reported grade 3-5 adverse events, with similar proportions in each arm.InterpretationA dose of 35 mg/kg rifampicin was safe, reduced the time to culture conversion in liquid media, and could be a promising component of future, shorter regimens. Our adaptive trial design was successfully implemented in a multi-centre, high tuberculosis burden setting, and could speed regimen development at reduced cost.FundingThe study was funded by the European and Developing Countries Clinical Trials partnership (EDCTP), the German Ministry for Education and Research (BmBF), and the Medical Research Council UK (MRC).
| S-EPMC5159618 | biostudies-literature
Project description:BackgroundMulti-Arm Multi-Stage designs aim at comparing several new treatments to a common reference, in order to select or drop any treatment arm to move forward when such evidence already exists based on interim analyses. We redesigned a Bayesian adaptive design initially proposed for dose-finding, focusing our interest in the comparison of multiple experimental drugs to a control on a binary criterion measure.MethodsWe redesigned a phase II clinical trial that randomly allocates patients across three (one control and two experimental) treatment arms to assess dropping decision rules. We were interested in dropping any arm due to futility, either based on historical control rate (first rule) or comparison across arms (second rule), and in stopping experimental arm due to its ability to reach a sufficient response rate (third rule), using the difference of response probabilities in Bayes binomial trials between the treated and control as a measure of treatment benefit. Simulations were then conducted to investigate the decision operating characteristics under a variety of plausible scenarios, as a function of the decision thresholds.ResultsOur findings suggest that one experimental treatment was less efficient than the control and could have been dropped from the trial based on a sample of approximately 20 instead of 40 patients. In the simulation study, stopping decisions were reached sooner for the first rule than for the second rule, with close mean estimates of response rates and small bias. According to the decision threshold, the mean sample size to detect the required 0.15 absolute benefit ranged from 63 to 70 (rule 3) with false negative rates of less than 2 % (rule 1) up to 6 % (rule 2). In contrast, detecting a 0.15 inferiority in response rates required a sample size ranging on average from 23 to 35 (rules 1 and 2, respectively) with a false positive rate ranging from 3.6 to 0.6 % (rule 3).ConclusionAdaptive trial design is a good way to improve clinical trials. It allows removing ineffective drugs and reducing the trial sample size, while maintaining unbiased estimates. Decision thresholds can be set according to predefined fixed error decision rates.Trial registrationClinicalTrials.gov Identifier: NCT01342692 .
| S-EPMC5399439 | biostudies-literature
Project description:Background and objectives: Impacts of mindfulness-based programs on blood pressure remain equivocal, possibly because the programs are not adapted to engage with determinants of hypertension, or due to floor effects. Primary objectives were to create a customized Mindfulness-Based Blood Pressure Reduction (MB-BP) program, and to evaluate acceptability, feasibility, and effects on hypothesized proximal self-regulation mechanisms. Secondary outcomes included modifiable determinants of blood pressure (BP), and clinic-assessed systolic blood pressure (SBP).Methods: This was a Stage 1 single-arm trial with one year follow-up. Focus groups and in-depth interviews were performed to evaluate acceptability and feasibility. Self-regulation outcomes, and determinants of BP, were assessed using validated questionnaires or objective assessments. The MB-BP curriculum was adapted from Mindfulness-Based Stress Reduction to direct participants' mindfulness skills towards modifiable determinants of blood pressure.Results: Acceptability and feasibility findings showed that of 53 eligible participants, 48 enrolled (91%). Of these, 43 (90%) attended at least 7 of the 10 MB-BP classes; 43 were followed to one year (90%). Focus groups (n = 19) and semi-structured interviews (n = 10) showed all participants viewed the delivery modality favorably, and identified logistic considerations concerning program access as barriers. A priori selected primary self-regulation outcomes showed improvements at one-year follow-up vs. baseline, including attention control (Sustained Attention to Response Task correct no-go score, p<0.001), emotion regulation (Difficulties in Emotion Regulation Score, p = 0.02), and self-awareness (Multidimensional Assessment of Interoceptive Awareness, p<0.001). Several determinants of hypertension were improved in participants not adhering to American Heart Association guidelines at baseline, including physical activity (p = 0.02), Dietary Approaches to Stop Hypertension-consistent diet (p<0.001), and alcohol consumption (p<0.001). Findings demonstrated mean 6.1 mmHg reduction in SBP (p = 0.008) at one year follow-up; effects were most pronounced in Stage 2 uncontrolled hypertensives (SBP?140 mmHg), showing 15.1 mmHg reduction (p<0.001).Conclusion: MB-BP has good acceptability and feasibility, and may engage with self-regulation and behavioral determinants of hypertension.
| S-EPMC6881004 | biostudies-literature