Dataset Information

Bayesian group sequential designs for phase III emergency medicine trials: a case study using the PARAMEDIC2 trial.

ABSTRACT:

Background

Phase III trials often require large sample sizes, leading to high costs and delays in clinical decision-making. Group sequential designs can improve trial efficiency by allowing for early stopping for efficacy and/or futility and thus may decrease the sample size, trial duration and associated costs. Bayesian approaches may offer additional benefits by incorporating previous information into the analyses and using decision criteria that are more practically relevant than those used in frequentist approaches. Frequentist group sequential designs have often been used for phase III studies, but the use of Bayesian group sequential designs is less common. The aim of this work was to explore how Bayesian group sequential designs could be constructed for phase III trials conducted in emergency medicine.

Methods

The PARAMEDIC2 trial was a phase III randomised controlled trial that compared the use of adrenaline to placebo in out-of-hospital cardiac arrest patients on 30-day survival rates. It used a frequentist group sequential design to allow early stopping for efficacy or harm. We constructed several alternative Bayesian group sequential designs and studied their operating characteristics via simulation. We then virtually re-executed the trial by applying the Bayesian designs to the PARAMEDIC2 data to demonstrate what might have happened if these designs had been used in practice.

Results

We produced three alternative Bayesian group sequential designs, each of which had greater than?90% power to detect the target treatment effect. A Bayesian design which performed interim analyses every 500 patients recruited produced the lowest average sample size. Using the alternative designs, the PARAMEDIC2 trial could have declared adrenaline superior for 30-day survival with approximately 1500 fewer patients.

Conclusions

Using the PARAMEDIC2 trial as a case study, we demonstrated how Bayesian group sequential designs can be constructed for phase III emergency medicine trials. The Bayesian framework enabled us to obtain efficient designs using decision criteria based on the probability of benefit or harm. It also enabled us to incorporate information from previous studies on the treatment effect via the prior distributions. We recommend the wider use of Bayesian approaches in phase III clinical trials.

Trial registration

PARAMEDIC2 Trial registration ISRCTN, ISRCTN73485024. Registered 13 March 2014, http://www.isrctn.com/ISRCTN73485024.

SUBMITTER: Ryan EG

PROVIDER: S-EPMC6961266 | biostudies-literature | 2020 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Bayesian group sequential designs for phase III emergency medicine trials: a case study using the PARAMEDIC2 trial.

Ryan Elizabeth G EG Stallard Nigel N Lall Ranjit R Ji Chen C Perkins Gavin D GD Gates Simon S

Trials 20200114 1

<h4>Background</h4>Phase III trials often require large sample sizes, leading to high costs and delays in clinical decision-making. Group sequential designs can improve trial efficiency by allowing for early stopping for efficacy and/or futility and thus may decrease the sample size, trial duration and associated costs. Bayesian approaches may offer additional benefits by incorporating previous information into the analyses and using decision criteria that are more practically relevant than thos ...[more]

PMID: 31937351

Similar Datasets

Project description:BackgroundBayesian adaptive designs can be more efficient than traditional methods for multi-arm randomised controlled trials. The aim of this work was to demonstrate how Bayesian adaptive designs can be constructed for multi-arm phase III clinical trials and assess potential benefits that these designs offer.MethodsWe constructed several alternative Bayesian adaptive designs for the Collaborative Ankle Support Trial (CAST), which was a randomised controlled trial that compared four treatments for severe ankle sprain. These designs incorporated response adaptive randomisation (RAR), arm dropping, and early stopping for efficacy or futility. We studied the operating characteristics of the Bayesian designs via simulation. We then virtually re-executed the trial by implementing the Bayesian adaptive designs using patient data sampled from the CAST study to demonstrate the practical applicability of the designs.ResultsWe constructed five Bayesian adaptive designs, each of which had high power and recruited fewer patients on average than the original designs target sample size. The virtual executions showed that most of the Bayesian designs would have led to trials that declared superiority of one of the interventions over the control. Bayesian adaptive designs with RAR or arm dropping were more likely to allocate patients to better performing arms at each interim analysis. Similar estimates and conclusions were obtained from the Bayesian adaptive designs as from the original trial.ConclusionsUsing CAST as an example, this case study shows how Bayesian adaptive designs can be constructed for phase III multi-arm trials using clinically relevant decision criteria. These designs demonstrated that they can potentially generate earlier results and allocate more patients to better performing arms. We recommend the wider use of Bayesian adaptive approaches in phase III clinical trials.Trial registrationCAST study registration ISRCTN, ISRCTN37807450. Retrospectively registered on 25 April 2003.

Project description:BackgroundTrial design plays a key role in clinical trials. Traditional group sequential design has been used in cardiovascular clinical trials over decades as the trials can potentially be stopped early, therefore, it can reduce pre-planned sample size and trial resources. In contrast, trials with adoptive designs provide greater flexibility and are more efficient due to the ability to modify trial design according to the interim analysis results. In this systematic review, we aim to explore characteristics of adaptive and traditional group sequential trials in practice and to gain an understanding how these trial designs are currently being reported in cardiology.MethodsPubMed, Embase and Cochrane Central Register of Controlled Trials database were searched from January 1980 to June 2022. Randomised controlled phase 2/3 trials with either adaptive or traditional group sequential design in patients with cardiovascular disease were included. Descriptive statistics were used to present the collected data.ResultsOf 456 articles found in the initial search, 56 were identified including 43 (76.8%) trials with traditional group sequential design and 13 (23.2%) with adaptive. Most trials were large, multicentre, led by the USA (50%) and Europe (28.6%), and were funded by companies (78.6%). For trials with group sequential design, frequency of interim analyses was determined mainly by the number of events (47%). 67% of the trials stopped early, in which 14 (32.6%) were due to efficacy, and 5 (11.6%) for futility. The commonly used stopping rule to terminate trials was O'Brien- Fleming-type alpha spending function (10 (23.3%)). For trials with adaptive designs, 54% of the trials stopped early, in which 4 (30.8%) were due to futility, and 2 (15.4%) for efficacy. Sample size re-estimation was commonly used (8 (61.5%)). In 69% of the trials, simulation including Bayesian approach was used to define the statistical stopping rules. The adaptive designs have been increasingly used (from 0 to 1999 to 38.6% after 2015 amongst adaptive trials). 25% of the trials reported "adaptive" in abstract or title of the studies.ConclusionsThe application of adaptive trials is increasingly popular in cardiovascular clinical trials. The reporting of adaptive design needs improving.

Project description:In clinical trials, the opportunity for an early stop during an interim analysis (either for efficacy or for futility) may relevantly save time and financial resources. This is especially important, if the planning assumptions required for power calculation are based on a low level of evidence. For example, when including two primary endpoints in the confirmatory analysis, the power of the trial depends on the effects of both endpoints and on their correlation. Assessing the feasibility of such a trial is therefore difficult, as the number of parameter assumptions to be correctly specified is large. For this reason, so-called 'group sequential designs' are of particular importance in this setting. Whereas the choice of adequate boundaries to stop a trial early for efficacy has been broadly discussed in the literature, the choice of optimal futility boundaries has not been investigated so far, although this may have serious consequences with respect to performance characteristics.In this work, we propose a general method to construct 'optimal' futility boundaries according to predefined criteria. Further, we present three different group sequential designs for two endpoints applying these futility boundaries. Our methods are illustrated by a real clinical trial example and by Monte-Carlo simulations.By construction, the provided method of choosing futility boundaries maximizes the probability to correctly stop in case of small or opposite effects while limiting the power loss and the probability of stopping the study 'wrongly'. Our results clearly demonstrate the benefit of using such 'optimal' futility boundaries, especially compared to futility boundaries commonly applied in practice.As the properties of futility boundaries are often not considered in practice and unfavorably chosen futility boundaries may imply bad properties of the study design, we recommend assessing the performance of these boundaries according to the criteria proposed in here.

Dataset Information

Bayesian group sequential designs for phase III emergency medicine trials: a case study using the PARAMEDIC2 trial.

Background

Methods

Results

Conclusions

Trial registration

Publications

Bayesian group sequential designs for phase III emergency medicine trials: a case study using the PARAMEDIC2 trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets