Dataset Information

Do we need to adjust for interim analyses in a Bayesian adaptive trial design?

ABSTRACT:

Background

Bayesian adaptive methods are increasingly being used to design clinical trials and offer several advantages over traditional approaches. Decisions at analysis points are usually based on the posterior distribution of the treatment effect. However, there is some confusion as to whether control of type I error is required for Bayesian designs as this is a frequentist concept.

Methods

We discuss the arguments for and against adjusting for multiplicities in Bayesian trials with interim analyses. With two case studies we illustrate the effect of including interim analyses on type I/II error rates in Bayesian clinical trials where no adjustments for multiplicities are made. We propose several approaches to control type I error, and also alternative methods for decision-making in Bayesian clinical trials.

Results

In both case studies we demonstrated that the type I error was inflated in the Bayesian adaptive designs through incorporation of interim analyses that allowed early stopping for efficacy and without adjustments to account for multiplicity. Incorporation of early stopping for efficacy also increased the power in some instances. An increase in the number of interim analyses that only allowed early stopping for futility decreased the type I error, but also decreased power. An increase in the number of interim analyses that allowed for either early stopping for efficacy or futility generally increased type I error and decreased power.

Conclusions

Currently, regulators require demonstration of control of type I error for both frequentist and Bayesian adaptive designs, particularly for late-phase trials. To demonstrate control of type I error in Bayesian adaptive designs, adjustments to the stopping boundaries are usually required for designs that allow for early stopping for efficacy as the number of analyses increase. If the designs only allow for early stopping for futility then adjustments to the stopping boundaries are not needed to control type I error. If one instead uses a strict Bayesian approach, which is currently more accepted in the design and analysis of exploratory trials, then type I errors could be ignored and the designs could instead focus on the posterior probabilities of treatment effects of clinically-relevant values.

SUBMITTER: Ryan EG

PROVIDER: S-EPMC7288484 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Do we need to adjust for interim analyses in a Bayesian adaptive trial design?

Ryan Elizabeth G EG Brock Kristian K Gates Simon S Slade Daniel D

BMC medical research methodology 20200610 1

<h4>Background</h4>Bayesian adaptive methods are increasingly being used to design clinical trials and offer several advantages over traditional approaches. Decisions at analysis points are usually based on the posterior distribution of the treatment effect. However, there is some confusion as to whether control of type I error is required for Bayesian designs as this is a frequentist concept.<h4>Methods</h4>We discuss the arguments for and against adjusting for multiplicities in Bayesian trials ...[more]

PMID: 32522284

Similar Datasets

Project description:BackgroundTrauma is the leading cause of death and disability in children in the USA. Tranexamic acid (TXA) reduces the blood transfusion requirements in adults and children during surgery. Several studies have evaluated TXA in adults with hemorrhagic trauma, but no randomized controlled trials have occurred in children with trauma. We propose a Bayesian adaptive clinical trial to investigate TXA in children with brain and/or torso hemorrhagic trauma.Methods/designWe designed a double-blind, Bayesian adaptive clinical trial that will enroll up to 2000 patients. We extend the traditional Emax dose-response model to incorporate a hierarchical structure so multiple doses of TXA can be evaluated in different injury populations (isolated head injury, isolated torso injury, or both head and torso injury). Up to 3 doses of TXA (15 mg/kg, 30 mg/kg, and 45 mg/kg bolus doses) will be compared to placebo. Equal allocation between placebo, 15 mg/kg, and 30 mg/kg will be used for an initial period within each injury group. Depending on the dose-response curve, the 45 mg/kg arm may open in an injury group if there is a trend towards increasing efficacy based on the observed relationship using the data from the lower doses. Response-adaptive randomization allows each injury group to differ in allocation proportions of TXA so an optimal dose can be identified for each injury group. Frequent interim stopping periods are included to evaluate efficacy and futility. The statistical design is evaluated through extensive simulations to determine the operating characteristics in several plausible scenarios. This trial achieves adequate power in each injury group.DiscussionThis trial design evaluating TXA in pediatric hemorrhagic trauma allows for three separate injury populations to be analyzed and compared within a single study framework. Individual conclusions regarding optimal dosing of TXA can be made within each injury group. Identifying the optimal dose of TXA, if any, for various injury types in childhood may reduce death and disability.

Dataset Information

Do we need to adjust for interim analyses in a Bayesian adaptive trial design?

Background

Methods

Results

Conclusions

Publications

Do we need to adjust for interim analyses in a Bayesian adaptive trial design?

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets