Dataset Information

Cost-effective clinical trial design: Application of a Bayesian sequential model to the ProFHER pragmatic trial.

ABSTRACT:

Background/aims

There is growing interest in the use of adaptive designs to improve the efficiency of clinical trials. We apply a Bayesian decision-theoretic model of a sequential experiment using cost and outcome data from the ProFHER pragmatic trial. We assess the model's potential for delivering value-based research.

Methods

Using parameter values estimated from the ProFHER pragmatic trial, including the costs of carrying out the trial, we establish when the trial could have stopped, had the model's value-based stopping rule been used. We use a bootstrap analysis and simulation study to assess a range of operating characteristics, which we compare with a fixed sample size design which does not allow for early stopping.

Results

We estimate that application of the model could have stopped the ProFHER trial early, reducing the sample size by about 14%, saving about 5% of the research budget and resulting in a technology recommendation which was the same as that of the trial. The bootstrap analysis suggests that the expected sample size would have been 38% lower, saving around 13% of the research budget, with a probability of 0.92 of making the same technology recommendation decision. It also shows a large degree of variability in the trial's sample size.

Conclusions

Benefits to trial cost stewardship may be achieved by monitoring trial data as they accumulate and using a stopping rule which balances the benefit of obtaining more information through continued recruitment with the cost of obtaining that information. We present recommendations for further research investigating the application of value-based sequential designs.

SUBMITTER: Forster M

PROVIDER: S-EPMC8592107 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:The basket trial evaluates the treatment effect of a targeted therapy in patients with the same genetic or molecular aberration, regardless of their cancer types. Bayesian hierarchical modeling has been proposed to adaptively borrow information across cancer types to improve the statistical power of basket trials. Although conceptually attractive, research has shown that Bayesian hierarchical models cannot appropriately determine the degree of information borrowing and may lead to substantially inflated type I error rates. METHODS:We propose a novel calibrated Bayesian hierarchical model approach to evaluate the treatment effect in basket trials. In our approach, the shrinkage parameter that controls information borrowing is not regarded as an unknown parameter. Instead, it is defined as a function of a similarity measure of the treatment effect across tumor subgroups. The key is that the function is calibrated using simulation such that information is strongly borrowed across subgroups if their treatment effects are similar and barely borrowed if the treatment effects are heterogeneous. RESULTS:The simulation study shows that our method has substantially better controlled type I error rates than the Bayesian hierarchical model. In some scenarios, for example, when the true response rate is between the null and alternative, the type I error rate of the proposed method can be inflated from 10% up to 20%, but is still better than that of the Bayesian hierarchical model. LIMITATION:The proposed design assumes a binary endpoint. Extension of the proposed design to ordinal and time-to-event endpoints is worthy of further investigation. CONCLUSION:The calibrated Bayesian hierarchical model provides a practical approach to design basket trials with more flexibility and better controlled type I error rates than the Bayesian hierarchical model. The software for implementing the proposed design is available at http://odin.mdacc.tmc.edu/~yyuan/index_code.html.

Project description:BackgroundHigh flow nasal cannula (HFNC) has been increasingly adopted in the past 2 decades as a mode of respiratory support for children hospitalized with bronchiolitis. The growing use of HFNC despite a paucity of high-quality data regarding the therapy's efficacy has led to concerns about overutilization. We developed an electronic health record (EHR) embedded, quality improvement (QI) oriented clinical trial to determine whether standardized management of HFNC weaning guided by clinical decision support (CDS) results in a reduction in the duration of HFNC compared to usual care for children with bronchiolitis.MethodsThe design and summary of the statistical analysis plan for the REspiratory SupporT for Efficient and cost-Effective Care (REST EEC; "rest easy") trial are presented. The investigators hypothesize that CDS-coupled, standardized HFNC weaning will reduce the duration of HFNC, the trial's primary endpoint, for children with bronchiolitis compared to usual care. Data supporting trial design and eventual analyses are collected from the EHR and other real world data sources using existing informatics infrastructure and QI data sources. The trial workflow, including randomization and deployment of the intervention, is embedded within the EHR of a large children's hospital using existing vendor features. Trial simulations indicate that by assuming a true hazard ratio effect size of 1.27, equivalent to a 6-h reduction in the median duration of HFNC, and enrolling a maximum of 350 children, there will be a > 0.75 probability of declaring superiority (interim analysis posterior probability of intervention effect > 0.99 or final analysis posterior probability of intervention effect > 0.9) and a > 0.85 probability of declaring superiority or the CDS intervention showing promise (final analysis posterior probability of intervention effect > 0.8). Iterative plan-do-study-act cycles are used to monitor the trial and provide targeted education to the workforce.DiscussionThrough incorporation of the trial into usual care workflows, relying on QI tools and resources to support trial conduct, and relying on Bayesian inference to determine whether the intervention is superior to usual care, REST EEC is a learning health system intervention that blends health system operations with active evidence generation to optimize the use of HFNC and associated patient outcomes.Trial registrationClinicalTrials.gov NCT05909566. Registered on June 18, 2023.