Dataset Information

Cost-effective clinical trial design: Application of a Bayesian sequential model to the ProFHER pragmatic trial.

ABSTRACT:

Background/aims

There is growing interest in the use of adaptive designs to improve the efficiency of clinical trials. We apply a Bayesian decision-theoretic model of a sequential experiment using cost and outcome data from the ProFHER pragmatic trial. We assess the model's potential for delivering value-based research.

Methods

Using parameter values estimated from the ProFHER pragmatic trial, including the costs of carrying out the trial, we establish when the trial could have stopped, had the model's value-based stopping rule been used. We use a bootstrap analysis and simulation study to assess a range of operating characteristics, which we compare with a fixed sample size design which does not allow for early stopping.

Results

We estimate that application of the model could have stopped the ProFHER trial early, reducing the sample size by about 14%, saving about 5% of the research budget and resulting in a technology recommendation which was the same as that of the trial. The bootstrap analysis suggests that the expected sample size would have been 38% lower, saving around 13% of the research budget, with a probability of 0.92 of making the same technology recommendation decision. It also shows a large degree of variability in the trial's sample size.

Conclusions

Benefits to trial cost stewardship may be achieved by monitoring trial data as they accumulate and using a stopping rule which balances the benefit of obtaining more information through continued recruitment with the cost of obtaining that information. We present recommendations for further research investigating the application of value-based sequential designs.

SUBMITTER: Forster M

PROVIDER: S-EPMC8592107 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:The basket trial evaluates the treatment effect of a targeted therapy in patients with the same genetic or molecular aberration, regardless of their cancer types. Bayesian hierarchical modeling has been proposed to adaptively borrow information across cancer types to improve the statistical power of basket trials. Although conceptually attractive, research has shown that Bayesian hierarchical models cannot appropriately determine the degree of information borrowing and may lead to substantially inflated type I error rates. METHODS:We propose a novel calibrated Bayesian hierarchical model approach to evaluate the treatment effect in basket trials. In our approach, the shrinkage parameter that controls information borrowing is not regarded as an unknown parameter. Instead, it is defined as a function of a similarity measure of the treatment effect across tumor subgroups. The key is that the function is calibrated using simulation such that information is strongly borrowed across subgroups if their treatment effects are similar and barely borrowed if the treatment effects are heterogeneous. RESULTS:The simulation study shows that our method has substantially better controlled type I error rates than the Bayesian hierarchical model. In some scenarios, for example, when the true response rate is between the null and alternative, the type I error rate of the proposed method can be inflated from 10% up to 20%, but is still better than that of the Bayesian hierarchical model. LIMITATION:The proposed design assumes a binary endpoint. Extension of the proposed design to ordinal and time-to-event endpoints is worthy of further investigation. CONCLUSION:The calibrated Bayesian hierarchical model provides a practical approach to design basket trials with more flexibility and better controlled type I error rates than the Bayesian hierarchical model. The software for implementing the proposed design is available at http://odin.mdacc.tmc.edu/~yyuan/index_code.html.

Project description:Background and objectivesMany investigators of Alzheimer's disease and related dementias (AD/ADRD) are unfamiliar with the embedded pragmatic clinical trials (ePCTs) and the indispensable pilot phase preceding ePCTs. This paper provides a much-needed example for such a pilot phase and discusses implementation barriers and additional infrastructure and implementation strategies developed in preparation for a nationwide AD/ADRD ePCT.Research design and methodsTwo pilot trials were conducted in 2 hospices sequentially to refine and test Aliviado Dementia Care-Hospice Edition, a complex quality improvement intervention for advanced dementia symptom management. Readiness for the subsequent full-scale ePCT was assessed by three milestones: ≥80% training completion rate ("feasibility"), ≥80% posttraining survey respondents indicating intention for practice changes ("applicability"), and at least 1 Aliviado care plan/assessment instrument administered in ≥75% of dementia patients admitted to home hospice within 1-month posttraining ("fidelity").ResultsParticipants included 72 interdisciplinary team members and 11 patients with AD/ADRD across the pilots. Feasibility, applicability, and fidelity outcomes (92%, 93%, and 100%, respectively) all surpassed the preestablished milestones (80%, 80%, and 75%). Main implementation challenges were related to hospice staff turnover, integration of the Aliviado toolbox materials within the electronic health records, and hospices' limited research experience and infrastructure.Discussion and implicationsThis pilot phase demonstrated feasibility, applicability, and fidelity required to proceed to the full-scale ePCT. Our study findings and discussions of additional infrastructure and implementation strategies developed following the pilot phase can inform researchers and clinicians interested in conducting AD/ADRD-related pilot studies for ePTCs or quality improvement initiatives.Clinical trials registration numberNCT03681119.