Estimands and inference in cluster-randomized vaccine trials.
Ontology highlight
ABSTRACT:
SUBMITTER: Kilpatrick KW
PROVIDER: S-EPMC8273646 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Within cluster randomized trials no algorithms exist to generate a full enumeration of a block randomization, balancing for covariates across treatment arms. Furthermore, often for practical reasons multiple blocks are required to fully randomize a study, which may not have been well balanced within blocks.We present a convenient and easy to use randomization tool to undertake allocation concealed block randomization. Our algorithm highlights allocations that minimize imbalance between treatment groups across multiple baseline covariates. We demonstrate the algorithm using a cluster randomized trial in primary care (the PRE-EMPT Study) and show that the software incorporates a trade off between independent random allocations that were likely to be imbalanced, and predictable deterministic approaches that would minimise imbalance. We extend the methodology of single block randomization to allocate to multiple blocks conditioning on previous allocations.The algorithm is included as Additional file 1 and we advocate its use for robust randomization within cluster randomized trials.
| S-EPMC2588445 | biostudies-other
Project description:BackgroundAn estimand is a precise description of the treatment effect to be estimated from a trial (the question) and is distinct from the methods of statistical analysis (how the question is to be answered). The potential use of estimands to improve trial research and reporting has been underpinned by the recent publication of the ICH E9(R1) Addendum on the use of estimands in clinical trials in 2019. We set out to assess how well estimands are described in published trial protocols.MethodsWe reviewed 50 trial protocols published in October 2020 in Trials and BMJ Open. For each protocol, we determined whether the estimand for the primary outcome was explicitly stated, not stated but inferable (i.e. could be constructed from the information given), or not inferable.ResultsNone of the 50 trials explicitly described the estimand for the primary outcome, and in 74% of trials, it was impossible to infer the estimand from the information included in the protocol. The population attribute of the estimand could not be inferred in 36% of trials, the treatment condition attribute in 20%, the population-level summary measure in 34%, and the handling of intercurrent events in 60% (the strategy for handling non-adherence was not inferable in 32% of protocols, and the strategy for handling mortality was not inferable in 80% of the protocols for which it was applicable). Conversely, the outcome attribute was stated for all trials. In 28% of trials, three or more of the five estimand attributes could not be inferred.ConclusionsThe description of estimands in published trial protocols is poor, and in most trials, it is impossible to understand exactly what treatment effect is being estimated. Given the utility of estimands to improve clinical research and reporting, this urgently needs to change.
| S-EPMC8500821 | biostudies-literature
Project description:In randomized studies involving severely ill patients, functional outcomes are often unobserved due to missed clinic visits, premature withdrawal, or death. It is well known that if these unobserved functional outcomes are not handled properly, biased treatment comparisons can be produced. In this article, we propose a procedure for comparing treatments that is based on a composite endpoint that combines information on both the functional outcome and survival. We further propose a missing data imputation scheme and sensitivity analysis strategy to handle the unobserved functional outcomes not due to death. Illustrations of the proposed method are given by analyzing data from a recent non-small cell lung cancer clinical trial and a recent trial of sedation interruption among mechanically ventilated patients.
| S-EPMC6383567 | biostudies-literature
Project description:Cluster randomized trials (CRTs) have been widely used in field experiments treating a cluster of individuals as the unit of randomization. This study focused particularly on situations where CRTs are accompanied by a common complication, namely, treatment noncompliance or, more generally, intervention nonadherence. In CRTs, compliance may be related not only to individual characteristics but also to the environment of clusters individuals belong to. Therefore, analyses ignoring the connection between compliance and clustering may not provide valid results. Although randomized field experiments often suffer from both noncompliance and clustering of the data, these features have been studied as separate rather than concurrent problems. On the basis of Monte Carlo simulations, this study demonstrated how clustering and noncompliance may affect statistical inferences and how these two complications can be accounted for simultaneously. In particular, the effect of the intervention on individuals who not only were assigned to active intervention but also abided by this intervention assignment (complier average causal effect) was the focus. For estimation of intervention effects considering noncompliance and data clustering, an ML-EM estimation method was employed.
| S-EPMC2917590 | biostudies-literature
Project description:Power considerations for trials evaluating vaccines against infectious diseases are complicated by indirect protective effects of vaccination. While cluster-randomized controlled trials (cRCTs) are less statistically efficient than individually randomized controlled trials (iRCTs), a cRCT's ability to measure direct and indirect vaccine effects may mitigate the loss of efficiency due to clustering. Within cRCTs, the number and size of clusters affects 3 determinants of power: the effect size being measured, disease incidence, and intracluster correlation. We simulated trials conducted in a collection of small communities to assess how indirect protection and clustering affected the power of cRCTs and iRCTs during an emerging epidemic. Across diverse parameters, we found that within the same trial population, cRCTs were never more powerful than iRCTs, although the difference can be small. We also identified 2 effects that attenuated the loss of cRCT power traditionally associated with increased cluster size. First, if enrollment of fewer, larger clusters was performed to achieve higher vaccine coverage within vaccinated communities, this increased the effect to be measured and, consequently, power. Second, the greater rate of imported transmission in larger communities may increase the attack rate and similarly mitigate loss of power relative to a trial in many, smaller communities.
| S-EPMC6070038 | biostudies-literature
Project description:BackgroundIn cluster randomized crossover (CRXO) trials, groups of participants (i.e., clusters) are randomly allocated to receive a sequence of interventions over time (i.e., cluster periods). CRXO trials are becoming more comment when they are feasible, as they require fewer clusters than parallel group cluster randomized trials. However, CRXO trials have not been frequently used in orthopedic fracture trials and represent a novel methodological application within the field. To disseminate the early knowledge gained from our experience initiating two cluster randomized crossover trials, we describe our process for the identification and selection of the orthopedic practices (i.e., clusters) participating in the PREP-IT program and present data to describe their key characteristics.MethodsThe PREP-IT program comprises two ongoing pragmatic cluster randomized crossover trials (Aqueous-PREP and PREPARE) which compare the effect of iodophor versus chlorhexidine solutions on surgical site infection and unplanned fracture-related reoperations in patients undergoing operative fracture management. We describe the process we used to identify and select orthopedic practices (clusters) for the PREP-IT trials, along with their characteristics.ResultsWe identified 58 potential orthopedic practices for inclusion in the PREP-IT trials. After screening each practice for eligibility, we selected 30 practices for participation and randomized each to a sequence of interventions (15 for Aqueous-PREP and 20 for PREPARE). The majority of orthopedic practices included in the Aqueous-PREP and PREPARE trials were situated in level I trauma centers (100% and 87%, respectively). Orthopedic practices in the Aqueous-PREP trial operatively treated a median of 149 open fracture patients per year, included a median of 11 orthopedic surgeons, and had access to a median of 5 infection preventionists. Orthopedic practices in the PREPARE trial treated a median of 142 open fracture and 1090 closed fracture patients per year, included a median of 7.5 orthopedic surgeons, and had access to a median of 6 infection preventionists.ConclusionsThe PREP-IT trials provide an example of how to follow the reporting standards for cluster randomized crossover trials by providing a clear definition of the cluster unit, a thorough description of the cluster identification and selection process, and sufficient description of key cluster characteristics.Trial registrationBoth trials are registered at ClinicalTrials.gov (A-PREP: NCT03385304 December 28, 2017, and PREPARE: NCT03523962 May 14, 2018).
| S-EPMC7425374 | biostudies-literature
Project description:Precise specification of the research question and associated treatment effect of interest is essential in clinical research, yet recent work shows that they are often incompletely specified. The ICH E9 (R1) Addendum on Estimands and Sensitivity Analysis in Clinical Trials introduces a framework that supports researchers in precisely and transparently specifying the treatment effect they aim to estimate in their clinical trial. In this paper, we present practical examples to demonstrate to all researchers involved in clinical trials how estimands can help them to specify the research question, lead to a better understanding of the treatment effect to be estimated and hence increase the probability of success of the trial.
| S-EPMC8724703 | biostudies-literature
Project description:Often patients may require treatment on multiple occasions. The re-randomisation design can be used in such multi-episode settings, as it allows patients to be re-enrolled and re-randomised for each new treatment episode they experience. We propose a set of estimands that can be used in multi-episode settings, focusing on issues unique to multi-episode settings, namely how each episode should be weighted, how the patient's treatment history in previous episodes should be handled, and whether episode-specific effects or average effects across all episodes should be used. We then propose independence estimators for each estimand, and show the manner in which many re-randomisation trials have been analysed in the past (a simple comparison between all intervention episodes vs. all control episodes) corresponds to a per-episode added-benefit estimand, that is, the average effect of the intervention across all episodes, over and above any benefit conferred from the intervention in previous episodes. We show this estimator is generally unbiased, and describe when other estimators will be unbiased. We conclude that (i) consideration of these estimands can help guide the choice of which analysis method is most appropriate; and (ii) the re-randomisation design with an independence estimator can be a useful approach in multi-episode settings.
| S-EPMC9251752 | biostudies-literature
Project description:We consider design issues for cluster randomized trials (CRTs) with a binary outcome where both unit costs and intraclass correlation coefficients (ICCs) in the two arms may be unequal. We first propose a design that maximizes cost efficiency (CE), defined as the ratio of the precision of the efficacy measure to the study cost. Because such designs can be highly sensitive to the unknown ICCs and the anticipated success rates in the two arms, a local strategy based on a single set of best guesses for the ICCs and success rates can be risky. To mitigate this issue, we propose a maximin optimal design that permits ranges of values to be specified for the success rate and the ICC in each arm. We derive maximin optimal designs for three common measures of the efficacy of the intervention, risk difference, relative risk and odds ratio, and study their properties. Using a real cancer control and prevention trial example, we ascertain the efficiency of the widely used balanced design relative to the maximin optimal design and show that the former can be quite inefficient and less robust to mis-specifications of the ICCs and the success rates in the two arms.
| S-EPMC5550375 | biostudies-literature
Project description:Regulatory guidelines describe the use of estimands in designing and conducting clinical trials. Estimands ensure alignment of the objectives with the design, conduct and analysis of a trial. An estimand is defined by four inter-related attributes: the population of interest, the variable (endpoint) of interest, the way intercurrent events are handled and the population level summary. A trial may employ multiple estimands to evaluate treatment effects from different perspectives in order to address different scientific questions. As estimands may be an unfamiliar concept for many clinicians treating diabetes, this paper reviews the estimand concept and uses the PIONEER 1 phase 3a clinical trial, which investigated the efficacy and safety of oral semaglutide vs placebo, as an example of the way in which estimands can be implemented and interpreted. In the PIONEER 1 trial, two estimands were employed for each efficacy endpoint and were labelled as: (a) the treatment policy estimand, used to assess the treatment effect regardless of use of rescue medication or discontinuation of trial product, and provides a broad perspective of the treatment effect in the population of patients with type 2 diabetes in clinical practice; and (b) the trial product estimand, used to assess the treatment effect if all patients had continued to use trial product for the planned duration of the trial without rescue medication, thereby providing information on the anticipated treatment effect of the medication. Both approaches are complementary to understanding the effect of the studied treatments.
| S-EPMC6771751 | biostudies-literature