Dataset Information

Explaining the variation in the attained power of a stepped-wedge trial with unequal cluster sizes.

ABSTRACT:

Background

In a cross-sectional stepped-wedge trial with unequal cluster sizes, attained power in the trial depends on the realized allocation of the clusters. This attained power may differ from the expected power calculated using standard formulae by averaging the attained powers over all allocations the randomization algorithm can generate. We investigated the effect of design factors and allocation characteristics on attained power and developed models to predict attained power based on allocation characteristics.

Method

Based on data simulated and analyzed using linear mixed-effects models, we evaluated the distribution of attained powers under different scenarios with varying intraclass correlation coefficient (ICC) of the responses, coefficient of variation (CV) of the cluster sizes, number of cluster-size groups, distributions of group sizes, and number of clusters. We explored the relationship between attained power and two allocation characteristics: the individual-level correlation between treatment status and time period, and the absolute treatment group imbalance. When computational time was excessive due to a scenario having a large number of possible allocations, we developed regression models to predict attained power using the treatment-vs-time period correlation and absolute treatment group imbalance as predictors.

Results

The risk of attained power falling more than 5% below the expected or nominal power decreased as the ICC or number of clusters increased and as the CV decreased. Attained power was strongly affected by the treatment-vs-time period correlation. The absolute treatment group imbalance had much less impact on attained power. The attained power for any allocation was predicted accurately using a logistic regression model with the treatment-vs-time period correlation and the absolute treatment group imbalance as predictors.

Conclusion

In a stepped-wedge trial with unequal cluster sizes, the risk that randomization yields an allocation with inadequate attained power depends on the ICC, the CV of the cluster sizes, and number of clusters. To reduce the computational burden of simulating attained power for allocations, the attained power can be predicted via regression modeling. Trial designers can reduce the risk of low attained power by restricting the randomization algorithm to avoid allocations with large treatment-vs-time period correlations.

SUBMITTER: Ouyang Y

PROVIDER: S-EPMC7315519 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Explaining the variation in the attained power of a stepped-wedge trial with unequal cluster sizes.

Ouyang Yongdong Y Karim Mohammad Ehsanul ME Gustafson Paul P Field Thalia S TS Wong Hubert H

BMC medical research methodology 20200624 1

<h4>Background</h4>In a cross-sectional stepped-wedge trial with unequal cluster sizes, attained power in the trial depends on the realized allocation of the clusters. This attained power may differ from the expected power calculated using standard formulae by averaging the attained powers over all allocations the randomization algorithm can generate. We investigated the effect of design factors and allocation characteristics on attained power and developed models to predict attained power based ...[more]

PMID: 32580698

Similar Datasets

Project description:BACKGROUND:Reducing the portion sizes of foods available in restaurants and cafeterias is one promising approach to reducing energy intake, but there is little evidence of its impact from randomised studies in field settings. This study aims to i. examine the feasibility and acceptability, and ii. estimate the impact on energy purchased, of reducing portion sizes in worksite cafeterias. METHODS:Nine worksites in England were recruited to reduce by at least 10% the portion sizes of foods available in their cafeterias from targeted categories (main meals, sides, desserts, cakes). In a stepped wedge randomised controlled pilot trial, each site was randomised to a date of implementation, staggered fortnightly, following a baseline period of four weeks. Impact on energy purchased was analysed using generalised linear mixed modelling. We also assessed feasibility, acceptability, and fidelity of intervention implementation. RESULTS:Data from six of the nine randomised sites were analysed, with three sites excluded for not providing sufficient data and/or not implementing the intervention. The extent to which the intervention was implemented varied by site, with between 6 and 49% of products altered within targeted categories. Feedback following the intervention suggested it was broadly acceptable to customers and cafeteria staff. For the primary outcome of daily energy (kcal) purchased from intervention categories, there was no statistically significant change when data from all six sites were pooled: percentage change -?8.9% (95% CI: -16.7, -?0.4; p?=?0.081). Each of these six sites showed reductions in energy purchased, ranging from -?15.6 to -?0.3%, which were borderline statistically significant at two sites (respective percentage changes (95% CIs): -?15.6% (-?26.7, -?2.8); -?14.0% (-?25.0, -?1.2)). Secondary outcome data are suggestive of a compensatory increase in energy purchased from food categories not targeted by the intervention, with no overall effect observed on energy purchased across all categories. CONCLUSIONS:The results of this pilot trial suggest that reducing portion sizes could be effective in reducing energy purchased and consumed from targeted food categories, and merits investigation in a larger trial. Future studies will need to address factors that prevented optimal implementation including site dropout and application across a limited range of products. TRIAL REGISTRATION:( ISRCTN52923504 ). Registered on 20th September 2016.

Project description:IntroductionMost potential kidney transplant donors in the UK are aged over 60 years, yet increasing donor age is associated with poorer graft survival and function. Urgent preimplantation kidney biopsy can identify chronic injury, and may aid selection of better 'quality' kidneys from this group. However, the impact of biopsy on transplant numbers remains unproven. The PreImplantation Trial of Histopathology In renal Allografts (PITHIA) study will assess whether the introduction of a national, 24 hours, digital histopathology service increases the number, and improves outcomes, of kidneys transplanted in the UK from older deceased donors.Methods and analysisPITHIA is an open, multicentre, stepped-wedge cluster randomised study, involving all UK adult kidney transplant centres. At 4-monthly intervals, a group of 4-5 randomly selected clusters (transplant centres) will be given access to remote, urgent, digital histopathology (total intervention period, 24 months). The trial has two primary end points: it is powered for an 11% increase in the proportion of primary kidney offers from deceased donors aged over 60 years that are transplanted, and a 6 mL/min increase in the estimated glomerular filtration rate of recipients at 12 months post-transplant. This would equate to an additional 120 kidney transplants performed in the UK annually. Trial outcome data will be collected centrally via the UK Transplant Registry held by NHS Blood and Transplant (NHSBT) and will be analysed using mixed effects models allowing for clustering within centres and adjusting for secular trends. An accompanying economic evaluation will estimate the cost-effectiveness of the service to the National Health Service.Ethics and disseminationThe study has been given favourable ethical opinion by the Cambridge South Research Ethics Committee and is approved by the Health Research Authority. We will present our findings at key transplant meetings, publish results within 4 years of the trial commencing and support volunteers at renal patient groups to disseminate the trial outcome.Trial registration numberISRCTN11708741; Pre-results.

Project description:BACKGROUND:Stepped wedge cluster randomized trials (SW-CRT) are increasingly used to evaluate new clinical programs, yet there is limited guidance on practical aspects of applying this design. We report our early experiences conducting a SW-CRT to examine an inpatient mobility program (STRIDE) in the Veterans Health Administration (VHA). We provide recommendations for future research using this design to evaluate clinical programs. METHODS:Based on data from study records and reflections from the investigator team, we describe and assess the design and initial stages of a SW-CRT, from site recruitment to program launch in 8 VHA hospitals. RESULTS:Site recruitment consisted of thirty 1-h conference calls with representatives from 22 individual VAs who expressed interest in implementing STRIDE. Of these, 8 hospitals were enrolled and randomly assigned in two stratified blocks (4 hospitals per block) to a STRIDE launch date. Block 1 randomization occurred in July 2017 with first STRIDE launch in December 2017; block 2 randomization occurred in April 2018 with first STRIDE launch in January 2019. The primary study outcome of discharge destination will be assessed using routinely collected data in the electronic health record (EHR). Within randomized blocks, two hospitals per sequence launched STRIDE approximately every 3?months with primary outcome assessment paused during the 3-month time period of program launch. All sites received 6-8 implementation support calls, according to a pre-specified schedule, from the time of recruitment to program launch, and all 8 sites successfully launched within their assigned 3-month window. Seven of the eight sites initially started with a limited roll out (for example on one ward) or modified version of STRIDE (for example, using existing staff to conduct walks until new positions were filled). CONCLUSIONS:Future studies should incorporate sufficient time for site recruitment and carefully consider the following to inform design of SW-CRTs to evaluate rollout of a new clinical program: (1) whether a blocked randomization fits study needs, (2) the amount of time and implementation support sites will need to start their programs, and (3) whether clinical programs are likely to include a "ramp-up" period. Successful execution of SW-CRT designs requires both adherence to rigorous design principles and also careful consideration of logistical requirements for timing of program roll out. TRIAL REGISTRATION:ClinicalsTrials.gov NCT03300336 . Prospectively registered on 3 October 2017.

Project description:BACKGROUND:Cluster randomised trials with unequal sized clusters often have lower precision than with clusters of equal size. To allow for this, sample sizes are inflated by a modified version of the design effect for clustering. These inflation factors are valid under the assumption that randomisation is stratified by cluster size. We investigate the impact of unequal cluster size when that constraint is relaxed, with particular focus on the stepped-wedge cluster randomised trial, where this is more difficult to achieve. METHODS:Assuming a multi-level mixed effect model with exchangeable correlation structure for a cross-sectional design, we use simulation methods to compare the precision for a trial with clusters of unequal size to a trial with clusters of equal size (relative efficiency). For a range of scenarios we illustrate the impact of various design features (the cluster-mean correlation - a function of the intracluster correlation and the cluster size, the number of clusters, number of randomisation sequences) on the average and distribution of the relative efficiency. RESULTS:Simulations confirm that the average reduction in precision, due to varying cluster sizes, is smaller in a stepped-wedge trial compared to the parallel trial. However, the variance of the distribution of the relative efficiency is large; and is larger under the stepped-wedge design compared to the parallel design. This can result in large variations in actual power, depending on the allocation of clusters to sequences. Designs with larger variations in cluster sizes, smaller number of clusters and studies with smaller cluster-mean correlations (smaller cluster sizes or smaller intra-cluster correlation) are particularly at risk. CONCLUSION:The actual realised power in a stepped-wedge trial might be substantially higher or lower than that estimated. This is particularly important when there are a small number of clusters or the variability in cluster sizes is large. Constraining the randomisation on cluster size, where feasible, might mitigate this effect.

Dataset Information

Explaining the variation in the attained power of a stepped-wedge trial with unequal cluster sizes.

Background

Method

Results

Conclusion

Publications

Explaining the variation in the attained power of a stepped-wedge trial with unequal cluster sizes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets