Dataset Information

Simulation methods to estimate design power: an overview for applied research.

ABSTRACT:

Background

Estimating the required sample size and statistical power for a study is an integral part of study design. For standard designs, power equations provide an efficient solution to the problem, but they are unavailable for many complex study designs that arise in practice. For such complex study designs, computer simulation is a useful alternative for estimating study power. Although this approach is well known among statisticians, in our experience many epidemiologists and social scientists are unfamiliar with the technique. This article aims to address this knowledge gap.

Methods

We review an approach to estimate study power for individual- or cluster-randomized designs using computer simulation. This flexible approach arises naturally from the model used to derive conventional power equations, but extends those methods to accommodate arbitrarily complex designs. The method is universally applicable to a broad range of designs and outcomes, and we present the material in a way that is approachable for quantitative, applied researchers. We illustrate the method using two examples (one simple, one complex) based on sanitation and nutritional interventions to improve child growth.

Results

We first show how simulation reproduces conventional power estimates for simple randomized designs over a broad range of sample scenarios to familiarize the reader with the approach. We then demonstrate how to extend the simulation approach to more complex designs. Finally, we discuss extensions to the examples in the article, and provide computer code to efficiently run the example simulations in both R and Stata.

Conclusions

Simulation methods offer a flexible option to estimate statistical power for standard and non-traditional study designs and parameters of interest. The approach we have described is universally applicable for evaluating study designs used in epidemiologic and social science research.

SUBMITTER: Arnold BF

PROVIDER: S-EPMC3146952 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundBillions of dollars are lost annually in health research that fails to create meaningful benefits for patients. Engaging in research co-design - the meaningful involvement of end-users in research - may help address this research waste. This rapid overview of reviews addressed three related questions, namely (1) what approaches to research co-design exist in health settings? (2) What activities do these research co-design approaches involve? (3) What do we know about the effectiveness of existing research co-design approaches? The review focused on the study planning phase of research, defined as the point up to which the research question and study design are finalised.MethodsReviews of research co-design were systematically identified using a rapid overview of reviews approach (PROSPERO: CRD42019123034). The search strategy encompassed three academic databases, three grey literature databases, and a hand-search of the journal Research Involvement and Engagement. Two reviewers independently conducted the screening and data extraction and resolved disagreements through discussion. Disputes were resolved through discussion with a senior author (PB). One reviewer performed quality assessment. The results were narratively synthesised.ResultsA total of 26 records (reporting on 23 reviews) met the inclusion criteria. Reviews varied widely in their application of 'research co-design' and their application contexts, scope and theoretical foci. The research co-design approaches identified involved interactions with end-users outside of study planning, such as recruitment and dissemination. Activities involved in research co-design included focus groups, interviews and surveys. The effectiveness of research co-design has rarely been evaluated empirically or experimentally; however, qualitative exploration has described the positive and negative outcomes associated with co-design. The research provided many recommendations for conducting research co-design, including training participating end-users in research skills, having regular communication between researchers and end-users, setting clear end-user expectations, and assigning set roles to all parties involved in co-design.ConclusionsResearch co-design appears to be widely used but seldom described or evaluated in detail. Though it has rarely been tested empirically or experimentally, existing research suggests that it can benefit researchers, practitioners, research processes and research outcomes. Realising the potential of research co-design may require the development of clearer and more consistent terminology, better reporting of the activities involved and better evaluation.

Project description:BackgroundShoulder dislocations are common occurrences, yet there are few simulation devices to train medical personnel on how to reduce these dislocations. Reductions require a familiarity with the shoulder and a nuanced motion against strong muscle tension. The goal of this work is to describe the design of an easily replicated, low-cost simulator for training shoulder reductions.Materials and methodsAn iterative, stepwise engineering design process was used to design and implement ReducTrain. A needs analysis with clinical experts led to the selection of the traction-countertraction and external rotation methods as educationally relevant techniques to include. A set of design requirements and acceptance criteria was established that considered durability, assembly time, and cost. An iterative prototyping development process was used to meet the acceptance criteria. Testing protocols for each design requirement are also presented. Step-by-step instructions are provided to allow the replication of ReducTrain from easily sourced materials, including plywood, resistance bands, dowels, and various fasteners, as well as a 3D-printed shoulder model, whose printable file is included at a link in the Additional file 1: Appendix.ResultsA description of the final model is given. The total cost for all materials for one ReducTrain model is under US $200, and it takes about 3 h and 20 min to assemble. Based on repetitive testing, the device should not see any noticeable changes in durability after 1000 uses but may exhibit some changes in resistance band strength after 2000 uses.DiscussionThe ReducTrain device fills a gap in emergency medicine and orthopedic simulation. Its wide variety of uses points to its utility in several instructional formats. With the rise of makerspaces and public workshops, the construction of the device can be easily completed. While the device has some limitations, its robust design allows for simple upkeep and a customizable training experience.ConclusionA simplified anatomical design allows for the ReducTrain model to serve as a viable training device for shoulder reductions.

Project description:BACKGROUND:Chronic kidney disease (CKD) is a substantial cause of morbidity and mortality worldwide with disproportionate effects in sub-Saharan Africa (SSA). The optimal methods to estimate glomerular filtration rate (GFR) and therefore to determine the presence of CKD in SSA are uncertain. We plan to measure iohexol excretion to accurately determine GFR in Malawi, South Africa and Uganda. We will then assess the performance of existing equations to estimate GFR and determine whether a modified equation can better improve estimation of GFR in sub-Saharan Africa. METHODS:The African Research on Kidney Disease (ARK) study is a three-country study embedded within existing cohorts. We seek to enrol 3000 adults >?18?years based on baseline serum creatinine. Study procedures include questionnaires on socio-demographics and established risk factors for kidney disease along with anthropometry, body composition, blood pressure, blood chemistry and urine microscopy and albuminuria. We will measure GFR (mGFR) by plasma clearance of iohexol at 120, 180 and 240?min. We will compare eGFR determined by established equations with mGFR using Bland-Altman plots. We will use regression methods to estimate GFR and compare the newly derived model with existing equations. DISCUSSION:Through the ARK study, we aim to establish the optimal approach to estimate GFR in SSA. The study has the advantage of drawing participants from three countries, which will increase the applicability of the findings across the region. It is also embedded within established cohorts that have longitudinal information and serial measures that can be used to characterize kidney disease over a period of time. This will help to overcome the limitations of previous research, including small numbers, selected population sub-groups, and lack of data on proteinuria. The ARK collaboration provides an opportunity for close working partnerships across different centres, using standardized protocols and measurements, and shared bio-repositories. We plan to build on the collaboration for this study for future work on kidney disease in sub-Saharan Africa, and welcome additional partners from across the continent.