Dataset Information

Sample size determinations in original research protocols for randomised clinical trials submitted to UK research ethics committees: review.

ABSTRACT:

Objectives

To assess the completeness of reporting of sample size determinations in unpublished research protocols and to develop guidance for research ethics committees and for statisticians advising these committees.

Design

Review of original research protocols.

Study selection

Unpublished research protocols for phase IIb, III, and IV randomised clinical trials of investigational medicinal products submitted to research ethics committees in the United Kingdom during 1 January to 31 December 2009.

Main outcome measures

Completeness of reporting of the sample size determination, including the justification of design assumptions, and disagreement between reported and recalculated sample size.

Results

446 study protocols were reviewed. Of these, 190 (43%) justified the treatment effect and 213 (48%) justified the population variability or survival experience. Only 55 (12%) discussed the clinical importance of the treatment effect sought. Few protocols provided a reasoned explanation as to why the design assumptions were plausible for the planned study. Sensitivity analyses investigating how the sample size changed under different design assumptions were lacking; six (1%) protocols included a re-estimation of the sample size in the study design. Overall, 188 (42%) protocols reported all of the information to accurately recalculate the sample size; the assumed withdrawal or dropout rate was not given in 177 (40%) studies. Only 134 of the 446 (30%) sample size calculations could be accurately reproduced. Study size tended to be over-estimated rather than under-estimated. Studies with non-commercial sponsors justified the design assumptions used in the calculation more often than studies with commercial sponsors but less often reported all the components needed to reproduce the sample size calculation. Sample sizes for studies with non-commercial sponsors were less often reproduced.

Conclusions

Most research protocols did not contain sufficient information to allow the sample size to be reproduced or the plausibility of the design assumptions to be assessed. Greater transparency in the reporting of the determination of the sample size and more focus on study design during the ethical review process would allow deficiencies to be resolved early, before the trial begins. Guidance for research ethics committees and statisticians advising these committees is needed.

SUBMITTER: Clark T

PROVIDER: S-EPMC3604970 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:OBJECTIVES:To assess biostatistical quality of study protocols submitted to German medical ethics committees according to personal appraisal of their statistical members. DESIGN:We conducted a web-based survey among biostatisticians who have been active as members in German medical ethics committees during the past 3 years. SETTING:The study population was identified by a comprehensive web search on websites of German medical ethics committees. PARTICIPANTS:The final list comprised 86 eligible persons. In total, 57 (66%) completed the survey. QUESTIONNAIRE:The first item checked whether the inclusion criterion was met. The last item assessed satisfaction with the survey. Four items aimed to characterise the medical ethics committee in terms of type and location, one item asked for the urgency of biostatistical training addressed to the medical investigators. The main 2×12 items reported an individual assessment of the quality of biostatistical aspects in the submitted study protocols, while distinguishing studies according to the German Medicines Act (AMG)/German Act on Medical Devices (MPG) and studies non-regulated by these laws. PRIMARY AND SECONDARY OUTCOME MEASURES:The individual assessment of the quality of biostatistical aspects corresponds to the primary objective. Thus, participants were asked to complete the sentence 'In x% of the submitted study protocols, the following problem occurs', where 12 different statistical problems were formulated. All other items assess secondary endpoints. RESULTS:For all biostatistical aspects, 45 of 49 (91.8%) participants judged the quality of AMG/MPG study protocols much better than that of 'non-regulated' studies. The latter are in median affected 20%-60%?more often by statistical problems. The highest need for training was reported for sample size calculation, missing values and multiple comparison procedures. CONCLUSIONS:Biostatisticians being active in German medical ethics committees classify the biostatistical quality of study protocols as low for 'non-regulated' studies, whereas quality is much better for AMG/MPG studies.

Project description:BACKGROUND:Screening for Down's syndrome forms part of routine obstetric practice. Ethical considerations relating to genetic screening form a major part of the workload of research ethics committees. This study investigated the attitudes of research ethics committee members to several conditions varying in clinical severity and prognosis, including Down's syndrome. METHODS:The members of 40 randomly chosen research ethics committees were surveyed. A simple questionnaire comprising 19 clinical scenarios based around four "clinical" conditions was designed to review conditions that were potentially embarrassing, affecting life span but not mental ability, premature death, and intellectual impairment with a risk of neonatal cardiac defects (Down's syndrome). Screening tests with different degrees of effectiveness were described and the diagnostic test descriptions ranged from having no risk to an unaffected fetus to causing spontaneous abortion of two normal fetuses for each affected fetus identified. Replies were graded on a scale of 1 to 5. RESULTS:Seventy seven replies were received from 28 different research ethics committees. Screening was supported for treatment of a life threatening condition (95% in favour) but screening for conditions of a slight increase in premature death (14% in favour) or cosmetic features (10% in favour) were considered unethical. Views were ambiguous (49% in favour) about conditions involving significant shortening of lifespan. Down's syndrome screening was considered more ethical when described as a serious condition (56% in favour) than when the clinical features were described (44% in favour). Once increased rates of spontaneous abortion on confirmatory testing were added, 79% (21% in favour) and 86% (14% in favour) stated that screening was unethical (for "serious" and "clinical features" descriptions, respectively). CONCLUSIONS:Down's syndrome screening raises ethical concerns about genetic testing in general that need to be dealt with before the introduction of any prenatal screening test.