Dataset Information

P-hacking in clinical trials and how incentives shape the distribution of results across phases.

ABSTRACT: Clinical research should conform to high standards of ethical and scientific integrity, given that human lives are at stake. However, economic incentives can generate conflicts of interest for investigators, who may be inclined to withhold unfavorable results or even tamper with data in order to achieve desired outcomes. To shed light on the integrity of clinical trial results, this paper systematically analyzes the distribution of P values of primary outcomes for phase II and phase III drug trials reported to the ClinicalTrials.gov registry. First, we detect no bunching of results just above the classical 5% threshold for statistical significance. Second, a density-discontinuity test reveals an upward jump at the 5% threshold for phase III results by small industry sponsors. Third, we document a larger fraction of significant results in phase III compared to phase II. Linking trials across phases, we find that early favorable results increase the likelihood of continuing into the next phase. Once we take into account this selective continuation, we can explain almost completely the excess of significant results in phase III for trials conducted by large industry sponsors. For small industry sponsors, instead, part of the excess remains unexplained.

SUBMITTER: Adda J

PROVIDER: S-EPMC7306753 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

P-hacking in clinical trials and how incentives shape the distribution of results across phases.

Adda Jérôme J Decker Christian C Ottaviani Marco M

Proceedings of the National Academy of Sciences of the United States of America 20200602 24

Clinical research should conform to high standards of ethical and scientific integrity, given that human lives are at stake. However, economic incentives can generate conflicts of interest for investigators, who may be inclined to withhold unfavorable results or even tamper with data in order to achieve desired outcomes. To shed light on the integrity of clinical trial results, this paper systematically analyzes the distribution of <i>P</i> values of primary outcomes for phase II and phase III d ...[more]

PMID: 32487730

Similar Datasets

Project description:Background/aims The Food and Drug Administration Amendments Act mandates that applicable clinical trials report basic summary results to the ClinicalTrials.gov database within 1?year of trial completion or termination. We aimed to determine the proportion of pulmonary trials reporting basic summary results to ClinicalTrials.gov and assess factors associated with reporting. Methods We identified pulmonary clinical trials subject to the Food and Drug Administration Amendments Act (called highly likely applicable clinical trials) that were completed or terminated between 2008 and 2012 and reported results by September 2013. We estimated the cumulative percentage of applicable clinical trials reporting results by pulmonary disease category. Multivariable Cox regression modeling identified characteristics independently associated with results reporting. Results Of 1450 pulmonary highly likely applicable clinical trials, 380 (26%) examined respiratory neoplasms, 238 (16%) asthma, 175 (12%) chronic obstructive pulmonary disease, and 657 (45%) other respiratory diseases. Most (75%) were pharmaceutical highly likely applicable clinical trials and 71% were industry-funded. Approximately 15% of highly likely applicable clinical trials reported results within 1?year of trial completion, while 55% reported results over the 5-year study period. Earlier phase highly likely applicable clinical trials were less likely to report results compared to phase 4 highly likely applicable clinical trials (phases 1/2 and 2 (adjusted hazard ratio 0.41 (95% confidence interval: 0.31-0.54)), phases 2/3 and 3 (adjusted hazard ratio 0.55 (95% confidence interval: 0.42-0.72)) and phase not applicable (adjusted hazard ratio 0.43 (95% confidence interval: 0.29-0.63)). Pulmonary highly likely applicable clinical trials without Food and Drug Administration oversight were less likely to report results compared with those with oversight (adjusted hazard ratio 0.65 (95% confidence interval: 0.51-0.83)). Conclusion A total of 15% of pulmonary clinical highly likely applicable clinical trials report basic summary results to ClinicalTrials.gov within 1?year of trial completion. Strategies to improve reporting are needed within the pulmonary community.

Dataset Information

P-hacking in clinical trials and how incentives shape the distribution of results across phases.

Publications

P-hacking in clinical trials and how incentives shape the distribution of results across phases.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets