Dataset Information

Trial registration as a safeguard against outcome reporting bias and spin? A case study of randomized controlled trials of acupuncture.

ABSTRACT: BACKGROUND AND OBJECTIVE:Trial registration is widely endorsed as it is considered not only to enhance transparency and quality of reporting but also to help safeguard against outcome reporting bias and probably spin, known as specific reporting that could distort the interpretation of results thus mislead readers. We planned to investigate the current registration status of recently published randomized controlled trials (RCTs) of acupuncture, outcome reporting bias in the prospectively registered trials, and the association between trial registration and presence of spin and methodological factors in acupuncture RCTs. METHODS:Acupuncture RCTs published in English in recent 5 years (January 2013 to December 2017) were searched in PubMed, Cochrane Central Register of Controlled Trials, and EMBASE. Trial registration records identified in the publications and trial registries were classified into prospectively registered, retrospectively registered, or unregistered. Primary outcomes were identified and the direction of the results was judged as statistically significant (positive) or statistically nonsignificant (negative). We compared registered and published primary outcomes to assess outcome reporting bias and assessed whether discrepancies favored statistically significant outcomes. Frequency and strategies of spin in published reports with statistically nonsignificant results for primary outcomes were then identified. We also analyzed whether the trial registration status was associated with spin and quality of methodological factors. RESULTS:Of the 322 included RCTs, 41.9% (n = 135) were prospectively registered. Among 64 studies that were prospectively registered and specified primary outcomes, 25 trials had the discrepancies between the registered and published primary outcomes and 60% of them (15 trials) favored the statistically significant findings. Among 169 studies that specified primary outcomes, trial registration status was not associated with the direction of results, i.e., statistically significant or not. Spin was identified in 56.4% out of 78 studies with statistically nonsignificant primary outcomes and claiming efficacy with no consideration of statistically nonsignificant primary outcomes was the most common strategy for spin. Trial registration status was not statistically different between studies with and without spin. CONCLUSION:While trial registration seemed to have improved over time, primary outcomes in registered records and publications were often inconsistent, tending to favor statistically significant findings and spin was common in studies with statistically nonsignificant primary outcomes. Journal editors and researchers in this field should be alerted to still prevalent reporting bias and spin.

SUBMITTER: Won J

PROVIDER: S-EPMC6776391 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Trial registration as a safeguard against outcome reporting bias and spin? A case study of randomized controlled trials of acupuncture.

Won Jiyoon J Kim Seoyeon S Bae Inhu I Lee Hyangsook H

PloS one 20191003 10

<h4>Background and objective</h4>Trial registration is widely endorsed as it is considered not only to enhance transparency and quality of reporting but also to help safeguard against outcome reporting bias and probably spin, known as specific reporting that could distort the interpretation of results thus mislead readers. We planned to investigate the current registration status of recently published randomized controlled trials (RCTs) of acupuncture, outcome reporting bias in the prospectively ...[more]

PMID: 31581278

Similar Datasets

Project description:BackgroundClinical trials on Traditional Chinese Medicine (TCM) should be registered in a publicly accessible international trial register and report on all outcomes. We systematically assessed and evaluated TCM trials in registries with their subsequent publications.ObjectiveTo describe the characteristics of TCM trials, estimate bias risk and outcome-reporting bias in clinical trials.Data sources and study selectionFifteen trial registries were searched from their inception to July 2012 to identify randomised trials on TCM including Chinese herbs, acupuncture and/or moxibustion, cupping, tuina, qigong, etc.Data extractionWe extracted data including TCM specialty and treated disease/conditions from the registries and searched for subsequent publications in PubMed and Chinese databases. We compared information in the registries of completed trials with any publications focusing on study design, sample size, randomisation, bias risk including reporting bias from the register protocol.Results1096 registered randomised trials were identified evaluating TCM, of which 505 were completed studies (46.1%). The most frequent conditions were pain (13.3%), musculoskeletal (11.7%), nervous (8.7%), digestive (7.1%), circulatory (6.5%), respiratory (6.3%), mental and behavioural disorders (6.2%) and cancer (6.0%). The trial register data identified parallel, phase II/III randomised trials with sample size estimations and blinding, but limited information about randomisation (sequence generation and allocation concealment). Comparing trial registration data of 115 completed trials (22.8%) with their subsequent 136 publications, inconsistencies were identified in one or more of the following: sample size (11%), outcome assessor blinding (37.5%), primary outcomes (29%) and safety (28%) reporting.ConclusionsIncreasing numbers of clinical trials investigating a variety of TCM interventions have been registered in international trial registries. The study design of registered TCM trials has improved in estimating sample size, use of blinding and placebos. However, selective outcome reporting is widespread and similar to conventional medicine and therefore study conclusions should be interpreted with caution.

Project description:Background & aimsIn 2005, the registration of all randomised controlled trials (RCTs) before enrolment of participants became a condition for publication by the International Committee of Medical Journal Editors to increase transparency in trial reporting. Among RCTs on transarterial chemoembolisation (TACE) for the treatment of hepatocellular carcinoma (HCC) published after 2007, we assess the proportion that were registered and compare registered primary outcomes (PO) with those reported in publications to determine whether primary outcome reporting bias favoured significant outcomes.MethodsWe searched MEDLINE and EMBASE for reports of RCTs evaluating TACE for HCC treatment between 1 September 2007 and 31 March 2018. Registration and publication information for each included RCT was compared using a standardised data extraction form.ResultsThirteen out of 53 (25%) included RCTs were correctly registered (i.e. before the starting date of the RCT), 14 (26%) were registered after the RCT starting date, and 26 (49%) were not registered. Six out of 14 of the retrospectively registered RCTs (43%) were registered after their completion date. The PO was clearly reported in the published article of all registered RCTs, whereas the report was not clear in 8/26 (31%) of the non-registered RCTs (p = 0.01). Among registered RCTs, 8/27 (30%) had major discrepancies between registered and published PO. The influence of these discrepancies could be assessed in 6 of them and was shown to statistically favour significant results in 2.ConclusionsRegistration and outcome reporting in RCTs on TACE for HCC are often inadequate. Registration should be reinforced because it is a key to transparency.Lay summaryTrial registration is fundamental to our understanding and interpretation of results, as it provides information on all relevant clinical trials (to place the results in a broader context), and on the details of their associated protocols (to ensure that the scientific plan is followed). Once a randomised controlled trial (RCT) is completed, the trial results are usually publicly shared via scientific articles that are expected to thoroughly and objectively report them. This study shows that half of the RCTs evaluating transarterial chemoembolisation for hepatocellular carcinoma were not registered, and identified major discrepancies between registered and published primary outcome favouring significant results.

Project description:BackgroundConfidence that randomized controlled trial (RCT) results accurately reflect intervention effectiveness depends on proper trial conduct and the accuracy and completeness of published trial reports. The Journal of Consulting and Clinical Psychology (JCCP) is the primary trials journal amongst American Psychological Association (APA) journals. The objectives of this study were to review RCTs recently published in JCCP to evaluate (1) adequacy of primary outcome analysis definitions; (2) registration status; and, (3) among registered trials, adequacy of outcome registrations. Additionally, we compared results from JCCP to findings from a recent study of top psychosomatic and behavioral medicine journals.MethodsEligible RCTs were published in JCCP in 2013-2014. For each RCT, two investigators independently extracted data on (1) adequacy of outcome analysis definitions in the published report, (2) whether the RCT was registered prior to enrolling patients, and (3) adequacy of outcome registration.ResultsOf 70 RCTs reviewed, 12 (17.1%) adequately defined primary or secondary outcome analyses, whereas 58 (82.3%) had multiple primary outcome analyses without statistical adjustment or undefined outcome analyses. There were 39 (55.7%) registered trials. Only two trials registered prior to patient enrollment with a single primary outcome variable and time point of assessment. However, in one of the two trials, registered and published outcomes were discrepant. No studies were adequately registered as per Standard Protocol Items: Recommendation for Interventional Trials guidelines. Compared to psychosomatic and behavioral medicine journals, the proportion of published trials with adequate outcome analysis declarations was significantly lower in JCCP (17.1% versus 32.9%; p = 0.029). The proportion of registered trials in JCCP (55.7%) was comparable to behavioral medicine journals (52.6%; p = 0.709).ConclusionsThe quality of published outcome analysis definitions and trial registrations in JCCP is suboptimal. Greater attention to proper trial registration and outcome analysis definition in published reports is needed.

Project description:BackgroundMandatory trial registration, and later results reporting, were proposed to mitigate selective clinical trial publication and outcome reporting. The Food and Drug Administration (FDA) Amendments Act (FDAAA) was enacted by Congress on September 27, 2007, requiring the registration of all non-phase I clinical trials involving FDA-regulated medical interventions and results reporting for approved drugs. The association between FDAAA enactment and the registration, results reporting, and publication bias of neuropsychiatric trials has not been studied.MethodsWe conducted a retrospective cohort study of all efficacy trials supporting FDA new drug approvals between 2005 to 2014 for neuropsychiatric indications. Trials were categorized as pre- or post-FDAAA based on initiation and/or completion dates. The main outcomes were the proportions of trials registered and reporting results in ClinicalTrials.gov, and the degree of publication bias, estimated using the relative risks pre- and post-FDAAA of both the publication of positive vs non-positive trials, as well as of publication of positive vs non-positive trials without misleading interpretations. Registration and results reporting proportions were compared pre- and post-FDAAA using the two-tailed Fisher exact test, and the degrees of publication bias were compared by calculating the ratio of relative risks (RRR) for each period.ResultsThe FDA approved 37 new drugs for neuropsychiatric indications between 2005 and 2014 on the basis of 142 efficacy trials, of which 101 were pre-FDAAA and 41 post-FDAAA. Post-FDAAA trials were significantly more likely to be registered (100% vs 64%; p < 0.001) and report results (100% vs 10%; p < 0.001) than pre-FDAAA trials. Pre-FDAAA, positive trials were more likely to be published (relative risk [RR] = 1.52; 95% confidence interval [CI] = 1.17-1.99; p = 0.002) and published without misleading interpretations (RR = 2.47; CI = 1.57-3.73; p < 0.001) than those with non-positive results. In contrast, post-FDAAA positive trials were equally likely to have been published (RR = 1; CI = 1-1, p = NA) and published without misleading interpretations (RR = 1.20; CI = 0.84-1.72; p = 0.30). The likelihood of publication bias pre-FDAAA vs post-FDAAA was greater for positive vs non-positive trials (RRR = 1.52; CI = 1.16-1.99; p = 0.002) and for publication without misleading interpretations (RRR = 2.06, CI = 1.17-3.61, p = 0.01).ConclusionsThe enactment of FDAAA was followed by significantly higher proportions of trials that were registered and reporting results on ClinicalTrials.gov and significantly lower degrees of publication bias among trials supporting recent FDA approval of drugs for neuropsychiatric indications.

Dataset Information

Trial registration as a safeguard against outcome reporting bias and spin? A case study of randomized controlled trials of acupuncture.

Publications

Trial registration as a safeguard against outcome reporting bias and spin? A case study of randomized controlled trials of acupuncture.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets