Dataset Information

Comparison of Clinical Trial Changes in Primary Outcome and Reported Intervention Effect Size Between Trial Registration and Publication.

ABSTRACT: Importance:Primary outcome change could threaten the validity of a clinical trial; however, evidence about the consequences on the reported intervention effect size is unclear. Objectives:To examine the status of randomized clinical trials whose primary outcome changed between trial registration and publication and to quantify the association of this change with the reported intervention effect size. Design, Setting, and Participants:In this cross-sectional study on the primary report of randomized clinical trials with clear prospectively registered primary outcomes, PubMed and Embase were searched for articles published between January 1, 2011, and December 31, 2015. The search was conducted in January 2016, identifying randomized clinical trials and the combination of keywords and text words related to registry. Main Outcomes and Measures:Based on the developed approach, trials were classified as having primary outcome change when there was a major discrepancy between the registered and published primary outcomes. Intervention effect was estimated or recalculated using the odds ratio (OR) for each comparison. Each component OR is structured so that an OR is less than 1 if the intervention group has a more favorable result than the control group. The ratio of ORs (ROR), which is the summary OR for trials with primary outcome change divided by those without, and its 95% CI were calculated, with a value less than 1 indicating a larger reported intervention effect size in trials with primary outcome change than those without. Results:Among 29?749 searched articles (28?810 MEDLINE and 939 Embase), 1488 articles were randomly selected for review. Of 389 trials with clear primary outcomes prospectively described in the registry (416 outcomes reported), 33.4% (130 of 389) of trials had at least 1 primary outcome change. Most (66 of 130) of the changes were either not reporting or omitting the primary outcome. In total, 338 trials (365 outcomes and 487 comparisons) were available for quantitative analysis on the reported intervention effect size bias assessment. Compared with those without primary outcome change, trials with primary outcome change showed a 16% (pooled ROR, 0.84; 95% CI, 0.73-0.96) larger reported intervention effect size. The result persisted after adjustment for potential confounders (ROR, 0.81; 95% CI, 0.71-0.93) and other sensitivity and subgroup analyses. Conclusions and Relevance:Results of this study suggest that inconsistencies between registered and published primary outcomes of clinical trials are common, and trials with primary outcome change are likely to have a larger intervention effect than those without.

SUBMITTER: Chen T

PROVIDER: S-EPMC6646984 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparison of Clinical Trial Changes in Primary Outcome and Reported Intervention Effect Size Between Trial Registration and Publication.

Chen Tao T Li Chao C Qin Rui R Wang Yang Y Yu Dahai D Dodd James J Wang Duolao D Cornelius Victoria V

JAMA network open 20190703 7

<h4>Importance</h4>Primary outcome change could threaten the validity of a clinical trial; however, evidence about the consequences on the reported intervention effect size is unclear.<h4>Objectives</h4>To examine the status of randomized clinical trials whose primary outcome changed between trial registration and publication and to quantify the association of this change with the reported intervention effect size.<h4>Design, setting, and participants</h4>In this cross-sectional study on the pri ...[more]

PMID: 31322690

Similar Datasets

Project description:Previously, we reviewed 1052 randomized-controlled trial abstracts presented at the American Society of Anesthesiologists annual meetings from 2001-2004. We found significant positive publication bias in the period examined, with the odds ratio for abstracts with positive results proceeding to journal publication over those with null results being 2.01 [95% confidence interval: 1.52, 2.66; P < 0.001]. Mandatory trial registration was introduced in 2005 as a required standard for publication. We sought to examine whether mandatory trial registration has decreased publication bias in the anesthesia and perioperative medicine literature. We reviewed all abstracts from the 2010-2016 American Society of Anesthesiologists meetings that reported on randomized-controlled trials in humans. We scored the result of each abstract as positive or null according to a priori definitions. We systematically searched for any subsequent publication of the studies and calculated the odds ratio for journal publication, comparing positive vs null studies. We compared the odds ratio from the 2010-2016 abstracts (post-mandatory trial registration) with the odds ratio from the 2001-2004 abstracts (pre-mandatory trial registration) as a ratio of odds ratios. We defined a 33% decrease in the odds ratio as significant, corresponding to a new odds ratio of 1.33. We reviewed 9789 abstracts; 1049 met inclusion criteria as randomized-controlled trials, with 542 (51.7%) of the abstracts going on to publication. The odds ratio for abstracts with positive results proceeding to journal publication was 1.28 [95% CI: 0.97, 1.67; P = 0.076]. With adjustment for sample size and abstract quality, the difference in publication rate between positive and null abstracts was statistically significant (odds ratio 1.34; 95% CI: 1.02, 1.76; P = 0.037). The ratio of odds ratios, comparing the odds ratio from the 2010-2016 abstracts (post-mandatory trial registration) to the odds ratio from the 2001-2004 abstracts (pre-mandatory trial registration), was 0.63 (95% CI: 0.43, 0.93); P = 0.021). We present the first study in the anesthesia and perioperative medicine literature that examines and compares publication bias over two discrete periods of time, prior to and after the implementation of mandatory trial registration. Our results suggest that the amount of publication bias has decreased markedly following implementation of mandatory trial registration. However, some positive publication bias in the anesthesia and perioperative medicine literature remains.

Project description:BackgroundClinicalTrials.gov is a publicly accessible, Internet-based registry of clinical trials managed by the US National Library of Medicine that has the potential to address selective trial publication. Our objectives were to examine completeness of registration within ClinicalTrials.gov and to determine the extent and correlates of selective publication.Methods and findingsWe examined reporting of registration information among a cross-section of trials that had been registered at ClinicalTrials.gov after December 31, 1999 and updated as having been completed by June 8, 2007, excluding phase I trials. We then determined publication status among a random 10% subsample by searching MEDLINE using a systematic protocol, after excluding trials completed after December 31, 2005 to allow at least 2 y for publication following completion. Among the full sample of completed trials (n = 7,515), nearly 100% reported all data elements mandated by ClinicalTrials.gov, such as intervention and sponsorship. Optional data element reporting varied, with 53% reporting trial end date, 66% reporting primary outcome, and 87% reporting trial start date. Among the 10% subsample, less than half (311 of 677, 46%) of trials were published, among which 96 (31%) provided a citation within ClinicalTrials.gov of a publication describing trial results. Trials primarily sponsored by industry (40%, 144 of 357) were less likely to be published when compared with nonindustry/nongovernment sponsored trials (56%, 110 of 198; p<0.001), but there was no significant difference when compared with government sponsored trials (47%, 57 of 122; p = 0.22). Among trials that reported an end date, 75 of 123 (61%) completed prior to 2004, 50 of 96 (52%) completed during 2004, and 62 of 149 (42%) completed during 2005 were published (p = 0.006).ConclusionsReporting of optional data elements varied and publication rates among completed trials registered within ClinicalTrials.gov were low. Without greater attention to reporting of all data elements, the potential for ClinicalTrials.gov to address selective publication of clinical trials will be limited. Please see later in the article for the Editors' Summary.

Project description:ObjectiveTo address the bias occurring in the medical literature associated with selective outcome reporting, in 2005, the International Committee of Medical Journal Editors (ICMJE) introduced mandatory trial registration guidelines and member journals required prospective registration of trials prior to patient enrolment as a condition of publication. No research has examined whether these guidelines are impacting psychiatry publications. Our objectives were to determine the extent to which articles published in psychiatry journals adhering to ICMJE guidelines were correctly prospectively registered, whether there was evidence of selective outcome reporting and changes to participant numbers, and whether there was a relationship between registration status and source of funding.Materials and methodsAny clinical trial (as defined by ICMJE) published between 1 January 2009 and 31 July 2013 in the top five psychiatry journals adhering to ICMJE guidelines (The American Journal of Psychiatry, Archives of General Psychiatry/JAMA Psychiatry, Biological Psychiatry, Journal of the American Academy of Child and Adolescent Psychiatry, and The Journal of Clinical Psychiatry) and conducted after July 2005 (or 2007 for two journals) was included. For each identified trial, where possible we extracted trial registration information, changes to POMs between publication and registry to assess selective outcome reporting, changes to participant numbers, and funding type.ResultsOut of 3305 articles, 181 studies were identified as clinical trials requiring registration: 21 (11.6%) were deemed unregistered, 61 (33.7%) were retrospectively registered, 37 (20.4%) had unclear POMs either in the article or the registry and 2 (1.1%) were registered in an inaccessible trial registry. Only 60 (33.1%) studies were prospectively registered with clearly defined POMs; 17 of these 60 (28.3%) showed evidence of selective outcome reporting and 16 (26.7%) demonstrated a change in participant numbers of 20% or more; only 26 (14.4%) of the 181 the trials were prospectively registered and did not alter their POMs or the time frames at which they were measured. Prospective registration with no changes in POMs occurred more frequently with pharmaceutical funding.DiscussionAlthough standards are in place to improve prospective registration and transparency in clinical trials, less than 15% of psychiatry trials were prospectively registered with no changes in POMs. Most trials were either not prospectively registered, changed POMs or the timeframes at some point after registration or changed participant numbers. Authors, journal editors and reviewers need to further efforts to highlight the value of prospective trial registration.

Project description:ObjectivesTo examine 1) the publication rate of registered otology trials in ClinicalTrials.gov, 2) the public availability of the results, 3) the study characteristics associated with publication, and 4) the time to publication after trial completion.BackgroundPublication bias, the publication or non-publication of research findings, depending on the nature and direction of results, is accountable for wrong treatment decisions. The extent of publication bias in otology trials has not been evaluated.MethodsAll registered otology trials were extracted from ClinicalTrials.gov with completion date up to December 2015. A search strategy was used to identify corresponding publications up to June 2017, providing at least 18 months to publish the results after trial completion. Characteristics were obtained from ClinicalTrials.gov and corresponding publications. Regression models were used to examine study characteristics associated with publication or non-publication.ResultsFrom the 419 trials identified on ClinicalTrials.gov, 225 (53.7%) corresponding publications were found in PubMed. Among these, 109 (48.4%) publications were cited on ClinicalTrials.gov and 124 (55.1%) articles reported the National Clinical Trial registry number. For 36 (8.6%) trials, results were only reported in ClinicalTrials.gov. Trials with a biological intervention were more likely to be published than studies involving drugs (odds ratio (OR) 10.41, 95% confidence interval (CI) 1.26-86.22, P = 0.030). Trials funded by industry were less likely to be published (OR 0.46, CI 0.25-0.84, P = 0.011). The median trial duration was 20 months (interquartile range (IQR) 26 months), and median time from trial completion to publication was 24 months (IQR 22 months).ConclusionIn 37.7% of the registered otology trials the results remained unpublished, even several years after trial completion. With little citations on ClinicalTrials.gov and low reporting of the Clinical Trial registry number, the accessibility is limited. Our findings show that there is room for improvement in accuracy of trial registration and publication of results, in order to diminish publication bias in otology studies.

Project description:BackgroundIn the United States, more than one-third of the adult population is obese, and approximately 25.2% of those aged ≥65 years have type 2 diabetes (T2D), which is the seventh leading cause of death. It is important to measure patient-reported outcomes and monitor progress or challenges over time when managing T2D to understand patients' perception of health and quantify the impact of disease processes or intervention effects. The evaluation of patient-reported outcome measures (PROMs) is especially important among patients with multiple chronic conditions in which clinical measures do not provide a complete picture of health.ObjectiveThis study examined the feasibility of collecting Patient-Reported Outcome Measurement Information System (PROMIS) measures, and preliminarily evaluated changes in PROMIS scores and compared the scores with standard scores of the general US population. The parent study is a pilot randomized controlled clinical trial testing three different modes (mobile health [mHealth], paper diary, and control) of self-monitoring in a behavioral lifestyle intervention among overweight or obese patients with T2D.MethodsPatients with comorbid overweight or obesity and a diagnosis of T2D for at least 6 months were recruited from a diabetes education program. Participants were randomized to the following three groups: mHealth, paper diary, and control (standard of care) groups. Paper diary and mHealth experimental groups received additional behavioral lifestyle intervention education sessions, as well as tools to self-monitor weight, physical activity, diet, and blood glucose. All participants completed PROMIS-57 and PROMIS-Global Health (GH) version 1.0 questionnaires during visits at baseline, 3 months, and 6 months. The PROMIS-57 includes the following seven domains: anxiety, depression, fatigue, pain interference, physical function, satisfaction with participation in social roles, and sleep disturbance. The PROMIS-GH is composed of the following two domains: global mental health and global physical health.ResultsA total of 26 patients (mHealth, 11; paper diary, 9; control, 6) were included in our analysis. The study sample was predominantly African American (68%) and female (57%), with a mean age of 54.7 years and a mean BMI of 37.5 kg/m2. All patients completed the PROMIS-57 and PROMIS-GH questionnaires, and we compared the mean scores of the three groups to investigate potential differences. No relevant differences were noted across the groups. However, positive trends were noted in both intervention (mHealth and paper diary) groups in the middle (month 3) and end (month 6) of the study.ConclusionsOur pilot study provides evidence for the feasibility of using PROMIS questionnaires to record important components of T2D-related symptoms among overweight or obese individuals. The results from our study support the use of PROMIS questionnaires to provide clinicians and researchers with a benchmark for assessing the overall need for symptom management and determining the success or challenges of an intervention.Trial registrationClinicalTrials.gov NCT02858648; https://clinicaltrials.gov/ct2/show/NCT02858648.

Project description:ObjectiveThe registration of clinical trials is required by law in Switzerland. We investigated (1) the proportion of registered and prospectively registered clinical trials, (2) the availability of results for ethically approved trial protocols, (3) factors associated with increased registration, and (4) reasons for non-registration.Design and settingWe included all clinical trials with mandatory prospective registration, which were approved by the ethics committee of Northwestern and Central Switzerland between January 1, 2016, and December 31, 2020.MethodsWe extracted relevant trial characteristics from the Swiss Business Administration System for Ethics Committees and systematically searched the International Clinical Trials Registry Platform and primary trial registries for corresponding registry entries. We used multivariable logistic regression to examine the association between trial characteristics and registration. We qualitatively assessed reasons for non-registration of trials through an email questionnaire for trial investigators.ResultsOf 473 included clinical trials, 432 (91%) were registered at all and 326 (69%) were prospectively registered. While the percentages of registration and prospective registration of investigator-sponsored trials increased from 85 to 93% and from 59 to 70% over 5 years, respectively, industry-sponsored trials consistently remained at a high level of prospective registration (92 to 100%). Trials with multiple centres, higher risk category, or methodological support from the local clinical trials unit were independently associated with increased registration rates. Of 103 clinical trials completed before August 2020, results were available for 70% of industry-sponsored trials and 45% of investigator-sponsored trials as peer-reviewed journal publications or in trial registries. Most common reasons for non-registration provided by investigators were lack of time or resources (53%), lack of knowledge (22%), and lack of reminders by the ethics committee (36%).ConclusionsIn Northwestern and Central Switzerland about 10% of clinical trials remained unregistered despite the obligation by law. More support for investigators and stricter enforcement by regulators are needed to improve the transparency of investigator-sponsored trials in particular.

Project description:ObjectivesEmergency surgical practice constitutes 50% of the workload for surgeons, but there is a lack of high quality randomised controlled trials (RCTs) in emergency surgery. This study aims to establish the differences between the registration, completion and publication of emergency and elective surgical trials.DesignThe clinicaltrials.gov and ISRCTN.com trials registry databases were searched for RCTs between 12 July 2010 and 12 July 2012 using the keyword 'surgery'. Publications were systematically searched for in Pubmed, MEDLINE and EMBASE.ParticipantsResults with no surgical interventions were excluded. The remaining results were manually categorised into 'emergency' or 'elective' and 'surgical' or 'adjunct' by two reviewers.Primary outcome measuresNumber of RCTs registered in emergency versus elective surgery.Secondary outcome measuresNumber of RCTs published in emergency versus elective surgery; reasons why trials remain unpublished; funding, sponsorship and impact of published articles; number of adjunct trials registered in emergency and elective surgery.Results2700 randomised trials were registered. 1173 trials were on a surgical population and of these, 414 trials were studying surgery. Only 9.4% (39/414) of surgical trials were in emergency surgery. The proportion of trials successfully published did not significantly differ between emergency and elective surgery (0.46 vs 0.52; mean difference (MD) -0.06, 95%?CI -0.24 to 0.12). Unpublished emergency surgical trials were statistically equally likely to be terminated early compared with elective trials (0.33 vs 0.16; MD -0.18, 95%?CI -0.06 to 0.41). Low accrual accounted for a similar majority in both groups (0.43 vs 0.46; MD -0.04, 95%?CI -0.48 to 0.41). Unpublished trials in both groups were statistically equally likely to still be planning publication (0.52 vs 0.71; MD -0.18, 95%?CI -0.43 to 0.07).ConclusionFewer RCTs are registered in emergency than elective surgery. Once trials are registered both groups are equally likely to be published.

Project description:BackgroundThe widely-used estimates of completeness of birth registration collected by Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS) and published by UNICEF primarily rely on registration status of children as reported by respondents. However, these self-reported estimates may be inaccurate when compared with completeness as assessed from nationally-reported official birth registration statistics, for several reasons, including over-reporting of registration due to concern about penalties for non-registration. This study assesses the concordance of self-reported birth registration and certification completeness with completeness calculated from civil registration and vital statistics (CRVS) systems data for 57 countries.MethodsSelf-reported estimates of birth registration and certification completeness, at ages less than five years and 12-23 months, were compiled and calculated from the UNICEF birth registration database, DHS and MICS. CRVS birth registration completeness was calculated as birth registrations reported by a national authority divided by estimates of live births published in the United Nations (UN) World Population Prospects or the Global Burden of Disease (GBD) Study. Summary measures of concordance were used to compare completeness estimates.FindingsBirth registration completeness (based on ages less than five years) calculated from self-reported data is higher than that estimated from CRVS data in most of the 57 countries (31 countries according to UN estimated births, average six percentage points (p.p.) higher; 43 countries according to GBD, average eight p.p. higher). For countries with CRVS completeness less than 95%, self-reported completeness was higher in 26 of 28 countries, an average 13 p.p. and median 9-10 p.p. higher. Self-reported completeness is at least 30 p.p. higher than CRVS completeness in three countries. Self-reported birth certification completeness exhibits closer concordance with CRVS completeness. Similar results are found for self-reported completeness at 12-23 months.ConclusionsThese findings suggest that self-reported completeness figures over-estimate completeness when compared with CRVS data, especially at lower levels of completeness, partly due to over-reporting of registration by respondents. Estimates published by UNICEF should be viewed cautiously, especially given their wide usage.

Dataset Information

Comparison of Clinical Trial Changes in Primary Outcome and Reported Intervention Effect Size Between Trial Registration and Publication.

Publications

Comparison of Clinical Trial Changes in Primary Outcome and Reported Intervention Effect Size Between Trial Registration and Publication.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets