Dataset Information

Sponsorship bias and quality of randomised controlled trials in veterinary medicine.

ABSTRACT:

Background

Randomised controlled trials (RCTs) are considered the gold standard form of evidence for assessing treatment efficacy, but many factors can influence their reliability including methodological quality, reporting quality and funding source. The aim of this study was to examine the relationship between funding source and positive outcome reporting in veterinary RCTs published in 2011 and to assess the risk of bias in the RCTs identified.

Methods

A structured search of PubMed was used to identify feline, canine, equine, bovine and ovine clinical trials examining the efficacy of pharmaceutical interventions published in 2011. Funding source and outcomes were extracted from each RCT and an assessment of risk of bias made using the Cochrane risk of bias tool.

Results

Literature searches returned 972 papers, with 86 papers (comprising 126 individual RCTs) included in the analysis. There was found to be a significantly higher proportion of positive outcomes reported in the pharmaceutical funding group (P) compared to the non-pharmaceutical (NP) and 'no funding source stated' (NF) groups (P = 56.9%, NP = 34.9%, NF = 29.1%, p < 0.05). A high proportion of trials had an unclear risk of bias across the five criteria examined.

Conclusions

We found evidence that veterinary RCTs were more likely to report positive outcomes if they have pharmaceutical industry funding or involvement. Consistently poor reporting of trials, including non-identification of funding source, was found which hinders the use of the available evidence.

SUBMITTER: Wareham KJ

PROVIDER: S-EPMC5557072 | biostudies-literature | 2017 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Sponsorship bias and quality of randomised controlled trials in veterinary medicine.

Wareham K J KJ Hyde R M RM Grindlay D D Brennan M L ML Dean R S RS

BMC veterinary research 20170814 1

<h4>Background</h4>Randomised controlled trials (RCTs) are considered the gold standard form of evidence for assessing treatment efficacy, but many factors can influence their reliability including methodological quality, reporting quality and funding source. The aim of this study was to examine the relationship between funding source and positive outcome reporting in veterinary RCTs published in 2011 and to assess the risk of bias in the RCTs identified.<h4>Methods</h4>A structured search of Pu ...[more]

PMID: 28807033

Similar Datasets

Project description:ObjectiveTo explore the risk of industry sponsorship bias in a systematically identified set of placebo controlled and active comparator trials of statins.DesignSystematic review and network meta-analysis.EligibilityOpen label and double blind randomised controlled trials comparing one statin with another at any dose or with control (placebo, diet, or usual care) for adults with, or at risk of developing, cardiovascular disease. Only trials that lasted longer than four weeks with more than 50 participants per trial arm were included. Two investigators assessed study eligibility.Data sourcesBibliographic databases and reference lists of relevant articles published between 1 January 1985 and 10 March 2013.Data extractionOne investigator extracted data and another confirmed accuracy.Main outcome measureMean absolute change from baseline concentration of low density lipoprotein (LDL) cholesterol.Data synthesisStudy level outcomes from randomised trials were combined using random effects network meta-analyses.ResultsWe included 183 randomised controlled trials of statins, 103 of which were two-armed or multi-armed active comparator trials. When all of the existing randomised evidence was synthesised in network meta-analyses, there were clear differences in the LDL cholesterol lowering effects of individual statins at different doses. In general, higher doses resulted in higher reductions in baseline LDL cholesterol levels. Of a total of 146 industry sponsored trials, 64 were placebo controlled (43.8%). The corresponding number for the non-industry sponsored trials was 16 (43.2%). Of the 35 unique comparisons available in 37 non-industry sponsored trials, 31 were also available in industry sponsored trials. There were no systematic differences in magnitude between the LDL cholesterol lowering effects of individual statins observed in industry sponsored versus non-industry sponsored trials. In industry sponsored trials, the mean change from baseline LDL cholesterol level was on average 1.77 mg/dL (95% credible interval -11.12 to 7.66) lower than the change observed in non-industry sponsored trials. There was no detectable inconsistency in the evidence network.ConclusionsOur analysis shows that the findings obtained from industry sponsored statin trials seem similar in magnitude as those in non-industry sources. There are actual differences in the effectiveness of individual statins at various doses that explain previously observed discrepancies between industry and non-industry sponsored trials.

Project description:BackgroundMultiple sclerosis (MS) is the most common non-traumatic disabling disease affecting young adults. A definitive curative treatment is currently unavailable. Many randomized controlled trials (RCTs) have reported the efficacy of Chinese herbal medicine (CHM) on MS. Because of the uncertain quality of these RCTs, the recommendations for routine use of CHM for MS remain inconclusive. The comprehensive evaluation of the quality of RCTs of CHM for MS is urgent.MethodsNine databases, namely, PubMed, Embase, Web of Science, Cochrane Library, EBSCO, Sinomed, Wanfang Database, China National Knowledge Infrastructure, and VIP Database, were searched from inception to September 2023. RCTs comparing CHM with placebo or pharmacological interventions for MS were considered eligible. The Consolidated Standards of Reporting Trials (CONSORT) and its extension for CHM formulas (CONSORT-CHM Formulas) checklists were used to evaluate the reporting quality of RCTs. The risk of bias was assessed using the Cochrane Risk of Bias tool. The selection criteria of high-frequency herbs for MS were those with cumulative frequency over 50% among the top-ranked herbs.ResultsA total of 25 RCTs were included. In the included RCTs, 33% of the CONSORT items and 21% of the CONSORT-CHM Formulas items were reported. Eligibility title, sample size calculation, allocation concealment, randomized implementation, and blinded description in CONSORT core items were reported by less than 5% of trials. For the CONSORT-CHM Formulas, the source and authentication method of each CHM ingredient was particularly poorly reported. Most studies classified the risk of bias as "unclear" due to insufficient information. The top five most frequently used herbs were, in order, Radix Rehmanniae Preparata, Radix Rehmanniae Recens, Herba Epimedii, Scorpio, and Poria. No serious adverse effect had been reported.ConclusionsThe low reporting of CONSORT items and the unclear risk of bias indicate the inadequate quality of RCTs in terms of reporting completeness and result validity. The CONSORT-CHM Formulas appropriately consider the unique characteristics of CHM, including principles, formulas, and Chinese medicinal substances. To improve the quality of RCTs on CHM for MS, researchers should adhere more closely to CONSORT-CHM Formulas guidelines and ensure comprehensive disclosure of all study design elements.

Project description:BackgroundClinical trials on Traditional Chinese Medicine (TCM) should be registered in a publicly accessible international trial register and report on all outcomes. We systematically assessed and evaluated TCM trials in registries with their subsequent publications.ObjectiveTo describe the characteristics of TCM trials, estimate bias risk and outcome-reporting bias in clinical trials.Data sources and study selectionFifteen trial registries were searched from their inception to July 2012 to identify randomised trials on TCM including Chinese herbs, acupuncture and/or moxibustion, cupping, tuina, qigong, etc.Data extractionWe extracted data including TCM specialty and treated disease/conditions from the registries and searched for subsequent publications in PubMed and Chinese databases. We compared information in the registries of completed trials with any publications focusing on study design, sample size, randomisation, bias risk including reporting bias from the register protocol.Results1096 registered randomised trials were identified evaluating TCM, of which 505 were completed studies (46.1%). The most frequent conditions were pain (13.3%), musculoskeletal (11.7%), nervous (8.7%), digestive (7.1%), circulatory (6.5%), respiratory (6.3%), mental and behavioural disorders (6.2%) and cancer (6.0%). The trial register data identified parallel, phase II/III randomised trials with sample size estimations and blinding, but limited information about randomisation (sequence generation and allocation concealment). Comparing trial registration data of 115 completed trials (22.8%) with their subsequent 136 publications, inconsistencies were identified in one or more of the following: sample size (11%), outcome assessor blinding (37.5%), primary outcomes (29%) and safety (28%) reporting.ConclusionsIncreasing numbers of clinical trials investigating a variety of TCM interventions have been registered in international trial registries. The study design of registered TCM trials has improved in estimating sample size, use of blinding and placebos. However, selective outcome reporting is widespread and similar to conventional medicine and therefore study conclusions should be interpreted with caution.

Project description:IntroductionMortality is the most widely accepted outcome measure in randomized controlled trials of therapies for critically ill adults, but most of these trials fail to show a statistically significant mortality benefit. The reasons for this are unknown.MethodsWe searched five high impact journals (Annals of Internal Medicine, British Medical Journal, JAMA, The Lancet, New England Journal of Medicine) for randomized controlled trials comparing mortality of therapies for critically ill adults over a ten year period. We abstracted data on the statistical design and results of these trials to compare the predicted delta (delta; the effect size of the therapy compared to control expressed as an absolute mortality reduction) to the observed delta to determine if there is a systematic overestimation of predicted delta that might explain the high prevalence of negative results in these trials.ResultsWe found 38 trials meeting our inclusion criteria. Only 5/38 (13.2%) of the trials provided justification for the predicted delta. The mean predicted delta among the 38 trials was 10.1% and the mean observed delta was 1.4% (P < 0.0001), resulting in a delta-gap of 8.7%. In only 2/38 (5.3%) of the trials did the observed delta exceed the predicted delta and only 7/38 (18.4%) of the trials demonstrated statistically significant results in the hypothesized direction; these trials had smaller delta-gaps than the remainder of the trials (delta-gap 0.9% versus 10.5%; P < 0.0001). For trials showing non-significant trends toward benefit greater than 3%, large increases in sample size (380% - 1100%) would be required if repeat trials use the observed delta from the index trial as the predicted delta for a follow-up study.ConclusionsInvestigators of therapies for critical illness systematically overestimate treatment effect size (delta) during the design of randomized controlled trials. This bias, which we refer to as "delta inflation", is a potential reason that these trials have a high rate of negative results."Absence of evidence is not evidence of absence."

Project description:Background: Chinese herbal medicine (CHM) provides a theoretical basis for the treatment of psoriasis with considerable benefits and a low toxicity. The purpose of this quantitative study was to show high-quality evidence of the efficacy and safety of CHM for the treatment of psoriasis to promote its clinical application. Methods: Several databases were systematically searched including PubMed, Embase, Cochrane Central Register of Controlled Trials, China Network Knowledge Infrastructure, Chinese Scientific Journals Database, and Wan Fang Database. High-quality randomized controlled trials that compared CHM with non-CHM interventions were included. The RevMan5.3 software was used to calculate risk ratios (RR) at 95% confidence intervals (CI) and conduct the meta-analysis. Results: Altogether, 1,215 patients participated in this study, including 711 in the experimental group and 504 in the control group. The psoriasis area severity index (PASI) score of the CHM group was significantly lower than that of the placebo group (MD, -4.02; 95% CI, -6.71 to -1.34; p = 0.003). To achieve PASI-60 and PASI-75, the arrival rate of the CHM group was higher than that of the placebo group (PASI-60: RR, 3.52; 95% CI, 1.17 to 10.61; p = 0.03; PASI-75: RR, 9.87; 95% CI, 3.11 to 31.31; p = 0.0001). Furthermore, the efficacy rate was higher in patients receiving CHM than in those receiving placebo (RR, 1.72; 95% CI, 1.01 to 2.93; p = 0.04). The results suggested a greater impact of CHM in improving the dermatology life quality index (DLQI) of patients (MD, -2.12; 95% CI, -3.75 to -0.49; p = 0.01). Regarding pruritus severity, there was no significant difference between the two groups (MD, -1.90; 95% CI, -3.79 to -0.01; p = 0.05). The meta-analysis revealed that the recurrence rate (RR, 0.74; 95% CI, 0.32 to 1.71; p = 0.48) and proportion of adverse events (RR, 1.36; 95% CI, 0.95 to 1.93; p = 0.09) associated with using CHM were similar to those associated with using a placebo. Conclusion: CHM appears safe and effective in the treatment of psoriasis and has a great positive impact on the DQLI of patients; however, CHM could not completely eliminate skin lesions, improve pruritus severity, and reduce the recurrence rate.

Dataset Information

Sponsorship bias and quality of randomised controlled trials in veterinary medicine.

Background

Methods

Results

Conclusions

Publications

Sponsorship bias and quality of randomised controlled trials in veterinary medicine.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets