Dataset Information

P value and Bayesian analysis in randomized-controlled trials in child health research published over 10 years, 2007 to 2017: a methodological review protocol.

ABSTRACT:

Background

There is an unresolved debate about the reliability of the interpretation of P value. Some investigators have suggested that an alternative Bayesian method is preferred in conducting health research. As randomized-controlled trials (RCTs) are important in generating research evidence, we decided to investigate the extent, if any, the inferential statistical framework in published RCTs in child health research have changed over 10 years. We aim to examine the change in P value and Bayesian analysis in RCTs in child health research papers published from 2007 to 2017.

Methods

We will search the Cochrane Central Register of Controlled Trials (Wiley) to identify relevant citations. We will leverage a pre-existing sample of child health RCTs published in 2007 (n=300) used in our previous study of reporting quality of pediatric RCTs. Using the same strategy and study selection methods, we will identify a comparable random sample of child health RCTs published in 2017 (n=300). Eligible studies will include RCTs in health research among individuals aged 21 years and below. One reviewer will select studies for inclusion and extract the data and another reviewer will verify these. Disagreements will be resolved by a discussion between reviewers or by involving another reviewer. We will perform a descriptive analysis of 2007 and 2017 samples and analyze the results using both the frequentist and Bayesian methods. We will present specific characteristics of the clinical trials from 2007 and 2017 in tabular and graphical forms. We will report the difference in the proportion of P value and Bayesian analysis between 2007 and 2017 to assess the 10-year change. Clustering around P values of significance, if observed, will be reported.

Discussion

This review will present the difference in the proportion of trials that reported on P value and Bayesian analysis between 2007 and 2017 to assess the 10-year change. The implications for future clinical research will be discussed and this research work will be published in a peer-reviewed journal. This review has the potential to help inform the need for a change in the methodological approach from the null hypothesis significance test to Bayesian methods.

Systematic review registration

Open Science Framework https://osf.io/aj2df.

SUBMITTER: Aregbesola A

PROVIDER: S-EPMC7948362 | biostudies-literature | 2021 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

P value and Bayesian analysis in randomized-controlled trials in child health research published over 10 years, 2007 to 2017: a methodological review protocol.

Aregbesola Alex A Gates Allison A Coyle Amanda A Sim Shannon S Vandermeer Ben B Skakum Megan M Contopoulos-Ioannidis Despina D Heath Anna A Hartling Lisa L Klassen Terry P TP

Systematic reviews 20210310 1

<h4>Background</h4>There is an unresolved debate about the reliability of the interpretation of P value. Some investigators have suggested that an alternative Bayesian method is preferred in conducting health research. As randomized-controlled trials (RCTs) are important in generating research evidence, we decided to investigate the extent, if any, the inferential statistical framework in published RCTs in child health research have changed over 10 years. We aim to examine the change in P value ...[more]

PMID: 33691775

Similar Datasets

Project description:OBJECTIVE:The aim of this study was to systematically evaluate the quality of the clinical practice guidelines (CPGs) for diabetes mellitus published in China over the period of January 2007 to April 2017. METHODS:We searched the China National Knowledge Infrastructure, Chinese Biomedical Literature database, VIP database and WanFang databases and guideline websites for CPGs for diabetes mellitus published between January 2007 and April 2017 in China. Two reviewers independently screened the literature according to the inclusion and exclusion criteria and extracted data. We used the the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool (Canadian Institutes of Health Research, Ottawa, Canada) to evaluate the quality of the included guidelines, calculated the scores of each domain and evaluated the consistency among the assessors via use of the intragroup correlation coefficient. And then we compared the results with Chinese CPGs and international CPGs. We conducted a subgroup analysis based on different classification criteria and compared scores of each domain subgroup analyses. RESULTS:A total of 98 guidelines were identified. The correlation coefficient within the group was 0.93, suggesting that the consistency between the evaluators was good. The scores of the six domains of AGREE II were described in median (IQR) as follows: scope and purpose 53.7 (50.0-59.7), stakeholder involvement 31.5 (27.3-37.0), rigour of development 19.1 (15.3-22.2), clarity of presentation 59.3 (50.0-64.8), applicability 18.1 (13.9-25.7) and editorial independence 0.0 (0.0-0.0). The mean score in each domain of quality of Chinese diabetes CPGs was lower than that of CPGs published worldwide but higher than the mean score of Chinese guidelines of all topics. A funding source, the updated version, organisation and publishers of the guidelines and target fields are all the factors influencing the quality of CPGs to a certain degree. CONCLUSIONS:A large number of Chinese diabetes CPGs have been produced. Their quality remain unsatisfactorily low compared with CPGs worldwide, there is still room for improvement. Chinese guideline developers should pay more attention to the transparency of methodology, and use the AGREE II instrument to develop and report guidelines.

Project description:BackgroundIndividualization of the follicle-stimulating hormone (FSH) starting dose is considered standard clinical practice during controlled ovarian stimulation (COS) in patients undergoing assisted reproductive technology (ART) treatment. Furthermore, the gonadotropin dose is regularly adjusted during COS to avoid hyper- or hypo-ovarian response, but limited data are currently available to characterize such adjustments. This review describes the frequency and direction (increase/decrease) of recombinant-human FSH (r-hFSH) dose adjustment reported in clinical trials.MethodsWe evaluated the proportion of patients undergoing ART treatment who received ≥ 1 r-hFSH dose adjustments. The inclusion criteria included studies (published Sept 2007 to Sept 2017) in women receiving ART treatment that allowed dose adjustment within the study protocol and that reported ≥ 1 dose adjustments of r-hFSH; studies not allowing/reporting dose adjustment were excluded. Data on study design, dose adjustment and patient characteristics were extracted. Point-incidence estimates were calculated per study and overall based on pooled number of cycles with dose adjustment across studies. The Clopper-Pearson method was used to calculate 95% confidence intervals (CI) for incidence where adjustment occurred in < 10% of patients; otherwise, a normal approximation method was used.ResultsInitially, 1409 publications were identified, of which 318 were excluded during initial screening and 1073 were excluded after full text review for not meeting the inclusion criteria. Eighteen studies (6630 cycles) reported dose adjustment: 5/18 studies (1359 cycles) reported data for an unspecified dose adjustment (direction not defined), in 10/18 studies (3952 cycles) dose increases were reported, and in 11/18 studies (5123 cycles) dose decreases were reported. The studies were performed in women with poor, normal and high response, with one study reporting in oocyte donors and one in obese women. The median day that dose adjustment was permitted was Day 6 after the start of treatment. The point estimates for incidence (95% CI) for unspecified dose adjustment, dose increases, and dose decreases were 45.3% (42.7, 48.0), 19.2% (18.0, 20.5), and 9.5% (8.7, 10.3), respectively.ConclusionsThis systematic review highlights that, in studies in which dose adjustment was allowed and reported, the estimated incidence of r-hFSH dose adjustments during ovarian stimulation was up to 45%.

Project description:Study Design?Systematic review. Clinical Questions?(1) Has the proportion and number of randomized controlled trials (RCTs) as an indicator of quality of evidence regarding lumbar fusion increased over the past 10 years? (2) Is there a difference in the proportion of RCTs among the four primary fusion diagnoses (degenerative disk disease, spondylolisthesis, deformity, and adjacent segment disease) over the past 10 years? (3) Is there a difference in the type and quality of clinical outcomes measures reported among RCTs over time? (4) Is there a difference in the type and quality of adverse events measures reported among RCTs over time? (5) Are there changes in fusion surgical approach and techniques over time by diagnosis over the past 10 years? Methods?Electronic databases and reference lists of key articles were searched from January 1, 2004, through December 31, 2013, to identify lumbar fusion RCTs. Fusion studies designed specifically to evaluate recombinant human bone morphogenetic protein-2 or other bone substitutes, revision surgery studies, nonrandomized comparison studies, case reports, case series, and cost-effectiveness studies were excluded. Results?Forty-two RCTs between January 1, 2004, and December 31, 2013, met the inclusion criteria and form the basis for this report. There were 35 RCTs identified evaluating patients diagnosed with degenerative disk disease, 4 RCTs evaluating patients diagnosed with degenerative spondylolisthesis, and 3 RCTs evaluating patients with a combination of degenerative disk disease and degenerative spondylolisthesis. No RCTs were identified evaluating patients with deformity or adjacent segment disease. Conclusions?This structured review demonstrates that there has been an increase in the available clinical database of RCTs using patient-reported outcomes evaluating the benefit of lumbar spinal fusion for the diagnoses of degenerative disk disease and degenerative spondylolisthesis. Gaps remain in the standardization of reportage of adverse events in such trials, as well as uniformity of surgical approaches used. Finally, continued efforts to develop higher-quality data for other surgical indications for lumbar fusion, most notably in the presence of adult spinal deformity and revision of prior surgical fusions, appear warranted.

Dataset Information

P value and Bayesian analysis in randomized-controlled trials in child health research published over 10 years, 2007 to 2017: a methodological review protocol.

Background

Methods

Discussion

Systematic review registration

Publications

P value and Bayesian analysis in randomized-controlled trials in child health research published over 10 years, 2007 to 2017: a methodological review protocol.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure