Dataset Information

Reporting of Statistical Inference in Abstracts of Major Cancer Journals, 1990 to 2020.

ABSTRACT:

Importance

Since the 1990s, reporting guidelines have developed that uniformly require authors to report a measure of precision (confidence intervals [CIs]) in addition to effect size.

Objective

To investigate the time trend of statistical inference and statistical reporting style in abstracts of major cancer journals.

Design, setting, and participants

This cross-sectional study reviewed all abstracts published between January 1, 1990, and December 31, 2020, in 10 high-ranking cancer journals (Lancet Oncology, Journal of Clinical Oncology, Cancer Discovery, Cancer Cell, JAMA Oncology, Annals of Oncology, Molecular Cancer, Journal of Thoracic Oncology, Journal of the National Cancer Institute, and Trends in Cancer) using a previously validated computerized algorithm to search the PubMed database. For the time trend analyses, 2 journals with only a few years of existence (JAMA Oncology and Trends in Cancer) were excluded.

Exposures

Calendar year, journal, and type of abstract (randomized clinical trial or other).

Main outcomes and measures

Proportions of abstracts containing CIs, P values without CIs, and qualitative expressions of statistical significance only were compared over time among journals.

Results

Overall, 24 034 of 42 509 abstracts (56.5%) contained statistical inference. Reporting of CIs increased over time in 5 of 8 journals. From 2016 to 2020, the most prevailing statistical reporting style was the presentation of CIs (3070 of 4895 [62.7%]). However, the proportion of abstracts reporting statistical inference based solely on the terms significant or nonsignificant was still 1195 of 4895 (24.4%) during this period and was most prevalent among basic science-oriented cancer journals (eg, 63 of 66 [95.5%] in Cancer Cell). A higher prevalence of CI reporting was associated with reporting of results from randomized clinical trials and the requirement to report according to guidelines (eg, 522 of 574 [90.9%] in Lancet Oncology).

Conclusions and relevance

These findings suggest that the reporting style of statistical inference in abstracts of major cancer journals has improved over time. A requirement in journals' instructions for authors to present statistical inference in accordance with reporting guidelines and the implementation of these guidelines in submitted manuscripts on the part of journal editors may improve reporting.

SUBMITTER: Stang A

PROVIDER: S-EPMC9227005 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesTo evaluate the methodological quality of randomised controlled trial (RCT) abstracts in leading critical care nursing journals against the Consolidated Standards of Reporting Trials-Abstracts (CONSORT-A) checklist and to identify variables related with abstract reporting quality.DesignDescriptive methodological quality review.Data sourceWe searched the PubMed database and the websites of each included journal.Eligibility criteriaWe included RCT abstracts published between 2011 and 2021 in the first 11 Scopus-ranking (2021) critical care nursing journals that reported the results of RCTs in English that referred to the care of adult patients with acute/critical illness or their relatives and/or caregivers and conducted in ICUs.Data extraction and synthesisTwo independent investigators extracted the data using a prespecified 17-item checklist directly derived from CONSORT-A. For the primary outcome, each item was evaluated whether it was adequately reported or not and descriptive statistics were reported. An overall score was calculated by summing the results of all items and multivariate linear regression was conducted to detect potential predictors.ResultsSeventy-eight RCT abstracts were included in this review. The items with the highest CONSORT-A adherence were authors, objective, conclusion, participants, interventions and outcome. The randomisation item had the lowest CONSORT-A adherence, followed by trial registration, funding source, harms or side effects, recruitment, blinding and outcome results. The average CONSORT-A score was 8.5±1.5 points (of the maximum 17.5 points). Multivariate analysis indicated that the categorised word score and publication date were positively associated with the overall CONSORT-A score, while the first author's country being in Asia was negatively associated with the overall CONSORT-A score.ConclusionsThe 78 RCT abstracts showed poor overall adherence to CONSORT-A. The results indicate that the methodological reporting quality of RCT abstracts in critical care nursing journals requires improvement to facilitate assessment of the applicability and relevance of the results reported.

Project description:ObjectiveTo investigate the effect of the CONSORT for Abstracts guidelines, and different editorial policies used by five leading general medical journals to implement the guidelines, on the reporting quality of abstracts of randomised trials.DesignInterrupted time series analysis.SampleWe randomly selected up to 60 primary reports of randomised trials per journal per year from five high impact, general medical journals in 2006-09, if indexed in PubMed with an electronic abstract. We excluded reports that did not include an electronic abstract, and any secondary trial publications or economic analyses. We classified journals in three categories: those not mentioning the guidelines in their instructions to authors (JAMA and New England Journal of Medicine), those referring to the guidelines in their instructions to authors but with no specific policy to implement them (BMJ), and those referring to the guidelines in their instructions to authors with an active policy to implement them (Annals of Internal Medicine and Lancet). Two authors extracted data independently using the CONSORT for Abstracts checklist.Main outcomeMean number of CONSORT items reported in selected abstracts, among nine items reported in fewer than 50% of the abstracts published across the five journals in 2006.ResultsWe assessed 955 reports of abstracts of randomised trials. Journals with an active policy to enforce the guidelines showed an immediate increase in the level of mean number of items reported (increase of 1.50 items; P=0.0037). At 23 months after publication of the guidelines, the mean number of items reported per abstract for the primary outcome was 5.41 of nine items, a 53% increase compared with the expected level estimated on the basis of pre-intervention trends. The change in level or trend did not increase in journals with no policy to enforce the guidelines (BMJ, JAMA, and New England Journal of Medicine).ConclusionActive implementation of the CONSORT for Abstracts guidelines by journals can lead to improvements in the reporting of abstracts of randomised trials.