Dataset Information

From QUOROM to PRISMA: a survey of high-impact medical journals' instructions to authors and a review of systematic reviews in anesthesia literature.

ABSTRACT:

Background

The PRISMA (Preferred Reporting Items of Systematic reviews and Meta-Analyses) Statement was published to help authors improve how they report systematic reviews. It is unknown how many journals mention PRISMA in their instructions to authors, or whether stronger journal language regarding use of PRISMA improves author compliance.

Methodology/principal findings

An Internet-based investigation examined the extent to which 146 leading medical journals have incorporated the PRISMA Statement into their instructions to authors. Results were analyzed using descriptive statistics. Also, systematic reviews published in the leading anesthesiology journals and the QUOROM (QUality Of Reporting Of Meta-analyses) Statement were used to explore the hypothesis that indicating compliance with the QUOROM Statement in the manuscript is associated with improved compliance with the reporting guideline. In a sample of 146 journals publishing systematic reviews, the PRISMA Statement was referred to in the instructions to authors for 27% (40/146) of journals; more often in general and internal medicine journals (7/14; 50%) than in specialty medicine journals (33/132; 25%). In the second part of the study, 13 systematic reviews published in the leading anesthesiology journals in 2008 were included for appraisal. Mention of the QUOROM Statement in the manuscript was associated with higher compliance with the QUOROM checklist (P = 0.022).

Conclusions/significance

Most of the leading medical journals used ambiguous language regarding what was expected of authors. Further improvement on quality of reporting of systematic reviews may entail journals clearly informing authors of their requirements. Stronger directions, such as requiring an indication of adherence to a research quality of reporting statement in the manuscript, may improve reporting and utility of systematic reviews.

SUBMITTER: Tao KM

PROVIDER: S-EPMC3217994 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND: The CONSORT Statement is a reporting guideline for authors when reporting randomized controlled trials (RCTs). It offers a standard way for authors to prepare RCT reports. It has been endorsed by many high-impact medical journals and by international editorial groups. This study was conducted to assess the endorsement of the CONSORT Statement by high-impact medical journals in China by reviewing their instructions for authors. METHODOLOGY/PRINCIPAL FINDINGS: A total of 200 medical journals were selected according to the Chinese Science and Technology Journal Citation Reports, 195 of which publish clinical research papers. Their instructions for authors were reviewed and all texts mentioning the CONSORT Statement or CONSORT extension papers were extracted. Any mention of the Uniform Requirements for Manuscripts Submitted to Biomedical Journals (URM) developed by the International Committee of Medical Journal Editors (ICMJE) or 'clinical trial registration' was also extracted. For journals endorsing the CONSORT Statement, their most recently published RCT reports were retrieved and evaluated to assess whether the journals have followed what the CONSORT Statement required. Out of the 195 medical journals publishing clinical research papers, only six (6/195, 3.08%) mentioned 'CONSORT' in their instructions for authors; out of the 200 medical journals surveyed, only 14 (14/200, 7.00%) mentioned 'ICMJE' or 'URM' in their instructions for authors, and another five journals stated in their instructions for authors that clinical trials should have trial registration numbers and that priority would be given to clinical trials which had been registered. Among the 62 RCT reports published in the six journals endorsing the CONSORT Statement, 20 (20/62, 32.26%) contained flow diagrams and only three (3/62, 4.84%) provided trial registration information. CONCLUSIONS/SIGNIFICANCE: Medical journals in China endorsing either the CONSORT Statement or the ICMJE's URM constituted a small percentage of the total; all of these journals used ambiguous language regarding what was expected of authors.

Project description:BACKGROUND:The aim of this study was to evaluate the current state of two publication practices, reporting guidelines requirements and clinical trial registration requirements, by analyzing the "Instructions for Authors" of emergency medicine journals. METHODS:We performed a web-based data abstraction from the "Instructions for Authors" of the 27 Emergency Medicine journals catalogued in the Expanded Science Citation Index of the 2014 Journal Citation Reports and Google Scholar Metrics h5-index to identify whether each journal required, recommended, or made no mention of the following reporting guidelines: EQUATOR Network, ICMJE, ARRIVE, CARE, CONSORT, STARD, TRIPOD, CHEERS, MOOSE, STROBE, COREQ, SRQR, SQUIRE, PRISMA-P, SPIRIT, PRISMA, and QUOROM. We also extracted whether journals required or recommended trial registration. Authors were blinded to one another's ratings until completion of the data validation. Cross-tabulations and descriptive statistics were calculated using IBM SPSS 22. RESULTS:Of the 27 emergency medicine journals, 11 (11/27, 40.7%) did not mention a single guideline within their "Instructions for Authors," while the remaining 16 (16/27, 59.3%) mentioned one or more guidelines. The QUOROM statement and SRQR were not mentioned by any journals whereas the ICMJE guidelines (18/27, 66.7%) and CONSORT statement (15/27, 55.6%) were mentioned most often. Of the 27 emergency medicine journals, 15 (15/27, 55.6%) did not mention trial or review registration, while the remaining 12 (12/27, 44.4%) at least mentioned one of the two. Trial registration through ClinicalTrials.gov was mentioned by seven (7/27, 25.9%) journals while the WHO registry was mentioned by four (4/27, 14.8%). Twelve (12/27, 44.4%) journals mentioned trial registration through any registry platform. DISCUSSION:The aim of this study was to evaluate the current state of two publication practices, reporting guidelines requirements and clinical trial registration requirements, by analyzing the "Instructions for Authors" of emergency medicine journals. In this study, there was not a single reporting guideline mentioned in more than half of the journals. This undermines efforts of other journals to improve the completeness and transparency of research reporting. CONCLUSIONS:Reporting guidelines are infrequently required or recommended by emergency medicine journals. Furthermore, few require clinical trial registration. These two mechanisms may limit bias and should be considered for adoption by journal editors in emergency medicine. TRIAL REGISTRATION:UMIN000022486.

Project description:Natural Language Processing (NLP) is a subset of artificial intelligence that enables machines to understand and respond to human language through Large Language Models (LLMs)‥ These models have diverse applications in fields such as medical research, scientific writing, and publishing, but concerns such as hallucination, ethical issues, bias, and cybersecurity need to be addressed. To understand the scientific community's understanding and perspective on the role of Artificial Intelligence (AI) in research and authorship, a survey was designed for corresponding authors in top medical journals. An online survey was conducted from July 13th, 2023, to September 1st, 2023, using the SurveyMonkey web instrument, and the population of interest were corresponding authors who published in 2022 in the 15 highest-impact medical journals, as ranked by the Journal Citation Report. The survey link has been sent to all the identified corresponding authors by mail. A total of 266 authors answered, and 236 entered the final analysis. Most of the researchers (40.6%) reported having moderate familiarity with artificial intelligence, while a minority (4.4%) had no associated knowledge. Furthermore, the vast majority (79.0%) believe that artificial intelligence will play a major role in the future of research. Of note, no correlation between academic metrics and artificial intelligence knowledge or confidence was found. The results indicate that although researchers have varying degrees of familiarity with artificial intelligence, its use in scientific research is still in its early phases. Despite lacking formal AI training, many scholars publishing in high-impact journals have started integrating such technologies into their projects, including rephrasing, translation, and proofreading tasks. Efforts should focus on providing training for their effective use, establishing guidelines by journal editors, and creating software applications that bundle multiple integrated tools into a single platform.