Dataset Information

Auto-correlation of journal impact factor for consensus research reporting statements: a cohort study.

ABSTRACT: Background. The Journal Citation Reports journal impact factors (JIFs) are widely used to rank and evaluate journals, standing as a proxy for the relative importance of a journal within its field. However, numerous criticisms have been made of use of a JIF to evaluate importance. This problem is exacerbated when the use of JIFs is extended to evaluate not only the journals, but the papers therein. The purpose of this study was therefore to investigate the relationship between the number of citations and journal IF for identical articles published simultaneously in multiple journals. Methods. Eligible articles were consensus research reporting statements listed on the EQUATOR Network website that were published simultaneously in three or more journals. The correlation between the citation count for each article and the median journal JIF over the published period, and between the citation count and number of article accesses was calculated for each reporting statement. Results. Nine research reporting statements were included in this analysis, representing 85 articles published across 58 journals in biomedicine. The number of citations was strongly correlated to the JIF for six of the nine reporting guidelines, with moderate correlation shown for the remaining three guidelines (median r = 0.66, 95% CI [0.45-0.90]). There was also a strong positive correlation between the number of citations and the number of article accesses (median r = 0.71, 95% CI [0.5-0.8]), although the number of data points for this analysis were limited. When adjusted for the individual reporting guidelines, each logarithm unit of JIF predicted a median increase of 0.8 logarithm units of citation counts (95% CI [-0.4-5.2]), and each logarithm unit of article accesses predicted a median increase of 0.1 logarithm units of citation counts (95% CI [-0.9-1.4]). This model explained 26% of the variance in citations (median adjusted r (2) = 0.26, range 0.18-1.0). Conclusion. The impact factor of the journal in which a reporting statement was published was shown to influence the number of citations that statement will gather over time. Similarly, the number of article accesses also influenced the number of citations, although to a lesser extent than the impact factor. This demonstrates that citation counts are not purely a reflection of scientific merit and the impact factor is, in fact, auto-correlated.

SUBMITTER: Shanahan DR

PROVIDER: S-EPMC4824875 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Auto-correlation of journal impact factor for consensus research reporting statements: a cohort study.

Shanahan Daniel R DR

PeerJ 20160331

Background. The Journal Citation Reports journal impact factors (JIFs) are widely used to rank and evaluate journals, standing as a proxy for the relative importance of a journal within its field. However, numerous criticisms have been made of use of a JIF to evaluate importance. This problem is exacerbated when the use of JIFs is extended to evaluate not only the journals, but the papers therein. The purpose of this study was therefore to investigate the relationship between the number of citat ...[more]

PMID: 27069817

Similar Datasets

Project description:BackgroundReporting of health research is often inadequate and incomplete. Complete and transparent reporting is imperative to enable readers to assess the validity of research findings for use in healthcare and policy decision-making. To this end, many guidelines, aimed at improving the quality of health research reports, have been developed for reporting a variety of research types. Despite efforts, many reporting guidelines are underused. In order to increase their uptake, evidence of their effectiveness is important and will provide authors, peer reviewers and editors with an important resource for use and implementation of pertinent guidance. The objective of this study was to assess whether endorsement of reporting guidelines by journals influences the completeness of reporting of health studies.MethodsGuidelines providing a minimum set of items to guide authors in reporting a specific type of research, developed with explicit methodology, and using a consensus process will be identified from an earlier systematic review and from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network's reporting guidelines library. MEDLINE, EMBASE, the Cochrane Methodology Register and Scopus will be searched for evaluations of those reporting guidelines; relevant evaluations from the recently conducted CONSORT systematic review will also be included. Single data extraction with 10% verification of study characteristics, 20% of outcomes and complete verification of aspects of study validity will be carried out. We will include evaluations of reporting guidelines that assess the completeness of reporting: (1) before and after journal endorsement, and/or (2) between endorsing and non-endorsing journals. For a given guideline, analyses will be conducted for individual and the total sum of items. When possible, standard, pooled effects with 99% confidence intervals using random effects models will be calculated.DiscussionEvidence on which guidelines have been evaluated and which are associated with improved completeness of reporting is important for various stakeholders, including editors who consider which guidelines to endorse in their journal editorial policies.

Project description:BackgroundReporting guidelines for different study designs are currently available to report studies with accuracy and transparency. There is a need to develop supplementary guideline items that are specific to areas within Pediatric Dentistry. This study aims to develop Reporting stAndards for research in PedIatric Dentistry (RAPID) guidelines using a pre-defined expert consensus-based Delphi process.MethodsThe development of the RAPID guidelines was based on the Guidance for Developers of Health Research Reporting Guidelines. Following a comprehensive search of the literature, the Executive Group identified ten themes in Pediatric Dentistry and compiled a draft checklist of items under each theme. The themes were categorized as: General, Oral Medicine, Pathology and Radiology, Children with Special Health Care Needs, Sedation and Hospital Dentistry, Behavior Guidance, Dental Caries, Preventive and Restorative Dentistry, Pulp Therapy, Traumatology, and Interceptive Orthodontics. A RAPID Delphi Group (RDG) was formed comprising of 69 members from 15 countries across six continents. Items were scored using a 9-point rating Likert scale. Items achieving a score of seven and above, marked by at least 70% of RDG members were accepted into the RAPID checklist items. Weighted mean scores were calculated for each item. Statistical significance was set at p < 0.05 and one-way ANOVA was used to calculate the difference in the weighted mean scores between the themes.ResultsThe final RAPID checklist comprised of 128 items that were finalized and approved by the RDG members in the online consensus meeting. The percentage for high scores (scores 7 to 9) ranged from 69.57 to 100% for individual items. The overall weighted mean score of the final items ranged from 7.51 to 8.28 (out of 9) and the difference was statistically significant between the themes (p < 0.05).ConclusionsThe RAPID statement provides guidance to researchers, authors, reviewers and editors, to ensure that all elements relevant to particular studies are adequately reported.

Dataset Information

Auto-correlation of journal impact factor for consensus research reporting statements: a cohort study.

Publications

Auto-correlation of journal impact factor for consensus research reporting statements: a cohort study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets