Dataset Information

A correlation comparison between Altmetric Attention Scores and citations for six PLOS journals.

ABSTRACT: This study considered all articles published in six Public Library of Science (PLOS) journals in 2012 and Web of Science citations for these articles as of May 2015. A total of 2,406 articles were analyzed to examine the relationships between Altmetric Attention Scores (AAS) and Web of Science citations. The AAS for an article, provided by Altmetric aggregates activities surrounding research outputs in social media (news outlet mentions, tweets, blogs, Wikipedia, etc.). Spearman correlation testing was done on all articles and articles with AAS. Further analysis compared the stratified datasets based on percentile ranks of AAS: top 50%, top 25%, top 10%, and top 1%. Comparisons across the six journals provided additional insights. The results show significant positive correlations between AAS and citations with varied strength for all articles and articles with AAS (or social media mentions), as well as for normalized AAS in the top 50%, top 25%, top 10%, and top 1% datasets. Four of the six PLOS journals, Genetics, Pathogens, Computational Biology, and Neglected Tropical Diseases, show significant positive correlations across all datasets. However, for the two journals with high impact factors, PLOS Biology and Medicine, the results are unexpected: the Medicine articles showed no significant correlations but the Biology articles tested positive for correlations with the whole dataset and the set with AAS. Both journals published substantially fewer articles than the other four journals. Further research to validate the AAS algorithm, adjust the weighting scheme, and include appropriate social media sources is needed to understand the potential uses and meaning of AAS in different contexts and its relationship to other metrics.

SUBMITTER: Huang W

PROVIDER: S-EPMC5886419 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A correlation comparison between Altmetric Attention Scores and citations for six PLOS journals.

Huang Wenya W Wang Peiling P Wu Qiang Q

PloS one 20180405 4

This study considered all articles published in six Public Library of Science (PLOS) journals in 2012 and Web of Science citations for these articles as of May 2015. A total of 2,406 articles were analyzed to examine the relationships between Altmetric Attention Scores (AAS) and Web of Science citations. The AAS for an article, provided by Altmetric aggregates activities surrounding research outputs in social media (news outlet mentions, tweets, blogs, Wikipedia, etc.). Spearman correlation test ...[more]

PMID: 29621253

Similar Datasets

Project description:BackgroundA journal's impact factor (IF) and total citations are often used as indicators of its publication quality. Furthermore, journals that require authors to abide by reporting guidelines or conduct trial registration generally have a higher quality of reporting. In this study, we sought to explore the potential associations between the enforcement of reporting guidelines or trial registration and a surgical journal's IF or total citations in order to find new approaches and ideas to improve journal publication quality.MethodsWe examined surgical journals from the 2018 Journal Citation Report's Expanded Scientific Citation Index to quantify the use of reporting guidelines or study registration. We reviewed the "instructions for authors" from each journal and used multivariable linear regression analysis to determine which guidelines were associated with the journal IF and total citations. The dependent variable was the logarithm base 10 of the IF in 2018 or the logarithm base 10 of total citations in 2018 (the results were presented as geometric means, specifically the ratio of the "endorsed group" results to "not endorsed group" results). The independent variable was one of the requirements (endorsed and not endorsed). Models adjust for the publication region, language, start year, publisher and journal size (only used to adjust total citations).ResultsWe included 188 surgical journals in our study. The results of multivariable linear regression analysis showed that journal IF was associated (P < 0.01) with the following requirements: randomized controlled trial (RCT) registration (geometric means ratio (GR) = 1.422, 95% CI [1.197-1.694]), Consolidated Standards of Reporting Trials (CONSORT) statement (1.318, [1.104-1.578]), Preferred Reporting Items for Systematic Reviews Meta-Analyses (PRISMA) statement (1.390, [1.148-1.683]), Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement (1.556, [1.262-1.919]), Standards for Reporting Diagnostic Accuracy (STARD) statement (1.585, [1.216-2.070]), and Meta-analysis of Observational Studies in Epidemiology (MOOSE) statement (2.113, [1.422-3.133]). We found associations between the endorsement of RCT registration (GR = 1.652, 95% CI [1.268-2.153]), CONSORT (1.570, [1.199-2.061]), PRISMA (1.698, [1.271-2.270]), STROBE (2.023, [1.476-2.773]), STARD (2.173, [1.452-3.243]), and MOOSE statements (2.249, [1.219-4.150]) and the number of total citations.ConclusionThe presence of reporting guidelines and trial registration was associated with higher IF or more total citations in surgical journals. If more surgical journals incorporate these policies into their submission requirements, this may improve publication quality, thus increasing their IF and total citations.

Project description:IntroductionCitation counts of articles have been used to measure scientific outcomes and assess suitability for grant applications. However, citation counts are not without limitations. With the rise of social media, altmetric scores may provide an alternative assessment tool.ObjectivesThe aims of the study were to assess the characteristics of highly cited articles in medical professionalism and their altmetric scores.MethodsThe Web of Science was searched for top-cited articles in medical professionalism, and the characteristics of each article were identified. The altmetric database was searched to identify report for each identified article. A model to assess the relationship between the number of citations and each of the key characteristics as well as altmetric scores was developed.ResultsNo correlations were found between the number of citations and number of years since publication (p=0.192), number of institutes (p=0.081), number of authors (p=0.270), females in authorship (p=0.150) or number of grants (p=0.384). The altmetric scores varied from 0 to 155, total=806, median=5.0, (IQR=20). Twitter (54%) and Mendeley (62%) were the most popular altmetric resources. No correlation was found between the number of citations and the altmetric scores (p=0.661). However, a correlation was found for articles published in 2007 and after (n=17, p=0.023). To further assess these variables, a model was developed using multivariate analysis; did not show significant differences across subgroups. The topics covered were learning and teaching professionalism, curriculum issues, professional and unprofessional behaviour.ConclusionsAltmetric scores of articles were significantly correlated with citations counts for articles published in 2007 and after. Highly cited articles were produced mainly by the USA, Canada and the UK. The study reflects the emerging role of social media in research dissemination. Future studies should investigate the specific features of highly cited articles and factors reinforcing distribution of research data among scholars and non-scholars.

Project description:The number of retracted articles has grown fast. However, the extent to which researchers and the public are made adequately aware of these retractions and how the media and social media respond to them remains unknown. Here, we aimed to evaluate the media and social media attention received by retracted articles and assess also the attention they receive post-retraction versus pre-retraction. We downloaded all records of retracted literature maintained by the Retraction Watch Database and originally published between January 1, 2010 to December 31, 2015. For all 3,008 retracted articles with a separate DOI for the original and its retraction, we downloaded the respective Altmetric Attention Score (AAS) (from Altmetric) and citation count (from Crossref), for the original article and its retraction notice on June 6, 2018. We also compared the AAS of a random sample of 572 retracted full journal articles available on PubMed to that of unretracted full articles matched from the same issue and journal. 1,687 (56.1%) of retracted research articles received some amount of Altmetric attention, and 165 (5.5%) were even considered popular (AAS>20). 31 (1.0%) of 2,953 with a record on Crossref received >100 citations by June 6, 2018. Popular articles received substantially more attention than their retraction, even after adjusting for attention received post-retraction (Median difference, 29; 95% CI, 17-61). Unreliable results were the most frequent reason for retraction of popular articles (32; 19%), while fake peer review was the most common reason (421; 15%) for the retraction of other articles. In comparison to matched articles, retracted articles tended to receive more Altmetric attention (23/31 matched groups; P-value, 0.01), even after adjusting for attention received post-retraction. Our findings reveal that retracted articles may receive high attention from media and social media and that for popular articles, pre-retraction attention far outweighs post-retraction attention.

Dataset Information

A correlation comparison between Altmetric Attention Scores and citations for six PLOS journals.

Publications

A correlation comparison between Altmetric Attention Scores and citations for six PLOS journals.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets