Dataset Information

Identifying Anomalous Citations for Objective Evaluation of Scholarly Article Impact.

ABSTRACT: Evaluating the impact of a scholarly article is of great significance and has attracted great attentions. Although citation-based evaluation approaches have been widely used, these approaches face limitations e.g. in identifying anomalous citations patterns. This negligence would inevitably cause unfairness and inaccuracy to the article impact evaluation. In this study, in order to discover the anomalous citations and ensure the fairness and accuracy of research outcome evaluation, we investigate the citation relationships between articles using the following factors: collaboration times, the time span of collaboration, citing times and the time span of citing to weaken the relationship of Conflict of Interest (COI) in the citation network. Meanwhile, we study a special kind of COI, namely suspected COI relationship. Based on the COI relationship, we further bring forward the COIRank algorithm, an innovative scheme for accurately assessing the impact of an article. Our method distinguishes the citation strength, and utilizes PageRank and HITS algorithms to rank scholarly articles comprehensively. The experiments are conducted on the American Physical Society (APS) dataset. We find that about 80.88% articles contain contributed citations by co-authors in 26,366 articles and 75.55% articles among these articles are cited by the authors belonging to the same affiliation, indicating COI and suspected COI should not be ignored for evaluating impact of scientific papers objectively. Moreover, our experimental results demonstrate COIRank algorithm significantly outperforms the state-of-art solutions. The validity of our approach is verified by using the probability of Recommendation Intensity.

SUBMITTER: Bai X

PROVIDER: S-EPMC5015995 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe Scholarly Concentrations program was established at Johns Hopkins University School of Medicine in 2009 with the aim of instilling passion for scholarship.ObjectiveOur study aimed to determine whether the Scholarly Concentrations program achieves positive changes in medical student self-efficacy in conducting research and, if so, whether this results in future career aspirations toward scholarship.DesignWe used the Clinical Research Appraisal Inventory-Short Form (CRAI-SF) to assess changes in self-efficacy among students completing the Scholarly Concentrations program between 2014 and 2017. We calculated composite mean scores of six domains. We included outcomes on whether students published a manuscript, overall program perceptions, and likelihood of future research careers. We analyzed relationships between CRAI-SF scores and outcomes using paired t-tests and multivariable-adjusted logistic regression.ResultsA total of 419 students completed the Scholarly Concentrations program. All 6 CRAI domain scores showed significant improvements in self-efficacy between the pre-Scholarly Concentrations and post-Scholarly Concentrations ratings (range of changes 0.76-1.39, p < 0.05 for all). We found significant associations between post-Scholarly Concentrations self-efficacy ratings and course satisfaction (adjusted OR 1.57 [95% CI 1.20, 2.07]) and mentor satisfaction (OR 1.46 [1.15, 1.86]), as well as students' intent to conduct future research (OR 1.46 [1.15, 1.86]). These results were robust to sensitivity analyses, and pronounced in the group of students without prior research experience.ConclusionsOur findings suggest that a Scholarly Concentrations program is associated with an increased self-efficacy for research, and these changes in self-efficacy are associated with higher satisfaction in the scholarly experience and increased likelihood of pursuing scholarly work. Other medical schools could use such a tool of self-efficacy to both investigate the overall Scholarly Concentrations experience and understand factors that may increase interest in future physician-scientist pathways.

Dataset Information

Identifying Anomalous Citations for Objective Evaluation of Scholarly Article Impact.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets