Dataset Information

Does bibliometric research confer legitimacy to research assessment practice? A sociological study of reputational control, 1972-2016.

ABSTRACT: The use of bibliometric measures in the evaluation of research has increased considerably based on expertise from the growing research field of evaluative citation analysis (ECA). However, mounting criticism of such metrics suggests that the professionalization of bibliometric expertise remains contested. This paper investigates why impact metrics, such as the journal impact factor and the h-index, proliferate even though their legitimacy as a means of professional research assessment is questioned. Our analysis is informed by two relevant sociological theories: Andrew Abbott's theory of professions and Richard Whitley's theory of scientific work. These complementary concepts are connected in order to demonstrate that ECA has failed so far to provide scientific authority for professional research assessment. This argument is based on an empirical investigation of the extent of reputational control in the relevant research area. Using three measures of reputational control that are computed from longitudinal inter-organizational networks in ECA (1972-2016), we show that peripheral and isolated actors contribute the same number of novel bibliometric indicators as central actors. In addition, the share of newcomers to the academic sector has remained high. These findings demonstrate that recent methodological debates in ECA have not been accompanied by the formation of an intellectual field in the sociological sense of a reputational organization. Therefore, we conclude that a growing gap exists between an academic sector with little capacity for collective action and increasing demand for routine performance assessment by research organizations and funding agencies. This gap has been filled by database providers. By selecting and distributing research metrics, these commercial providers have gained a powerful role in defining de-facto standards of research excellence without being challenged by expert authority.

SUBMITTER: Jappe A

PROVIDER: S-EPMC6002049 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Does bibliometric research confer legitimacy to research assessment practice? A sociological study of reputational control, 1972-2016.

Jappe Arlette A Pithan David D Heinze Thomas T

PloS one 20180614 6

The use of bibliometric measures in the evaluation of research has increased considerably based on expertise from the growing research field of evaluative citation analysis (ECA). However, mounting criticism of such metrics suggests that the professionalization of bibliometric expertise remains contested. This paper investigates why impact metrics, such as the journal impact factor and the h-index, proliferate even though their legitimacy as a means of professional research assessment is questio ...[more]

PMID: 29902239

Similar Datasets

Project description:BackgroundThe health of migrants has become an important issue in global health and foreign policy. Assessing the current status of research activity and identifying gaps in global migration health (GMH) is an important step in mapping the evidence-base and on advocating health needs of migrants and mobile populations. The aim of this study was to analyze globally published peer-reviewed literature in GMH.MethodsA bibliometric analysis methodology was used. The Scopus database was used to retrieve documents in peer-reviewed journals in GMH for the study period from 2000 to 2016. A group of experts in GMH developed the needed keywords and validated the final search strategy.ResultsThe number of retrieved documents was 21,457. Approximately one third (6878; 32.1%) of the retrieved documents were published in the last three years of the study period. In total, 5451 (25.4%) documents were about refugees and asylum seekers, while 1328 (6.2%) were about migrant workers, 440 (2.1%) were about international students, 679 (3.2%) were about victims of human trafficking/smuggling, 26 (0.1%) were about patients' mobility across international borders, and the remaining documents were about unspecified categories of migrants. The majority of the retrieved documents (10,086; 47.0%) were in psychosocial and mental health domain, while 2945 (13.7%) documents were in infectious diseases, 6819 (31.8%) documents were in health policy and systems, 2759 (12.8%) documents were in maternal and reproductive health, and 1918 (8.9%) were in non-communicable diseases. The contribution of authors and institutions in Asian countries, Latin America, Africa, Middle East, and Eastern European countries was low. Literature in GMH represents the perspectives of high-income migrant destination countries.ConclusionOur heat map of research output shows that despite the ever-growing prominence of human mobility across the globe, and Sustainable Development Goals of leaving no one behind, research output on migrants' health is not consistent with the global migration pattern. A stronger evidence base is needed to enable authorities to make evidence-informed decisions on migration health policy and practice. Research collaboration and networks should be encouraged to prioritize research in GMH.

Project description:West Nile virus (WNV) is an emerging infectious disease which is most commonly transmitted to humans through mosquito, and is considered a major public-health problem worldwide. The aim of the current study is to bibliometrically analyze the quantity and quality of publications indexed in Scopus from different countries to reveal the characteristics of global research output regarding WNV.This study is a bibliometric analysis based on the Scopus database. This study focused on identifying WNV publication trends with regard to publication year, publication type, prolific countries, language of publication, as well as, prolific journals, citations, and collaboration patterns.A total of 4729 publications were considered in this study, which were published between 1943 and 2016. The annual quantity of literature published before 2000 followed a low rate of research growth; while the quantity of publications after 2000 were published in a stage of rapid development. The country with the greatest number of publications in WNV research field was the USA with 2304 (48.7%) publications, followed by France with 224 (4.7%) publications, and Canada with 222 (4.7%) publications. Contributions from low- and middle-income countries (LMIC) were considerably small, that is, (n = 519 publications; 11%). All publications related to WNV achieved h-index of 140 and were cited 124,222 times. The median [interquartile range] number of citations per article thus amounts to 9 [2-28]. The USA had the highest h-index of 131. Emerging Infectious Diseases is the most productive journal with 227 articles, followed by Journal of Virology with 162 publications. The result designated that Centers for Disease Control and Prevention was ranked the first in terms of publication output, followed by National Center for Emerging and Zoonotic Infectious Diseases.There is an obvious trend of WNV research after 2000, and countries with high income have more contributions in WNV research field. The research output is low among LMIC. The USA produced the largest number of publications. The Centers for Disease Control and Prevention obtained the leading position of the institutions in terms of publication output. In general, this study not only presents a full view of global WNV research, but also can contribute for future further research in this field.

Dataset Information

Does bibliometric research confer legitimacy to research assessment practice? A sociological study of reputational control, 1972-2016.

Publications

Does bibliometric research confer legitimacy to research assessment practice? A sociological study of reputational control, 1972-2016.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets