Quantifying the impact and relevance of scientific research.
Ontology highlight
ABSTRACT:
SUBMITTER: Sutherland WJ
PROVIDER: S-EPMC3217965 | biostudies-literature | 2011
REPOSITORIES: biostudies-literature
Publications
Quantifying the impact and relevance of scientific research.
Sutherland William J WJ Goulson David D Potts Simon G SG Dicks Lynn V LV
PloS one 20111116 11
Qualitative and quantitative methods are being developed to measure the impacts of research on society, but they suffer from serious drawbacks associated with linking a piece of research to its subsequent impacts. We have developed a method to derive impact scores for individual research publications according to their contribution to answering questions of quantified importance to end users of research. To demonstrate the approach, here we evaluate the impacts of research into means of conservi ...[more]
Similar Datasets
Project description:Tie strength has been examined as an antecedent of creativity. Although it has been discovered that international collaboration affects scientific performance, the effect of tie strength in the international collaboration network has been largely neglected. Based on international publications of 72 countries/regions published from 1993 to 2013, we combine descriptive and panel regression methods to examine how the bonding of strong collaboration ties contributes to countries' international scientific performance. Strong ties occur at an average rate of 1 in 4 collaborators, whereas countries/regions share on average 84% of articles with their strong-tie collaborators. Our quantitative results provide an explanation for this phenomenon in international collaboration: the establishment of a strong tie relationship contributes to above-average productivity and citation frequency for countries/regions. To further explore which types of strong ties tend to have stronger citation impact, we analyse the relationship between persistent and stable collaboration and publication citation impact. Experimental results show that international collaborations with greater persistence and moderate stability tend to produce high impact publications. It is noteworthy that when the collaboration period is divided into different time intervals, similar findings can be found after the same analysis procedure is carried out. This indicates that our conclusions are robust. Overall, this study provides quantitative insights into the added value of long-term commitment and social trust associated with strong collaborative partnerships in international collaboration.
| S-EPMC9844855 | biostudies-literature
Project description:We investigate publications in medical research that have gone unnoticed for a number of years after being published and then suddenly become cited to a significant degree. Such publications are called Sleeping Beauties (SBs). This study focuses on SBs that are cited in patents. We find that the increasing trend of the relative number of SBs comes to an end around 1998. However, still a constant fraction of publications becomes an SB. Many SBs become highly cited publications, they even belong to the top-10 to 20% most cited publications in their field. We measured the scaling of the number of SBs in relation to the sleeping period length, during-sleep citation-intensity, and with awakening citation-intensity. We determined the Grand Sleeping Beauty Equation for these medical SBs which shows that the probability of awakening after a period of deep sleep is becoming rapidly smaller for longer sleeping periods and that the probability for higher awakening intensities decreases extremely rapidly. The exponents of the scaling functions show a time-dependent behavior which suggests a decreasing occurrence of SBs with longer sleeping periods. We demonstrate that the fraction of SBs cited by patents before scientific awakening exponentially increases. This finding shows that the technological time lag is becoming shorter than the sleeping time. Inventor-author self-citations may result in shorter technological time lags, but this effect is small. Finally, we discuss characteristics of an SBs that became one of the highest cited medical papers ever.
| S-EPMC6799932 | biostudies-literature
Project description:BackgroundQuality and accuracy of online scientific data are crucial, given that the internet and social media serve nowadays as primary sources of medical knowledge.ObjectiveThis study aims to analyze the relationship between scientific relevance and online visibility of strabismus research to answer the following questions: (1) Are the most popular strabismus papers scientifically relevant? (2) Are the most high-impact strabismus studies shared enough online?MethodsThe Altmetric Attention Score (AAS) was used as a proxy for online visibility, whereas citations and the journal's impact factor (IF) served as a metric for scientific relevance. Using "strabismus" as a keyword, 100 papers with the highest AAS and 100 papers with the highest number of citations were identified. Statistical analyses, including the Spearman rank test, linear regression, and factor analysis, were performed to assess the relationship between AAS, citations, a journal's IF, and mentions across 18 individual Web 2.0 platforms.ResultsA weak, positive, statistically significant correlation was observed between normalized AAS and normalized citations (P<.001; r=0.27) for papers with high visibility. Only Twitter mentions and Mendeley readers correlated significantly with normalized citations (P=.02 and P<.001, respectively) and IF (P=.04 and P=.009, respectively), with Twitter being the strongest significant predictor of citation numbers (r=0.53). For high-impact papers, no correlation was found between normalized citations and normalized AAS (P=.12) or the IF of the journal (P=.55).ConclusionsWhile clinical relevance influences online attention, most high-impact research related to strabismus is not sufficiently shared on the web. Therefore, researchers should make a greater effort to share high-impact papers related to strabismus on online media platforms to improve accessibility and quality of evidence-based knowledge for patients.
| S-EPMC11208826 | biostudies-literature
Project description:The Scientific Revolution represents a turning point in the history of humanity. Yet it remains ill-understood, partly because of a lack of quantification. Here, we leverage large datasets of individual biographies (N = 22,943) and present the first estimates of scientific production during the late medieval and early modern period (1300-1850). Our data reveal striking differences across countries, with England and the United Provinces being much more creative than other countries, suggesting that economic development has been key in generating the Scientific Revolution. In line with recent results in behavioural sciences, we show that scientific creativity and economic development are associated with other kinds of creative activities in philosophy, literature, music and the arts, as well as with inclusive institutions and ascetic religiosity, suggesting a common underlying mindset associated with long-term orientation and exploration. Finally, we investigate the interplay between economic development and cultural transmission (the so-called 'Republic of Letters') using partially observed Markov models imported from population biology. Surprisingly, the role of horizontal transmission (from one country to another) seems to have been marginal. Beyond the case of science, our results suggest that economic development is an important factor in the evolution of aspects of human culture.
| S-EPMC10426016 | biostudies-literature
Project description:Scientists are frequently faced with the important decision to start or terminate a creative partnership. This process can be influenced by strategic motivations, as early career researchers are pursuers, whereas senior researchers are typically attractors, of new collaborative opportunities. Focusing on the longitudinal aspects of scientific collaboration, we analyzed 473 collaboration profiles using an egocentric perspective that accounts for researcher-specific characteristics and provides insight into a range of topics, from career achievement and sustainability to team dynamics and efficiency. From more than 166,000 collaboration records, we quantify the frequency distributions of collaboration duration and tie strength, showing that collaboration networks are dominated by weak ties characterized by high turnover rates. We use analytic extreme value thresholds to identify a new class of indispensable super ties, the strongest of which commonly exhibit >50% publication overlap with the central scientist. The prevalence of super ties suggests that they arise from career strategies based upon cost, risk, and reward sharing and complementary skill matching. We then use a combination of descriptive and panel regression methods to compare the subset of publications coauthored with a super tie to the subset without one, controlling for pertinent features such as career age, prestige, team size, and prior group experience. We find that super ties contribute to above-average productivity and a 17% citation increase per publication, thus identifying these partnerships--the analog of life partners--as a major factor in science career development.
| S-EPMC4553788 | biostudies-literature
Project description:In this paper, we estimate the impact of receiving an NIH grant on subsequent publications and citations. Our sample consists of all applications (unsuccessful as well as successful) to the NIH from 1980 to 2000 for standard research grants (R01s). Both OLS and IV estimates show that receipt of an NIH research grant (worth roughly $1.7 million) leads to only one additional publication over the next five years, which corresponds to a 7 percent increase. The limited impact of NIH grants is consistent with a model in which the market for research funding is competitive, so that the loss of an NIH grant simply causes researchers to shift to another source of funding.
| S-EPMC3156466 | biostudies-literature
Project description:Quantifying and comparing the scientific output of researchers has become critical for governments, funding agencies and universities. Comparison by reputation and direct assessment of contributions to the field is no longer possible, as the number of scientists increases and traditional definitions about scientific fields become blurred. The h-index is often used for comparing scientists, but has several well-documented shortcomings. In this paper, we introduce a new index for measuring and comparing the publication records of scientists: the pagerank-index (symbolised as π). The index uses a version of pagerank algorithm and the citation networks of papers in its computation, and is fundamentally different from the existing variants of h-index because it considers not only the number of citations but also the actual impact of each citation. We adapt two approaches to demonstrate the utility of the new index. Firstly, we use a simulation model of a community of authors, whereby we create various 'groups' of authors which are different from each other in inherent publication habits, to show that the pagerank-index is fairer than the existing indices in three distinct scenarios: (i) when authors try to 'massage' their index by publishing papers in low-quality outlets primarily to self-cite other papers (ii) when authors collaborate in large groups in order to obtain more authorships (iii) when authors spend most of their time in producing genuine but low quality publications that would massage their index. Secondly, we undertake two real world case studies: (i) the evolving author community of quantum game theory, as defined by Google Scholar (ii) a snapshot of the high energy physics (HEP) theory research community in arXiv. In both case studies, we find that the list of top authors vary very significantly when h-index and pagerank-index are used for comparison. We show that in both cases, authors who have collaborated in large groups and/or published less impactful papers tend to be comparatively favoured by the h-index, whereas the pagerank-index highlights authors who have made a relatively small number of definitive contributions, or written papers which served to highlight the link between diverse disciplines, or typically worked in smaller groups. Thus, we argue that the pagerank-index is an inherently fairer and more nuanced metric to quantify the publication records of scientists compared to existing measures.
| S-EPMC4545754 | biostudies-literature
Project description:With the shift in their social roles, modern zoos and aquariums are required to develop scientific research. Although zoos and aquariums worldwide have reported an increase in the number of papers they publish and the diversification of their fields in recent decades, the specific circumstances in Japan are slightly unclear. We listed peer-reviewed papers authored by Japanese zoos and aquariums using search engines and quantitatively evaluated the changes in the number of papers published over 62 years. Our results showed that papers published in Japan have increased remarkably since the 1990s, and research fields have diversified as in the rest of the world. In particular, joint research with research institutes has seen an upward trend, and the instances of English-language papers have increased. Meanwhile, the content of the research was biased. In zoos, research on animal welfare has been increasing, but the focus was heavily biased toward captive mammals. Aquariums contributed to the understanding of local ecosystems through the fundamental study of wildlife, but there were fewer papers on improving husbandry. Our results indicated that while research by Japanese zoos and aquariums is developing, research on welfare, conservation, and education regarding native endangered species must still be improved.
| S-EPMC8909568 | biostudies-literature
Project description:The "h index" proposed by Hirsch [Hirsch JE (2005) Proc Natl Acad Sci USA 102:16569-16573] is a good indicator of the impact of a scientist's research and has the advantage of being objective. When evaluating departments, institutions, or laboratories, the importance of the h index can be further enhanced when it is properly calibrated for the size of the group. Particularly acute is the issue of federally funded facilities whose number of actively publishing scientists frequently dwarfs that of academic departments. Recently, Molinari and Molinari [Molinari JF, Molinari A (2008) Scientometrics, in press] developed a methodology that shows that the h index has a universal growth rate for large numbers of papers, allowing for meaningful comparisons between institutions. An additional challenge when comparing large institutions is that fields have distinct internal cultures, with different typical rates of publication and citation; biology is more highly cited than physics, for example. For this reason, the present study has focused on the physical sciences, engineering, and technology and has excluded biomedical research. Comparisons between individual disciplines are reported here to provide a framework. Generally, it was found that the universal growth rate of Molinari and Molinari holds well across the categories considered, testifying to the robustness of both their growth law and our results. The goal here is to set the highest standard of comparison for federal investment in science. Comparisons are made of the nation's preeminent private and public institutions. We find that many among the national science facilities compare favorably in research impact with the nation's leading universities.
| S-EPMC2084276 | biostudies-literature
Project description:Science is a social process with far-reaching impact on our modern society. In recent years, for the first time we are able to scientifically study the science itself. This is enabled by massive amounts of data on scientific publications that is increasingly becoming available. The data is contained in several databases such as Web of Science or PubMed, maintained by various public and private entities. Unfortunately, these databases are not always consistent, which considerably hinders this study. Relying on the powerful framework of complex networks, we conduct a systematic analysis of the consistency among six major scientific databases. We found that identifying a single "best" database is far from easy. Nevertheless, our results indicate appreciable differences in mutual consistency of different databases, which we interpret as recipes for future bibliometric studies.
| S-EPMC4436008 | biostudies-literature