Automated Research Impact Assessment: A New Bibliometrics Approach.
Ontology highlight
ABSTRACT:
SUBMITTER: Drew CH
PROVIDER: S-EPMC4791943 | biostudies-literature | 2016 Mar
REPOSITORIES: biostudies-literature
Publications
Automated Research Impact Assessment: A New Bibliometrics Approach.
Drew Christina H CH Pettibone Kristianna G KG Finch Fallis Owen FO Giles Douglas D Jordan Paul P
Scientometrics 20160130 3
As federal programs are held more accountable for their research investments, The National Institute of Environmental Health Sciences (NIEHS) has developed a new method to quantify the impact of our funded research on the scientific and broader communities. In this article we review traditional bibliometric analyses, address challenges associated with them, and describe a new bibliometric analysis method, the Automated Research Impact Assessment (ARIA). ARIA taps into a resource that has only ra ...[more]
Similar Datasets
Project description:IntroductionTo enhance the performance evaluation of Clinical and Translational Science Award (CTSA) hubs, we examined the utility of advanced bibliometric measures that go beyond simple publication counts to demonstrate the impact of translational research output.MethodsThe sampled data included North Carolina Translational and Clinical Science Institute (NC TraCS)-supported publications produced between September 2008 and March 2017. We adopted advanced bibliometric measures and a state-of-the-art bibliometric network analysis tool to assess research productivity, citation impact, the scope of research collaboration, and the clusters of research topics.ResultsTotally, 754 NC TraCS-supported publications generated over 24,000 citation counts by April 2017 with an average of 33 cites per article. NC TraCS-supported research papers received more than twice as many cites per year as the average National Institute of Health-funded research publications from the same field and time. We identified the top productive researchers and their networks within the CTSA hub. Findings demonstrated the impact of NC TraCS in facilitating interdisciplinary collaborations within the CTSA hub and across the CTSA consortium and connecting researchers with right peers and organizations.ConclusionBoth improved bibliometrics measures and bibliometric network analysis can bring new perspectives to CTSA evaluation via citation influence and the scope of research collaborations.
| S-EPMC7681148 | biostudies-literature
Project description:Traditionally, the success of a researcher is assessed by the number of publications he or she publishes in peer-reviewed, indexed, high impact journals. This essential yardstick, often referred to as the impact of a specific researcher, is assessed through the use of various metrics. While researchers may be acquainted with such matrices, many do not know how to use them to enhance their careers. In addition to these metrics, a number of other factors should be taken into consideration to objectively evaluate a scientist's profile as a researcher and academician. Moreover, each metric has its own limitations that need to be considered when selecting an appropriate metric for evaluation. This paper provides a broad overview of the wide array of metrics currently in use in academia and research. Popular metrics are discussed and defined, including traditional metrics and article-level metrics, some of which are applied to researchers for a greater understanding of a particular concept, including varicocele that is the thematic area of this Special Issue of Asian Journal of Andrology. We recommend the combined use of quantitative and qualitative evaluation using judiciously selected metrics for a more objective assessment of scholarly output and research impact.
| S-EPMC4770502 | biostudies-other
Project description:Data acquisition in (pre)clinical studies is often based on a hypothesis. Numerical algorithms, however, may help to find biomarkers from existing data without formulating any hypothesis. By simply assessing whether a statistical relationship exists between two parameters from a (unlimited) database, every (in)conceivable combination of data becomes a hypothesis. The aim was to create an unbiased and highly automated approach for secondary analysis of (pre)clinical research, including the possibility of a non-linear functional relationship. In our example, an almost homogeneous database was formed by overall 45 parameters (vital, blood and plasma parameters) measured in 11 individual experimental studies at 6 different time points using 57 rats without and 63 rats with systemic inflammation following lipopolysaccharide infusion. For each rat, four group classifiers (treatment, survival, study, ID) were used to get valid samples by a later filtering of the statistical base. Any information about the hypothesis leading to the respective studies was suppressed. In order to assess whether a statistical relationship exists, a total of six different functional prototypes (linear and non-linear) were postulated and examined for their regression. Regression quality, correlation and significance were obtained in form of matrices. In our example, ultimately 510 300 regressions were optimized, automatically evaluated and filtered. The developed algorithm is able to reveal statistical relationships from a nearly crude database with low effort by systematic and unbiased analysis. The finding of well-known correlations proves its reliability, whose validity could be increased by clean aggregation of different studies. In addition, new interesting hints for future research could be gained. Thus, unknown markers can be found which are associated with an increased risk of death during systemic inflammation and sepsis. A further development of the program is planned including multiple regressions (more than two parameters could be related to each other) or cluster analysis.
| S-EPMC6859257 | biostudies-literature
Project description:This paper analyzes the concordance between bibliometrics and peer review. It draws evidence from the data of two experiments of the Italian governmental agency for research evaluation. The experiments were performed by the agency for validating the adoption in the Italian research assessment exercises of a dual system of evaluation, where some outputs were evaluated by bibliometrics and others by peer review. The two experiments were based on stratified random samples of journal articles. Each article was scored by bibliometrics and by peer review. The degree of concordance between the two evaluations is then computed. The correct setting of the experiments is defined by developing the design-based estimation of the Cohen's kappa coefficient and some testing procedures for assessing the homogeneity of missing proportions between strata. The results of both experiments show that for each research areas of science, technology, engineering and mathematics the degree of agreement between bibliometrics and peer review is-at most-weak at an individual article level. Thus, the outcome of the experiments does not validate the use of the dual system of evaluation in the Italian research assessments. More in general, the very weak concordance indicates that metrics should not replace peer review at the level of individual article. Hence, the use of the dual system in a research assessment might worsen the quality of information compared to the adoption of peer review only or bibliometrics only.
| S-EPMC7673579 | biostudies-literature
Project description:This bibliometric study of a large publication set dealing with research on climate change aims at mapping the relevant literature from a bibliometric perspective and presents a multitude of quantitative data: (1) The growth of the overall publication output as well as (2) of some major subfields, (3) the contributing journals and countries as well as their citation impact, and (4) a title word analysis aiming to illustrate the time evolution and relative importance of specific research topics. The study is based on 222,060 papers (articles and reviews only) published between 1980 and 2014. The total number of papers shows a strong increase with a doubling every 5-6 years. Continental biomass related research is the major subfield, closely followed by climate modeling. Research dealing with adaptation, mitigation, risks, and vulnerability of global warming is comparatively small, but their share of papers increased exponentially since 2005. Research on vulnerability and on adaptation published the largest proportion of very important papers (in terms of citation impact). Climate change research has become an issue also for disciplines beyond the natural sciences. The categories Engineering and Social Sciences show the strongest field-specific relative increase. The Journal of Geophysical Research, the Journal of Climate, the Geophysical Research Letters, and Climatic Change appear at the top positions in terms of the total number of papers published. Research on climate change is quantitatively dominated by the USA, followed by the UK, Germany, and Canada. The citation-based indicators exhibit consistently that the UK has produced the largest proportion of high impact papers compared to the other countries (having published more than 10,000 papers). Also, Switzerland, Denmark and also The Netherlands (with a publication output between around 3,000 and 6,000 papers) perform top-the impact of their contributions is on a high level. The title word analysis shows that the term climate change comes forward with time. Furthermore, the term impact arises and points to research dealing with the various effects of climate change. The discussion of the question of human induced climate change towards a clear fact (for the majority of the scientific community) stimulated research on future pathways for adaptation and mitigation. Finally, the term model and related terms prominently appear independent of time, indicating the high relevance of climate modeling.
| S-EPMC4966958 | biostudies-other
Project description:Identifying research gaps and generating research questions are often a first step in developing ideas for writing a research paper or grant proposal. The concept of substance-based bibliometrics uses the counts of substances in the scientific literature to better understand, assess, and clarify the state and impact of information in the chemical sciences. Connecting substances indexed to specific bioactivity or target indicators can lead to assessing the biochemical, biological, and medicinal relevance of substances as well as developing ideas for expanding drug design and discovery through identifying and modifying the structural features of molecules. This study uses Chemical Abstracts through the SciFinder database to count for the occurrence of substances in the scientific literature. The study sets out search strategies for discovering potential research gaps and new ideas through visualization of chemical structures with known bioactivity and target indicators. The author recommends that subject librarians integrate research gap training in their bibliographic instruction classes, particularly to upper-level undergraduate and graduate chemistry students.
| S-EPMC6648406 | biostudies-literature
Project description:The habenula (Hb) is a small structure of the posterior diencephalon that is highly conserved across vertebrates but nonetheless has attracted relatively little research attention until the past two decades. The resurgent interest is motivated by neurobehavioral studies demonstrating critical functions in a broad spectrum of motivational and cognitive processes, including functions relevant to psychiatric diseases. The Hb is widely conceived as an "anti-reward" center that acts by regulating brain monoaminergic systems. However, there is still no general conceptual framework for habenula research, and no study has focused on uncovering potentially significant but overlooked topics that may advance our understanding of physiological functions or suggest potential clinical applications of Hb-targeted interventions. Using science mapping tools, we quantitatively and qualitatively analyzed the relevant publications retrieved from the Web of Science Core Collection (WoSCC) database from 2002 to 2021. Herein we present an overview of habenula-related publications, reveal primary research trends, and prioritize some key research fronts by complementary bibliometric analysis. High-priority research fronts include Ventral Pallidum, Nucleus Accumbens, Nicotine and MHb, GLT-1, Zebrafish, and GCaMP, Ketamine, Deep Brain Stimulation, and GPR139. The high intrinsic heterogeneity of the Hb, extensive connectivity with both hindbrain and forebrain structures, and emerging associations with all three dimensions of mental disorders (internalizing, externalizing, and psychosis) suggest that the Hb may be the neuronal substrate for a common psychopathology factor shared by all mental illnesses termed the p factor. A future challenge is to explore the therapeutic potential of habenular modulation at circuit, cellular, and molecular levels.
| S-EPMC9382245 | biostudies-literature
Project description:BackgroundGlobally, several generations of doctors in the field of lymphedema have created numerous publications. To date, no bibliometric analysis has been performed specifically on these publications. For the further promotion of research on lymphedema and to align with the international research frontiers, it is essential to understand the current state of Lymphedema research output.ObjectiveThis study aims to statistically and visually analyze the characteristics of publications output, distribution of contributions and development process of lymphedema, enriching the knowledge base of Lymphedema, and then seek potential research topics and collaborators.MethodsBased on the Web of Science core collection database, we firstly analyzed the quantity and quality of publications in the field of lymphedema, secondly profiled the publishing groups in terms of country, institution, author's publication and cooperation network, and finally sorted out and summarized the hot topics of research.ResultsA total of 8569 papers were retrieved from 1900-2021. The top4 journals with the most publications were LYMPHOLOGY, LYMPHATIC RESEARCH AND BIOLOGY, PLASTIC AND RECONSTRUCTIVE SURGERY and ANNALS OF SURGICAL ONCOLOGY. The top 4 countries with the most publications were USA, Japan, UK, and China. The United States dominates the total number of publications and the international cooperation network. The most productive research institution is Harvard University, and the research institution with the most collaborating institutions is Memorial Sloan Kettering Cancer Center. Mortimer, Peter S contributes the most research in this field. The research achievements of Japanese scholars in this field are of great significance. The top 5 ranked keywords are "Breast Cancer", "Health-Related Quality Of Life", "Lymphscintigraphy", "Lymphovenous Anastomosis", and "Lymphangiogenesis".ConclusionMore and more scholars are devoted to the research of cancer-related Lymphedema. It is foreseeable that breast cancer-related lymphedema and lymphangiogenesis will remain a focus of future research. Advances in Lymphatic vessel imaging and the development of lymphatic microsurgery will further play a role in the clinical workup of lymphedema. Meanwhile, This study can help researchers identify potential collaborators and partner institutions and contribute to further research.
| S-EPMC9389543 | biostudies-literature
Project description:The COVID-19 pandemic constitutes an ongoing worldwide threat to human society and has caused massive impacts on global public health, the economy and the political landscape. The key to gaining control of the disease lies in understanding the genetics of SARS-CoV-2 and the disease spectrum that follows infection. This study leverages traditional and intelligent bibliometric methods to conduct a multi-dimensional analysis on 5,632 COVID-19 genetic research papers, revealing that 1) the key players include research institutions from the United States, China, Britain and Canada; 2) research topics predominantly focus on virus infection mechanisms, virus testing, gene expression related to the immune reactions and patient clinical manifestation; 3) studies originated from the comparison of SARS-CoV-2 to previous human coronaviruses, following which research directions diverge into the analysis of virus molecular structure and genetics, the human immune response, vaccine development and gene expression related to immune responses; and 4) genes that are frequently highlighted include ACE2, IL6, TMPRSS2, and TNF. Emerging genes to the COVID-19 consist of FURIN, CXCL10, OAS1, OAS2, OAS3, and ISG15. This study demonstrates that our suite of novel bibliometric tools could help biomedical researchers follow this rapidly growing field and provide substantial evidence for policymakers' decision-making on science policy and public health administration.
| S-EPMC8184093 | biostudies-literature
Project description:With the rapid global spread of the COVID-19 pandemic, researchers have contributed several important advances. The WHO and countries with severe outbreaks have developed diagnosis and treatment guidelines. Here, we analyze the current transformation and application of scientific research to global epidemic prevention and control. We described and analyzed current COVID-19 research from the perspectives of international cooperation, interdisciplinary cooperation, and research hotspots using a bibliometric clustering algorithm. Using the diagnosis and treatment guidelines of the WHO and the United States and China as examples, we evaluate the transformation of scientific results from basic research to applications. Scientific research results that have not yet been incorporated into these guidelines are summarized to encourage updates and improvements by applying scientific research to prevention and control. COVID-19 has fostered interdisciplinary cooperative research, and the current results are mainly focused on the origin, epidemiological characteristics, clinical research, and diagnosis and treatment methods for the virus. Due to the ongoing publication of new research, diagnosis and treatment guidelines are constantly improving. However, some research gaps still exist, and some results have not yet been incorporated into the guidelines. The current research is still in the preliminary exploratory stage, and some problems, such as weak international cooperation, unbalanced interdisciplinary cooperation, and the lack of coordination between research and applications, exist. Therefore, countries around the world must improve the International Public Health Emergency Management System and prepare for major public health emergencies in the future.
| S-EPMC7526071 | biostudies-literature