Project description:ImportanceRetraction is a tool that journals can use to deter research misconduct and alert their audience to erroneous content published in the journals. However, retracted articles may continue to damage science if they are still cited as legitimate articles.ObjectiveTo characterize patterns of postretraction citations, particularly in microRNA biomarker research, a field with one of the highest rates of retraction.Evidence reviewRetracted scientific articles on microRNAs were retrieved from PubMed, Web of Science, and Retraction Watch between database inception and July 17, 2021, according to preestablished search strategies. Control articles with characteristics in common with retracted articles (ie, published in the same journals in the same years and months and with the same number of authors) were matched and retrieved from PubMed. Citation metrics of retractions and control articles were collected from Web of Science. PubPeer was referenced to examine the public response or comments on included retractions. Data were analyzed from September 2021 through March 2023.FindingsA total of 10 461 articles were analyzed, with 887 retractions and 9574 articles as controls. Among retracted articles, which were published from 1999 to 2021, there were 756 articles (85.23%) written by researchers affiliated with Chinese institutions. Retracted articles were cited 6327 times after retraction. Of 792 retracted articles that were cited, 621 articles (78.41%) were cited at least once after retraction and 238 articles (30.05%) were cited more often after retraction than before retraction. Overall citations (comprising citations before and after retraction) and postretraction citations accumulated over time (eg, the median [IQR] number of postretraction citations was 1 [1-2] and 23 [9-44] citations at the first 6 and 66 months, respectively, between retraction and citation retrieval). A random sample of 87 retracted articles (9.81%) recorded 478 citations after retraction, with 208 citations (43.51%) in articles published 12 months or longer after retraction. Of these citing articles, 19 articles (3.97%) mentioned the retractions. Compared with the control group of 1620 nonretracted articles, no significant differences were found in overall number of citations or citations after retraction. Among 478 articles citing retracted articles, 414 articles were found on PubMed and had matched control articles; these articles had higher odds of being subsequently retracted than 7954 matched control articles (odds ratio, 6.57; 95% CI, 3.39-12.72).Conclusions and relevanceIn this study, retraction was not associated with a reduction in citations of retracted articles, but articles that cited retracted publications had higher odds of later retraction. These findings suggest that journals may need to implement mechanisms for detection of postretraction citations.
Project description:In this article, we present a methodology which takes as input a collection of retracted articles, gathers the entities citing them, characterizes such entities according to multiple dimensions (disciplines, year of publication, sentiment, etc.), and applies a quantitative and qualitative analysis on the collected values. The methodology is composed of four phases: (1) identifying, retrieving, and extracting basic metadata of the entities which have cited a retracted article, (2) extracting and labeling additional features based on the textual content of the citing entities, (3) building a descriptive statistical summary based on the collected data, and finally (4) running a topic modeling analysis. The goal of the methodology is to generate data and visualizations that help understanding possible behaviors related to retraction cases. We present the methodology in a structured step-by-step form following its four phases, discuss its limits and possible workarounds, and list the planned future improvements.
Project description:In this article, we show the results of a quantitative and qualitative analysis of open citations on a popular and highly cited retracted paper: "Ileal-lymphoid-nodular hyperplasia, non-specific colitis and pervasive developmental disorder in children" by Wakefield et al., published in 1998. The main purpose of our study is to understand the behavior of the publications citing one retracted article and the characteristics of the citations the retracted article accumulated over time. Our analysis is based on a methodology which illustrates how we gathered the data, extracted the topics of the citing articles and visualized the results. The data and services used are all open and free to foster the reproducibility of the analysis. The outcomes concerned the analysis of the entities citing Wakefield et al.'s article and their related in-text citations. We observed a constant increasing number of citations in the last 20 years, accompanied with a constant increment in the percentage of those acknowledging its retraction. Citing articles have started either discussing or dealing with the retraction of Wakefield et al.'s article even before its full retraction happened in 2010. Articles in the social sciences domain citing the Wakefield et al.'s one were among those that have mostly discussed its retraction. In addition, when observing the in-text citations, we noticed that a large number of the citations received by Wakefield et al.'s article has focused on general discussions without recalling strictly medical details, especially after the full retraction. Medical studies did not hesitate in acknowledging the retraction of the Wakefield et al.'s article and often provided strong negative statements on it.
Project description:BackgroundMore than 400 articles with the title of 100 top-cited articles (Top100) have been published in PubMed. It is unknown whether their citations are fewer (or more) than those found in other bibliometric studies (Nontop100). After determining article themes using coword analysis, a temporal bubble graph (TBG) was used to verify the hypothesis that the Top100 had fewer citations than the Nontop100.MethodsUsing the Web of Science core collection, the top 50 most cited articles were compiled by Top100 and Nontop100, respectively, based on the research area of biomedicine and bibliometrics only. Coword analysis was used to extract themes. The study results were displayed using 6 different visualizations, including charts with bars, pyramids, forests, clusters, chords, and bubbles. Mean citations were compared between Top100 and Nontop100 using the bootstrapping method.ResultsThere were 18 citations in total for the 2 sets of the 50 most cited articles (range 1-134; 5 and 26.5 for Top100 and Nontop100, respectively). A significant difference in mean citations was observed between the 2 groups of Top100 and Nontop100 based on the bootstrapping method (3, 95% confidence interval: [1.18, 4.82]; 26.5, 95% confidence interval: [23.82, 29.18], P < .001). The 11 themes were clustered using coword analysis and applied to a TBG, which is composed of 4 dimensions: themes, years, citations and groups of articles. Among the 2 groups, the majority of articles were published in the journal of Medicine (Baltimore), with 9 and 7, respectively.ConclusionEleven themes were identified as a result of this study. In addition, it reveals distinct differences between the 2 groups of Top100 and Nontop100, with the former containing more recently published articles and the latter containing more citations for articles. Clinical and research clinicians and researchers can use bibliometric analysis to appraise published literature and to understand the scientific landmark using TBG in bibliometrics.
Project description:BackgroundRetractions are a key proxy for recognizing errors in research and publication and for reconciling misconduct in the scientific literature. The underlying factors associated with retractions can provide insight and guide policy for journal editors and authors within a discipline. The goal of this study was to systematically review and analyze retracted articles in veterinary medicine and animal health. A database search for retractions of articles with a veterinary/animal health topic, in a veterinary journal, or by veterinary institution-affiliated authors was conducted from first available records through February 2019 in MEDLINE/PubMed, Web of Science, Scopus, Retraction Watch, and Google Scholar. Annual frequency of retractions, journal and article characteristics, author affiliation and country, reasons for retraction, and retraction outcomes were recorded.ResultsTwo-hundred-forty-two articles retracted between 1993 and 2019 were included in the study. Over this period, the estimated rate of retraction increased from 0.03/1000 to 1.07/1000 veterinary articles. Median time from publication to retraction was 478 days (range 0-3653 days). Retracted articles were published in 30 (12.3%) veterinary journals and 132 (81.5%) nonveterinary journals. Veterinary journals had disproportionately more retractions than nonveterinary journals (P = .0155). Authors/groups with ≥2 retractions accounted for 37.2% of retractions. Authors from Iran and China published 19.4 and 18.2% of retracted articles respectively. Authors were affiliated with a faculty of veterinary medicine in 59.1% of retracted articles. Of 242 retractions, 204 (84.3%) were research articles, of which 6.4% were veterinary clinical research. Publication misconduct (plagiarism, duplicate publication, compromised peer review) accounted for 75.6% of retractions, compared with errors (20.6%) and research misconduct (18.2%). Journals published by societies/institutions were less likely than those from commercial publishers to indicate a reason for retraction. Thirty-one percent of HTML articles and 14% of PDFs were available online but not marked as retracted.ConclusionsThe rate of retraction in the field of veterinary and animal health has increased by ~ 10-fold per 1000 articles since 1993, resulting primarily from increased publication misconduct, often by repeat offenders. Veterinary journals and society/institutional journals could benefit from improvement in the quality of retraction notices.
Project description:Background Well-conducted meta-analyses are considered to be at the top of the evidence-based hierarchy pyramid, with an expansion of these publications within the cardiovascular research arena. There are limited data evaluating the trends and quality of such publications. The objective of this study was to evaluate the methodological rigor and temporal trends of cardiovascular medicine-related meta-analyses published in the highest impact journals. Methods and Results Using the Medline database, we retrieved cardiovascular medicine-related systematic reviews and meta-analyses published in The New England Journal of Medicine, The Lancet, Journal of the American Medical Association, The British Medical Journal, Annals of Internal Medicine, Circulation, European Heart Journal, and Journal of American College of Cardiology between January 1, 2012 and December 31, 2018. Among 6406 original investigations published during the study period, meta-analyses represented 422 (6.6%) articles, with an annual decline in the proportion of published meta-analyses (8.7% in 2012 versus 4.6% in 2018, Ptrend=0.002). A substantial number of studies failed to incorporate elements of Preferred Reporting Items for Systematic Reviews and Meta-Analyses or Meta-Analysis of Observational Studies in Epidemiology guidelines (51.9%) and only a minority of studies (10.4%) were registered in PROSPERO (International Prospective Register of Systematic Reviews). Fewer manuscripts failed to incorporate the Preferred Reporting Items for Systematic Reviews and Meta-Analyses or Meta-Analysis of Observational Studies in Epidemiology elements over time (60.2% in 2012 versus 40.0% in 2018, Ptrend<0.001) whereas the number of meta-analyses registered at PROSPERO has increased (2.4% in 2013 versus 17.5% in 2018, Ptrend<0.001). Conclusions The proportion of cardiovascular medicine-related meta-analyses published in the highest impact journals has declined over time. Although there is an increasing trend in compliance with quality-based guidelines, the overall compliance remains low.
Project description:ImportanceWomen are less likely to be promoted and hold leadership positions in academic medicine. How often academic articles are cited is a key measure of scholarly impact and frequently assessed for professional advancement; however, it is unknown whether peer-reviewed articles written by men and women are cited differently.ObjectiveTo evaluate whether academic articles from high-impact medical journals written by men and women are cited differently.Design, setting, and participantsIn this cross-sectional study of all original research and commentary articles from 5 high-impact medical journals (Annals of Internal Medicine, British Medical Journal, JAMA, JAMA Internal Medicine, and The New England Journal of Medicine) from 2015 to 2018, the gender of the primary and senior authors of each article were identified using an online database, and the number of times each article has been cited was identified using Web of Science. The number of citations by primary and senior author gender were then compared. Data were analyzed from July 2020 to April 2021.ExposuresPrimary and senior authors' genders.Main outcomes and measuresNumber of citations per article.ResultsAmong 5554 articles, women wrote 1975 (35.6%) as primary author and 1273 of 4940 (25.8%) as senior author. Original research articles written by women as primary authors had fewer median (interquartile range) citations than articles written by men as primary authors (36 [17-82] citations vs 54 [22-141] citations; P < .001) and senior authors (37 [17-93] citations vs 51 [20-128] citations; P < .001). Articles written by women as both primary and senior authors had approximately half as many median (interquartile range) citations as those authored by men as both primary and senior authors (33 [15-68] citations vs 59 [23-149] citations; P < .001). Differences in citations remained in each year of the study and were less pronounced among commentary articles.Conclusions and relevanceIn this study, articles written by women in high-impact medical journals had fewer citations than those written by men, particularly when women wrote together as primary and senior authors. These differences may have important consequences for the professional success of women and achieving gender equity in academic medicine.
Project description:The effective evaluation of the impact of a scholarly article is a significant endeavor; for this reason, it has garnered attention. From the perspective of knowledge flow, this paper extracted various knowledge flow patterns concealed in articles citation counts to describe the citation impact of the articles. First, the intensity characteristic of knowledge flow was investigated to distinguish the different citation vitality of articles. Second, the knowledge diffusion capacity was examined to differentiate the size of the scope of articles' influences on the academic environment. Finally, the knowledge transfer capacity was discussed to investigate the support degree of articles on the follow-up research. Experimental results show that articles got more citations recently have a higher knowledge flow intensity. The articles have various impacts on the academic environment and have different supporting effects on the follow-up research, representing the differences in their knowledge diffusion and knowledge transfer capabilities. Compared with the single quantitative index of citation frequency, these knowledge flow patterns can carefully explore the citation value of articles. By integrating the three knowledge flow patterns to examine the total citation impact of articles, we found that the articles exhibit distinct value of citation impact even if they were published in the same field, in the same year, and with similar citation frequencies.
Project description:BackgroundThe number of retracted scholarly articles has risen precipitously in recent years. Past surveys of the retracted literature each limited their scope to articles in PubMed, though many retracted articles are not indexed in PubMed. To understand the scope and characteristics of retracted articles across the full spectrum of scholarly disciplines, we surveyed 42 of the largest bibliographic databases for major scholarly fields and publisher websites to identify retracted articles. This study examines various trends among them.ResultsWe found, 4,449 scholarly publications retracted from 1928-2011. Unlike Math, Physics, Engineering and Social Sciences, the percentages of retractions in Medicine, Life Science and Chemistry exceeded their percentages among Web of Science (WoS) records. Retractions due to alleged publishing misconduct (47%) outnumbered those due to alleged research misconduct (20%) or questionable data/interpretations (42%). This total exceeds 100% since multiple justifications were listed in some retraction notices. Retraction/WoS record ratios vary among author affiliation countries. Though widespread, only miniscule percentages of publications for individual years, countries, journals, or disciplines have been retracted. Fifteen prolific individuals accounted for more than half of all retractions due to alleged research misconduct, and strongly influenced all retraction characteristics. The number of articles retracted per year increased by a factor of 19.06 from 2001 to 2010, though excluding repeat offenders and adjusting for growth of the published literature decreases it to a factor of 11.36.ConclusionsRetracted articles occur across the full spectrum of scholarly disciplines. Most retracted articles do not contain flawed data; and the authors of most retracted articles have not been accused of research misconduct. Despite recent increases, the proportion of published scholarly literature affected by retraction remains very small. Articles and editorials discussing retractions, or their relation to research integrity, should always consider individual cases in these broad contexts. However, better mechanisms are still needed for raising researchers' awareness of the retracted literature in their field.