Dataset Information

Social media attention and citations of published outputs from re-use of clinical trial data: a matched comparison with articles published in the same journals.

ABSTRACT:

Background

Data-sharing policies in randomized clinical trials (RCTs) should have an evaluation component. The main objective of this case-control study was to assess the impact of published re-uses of RCT data in terms of media attention (Altmetric) and citation rates.

Methods

Re-uses of RCT data published up to December 2019 (cases) were searched for by two reviewers on 3 repositories (CSDR, YODA project, and Vivli) and matched to control papers published in the same journal. The Altmetric Attention Score (primary outcome), components of this score (e.g. mention of policy sources, media attention) and the total number of citations were compared between these two groups.

Results

89 re-uses were identified: 48 (53.9%) secondary analyses, 34 (38.2%) meta-analyses, 4 (4.5%) methodological analyses and 3 (3.4%) re-analyses. The median (interquartile range) Altmetric Attention Scores were 5.9 (1.3-22.2) for re-use and 2.8 (0.3-12.3) for controls (p = 0.14). No statistical difference was found on any of the components of in the Altmetric Attention Score. The median (interquartile range) numbers of citations were 3 (1-8) for reuses and 4 (1 - 11.5) for controls (p = 0.30). Only 6/89 re-uses (6.7%) were cited in a policy source.

Conclusions

Using all available re-uses of RCT data to date from major data repositories, we were not able to demonstrate that re-uses attracted more attention than a matched sample of studies published in the same journals. Small average differences are still possible, as the sample size was limited. However matching choices have some limitations so results should be interpreted very cautiously. Also, citations by policy sources for re-uses were rare.

Trial registration

Registration: osf.io/fp62e.

SUBMITTER: Anthony N

PROVIDER: S-EPMC8182934 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Social media coverage is increasingly used to spread the message of scientific publications. Traditionally, the scientific impact of an article is measured by the number of citations. At a journal level, this conventionally matures over a 2-year period, and it is challenging to gauge impact around the time of publication. OBJECTIVE:We, therefore, aimed to assess whether Web-based attention is associated with citations and to develop a predictive model that assigns relative importance to different elements of social media coverage: the #SoME_Impact score. METHODS:We included all original articles published in 2015 in a selection of the highest impact journals: The New England Journal of Medicine, The Lancet, the Journal of the American Medical Association, Nature, Cell, and Science. We first characterized the change in Altmetric score over time by taking a single month's sample of recently published articles from the same journals and gathered Altmetric data daily from the time of publication to create a mixed effects spline model. We then obtained the overall weighted Altmetric score for all articles from 2015, the unweighted data for each Altmetric component, and the 2-year citation count from Scopus for each of these articles from 2016 to 2017. We created a stepwise multivariable linear regression model to develop a #SoME_Score that was predictive of 2-year citations. The score was validated using a dataset of articles from the same journals published in 2016. RESULTS:In our unselected sample of 145 recently published articles, social media coverage appeared to plateau approximately 14 days after publication. A total of 3150 articles with a median citation count of 16 (IQR 5-33) and Altmetric score of 72 (IQR 28-169) were included for analysis. On multivariable regression, compared with articles in the lowest quantile of #SoME_Score, articles in the second, third, and upper quantiles had 0.81, 15.20, and 87.67 more citations, respectively. On the validation dataset, #SoME_Score model outperformed the Altmetric score (adjusted R2 0.19 vs 0.09; P<.001). Articles in the upper quantile of #SoME_Score were more than 5 times more likely to be among the upper quantile of those cites (odds ratio 5.61, 95% CI 4.70-6.73). CONCLUSIONS:Social media attention predicts citations and could be used as an early surrogate measure of scientific impact. Owing to the cross-sectional study design, we cannot determine whether correlation relates to causation.

Project description:BACKGROUND:Randomised controlled trials (RCTs) provide the most reliable information to inform clinical practice and patient care. We aimed to map global clinical research publication activity through RCT-related articles in high-impact-factor medical journals over the past five decades. METHODS:We conducted a cross-sectional analysis of articles published in the highest ranked medical journals with an impact factor?>?10 (according to Journal Citation Reports published in 2017). We searched PubMed/MEDLINE (from inception to December 31, 2017) for all RCT-related articles (e.g. primary RCTs, secondary analyses and methodology papers) published in high-impact-factor medical journals. For each included article, raw metadata were abstracted from the Web of Science. A process of standardization was conducted to unify the different terms and grammatical variants and to remove typographical, transcription and/or indexing errors. Descriptive analyses were conducted (including the number of articles, citations, most prolific authors, countries, journals, funding sources and keywords). Network analyses of collaborations between countries and co-words are presented. RESULTS:We included 39,305 articles (for the period 1965-2017) published in forty journals. The Lancet (n?=?3593; 9.1%), the Journal of Clinical Oncology (n?=?3343; 8.5%) and The New England Journal of Medicine (n?=?3275 articles; 8.3%) published the largest number of RCTs. A total of 154 countries were involved in the production of articles. The global productivity ranking was led by the United States (n?=?18,393 articles), followed by the United Kingdom (n?=?8028 articles), Canada (n?=?4548 articles) and Germany (n?=?4415 articles). Seventeen authors who had published 100 or more articles were identified; the most prolific authors were affiliated with Duke University (United States), Harvard University (United States) and McMaster University (Canada). The main funding institutions were the National Institutes of Health (United States), Hoffmann-La Roche (Switzerland), Pfizer (United States), Merck Sharp & Dohme (United States) and Novartis (Switzerland). The 100 most cited RCTs were published in nine journals, led by The New England Journal of Medicine (n?=?78 articles), The Lancet (n?=?9 articles) and JAMA (n?=?7 articles). These landmark contributions focused on novel methodological approaches (e.g. the "Bland-Altman method") and trials on the management of chronic conditions (e.g. diabetes control, hormone replacement therapy in postmenopausal women, multiple therapies for diverse cancers, cardiovascular therapies such as lipid-lowering statins, antihypertensive medications, and antiplatelet and antithrombotic therapy). CONCLUSIONS:Our analysis identified authors, countries, funding institutions, landmark contributions and high-impact-factor medical journals publishing RCTs. Over the last 50?years, publication production in leading medical journals has increased, with Western countries leading in research but with low- and middle-income countries showing very limited representation.

Project description:ImportanceWomen are less likely to be promoted and hold leadership positions in academic medicine. How often academic articles are cited is a key measure of scholarly impact and frequently assessed for professional advancement; however, it is unknown whether peer-reviewed articles written by men and women are cited differently.ObjectiveTo evaluate whether academic articles from high-impact medical journals written by men and women are cited differently.Design, setting, and participantsIn this cross-sectional study of all original research and commentary articles from 5 high-impact medical journals (Annals of Internal Medicine, British Medical Journal, JAMA, JAMA Internal Medicine, and The New England Journal of Medicine) from 2015 to 2018, the gender of the primary and senior authors of each article were identified using an online database, and the number of times each article has been cited was identified using Web of Science. The number of citations by primary and senior author gender were then compared. Data were analyzed from July 2020 to April 2021.ExposuresPrimary and senior authors' genders.Main outcomes and measuresNumber of citations per article.ResultsAmong 5554 articles, women wrote 1975 (35.6%) as primary author and 1273 of 4940 (25.8%) as senior author. Original research articles written by women as primary authors had fewer median (interquartile range) citations than articles written by men as primary authors (36 [17-82] citations vs 54 [22-141] citations; P < .001) and senior authors (37 [17-93] citations vs 51 [20-128] citations; P < .001). Articles written by women as both primary and senior authors had approximately half as many median (interquartile range) citations as those authored by men as both primary and senior authors (33 [15-68] citations vs 59 [23-149] citations; P < .001). Differences in citations remained in each year of the study and were less pronounced among commentary articles.Conclusions and relevanceIn this study, articles written by women in high-impact medical journals had fewer citations than those written by men, particularly when women wrote together as primary and senior authors. These differences may have important consequences for the professional success of women and achieving gender equity in academic medicine.

Project description:Background:New metrics have been developed to assess the impact of research and provide an indication of online media attention and data dissemination. We aimed to describe online media attention of articles evaluating cancer treatments and identify the factors associated with high online media attention. Methods:We systematically searched MEDLINE via PubMed on March 1, 2015 for articles published during the first 6 months of 2014 in oncology and medical journals with a diverse range of impact factors, from 3.9 to 54.4, and selected a sample of articles evaluating a cancer treatment regardless of study design. Altmetric Explorer was used to identify online media attention of selected articles. The primary outcome was media attention an article received online as measured by Altmetric score (i.e., number of mentions in online news outlets, science blogs and social media). Regression analysis was performed to investigate the factors associated with high media attention, and regression coefficients represent the logarithm of ratio of mean (RoM) values of Altmetric score per unit change in the covariate. Results:Among 792 articles, 218 (27.5%) received no online media attention (Altmetric score?=?0). The median [Q1-Q3] Altmetric score was 2.0 [0.0-8.0], range 0.0-428.0. On multivariate analysis, factors associated with high Altmetric score were presence of a press release (RoM?=?10.14, 95%CI [4.91-20.96]), open access to the article (RoM?=?1.48, 95%CI [1.02-2.16]), and journal impact factor (RoM?=?1.10, 95%CI [1.07-1.12]. As compared with observational studies, systematic reviews were not associated with high Altmetric score (RoM?=?1.46, 95%CI [0.74-2.86]; P?=?0.27), nor were RCTs (RoM?=?0.65, 95%CI [0.41-1.02]; P?=?0.059) and phase I/II non-RCTs (RoM?=?0.58, 95%CI [0.33-1.05]; P?=?0.07). The articles with abstract conclusions favouring study treatments were not associated with high Altmetric score (RoM?=?0.97, 95%CI [0.60-1.58]; P?=?0.91). Conclusions:Most important factors associated with high online media attention were the presence of a press release and the journal impact factor. There was no evidence that study design with high level of evidence and type of abstract conclusion were associated with high online media attention.