Project description:ImportanceAlthough peer review is an important component of publication for new research, the viability of this process has been questioned, particularly with the added stressors of the COVID-19 pandemic.ObjectiveTo characterize rates of peer reviewer acceptance of invitations to review manuscripts, reviewer turnaround times, and editor-assessed quality of reviews before and after the start of the COVID-19 pandemic at a large, open-access general medical journal.Design, setting, and participantsThis retrospective, pre-post cohort study examined all research manuscripts submitted to JAMA Network Open between January 1, 2019, and June 29, 2021, either directly or via transfer from other JAMA Network journals, for which at least 1 peer review of manuscript content was solicited. Measures were compared between the period before the World Health Organization declaration of a COVID-19 pandemic on March 11, 2020 (14.3 months), and the period during the pandemic (15.6 months) among all reviewed manuscripts and between pandemic-period manuscripts that did or did not address COVID-19.Main outcomes and measuresFor each reviewed manuscript, the number of invitations sent to reviewers, proportions of reviewers accepting invitations, time in days to return reviews, and editor-assessed quality ratings of reviews were determined.ResultsIn total, the journal sought review for 5013 manuscripts, including 4295 Original Investigations (85.7%) and 718 Research Letters (14.3%); 1860 manuscripts were submitted during the prepandemic period and 3153 during the pandemic period. Comparing the prepandemic with the pandemic period, the mean (SD) number of reviews rated as high quality (very good or excellent) per manuscript increased slightly from 1.3 (0.7) to 1.5 (0.7) (P < .001), and the mean (SD) time for reviewers to return reviews was modestly shorter (from 15.8 [7.6] days to 14.4 [7.0] days; P < .001), a difference that persisted in linear regression models accounting for manuscript type, study design, and whether the manuscript addressed COVID-19.Conclusions and relevanceIn this cohort study, the speed and editor-reported quality of peer reviews in an open-access general medical journal improved modestly during the initial year of the pandemic. Additional study will be necessary to understand how the pandemic has affected reviewer burden and fatigue.
Project description:BackgroundThe COVID-19 pandemic has severely affected health systems and medical research worldwide but its impact on the global publication dynamics and non-COVID-19 research has not been measured. We hypothesized that the COVID-19 pandemic may have impacted the scientific production of non-COVID-19 research.MethodsWe conducted a comprehensive meta-research on studies (original articles, research letters and case reports) published between 01/01/2019 and 01/01/2021 in 10 high-impact medical and infectious disease journals (New England Journal of Medicine, Lancet, Journal of the American Medical Association, Nature Medicine, British Medical Journal, Annals of Internal Medicine, Lancet Global Health, Lancet Public Health, Lancet Infectious Disease and Clinical Infectious Disease). For each publication, we recorded publication date, publication type, number of authors, whether the publication was related to COVID-19, whether the publication was based on a case series, and the number of patients included in the study if the publication was based on a case report or a case series. We estimated the publication dynamics with a locally estimated scatterplot smoothing method. A Natural Language Processing algorithm was designed to calculate the number of authors for each publication. We simulated the number of non-COVID-19 studies that could have been published during the pandemic by extrapolating the publication dynamics of 2019 to 2020, and comparing the expected number to the observed number of studies.ResultsAmong the 22,525 studies assessed, 6319 met the inclusion criteria, of which 1022 (16.2%) were related to COVID-19 research. A dramatic increase in the number of publications in general journals was observed from February to April 2020 from a weekly median number of publications of 4.0 (IQR: 2.8-5.5) to 19.5 (IQR: 15.8-24.8) (p < 0.001), followed afterwards by a pattern of stability with a weekly median number of publications of 10.0 (IQR: 6.0-14.0) until December 2020 (p = 0.045 in comparison with April). Two prototypical editorial strategies were found: 1) journals that maintained the volume of non-COVID-19 publications while integrating COVID-19 research and thus increased their overall scientific production, and 2) journals that decreased the volume of non-COVID-19 publications while integrating COVID-19 publications. We estimated using simulation models that the COVID pandemic was associated with a 18% decrease in the production of non-COVID-19 research. We also found a significant change of the publication type in COVID-19 research as compared with non-COVID-19 research illustrated by a decrease in the number of original articles, (47.9% in COVID-19 publications vs 71.3% in non-COVID-19 publications, p < 0.001). Last, COVID-19 publications showed a higher number of authors, especially for case reports with a median of 9.0 authors (IQR: 6.0-13.0) in COVID-19 publications, compared to a median of 4.0 authors (IQR: 3.0-6.0) in non-COVID-19 publications (p < 0.001).ConclusionIn this meta-research gathering publications from high-impact medical journals, we have shown that the dramatic rise in COVID-19 publications was accompanied by a substantial decrease of non-COVID-19 research. META-RESEARCH REGISTRATION: https://osf.io/9vtzp/ .
Project description:ObjectivePreprints have had a prominent role in the swift scientific response to COVID-19. Two years into the pandemic, we investigated how much preprints had contributed to timely data sharing by analyzing the lag time from preprint posting to journal publication.ResultsTo estimate the median number of days between the date a manuscript was posted as a preprint and the date of its publication in a scientific journal, we analyzed preprints posted from January 1, 2020, to December 31, 2021 in the NIH iSearch COVID-19 Portfolio database and performed a Kaplan-Meier (KM) survival analysis using a non-mixture parametric cure model. Of the 39,243 preprints in our analysis, 7712 (20%) were published in a journal, after a median lag of 178 days (95% CI: 175-181). Most of the published preprints were posted on the bioRxiv (29%) or medRxiv (65%) servers, which allow authors to choose a subject category when posting. Of the 20,698 preprints posted on these two servers, 7358 (36%) were published, including approximately half of those categorized as biochemistry, biophysics, and genomics, which became published articles within the study interval, compared with 29% categorized as epidemiology and 26% as bioinformatics.
Project description:BackgroundGiven available effective biomedical and behavioral prevention and treatment interventions, HIV-related implementation research (IR) is expanding. The rapid generation and dissemination of IR to inform guidelines and practice has the potential to optimize the impact of the Ending the Epidemic Initiative and the HIV pandemic response more broadly.MethodsWe leveraged a prior mapping review of NIH-funded awards in HIV and IR from January 2013 to March 2018 and identified all publications linked to those grants in NIH RePORTER through January 1, 2021 (n = 1509). Deduplication and screening of nonoriginal research reduced the count to 1032 articles, of which 952 were eligible and included in this review. Publication volume and timing were summarized; Kaplan-Meier plots estimated time to publication.ResultsAmong the 215 NIH-funded IR-related awards, 127 of 215 (59%) published original research directly related to the grant, averaging 2.0 articles (SD: 3.3) per award, largely in the early IR phases. Many articles (521 of 952, 55%) attributed to grants did not report grant-related data. Time from article submission to publication averaged 205 days (SD: 107). The median time-to-first publication from funding start was 4 years. Data dissemination velocity varied by award type, trending toward faster publication in recent years. Delays in data velocity included (1) time from funding to enrollment, (2) enrollment length, and (3) time from data collection completion to publication.ConclusionResearch publication was high overall, and time-to-publication is accelerating; however, over 40% of grants have yet to publish findings from grant-related data. Addressing bottlenecks in the production and dissemination of HIV-related IR would reinforce its programmatic and policy relevance in the HIV response.
Project description:IntroductionCOVID-19 changed scholarly publishing. Yet, its impact on medical education publishing is unstudied. Because journal articles and their corresponding publication timelines can influence academic success, the field needs updated publication timelines to set evidence-based expectations for academic productivity. This study attempts to answer the following research questions: did publication timelines significantly change around the time of COVID-19 and, if so, how?MethodsWe conducted a bibliometric study; our sample included articles published between January 2018, and December 2022, that appeared in the Medical Education Journals List-24 (MEJ-24). We clustered articles into three time-based groups (pre-COVID, COVID-overlap, and COVID-endemic), and two subject-based groups (about COVID-19 and not about COVID-19). We downloaded each article's metadata from the National Library of Medicine and analyzed data using descriptive statistics, analysis of variance, and post-hoc tests to compare mean time differences across groups.ResultsOverall, time to publish averaged 300.8 days (SD = 200.8). One-way between-groups ANOVA showed significant differences between the three time-based groups F (2, 7473) = 2150.7, p < .001. The post-hoc comparisons indicated that COVID-overlap articles took significantly longer (n = 1470, M= 539; SD = 210.6) as compared to pre-COVID (n = 1281; M = 302; SD = 172.5) and COVID-endemic articles (n = 4725; M = 226; SD = 136.5). Notably, COVID-endemic articles were published in significantly less time than pre-pandemic articles, p < .001.DiscussionLonger publication time was most pronounced for COVID-overlap articles. Publication timelines for COVID-endemic articles have shortened. Future research should explore how the shift in publication timelines has shaped medical education scholarship.
Project description:IntroductionThe situation of COVID-19 pandemic is becoming more complex. The research institutes should focus on the most important challenge related to this outbreak at the national level. We aim to realize this scoping review to map publications on COVID-19 in Vietnam in order to guide research priorities and policies in the country.MethodsThis study was conducted at the Thai Binh University of Medicine and Pharmacy, from May to August 2020, according to the guidance for conducting systematic scoping review.ResultsA total of 72 studies met the inclusion criteria. The most frequent publications were original articles (27.8%), followed by letter to editor/correspondence (26.4%). According to the research priorities for COVID-19 set by the WHO, 41.7% studies focused on control and prevention of COVID-19, but none of studies on personal protective equipment or protocol for healthcare workers' safety were conducted. 12.5% studies carried out a thorough investigation into epidemiology of the COVID-19 pandemic in Vietnam. Virology and genomics, natural history of the virus and its transmission in Vietnam were described by 18.1% papers. Only one study was conducted in terms of development for candidate therapeutics.ConclusionWe call for national investigation on treatment against SARS-CoV-2 and protocol for medical staff protection. The government and academic institutions should work in collaboration with international stakeholders, including the WHO, to combat together the COVID-19.
Project description:IntroductionJournal self-citation contributes to the overall citation count of a journal and to some metrics like the impact factor. However, little is known about the extent of journal self-citations in COVID-19 research. This study aimed to determine the journal self-citations in COVID-19 research and to compare them according to the type of publication and publisher.MethodsData in COVID-19 research extracted from the Web of Science Core Collection 2020-2023 was collected and further analyzed with InCites. The journals with the highest self-citation rates and self-citation per publication were identified. Statistical comparisons were made according to the type of publication and publishers, as well as with other major infectious diseases.ResultsThe median self-citation rate was 4.0% (IQR 0-11.7%), and the median journal self-citation rate was 5.9% (IQR 0-12.5%). 1,859 journals (13% of total coverage) had self-citation rates at or above 20%, meaning that more than one in five references are journal self-citations. There was a positive and statistically significant correlation of self-citations with the other indicators, including number of publications, citations, and self-citations per publication (p<0.001). Editorial materials contributed more to journal SC with a median self-citation rate of 5%, which was statistically higher than other documents such as articles, letters or reviews (p<0.001). Among the top twelve publishers, the Multidisciplinary Digital Publishing Institute had a median self-citation rate of 8.33% and was statistically higher than the rest (p<0.001). Self-citation rates for COVID-19 were lower than tuberculosis and HIV/AIDS, but self-citations per publication of these diseases were statistically lower than those for COVID-19 (p<0.001).ConclusionSome journals from the Web of Science Core Collection displayed exorbitant journal self-citation patterns during the period 2020-2023. Approximately, one in every five paper references in COVID-19 is a journal self-citation. Types of publication such as editorials engage in this practice more frequently than others, suggesting that in COVID-19 research, self-citing non-citable items could potentially contribute to inflate journal impact factors during the pandemic.
Project description:Background The Covid-19 pandemic impacted scientific publishing, though it's effect on publication times in urology literature is unknown. The objective of our study were to determine and compare acceptance and publication times in general and specific urology journals, and to quantify these times before and during the Covid-19 pandemic. Methods We identified all original articles published in seven urology journals in 2019 and 2021, and extracted data on submission, acceptance, online, and in-print publication times. Differences between groups were compared using Mann-Whitney U tests. Results A total of 2880 articles were included, comprising 1601 articles published in 2021 and 1279 in 2019. Less experimental/animal studies were published in 2021 compared to 2019 (197 vs. 289). Time between submission and online publication was longer in 2021 (median 4.4 vs 3.3 months, p < 0.001), though acceptance times were not different (median 3.3 vs 3.3 months, p = 0.25). Prostate (median: 2.8 months, Neurourology and Urodynamics (median: 2.8 months) and Word Journal of Urology (median 2.9 months) had the shortest acceptance time in 2021. Time between submission and in-print publication ranged from 4.6 months (IQR: 3.6–6.8) for Prostate to 11.9 months (IQR: 9.8–13.2) for World Journal of Urology. Acceptance times were significantly longer in 2021 compared to 2019 for Prostate Cancer and Prostatic Diseases, Journal of Sexual Medicine, and Prostate. Moreover, time between submission and in print publication was longer in 2021 compared to 2019 for Journal of Sexual Medicine and Urologic Oncology: Seminars and Original Investigations, and shorter for Neurourology and Urodynamics. The median time to in print publication was lower for publications from US institutions (median 7.0 vs. 7.7 months in 2019 and 8.7 months vs 9.1 months in 2021). Conclusions We identified journal specific acceptance and publication times and observed substantial differences between urology journals for the years 2019 and 2021.
Project description:Journal impact factors have become an important criterion to judge the quality of scientific publications over the years, influencing the evaluation of institutions and individual researchers worldwide. However, they are also subject to a number of criticisms. Here we point out that the calculation of a journal's impact factor is mainly based on the date of publication of its articles in print form, despite the fact that most journals now make their articles available online before that date. We analyze 61 neuroscience journals and show that delays between online and print publication of articles increased steadily over the last decade. Importantly, such a practice varies widely among journals, as some of them have no delays, while for others this period is longer than a year. Using a modified impact factor based on online rather than print publication dates, we demonstrate that online-to-print delays can artificially raise a journal's impact factor, and that this inflation is greater for longer publication lags. We also show that correcting the effect of publication delay on impact factors changes journal rankings based on this metric. We thus suggest that indexing of articles in citation databases and calculation of citation metrics should be based on the date of an article's online appearance, rather than on that of its publication in print.
Project description:Solicited journal entries are a qualitative research method with a fairly strong tradition in sociological research and particularly in qualitative health research. However, the practices and strengths associated with solicited journal entries have not been explored as frequently or comprehensively as more conventional qualitative research methods, such as interviews. During the COVID-19 pandemic we carried out two online studies employing solicited written journal entries and photos. One study focused on pregnancy and health care experiences during the pandemic and the other on everyday life while working from home due to public health restrictions. Here, we discuss solicited online journal entries as a qualitative method and reflect on the strengths and challenges we encountered, including those related to using the online survey tool LimeSurvey for a qualitative diary-based study. The richness of data and the ability to solicit participants' contemporaneous reflections over the course of a set length of time, the ability to reach people across time zones and in multiple places, and the ability to adapt prompts in a quickly changing research context are major strengths of online journaling. The level of commitment required by participants, the potential for attrition, the need for literacy and technology access, and the large amount of data from each participant are potential limitations for researchers to consider.