Dataset Information

Stress testing journals: a quasi-experimental study of rejection rates of a previously published paper.

ABSTRACT: BACKGROUND:When a journal receives a duplicate publication, the ability to identify the submitted work as previously published, and reject it, is an assay to publication ethics best practices. The aim of this study was to evaluate how three different types of journals, namely open access (OA) journals, subscription-based journals, and presumed predatory journals, responded to receiving a previously published manuscript for review. METHODS:We performed a quasi-experimental study in which we submitted a previously published article to a random sample of 602 biomedical journals, roughly 200 journals from each journal type sampled: OA journals, subscription-based journals, and presumed predatory journals. Three hundred and three journals received a Word version in manuscript format, while 299 journals received the formatted publisher's PDF version of the published article. We then recorded responses to the submission received after approximately 1?month. Responses were reviewed, extracted, and coded in duplicate. Our primary outcome was the rate of rejection of the two types of submitted articles (PDF vs Word) within our three journal types. RESULTS:We received correspondence back from 308 (51.1%) journals within our study timeline (32?days); (N?=?46 predatory journals, N?=?127 OA journals, N?=?135 subscription-based journals). Of the journals that responded, 153 received the Word version of the paper, while 155 received the PDF version. Four journals (1.3%) accepted our paper, 291 (94.5%) journals rejected the paper, and 13 (4.2%) requested a revision. A chi-square test looking at journal type, and submission type, was significant (?2 (4)?=?23.50, p?

SUBMITTER: Cobey KD

PROVIDER: S-EPMC7171725 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Stress testing journals: a quasi-experimental study of rejection rates of a previously published paper.

Cobey Kelly D KD Rice Danielle B DB Lalu Manoj M MM Abramowitz Daniel D Ahmadzai Nadera N Cunningham Heather H Ayala Ana Patricia AP Raffoul Hana H Khan Faizan F Shamseer Larissa L Moher David D

BMC medicine 20200421 1

<h4>Background</h4>When a journal receives a duplicate publication, the ability to identify the submitted work as previously published, and reject it, is an assay to publication ethics best practices. The aim of this study was to evaluate how three different types of journals, namely open access (OA) journals, subscription-based journals, and presumed predatory journals, responded to receiving a previously published manuscript for review.<h4>Methods</h4>We performed a quasi-experimental study in ...[more]

PMID: 32312313

Similar Datasets

Project description:BackgroundLack of reproducibility of preclinical studies has been identified as an impediment for translation of basic mechanistic research into effective clinical therapies. Indeed, the National Institutes of Health has revised its grant application process to require more rigorous study design, including sample size calculations, blinding procedures, and randomization steps. We hypothesized that the reporting of such metrics of study design rigor has increased over time for animal-experimental research published in anesthesia journals.MethodsPubMed was searched for animal-experimental studies published in 2005, 2010, and 2015 in primarily English-language anesthesia journals. A total of 1466 publications were graded on the performance of sample size estimation, randomization, and blinding. Cochran-Armitage test was used to assess linear trends over time for the primary outcome of whether or not a metric was reported. Interrater agreement for each of the 3 metrics (power, randomization, and blinding) was assessed using the weighted κ coefficient in a 10% random sample of articles rerated by a second investigator blinded to the ratings of the first investigator.ResultsA total of 1466 manuscripts were analyzed. Reporting for all 3 metrics of experimental design rigor increased over time (2005 to 2010 to 2015): for power analysis, from 5% (27/516), to 12% (59/485), to 17% (77/465); for randomization, from 41% (213/516), to 50% (243/485), to 54% (253/465); and for blinding, from 26% (135/516), to 38% (186/485), to 47% (217/465). The weighted κ coefficients and 98.3% confidence interval indicate almost perfect agreement between the 2 raters beyond that which occurs by chance alone (power, 0.93 [0.85, 1.0], randomization, 0.91 [0.85, 0.98], and blinding, 0.90 [0.84, 0.96]).ConclusionsOur hypothesis that reported metrics of rigor in animal-experimental studies in anesthesia journals have increased during the past decade was confirmed. More consistent reporting, or explicit justification for absence, of sample size calculations, blinding techniques, and randomization procedures could better enable readers to evaluate potential sources of bias in animal-experimental research manuscripts. Future studies should assess whether such steps lead to improved translation of animal-experimental anesthesia research into successful clinical trials.

Project description:BackgroundThe approximately 1100 medical journals now active in China are publishing a rapidly increasing number of research reports, including many studies identified by their authors as randomized controlled trials. It has been noticed that these reports mostly present positive results, and their quality and authenticity have consequently been called into question. We investigated the adequacy of randomization of clinical trials published in recent years in China to determine how many of them met acceptable standards for allocating participants to treatment groups.MethodsThe China National Knowledge Infrastructure electronic database was searched for reports of randomized controlled trials on 20 common diseases published from January 1994 to June 2005. From this sample, a subset of trials that appeared to have used randomization methods was selected. Twenty-one investigators trained in the relevant knowledge, communication skills and quality control issues interviewed the original authors of these trials about the participant randomization methods and related quality-control features of their trials.ResultsFrom an initial sample of 37,313 articles identified in the China National Knowledge Infrastructure database, we found 3137 apparent randomized controlled trials. Of these, 1452 were studies of conventional medicine (published in 411 journals) and 1685 were studies of traditional Chinese medicine (published in 352 journals). Interviews with the authors of 2235 of these reports revealed that only 207 studies adhered to accepted methodology for randomization and could on those grounds be deemed authentic randomized controlled trials (6.8%, 95% confidence interval 5.9-7.7). There was no statistically significant difference in the rate of authenticity between randomized controlled trials of traditional interventions and those of conventional interventions. Randomized controlled trials conducted at hospitals affiliated to medical universities were more likely to be authentic than trials conducted at level 3 and level 2 hospitals (relative risk 1.58, 95% confidence interval 1.18-2.13, and relative risk 14.42, 95% confidence interval 9.40-22.10, respectively). The likelihood of authenticity was higher in level 3 hospitals than in level 2 hospitals (relative risk 9.32, 95% confidence interval 5.83-14.89). All randomized controlled trials of pre-market drug clinical trial were authentic by our criteria. Of the trials conducted at university-affiliated hospitals, 56.3% were authentic (95% confidence interval 32.0-81.0).ConclusionMost reports of randomized controlled trials published in some Chinese journals lacked an adequate description of randomization. Similarly, most so called 'randomized controlled trials' were not real randomized controlled trials owing to a lack of adequate understanding on the part of the authors of rigorous clinical trial design. All randomized controlled trials of pre-market drug clinical trial included in this research were authentic. Randomized controlled trials conducted by authors in high level hospitals, especially in hospitals affiliated to medical universities had a higher rate of authenticity. That so many non-randomized controlled trials were published as randomized controlled trials reflected the fact that peer review needs to be improved and a good practice guide for peer review including how to identify the authenticity of the study urgently needs to be developed.

Project description:BACKGROUND:From 2000 to 2008, in urban areas in Spain, adolescent fertility and abortion rates underwent unprecedented increases, consecutive to intensive immigration from developing countries. To address unmet needs for contraception information and services, a community-based, gender-sensitive and culturally adapted brief counselling intervention (SIRIAN program) was launched in some deprived neighbourhoods with a high proportion of immigrants in Barcelona. Once a randomized controlled trial demonstrated its effectiveness in increasing the use of contraceptives, we aim to examine its population impact on adolescent fertility rates. METHODS:Quasi-experimental study with comparison group, using population data from 2005 to 2016. Five neighbourhoods in the lowest tercile of Disposable Household Income were intervened in 2011-13. The comparison group included the three neighbourhoods which were in the same municipal district and in the lowest Disposable Household Income tercile, and displayed the highest adolescent fertility rates. Generalized linear models were fitted to assess absolute adolescent fertility rates and adjusted by immigrant population between pre-intervention (2005-10) and post-intervention periods (2011-16); Difference in Differences and relative pre-post changes analysis were performed. RESULTS:In 2005-10 the intervention group adolescent fertility rate was 27.90 (per 1000 women 15-19) and 21.84 in the comparison group. In 2011-16 intervention areas experienced great declines (adolescent fertility rate change: -?12.30 (-?12.45 to -?12.21); p?<?0.001), while comparison neighbourhoods remained unchanged (adolescent fertility rate change: 1.91 (-?2.25 to 6.07); p?=?0.368). A reduction of -?10.97 points (-?13.91 to -?8.03); p?<?0.001) is associated to the intervention. CONCLUSION:Adolescent fertility rate significantly declined in the intervention group but remained stable in the comparison group. This quasi-experimental study provide evidence that, in a country with universal health coverage, a community counselling intervention that increases access to contraception, knowledge and sexual health care in hard-to-reach segments of the population can contribute to substantially reduce adolescent fertility rates. Reducing adolescent fertility rates could become a feasible goal in cities with similar conditions.

Project description:ObjectiveStress is a significant concern in medical education, and identifying effective ways to deal with stress may help with students' mental health and professional development. This study aimed to examine the effects of the Transforming Stress Program (TSP) amongst first-year medical students on their stress mindset and coping strategies when confronted with stressors.MethodsWe conducted a quasi-experimental study at the University of Medicine and Pharmacy, Ho Chi Minh City, Vietnam. A total of 409 first-year students at the Faculty of Medicine were divided into intervention group (205 students) and control group (204 students). The 10-week TSP was delivered as an extra-curricular course. The training adopts psychoeducation based on Dialectical Behavioral Therapy with mindfulness as a fundamental practice incorporated into each component of the program. The intervention group received the training in the first semester; the control group received identical program in the second semester. Stress Mindset Measurement and Brief Coping Orientation to Problems Experienced were measured before the intervention (T0), immediately after intervention on Intervention group (T1), and six months after intervention on Intervention group (T2).ResultsAt T1, the intervention group showed 65% improvements in stress mindset scores and increases in coping strategies scores in six domains (Problem solving, Social support, Humor, Religion, Venting, and Self-distraction) and decreases in three (Avoidance, Substance use, and Self-blame). The effect sizes were significant in all outcomes (Cohen's d > 0.2). Measurements of the control group did not change significantly in the same period. At T2, effects of the TSP were found decreased in some domains (Avoidance, Substance use, and Self-blame) compared to T1, but largely remained significantly better than T0.ConclusionsThe TSP is a feasible and effective approach that significantly enhanced medical students' stress mindset and coping strategies. Some effects were still observable 6 months after the intervention. The relatively intensive intervention requires support of the school administration and staff.

Dataset Information

Stress testing journals: a quasi-experimental study of rejection rates of a previously published paper.

Publications

Stress testing journals: a quasi-experimental study of rejection rates of a previously published paper.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets