Dataset Information

Evaluating association between linguistic characteristics of abstracts and risk of bias: Case of Japanese randomized controlled trials.

ABSTRACT: Despite the ongoing growth in the number of published randomized controlled trials (RCTs) and increased quality assessment of RCTs, the association between the quality and characteristics in the text has not been sufficiently studied. We are interested in a specific question: what kind of sentences is a good indicator of high quality RCTs? To help researchers to efficiently screen articles worth reading, this study aims 1) to quantify the linguistic features of articles and 2) to build a document assessment model to evaluate quality of RCTs using only the abstract. All RCTs that were conducted in Japan in 2010 as original articles were included in the analysis. Data were independently assessed by two reviewers using a risk-of-bias tool. Three aspects of linguistic style were quantitatively measured, and a document model was constructed to evaluate the RCTs. A total of 302 RCTs were selected for quality assessment. Of these, 255 articles were assessed as high quality and 47 as low quality. High-quality articles tended to use longer words than low-quality articles (p = 0.048), however sentences were generally shorter (p = 0.004). Further, high-quality articles included a larger proportion of noun phrases (p = 0.026) but a smaller proportion of verb phrases (p = 0.041). The optimal number of topics to assess the quality of articles was four, while two topics had a significant association with quality. Despite a number of articles published about RCTs in Japan, significant differences exist in several textual features between high- and low-quality RCTs. Instead of the risk-of-bias tool, these results can be used as the new criteria to rapidly screen valuable articles and it also revealed quality control of RCT articles is urgently needed in Japan.

SUBMITTER: Yoneoka D

PROVIDER: S-EPMC5344454 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Evaluating association between linguistic characteristics of abstracts and risk of bias: Case of Japanese randomized controlled trials.

Yoneoka Daisuke D Ota Erika E

PloS one 20170309 3

Despite the ongoing growth in the number of published randomized controlled trials (RCTs) and increased quality assessment of RCTs, the association between the quality and characteristics in the text has not been sufficiently studied. We are interested in a specific question: what kind of sentences is a good indicator of high quality RCTs? To help researchers to efficiently screen articles worth reading, this study aims 1) to quantify the linguistic features of articles and 2) to build a documen ...[more]

PMID: 28278271

Similar Datasets

Project description:A growing number of randomized controlled trials (RCTs) have investigated the therapeutic value of yoga interventions. This bibliometric analysis aimed to provide a comprehensive review of the characteristics of the totality of available randomized yoga trials.All RCTs of yoga were eligible. Medline/PubMed, Scopus, the Cochrane Library, IndMED, and the tables of content of yoga specialty journals not listed in medical databases were screened through February 2014. Bibliometric data, data on participants, and intervention were extracted and analyzed descriptively.Published between 1975 and 2014, a total of 366 papers were included, reporting 312 RCTs from 23 different countries with 22,548 participants. The median study sample size was 59 (range 8-410, interquartile range?=?31, 93). Two hundred sixty-four RCTs (84.6%) were conducted with adults, 105 (33.7%) with older adults and 31 (9.9%) with children. Eighty-four RCTs (26.9%) were conducted with healthy participants. Other trials enrolled patients with one of 63 varied medical conditions; the most common being breast cancer (17 RCTs, 5.4%), depression (14 RCTs, 4.5%), asthma (14 RCTs, 4.5%) and type 2 diabetes mellitus (13 RCTs, 4.2%). Whilst 119 RCTs (38.1%) did not define the style of yoga used, 35 RCTs (11.2%) used Hatha yoga and 30 RCTs (9.6%) yoga breathing. The remaining 128 RCTs (41.0%) used 46 varied yoga styles, with a median intervention length of 9 weeks (range 1 day to 1 year; interquartile range?=?5, 12). Two hundred and forty-four RCTs (78.2%) used yoga postures, 232 RCTs (74.4%) used breath control, 153 RCTs (49.0%) used meditation and 32 RCTs (10.3%) used philosophy lectures. One hundred and seventy-four RCTs (55.6%) compared yoga with no specific treatment; 21 varied control interventions were used in the remaining RCTs.This bibliometric analysis presents the most complete up-to-date overview on published randomized yoga trials. While the available research evidence is sparse for most conditions, there was a marked increase in published RCTs in recent years.

Project description:BackgroundClear, transparent, and sufficiently detailed abstracts of conferences and journal articles related to randomized controlled trials (RCTs) are important, because readers often base their assessment of a trial solely on information in the abstract. Here, we extend the CONSORT (Consolidated Standards of Reporting Trials) Statement to develop a minimum list of essential items, which authors should consider when reporting the results of a RCT in any journal or conference abstract.Methods and findingsWe generated a list of items from existing quality assessment tools and empirical evidence. A three-round, modified-Delphi process was used to select items. In all, 109 participants were invited to participate in an electronic survey; the response rate was 61%. Survey results were presented at a meeting of the CONSORT Group in Montebello, Canada, January 2007, involving 26 participants, including clinical trialists, statisticians, epidemiologists, and biomedical editors. Checklist items were discussed for eligibility into the final checklist. The checklist was then revised to ensure that it reflected discussions held during and subsequent to the meeting. CONSORT for Abstracts recommends that abstracts relating to RCTs have a structured format. Items should include details of trial objectives; trial design (e.g., method of allocation, blinding/masking); trial participants (i.e., description, numbers randomized, and number analyzed); interventions intended for each randomized group and their impact on primary efficacy outcomes and harms; trial conclusions; trial registration name and number; and source of funding. We recommend the checklist be used in conjunction with this explanatory document, which includes examples of good reporting, rationale, and evidence, when available, for the inclusion of each item.ConclusionsCONSORT for Abstracts aims to improve reporting of abstracts of RCTs published in journal articles and conference proceedings. It will help authors of abstracts of these trials provide the detail and clarity needed by readers wishing to assess a trial's validity and the applicability of its results.

Project description:BACKGROUND AND OBJECTIVE:Trial registration is widely endorsed as it is considered not only to enhance transparency and quality of reporting but also to help safeguard against outcome reporting bias and probably spin, known as specific reporting that could distort the interpretation of results thus mislead readers. We planned to investigate the current registration status of recently published randomized controlled trials (RCTs) of acupuncture, outcome reporting bias in the prospectively registered trials, and the association between trial registration and presence of spin and methodological factors in acupuncture RCTs. METHODS:Acupuncture RCTs published in English in recent 5 years (January 2013 to December 2017) were searched in PubMed, Cochrane Central Register of Controlled Trials, and EMBASE. Trial registration records identified in the publications and trial registries were classified into prospectively registered, retrospectively registered, or unregistered. Primary outcomes were identified and the direction of the results was judged as statistically significant (positive) or statistically nonsignificant (negative). We compared registered and published primary outcomes to assess outcome reporting bias and assessed whether discrepancies favored statistically significant outcomes. Frequency and strategies of spin in published reports with statistically nonsignificant results for primary outcomes were then identified. We also analyzed whether the trial registration status was associated with spin and quality of methodological factors. RESULTS:Of the 322 included RCTs, 41.9% (n = 135) were prospectively registered. Among 64 studies that were prospectively registered and specified primary outcomes, 25 trials had the discrepancies between the registered and published primary outcomes and 60% of them (15 trials) favored the statistically significant findings. Among 169 studies that specified primary outcomes, trial registration status was not associated with the direction of results, i.e., statistically significant or not. Spin was identified in 56.4% out of 78 studies with statistically nonsignificant primary outcomes and claiming efficacy with no consideration of statistically nonsignificant primary outcomes was the most common strategy for spin. Trial registration status was not statistically different between studies with and without spin. CONCLUSION:While trial registration seemed to have improved over time, primary outcomes in registered records and publications were often inconsistent, tending to favor statistically significant findings and spin was common in studies with statistically nonsignificant primary outcomes. Journal editors and researchers in this field should be alerted to still prevalent reporting bias and spin.

Dataset Information

Evaluating association between linguistic characteristics of abstracts and risk of bias: Case of Japanese randomized controlled trials.

Publications

Evaluating association between linguistic characteristics of abstracts and risk of bias: Case of Japanese randomized controlled trials.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets