Dataset Information

Reporting quality of Cochrane systematic reviews with Chinese herbal medicines.

ABSTRACT:

Background

Chinese herbal medicines (CHMs) are the major interventions of traditional Chinese medicine (TCM), which are typically administered as either single herbs or formulas. The Cochrane systematic reviews (SRs) of CHMs are essential references for evaluating the efficacy and safety of CHMs interventions; they are expected to be accurate and reliable. This study aimed to assess the reporting quality of these SRs, particularly whether necessary information related to CHM was adequately reported.

Methods

The Cochrane Database was systematically searched for all SRs of CHM that were published up to 31 December 2017. The primary analysis was to assess their reporting quality based on 27-item of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) and 9-item of CHM-related information designed according to TCM theory. Descriptive statistics were additionally used to analyze their baseline characteristics.

Results

A total of 109 Cochrane SRs of CHM were identified from 1999 to 2017. For 27-item of PRISMA, 26 had the reporting compliances higher than 50%, of which 11 were fully reporting (100%). However, for CHM-related information, 65 (59.6%) SRs did not report the specific name of the CHM in the title, 42 (38.5%) lacked TCM-related rationales in the introduction, 62 (56.9%) did not include CHM-related characteristics in the additional analyses, and 77 (70.6%) did not analyze CHM results in terms of TCM-related theories in the discussion. Of 97 SRs that included clinical trials, 38 (39.2%) did not provide the details of composition and dosage of CHMs, 85 (87.6%) did not report the CHM sources, 13 (13.4%) did not provide the dosage form, 95 (97.9%) lacked CHM quality control information, and 57 (58.8%) did not describe details of the controls. For 62 (72.9%) of 85 SRs that included meta-analysis, it was impossible to assess whether meta-analysis had been properly conducted due to inadequate reporting of CHM interventions.

Conclusion

Although the Cochrane SRs of CHM showed reporting compliance with PRISMA checklist, their reporting quality needs improvement, especially about full reporting of CHM interventions and of TCM-related rationales. Reporting guideline of "PRISMA extension for CHM interventions" should be developed thus to improve their quality.

SUBMITTER: Zhang X

PROVIDER: S-EPMC6892158 | biostudies-literature | 2019 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reporting quality of Cochrane systematic reviews with Chinese herbal medicines.

Zhang Xuan X Aixinjueluo Qi-Ying QY Li Si-Yao SY Song Lisa-L LL Lau Chung-Tai CT Tan Ran R Bian Zhao-Xiang ZX

Systematic reviews 20191203 1

<h4>Background</h4>Chinese herbal medicines (CHMs) are the major interventions of traditional Chinese medicine (TCM), which are typically administered as either single herbs or formulas. The Cochrane systematic reviews (SRs) of CHMs are essential references for evaluating the efficacy and safety of CHMs interventions; they are expected to be accurate and reliable. This study aimed to assess the reporting quality of these SRs, particularly whether necessary information related to CHM was adequate ...[more]

PMID: 31796121

Similar Datasets

Project description:BackgroundMoxibustion is one of the major interventions of Chinese medicine (CM). The systematic reviews (SRs) are essential references for evaluating the efficacy and safety of moxibustion interventions. This study aimed to assess the reporting quality of these SRs, particularly whether necessary information related to moxibustion was adequately reported.MethodsSeven databases (including four English and three Chinese databases) were systematically searched for SRs of moxibustion that were published up to 31 December 2019. The primary analysis was to assess their reporting quality based on 27-item of the Preferred Reporting Items for SRs and Meta-Analyses (PRISMA) and 14-item of moxibustion-related information designed according to CM theory and the STandards for Reporting Interventions in Clinical Trials Of Moxibustion (STRICTOM). Descriptive statistics were also used to analyze their baseline characteristics.ResultsA total of 97 SRs of moxibustion were identified from 2011 to 2019. For 27-item of PRISMA, except item 5, 8, 16 and 23, the remaining 23 items had the reporting compliances higher than 55%, of which 2 items (item 20 and 26) were fully reporting (100%). However, for moxibustion-related information, 69.1% (67/97) SRs did not provide the specific type of moxibustion, 39.2% (38/97) lacked details regarding the materials, procedure and technique used for moxibustion, 67.0% (65/97) did not report the selection criteria of acupoints for moxibustion, 28.9% (28/97) did not provide the number or duration of treatment sessions, 69.1% (67/97) did not provide any information about safety evaluation, and 94.8% (92/97) SRs did not report the treatment environment. For 51 (55.4%) of 92 SRs that included meta-analysis, it was impossible to assess whether meta-analysis had been properly conducted due to inadequate reporting of moxibustion interventions.ConclusionThe reporting quality of SRs of moxibustion need further improvements in terms of adequate reporting of moxibustion interventions and of moxibustion-related rationales. Reporting guideline of "PRISMA extension for moxibustion interventions" should be developed thus to improve their quality.

Project description:High-quality reporting of treatment details can aid replication of study results in real-world clinical practice. The Standards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA) is a reporting guideline for key elements of acupuncture interventions in clinical trials. This study used STRICTA to investigate whether Cochrane reviews of acupuncture adequately report important treatment details.Systematic reviewCochrane reviews of acupuncture were identified from The Cochrane Library (issue 7, 2012). Randomised controlled trials (RCTs) included in the reviews and published after 2005 were obtained. Using STRICTA, we extracted acupuncture-related information from the Cochrane reviews and the RCTs. The characteristics of the included studies' table were the major source of intervention information from Cochrane reviews. Reporting quality of acupuncture interventions in Cochrane reviews was assessed and compared with the respective RCTs.25 Cochrane reviews of acupuncture and 92 RCTs met the selection criteria. Cochrane reviews were 16% less likely to report the acupuncture-related items of STRICTA than RCTs (risk ratio 0.84, 95% CI 0.79 to 0.88, I(2)=8%). Information was significantly better reported for 10 of the 15 treatment-group items of STRICTA in RCTs than in Cochrane reviews (p<0.05), while four items did so without statistical significance. One item related to practitioner background was significantly better reported in Cochrane reviews.Reporting quality of treatment details in Cochrane reviews of acupuncture was insufficient with regard to STRICTA, even though such information was readily reported in RCTs. The overall quality of reporting of the RCTs, while better than the reviews, was also often suboptimal. Use of STRICTA guideline during the review process is recommended to adequately report the key treatment components in Cochrane reviews of acupuncture. The potential impact of STRICTA to the replicability and utilisation of reviews in future research and practice needs to be investigated.

Project description:BackgroundPrevious research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews.MethodsWe included systematic reviews of health interventions in humans published in English. We analysed 75 Cochrane reviews from May and June 2020 and a random sample of non-Cochrane reviews published in the same period and retrieved from Medline. We linked reviews with protocols and study registrations. We collected information on preparing, piloting, and performing data extraction and on use of software to assist review conduct (automation tools). Data were extracted by one author, with 20% extracted in duplicate. Data were analysed descriptively.ResultsOf the 152 included reviews, 77 reported use of a standardized extraction form (51%); 42 provided information on the type of form used (28%); 24 on piloting (16%); 58 on what data was collected (38%); 133 on the extraction method (88%); 107 on resolving disagreements (70%); 103 on methods to obtain additional data or information (68%); 52 on procedures to avoid data errors (34%); and 47 on methods to deal with multiple study reports (31%). Items were more frequently reported in Cochrane than non-Cochrane reviews. The data extraction form used was published in 10 reviews (7%). Use of software was rarely reported except for statistical analysis software and use of RevMan and GRADEpro GDT in Cochrane reviews. Covidence was the most frequent automation tool used: 18 reviews used it for study selection (12%) and 9 for data extraction (6%).ConclusionsReporting of data extraction methods in systematic reviews is limited, especially in non-Cochrane reviews. This includes core items of data extraction such as methods used to manage disagreements. Few reviews currently use software to assist data extraction and review conduct. Our results can serve as a baseline to assess the uptake of such tools in future analyses.

Dataset Information

Reporting quality of Cochrane systematic reviews with Chinese herbal medicines.

Background

Methods

Results

Conclusion

Publications

Reporting quality of Cochrane systematic reviews with Chinese herbal medicines.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets