Dataset Information

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.

ABSTRACT:

Objective

Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality.

Background

Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) measurement tool was designed to appraise methodology. The paediatric surgical literature has seen an increasing number of reviews over the past decade, but quality has not been evaluated.

Methods

Adhering to PRISMA guidelines, we performed a systematic review with a priori design to identify systematic reviews and meta-analyses of interventions in paediatric surgery. From 01/2010 to 06/2016, we searched: MEDLINE, EMBASE, Cochrane, Centre for Reviews and Dissemination, Web of Science, Google Scholar, reference lists and journals. Two reviewers independently selected studies and extracted data. We assessed conduct and reporting using AMSTAR and PRISMA. Scores were calculated as the sum of reported items. We also extracted author, journal and article characteristics, and used them in exploratory analysis to determine which variables predict quality.

Results

112 articles fulfilled eligibility criteria (53 systematic reviews; 59 meta-analyses). Overall, 68% AMSTAR and 56.8% PRISMA items were reported adequately. Poorest scores were identified with regards a priori design, inclusion of structured summaries, including the grey literature, citing excluded articles and evaluating bias. 13 reviews were pre-registered and 6 in PRISMA-endorsing journals. The following predicted quality in univariate analysis:, word count, Cochrane review, journal h-index, impact factor, journal endorses PRISMA, PRISMA adherence suggested in author guidance, article mentions PRISMA, review includes comparison of interventions and review registration. The latter three variables were significant in multivariate regression.

Conclusions

There are gaps in the conduct and reporting of systematic reviews in paediatric surgery. More endorsement by journals of the PRISMA guideline may improve review quality, and the dissemination of reliable evidence to paediatric clinicians.

SUBMITTER: Cullis PS

PROVIDER: S-EPMC5383307 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.

Cullis Paul Stephen PS Gudlaugsdottir Katrin K Andrews James J

PloS one 20170406 4

<h4>Objective</h4>Our objective was to evaluate quality of conduct and reporting of published systematic reviews and meta-analyses in paediatric surgery. We also aimed to identify characteristics predictive of review quality.<h4>Background</h4>Systematic reviews summarise evidence by combining sources, but are potentially prone to bias. To counter this, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was published to aid in reporting. Similarly, the Assessing the ...[more]

PMID: 28384296

Similar Datasets

Project description:BackgroundThe QUOROM and PRISMA statements were published in 1999 and 2009, respectively, to improve the consistency of reporting systematic reviews (SRs)/meta-analyses (MAs) of clinical trials. However, not all SRs/MAs adhere completely to these important standards. In particular, it is not clear how well SRs/MAs of acupuncture studies adhere to reporting standards and which reporting criteria are generally ignored in these analyses.ObjectivesTo evaluate reporting quality in SRs/MAs of acupuncture studies.MethodsWe performed a literature search for studies published prior to 2014 using the following public archives: PubMed, EMBASE, Web of Science, the Cochrane Database of Systematic Reviews (CDSR), the Chinese Biomedical Literature Database (CBM), the Traditional Chinese Medicine (TCM) database, the Chinese Journal Full-text Database (CJFD), the Chinese Scientific Journal Full-text Database (CSJD), and the Wanfang database. Data were extracted into pre-prepared Excel data-extraction forms. Reporting quality was assessed based on the PRISMA checklist (27 items).ResultsOf 476 appropriate SRs/MAs identified in our search, 203, 227, and 46 were published in Chinese journals, international journals, and the Cochrane Database, respectively. In 476 SRs/MAs, only 3 reported the information completely. By contrast, approximately 4.93% (1/203), 8.81% (2/227) and 0.00% (0/46) SRs/Mas reported less than 10 items in Chinese journals, international journals and CDSR, respectively. In general, the least frequently reported items (reported≤50%) in SRs/MAs were "protocol and registration", "risk of bias across studies", and "additional analyses" in both methods and results sections.ConclusionsSRs/MAs of acupuncture studies have not comprehensively reported information recommended in the PRISMA statement. Our study underscores that, in addition to focusing on careful study design and performance, attention should be paid to comprehensive reporting standards in SRs/MAs on acupuncture studies.

Project description:ObjectivesTo examine the quality of reporting of harms in systematic reviews, and to determine the need for a reporting guideline specific for reviews of harms.DesignSystematic review.Data sourcesCochrane Database of Systematic Reviews (CDSR) and Database of Abstracts of Reviews of Effects (DARE).Review methodsDatabases were searched for systematic reviews having an adverse event as the main outcome, published from January 2008 to April 2011. Adverse events included an adverse reaction, harms, or complications associated with any healthcare intervention. Articles with a primary aim to investigate the complete safety profile of an intervention were also included. We developed a list of 37 items to measure the quality of reporting on harms in each review; data were collected as dichotomous outcomes ("yes" or "no" for each item).ResultsOf 4644 reviews identified, 309 were systematic reviews or meta-analyses primarily assessing harms (13 from CDSR; 296 from DARE). Despite a short time interval, the comparison between the years of 2008 and 2010-11 showed no difference on the quality of reporting over time (P=0.079). Titles in fewer than half the reviews (proportion of reviews 0.46 (95% confidence interval 0.40 to 0.52)) did not mention any harm related terms. Almost one third of DARE reviews (0.26 (0.22 to 0.31)) did not clearly define the adverse events reviewed, nor did they specify the study designs selected for inclusion in their methods section. Almost half of reviews (n=170) did not consider patient risk factors or length of follow-up when reviewing harms of an intervention. Of 67 reviews of complications related to surgery or other procedures, only four (0.05 (0.01 to 0.14)) reported professional qualifications of the individuals involved. The overall, unweighted, proportion of reviews with good reporting was 0.56 (0.55 to 0.57); corresponding proportions were 0.55 (0.53 to 0.57) in 2008, 0.55 (0.54 to 0.57) in 2009, and 0.57 (0.55 to 0.58) in 2010-11.ConclusionSystematic reviews compound the poor reporting of harms data in primary studies by failing to report on harms or doing so inadequately. Improving reporting of adverse events in systematic reviews is an important step towards a balanced assessment of an intervention.

Project description:BackgroundDose-response meta-analysis (DRMA) is a useful tool to investigate potential dose-response relationship between certain exposure or intervention and the outcome of interest. A large number of DRMAs have been published in the past several years. However, the standard of reporting for such studies is not known.MethodsMedline, Embase, and Wiley Library were searched for systematic reviews with DRMAs (SR-DRMAs) published from January 2011 to July 2017. We used the combination of PRISMA and MOOSE statements, containing 33 items, to assess the reporting of included SR-DRMAs. The adherence of reporting was defined as the proportion of SR-DRMAs meeting the reporting requirement of an item. We explored the association between five pre-specified variables with the total score of reporting on both fully as well as each domain of the checklist.ResultsIn total, 529 SR-DRMAs were eligible. Ten out of 33 items were under reported, and this mainly refers to the methods domain: only a small proportion of SR-DRMAs stated whether a review protocol existed (45, 8.5%); clarified the qualifications of searchers (1.7%); presented full electronic search strategy (25.9%); described any effort to include all available studies (22.9%), described methods for languages other than English (27.4%), and stated the process for selecting studies (20.2%). Multiple regression analysis suggested that studies with more authors (regression coefficient = 0.78; 95% CI: 0.35, 1.20; P < 0.001), published more recently (regression coefficient = 0.38; 95% CI: 0.28 to 0.47; trend P < 0.001), used reporting guideline (regression coefficient = 0.98; 95% CI: 0.68 to 1.32; P < 0.001), and involvement of methodologist (regression coefficient = 0.86; 95% CI: 0.42 to 1.32; P < 0.001) were associated with higher score of reporting. Further regression suggested that the improvement on the quality mainly concentrated on the methods and results domains.ConclusionsThe reporting of SR-DRMAs needs to be further improved, particularly in the issues refer to the methods. The quality of reporting may improve when involving more authors and methodologists and employing any reporting guidelines.

Project description:BackgroundSurvival analyses methods (SAMs) are central to analysing time-to-event outcomes. Appropriate application and reporting of such methods are important to ensure correct interpretation of the data. In this study, we systematically review the application and reporting of SAMs in studies of tuberculosis (TB) patients in Africa. It is the first review to assess the application and reporting of SAMs in this context.MethodsSystematic review of studies involving TB patients from Africa published between January 2010 and April 2020 in English language. Studies were eligible if they reported use of SAMs. Application and reporting of SAMs were evaluated based on seven author-defined criteria.ResultsSeventy-six studies were included with patient numbers ranging from 56 to 182,890. Forty-three (57%) studies involved a statistician/epidemiologist. The number of published papers per year applying SAMs increased from two in 2010 to 18 in 2019 (P = 0.004). Sample size estimation was not reported by 67 (88%) studies. A total of 22 (29%) studies did not report summary follow-up time. The survival function was commonly presented using Kaplan-Meier survival curves (n = 51, (67%) studies) and group comparisons were performed using log-rank tests (n = 44, (58%) studies). Sixty seven (91%), 3 (4.1%) and 4 (5.4%) studies reported Cox proportional hazard, competing risk and parametric survival regression models, respectively. A total of 37 (49%) studies had hierarchical clustering, of which 28 (76%) did not adjust for the clustering in the analysis. Reporting was adequate among 4.0, 1.3 and 6.6% studies for sample size estimation, plotting of survival curves and test of survival regression underlying assumptions, respectively. Forty-five (59%), 52 (68%) and 73 (96%) studies adequately reported comparison of survival curves, follow-up time and measures of effect, respectively.ConclusionThe quality of reporting survival analyses remains inadequate despite its increasing application. Because similar reporting deficiencies may be common in other diseases in low- and middle-income countries, reporting guidelines, additional training, and more capacity building are needed along with more vigilance by reviewers and journal editors.

Dataset Information

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.

Objective

Background

Methods

Results

Conclusions

Publications

A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets