Dataset Information

Reporting of results from network meta-analyses: methodological systematic review.

ABSTRACT:

Objective

To examine how the results of network meta-analyses are reported.

Design

Methodological systematic review of published reports of network meta-analyses.

Data sources

Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, Medline, and Embase, searched from inception to 12 July 2012.

Study selection

All network meta-analyses comparing the clinical efficacy of three or more interventions in randomised controlled trials were included, excluding meta-analyses with an open loop network of three interventions.

Data extraction and synthesis

The reporting of the network and results was assessed. A composite outcome included the description of the network (number of interventions, direct comparisons, and randomised controlled trials and patients for each comparison) and the reporting of effect sizes derived from direct evidence, indirect evidence, and the network meta-analysis.

Results

121 network meta-analyses (55 published in general journals; 48 funded by at least one private source) were included. The network and its geometry (network graph) were not reported in 100 (83%) articles. The effect sizes derived from direct evidence, indirect evidence, and the network meta-analysis were not reported in 48 (40%), 108 (89%), and 43 (36%) articles, respectively. In 52 reports that ranked interventions, 43 did not report the uncertainty in ranking. Overall, 119 (98%) reports of network meta-analyses did not give a description of the network or effect sizes from direct evidence, indirect evidence, and the network meta-analysis. This finding did not differ by journal type or funding source.

Conclusions

The results of network meta-analyses are heterogeneously reported. Development of reporting guidelines to assist authors in writing and readers in critically appraising reports of network meta-analyses is timely.

SUBMITTER: Bafeta A

PROVIDER: S-EPMC3949412 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo examine whether network meta-analyses, increasingly used to assess comparative effectiveness of healthcare interventions, follow the key methodological recommendations for reporting and conduct of systematic reviews.DesignMethodological systematic review of reports of network meta-analyses.Data sourcesCochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, Medline, and Embase, searched from inception to 12 July 2012.Review methodsAll network meta-analyses comparing clinical efficacy of three or more interventions based on randomised controlled trials, excluding meta-analyses with an open loop network of three interventions. We assessed the reporting of general characteristics and key methodological components of the systematic review process using two composite outcomes. For some components, if reporting was adequate, we assessed their conduct quality.ResultsOf 121 network meta-analyses covering a wide range of medical areas, 100 (83%) assessed pharmacological interventions and 11 (9%) non-pharmacological interventions; 56 (46%) were published in journals with a high impact factor. The electronic search strategy for each database was not reported in 88 (73%) network meta-analyses; for 36 (30%), the primary outcome was not clearly identified. Overall, 61 (50%) network meta-analyses did not report any information regarding the assessment of risk of bias of individual studies, and 103 (85%) did not report any methods to assess the likelihood of publication bias. Overall, 87 (72%) network meta-analyses did not report the literature search, searched only one database, did not search other sources, or did not report an assessment of risk of bias of individual studies. These methodological components did not differ by publication in a general or specialty journal or by public or private funding.ConclusionsEssential methodological components of the systematic review process-conducting a literature search and assessing risk of bias of individual studies-are frequently lacking in reports of network meta-analyses, even when published in journals with high impact factors.

Project description:BACKGROUND:Syntheses of qualitative studies can inform health policy, services and our understanding of patient experience. Meta-ethnography is a systematic seven-phase interpretive qualitative synthesis approach well-suited to producing new theories and conceptual models. However, there are concerns about the quality of meta-ethnography reporting, particularly the analysis and synthesis processes. Our aim was to investigate the application and reporting of methods in recent meta-ethnography journal papers, focusing on the analysis and synthesis process and output. METHODS:Methodological systematic review of health-related meta-ethnography journal papers published from 2012-2013. We searched six electronic databases, Google Scholar and Zetoc for papers using key terms including 'meta-ethnography.' Two authors independently screened papers by title and abstract with 100% agreement. We identified 32 relevant papers. Three authors independently extracted data and all authors analysed the application and reporting of methods using content analysis. RESULTS:Meta-ethnography was applied in diverse ways, sometimes inappropriately. In 13% of papers the approach did not suit the research aim. In 66% of papers reviewers did not follow the principles of meta-ethnography. The analytical and synthesis processes were poorly reported overall. In only 31% of papers reviewers clearly described how they analysed conceptual data from primary studies (phase 5, 'translation' of studies) and in only one paper (3%) reviewers explicitly described how they conducted the analytic synthesis process (phase 6). In 38% of papers we could not ascertain if reviewers had achieved any new interpretation of primary studies. In over 30% of papers seminal methodological texts which could have informed methods were not cited. CONCLUSIONS:We believe this is the first in-depth methodological systematic review of meta-ethnography conduct and reporting. Meta-ethnography is an evolving approach. Current reporting of methods, analysis and synthesis lacks clarity and comprehensiveness. This is a major barrier to use of meta-ethnography findings that could contribute significantly to the evidence base because it makes judging their rigour and credibility difficult. To realise the high potential value of meta-ethnography for enhancing health care and understanding patient experience requires reporting that clearly conveys the methodology, analysis and findings. Tailored meta-ethnography reporting guidelines, developed through expert consensus, could improve reporting.

Project description:BackgroundEvidence has shown that private industry-sponsored randomized controlled trials (RCTs) and meta-analyses are more likely to report intervention-favourable results compared with other sources of funding. However, this has not been assessed in network meta-analyses (NMAs).ObjectivesTo (a) explore the recommendation rate of industry-sponsored NMAs on their company's intervention, and (b) assess reporting in NMAs of pharmacologic interventions according to their funding type.MethodsDesign: Scoping review of published NMAs with RCTs.Information sourcesWe used a pre-existing NMA database including 1,144 articles from MEDLINE, EMBASE and Cochrane Database of Systematic Reviews, published between January 2013 and July 2018.Study selectionNMAs with transparent funding information and comparing pharmacologic interventions with/without placebo.SynthesisWe captured whether NMAs recommended their own or another company's intervention, classified NMAs according to their primary outcome findings (i.e., statistical significance and direction of effect), and according to the overall reported conclusion. We assessed reporting using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension to NMA (PRISMA-NMA) 32-item checklist. We matched and compared industry with non-industry NMAs having the same research question, disease, primary outcome, and pharmacologic intervention against placebo/control.ResultsWe retrieved 658 NMAs, which reported a median of 23 items in the PRISMA-NMA checklist (interquartile range [IQR]: 21-26). NMAs were categorized as 314 publicly-sponsored (PRISMA-NMA median 24.5, IQR 22-27), 208 non-sponsored (PRISMA-NMA median 23, IQR 20-25), and 136 industry/mixed-sponsored NMAs (PRISMA-NMA median 21, IQR 19-24). Most industry-sponsored NMAs recommended their own manufactured drug (92%), suggested a statistically significant positive treatment-effect for their drug (82%), and reported an overall positive conclusion (92%). Our matched NMAs (25 industry vs 25 non-industry) indicated that industry-sponsored NMAs had favourable conclusions more often (100% vs 80%) and were associated with larger (but not statistically significantly different) efficacy effect sizes (in 61% of NMAs) compared with non-industry-sponsored NMAs.ConclusionsDifferences in completeness of reporting and author characteristics were apparent among NMAs with different types of funding. Publicly-sponsored NMAs had the best reporting and published their findings in higher impact-factor journals. Knowledge users should be mindful of this potential funding bias in NMAs.