Meta-analysis and The Cochrane Collaboration: 20 years of the Cochrane Statistical Methods Group.
Ontology highlight
ABSTRACT:
SUBMITTER: McKenzie JE
PROVIDER: S-EPMC4219183 | biostudies-literature | 2013 Nov
REPOSITORIES: biostudies-literature
Publications
Meta-analysis and The Cochrane Collaboration: 20 years of the Cochrane Statistical Methods Group.
McKenzie Joanne E JE Salanti Georgia G Lewis Steff C SC Altman Douglas G DG
Systematic reviews 20131126
The Statistical Methods Group has played a pivotal role in The Cochrane Collaboration over the past 20 years. The Statistical Methods Group has determined the direction of statistical methods used within Cochrane reviews, developed guidance for these methods, provided training, and continued to discuss and consider new and controversial issues in meta-analysis. The contribution of Statistical Methods Group members to the meta-analysis literature has been extensive and has helped to shape the wid ...[more]
Similar Datasets
Project description:This review is an abridged version of a Cochrane Review previously published in the Cochrane Database of Systematic Reviews 2010, Issue 4, Art. No.: MR000013 DOI: 10.1002/14651858.MR000013.pub5 (see www.thecochranelibrary.com for information). Cochrane Reviews are regularly updated as new evidence emerges and in response to feedback, and Cochrane Database of Systematic Reviews should be consulted for the most recent version of the review. To identify interventions designed to improve recruitment to randomised controlled trials, and to quantify their effect on trial participation. Systematic review. The Cochrane Methodology Review Group Specialised Register in the Cochrane Library, MEDLINE, EMBASE, ERIC, Science Citation Index, Social Sciences Citation Index, C2-SPECTR, the National Research Register and PubMed. Most searches were undertaken up to 2010; no language restrictions were applied. Randomised and quasi-randomised controlled trials, including those recruiting to hypothetical studies. Studies on retention strategies, examining ways to increase questionnaire response or evaluating the use of incentives for clinicians were excluded. The study population included any potential trial participant (eg, patient, clinician and member of the public), or individual or group of individuals responsible for trial recruitment (eg, clinicians, researchers and recruitment sites). Two authors independently screened identified studies for eligibility. 45 trials with over 43 000 participants were included. Some interventions were effective in increasing recruitment: telephone reminders to non-respondents (risk ratio (RR) 1.66, 95% CI 1.03 to 2.46; two studies, 1058 participants), use of opt-out rather than opt-in procedures for contacting potential participants (RR 1.39, 95% CI 1.06 to 1.84; one study, 152 participants) and open designs where participants know which treatment they are receiving in the trial (RR 1.22, 95% CI 1.09 to 1.36; two studies, 4833 participants). However, the effect of many other strategies is less clear, including the use of video to provide trial information and interventions aimed at recruiters. There are promising strategies for increasing recruitment to trials, but some methods, such as open-trial designs and opt-out strategies, must be considered carefully as their use may also present methodological or ethical challenges. Questions remain as to the applicability of results originating from hypothetical trials, including those relating to the use of monetary incentives, and there is a clear knowledge gap with regard to effective strategies aimed at recruiters.
| S-EPMC3586125 | biostudies-literature
Project description:BackgroundBudesonide is an oral glucocorticoid designed for the treatment of inflammatory bowel disease (IBD) that may reduce systemic adverse events (AEs). This review examined the efficacy and safety of budesonide for the induction and maintenance of clinical remission in Crohn's disease (CD).MethodsMEDLINE, EMBASE, other electronic databases, reference lists and conference proceedings were searched to November 2017 to identify randomized controlled trials of budesonide. Outcomes were the induction and maintenance of remission at eight weeks and one year, respectively, as well as corticosteroid-related AEs and abnormal adrenocorticotropic hormone (ACTH) tests. Pooled relative risks (RRs) and 95% confidence intervals (CIs) were estimated using random effects models.ResultsThirteen induction and 10 maintenance trials were included. Budesonide 9 mg/day was more effective than placebo (RR 1.93; 95% CI, 1.37-2.73; GRADE: moderate) but less effective than conventional steroids (RR 0.85; 95% CI, 0.75-0.97; GRADE: moderate) to induce remission. Corticosteroid-related AEs occurred less often with induction doses of budesonide than steroids (RR 0.64; 95% CI, 0.54-0.76; GRADE: moderate); budesonide did not increase AEs relative to placebo (RR 0.97; 95% CI, 0.76-1.23; GRADE: moderate). Budesonide 6 mg/day was not different from placebo for maintaining remission (RR 1.13; 95% CI, 0.94-1.35; GRADE: moderate). Both induction (GRADE: low for 3 mg/day, moderate for 9 mg/day) and maintenance budesonide treatment (GRADE: very low for 3 mg/day, low for 6 mg/day) increased the risk of an abnormal ACTH test compared with placebo, but less than conventional steroids (GRADE: very low for both induction and maintenance).ConclusionFor induction of clinical remission, budesonide was more effective than placebo, but less effective than conventional steroids. Budesonide was not effective for the maintenance of remission. Budesonide was safer than conventional steroids, but the long-term effects on the adrenal axis and bone health remain unknown.
| S-EPMC6328928 | biostudies-literature
Project description:ObjectivesTo develop methods guidance to support the conduct of rapid reviews (RRs) produced within Cochrane and beyond, in response to requests for timely evidence syntheses for decision-making purposes including urgent health issues of high priority.Study design and settingInterim recommendations were informed by a scoping review of the underlying evidence, primary methods studies conducted, and a survey sent to 119 representatives from 20 Cochrane entities, who were asked to rate and rank RR methods across stages of review conduct. Discussions among those with expertise in RR methods further informed the list of recommendations with accompanying rationales provided.ResultsBased on survey results from 63 respondents (53% response rate), 26 RR methods recommendations are presented for which there was a high or moderate level of agreement or scored highest in the absence of such agreement. Where possible, how recommendations align with Cochrane methods guidance for systematic reviews is highlighted.ConclusionThe Cochrane Rapid Reviews Methods Group offers new, interim guidance to support the conduct of RRs. Because best practice is limited by the lack of currently available evidence for some RR methods shortcuts taken, this guidance will need to be updated as additional abbreviated methods are evaluated.
| S-EPMC7557165 | biostudies-literature
Project description:BackgroundHIV is increasingly considered a chronic illness. More individuals are living longer and aging with the health-related consequences associated with HIV and multi-morbidity. Exercise is a self-management approach that can promote health for people aging with HIV. We examined the safety and effectiveness of progressive resistive exercise (PRE) interventions on immunological, virological, cardiorespiratory, strength, weight, body composition, and psychological outcomes in adults living with HIV.MethodsWe conducted a systematic review using the Cochrane Collaboration protocol. Searching databases up to April 2013, we included randomized controlled trials that compared PRE with no exercise or another intervention performed at least three times per week for at least four weeks with adults living with HIV. Two reviewers independently determined study eligibility. We extracted data from included studies and assessed risk of bias using the Cochrane Collaboration risk of bias tool. Meta-analyses were conducted using random effects models with Review Manager (RevMan) computer software.ResultsTwenty studies met inclusion criteria (n = 764 participants at study completion); the majority of participants were men (77%) taking antiretroviral therapy (14/20 included studies). Exercise interventions included PRE alone (8 studies) or a combination of resistive and aerobic exercise (12 studies) ranging from 6 to 52 weeks in duration. Thirty-four meta-analyses were performed. Results demonstrated statistically significant improvements in cardiorespiratory status (maximum oxygen consumption, exercise time), strength (chest press, knee flexion), weight, and body composition (arm and thigh girth, leg muscle area) among exercisers versus non-exercisers. We found no significant differences in change in CD4 count and viral load. We were unable to perform meta-analyses for psychological outcomes however results from individual studies demonstrated improvements in health-related quality of life with exercisers compared with non-exercisers.ConclusionsPerforming progressive resistive exercise (PRE) or a combination of resistive and aerobic exercise at least three times per week for at least six weeks is safe and can lead to improvements in cardiorespiratory fitness, strength, weight, and body composition for adults with HIV. Exercise may be considered a safe and beneficial for enhancing the health of medically stable adults aging with HIV.
| S-EPMC5389006 | biostudies-literature
Project description:There is heightened interest in using next-generation sequencing technologies to identify rare variants that influence complex human diseases and traits. Meta-analysis is essential to this endeavor because large sample sizes are required for detecting associations with rare variants. In this article, we provide a comprehensive overview of statistical methods for meta-analysis of sequencing studies for discovering rare-variant associations. Specifically, we discuss the calculation of relevant summary statistics from participating studies, the construction of gene-level association tests, the choice of transformation for quantitative traits, the use of fixed-effects versus random-effects models, and the removal of shadow association signals through conditional analysis. We also show that meta-analysis based on properly calculated summary statistics is as powerful as joint analysis of individual-participant data. In addition, we demonstrate the performance of different meta-analysis methods by using both simulated and empirical data. We then compare four major software packages for meta-analysis of rare-variant associations-MASS, RAREMETAL, MetaSKAT, and seqMeta-in terms of the underlying statistical methodology, analysis pipeline, and software interface. Finally, we present PreMeta, a software interface that integrates the four meta-analysis packages and allows a consortium to combine otherwise incompatible summary statistics.
| S-EPMC4571037 | biostudies-literature
Project description:The Cochrane Collaboration, an international not-for-profit organization that prepares and maintains systematic reviews of randomized trials of health care therapies, has produced reviews summarizing much of the evidence on Traditional Chinese Medicine (TCM). Our objective was to review the evidence base according to Cochrane systematic reviews.In order to detect reviews focusing on TCM, we searched the titles and abstracts of all reviews in Issue 4, 2008 of the Cochrane Database of Systematic Reviews. For each review, we extracted data on the number of trials included and the total number of participants. We provided an indication of the strength of the review findings by assessing the reviewers' abstract conclusions statement. We supplemented our assessment of the abstract conclusions statements with a listing of the comparisons and outcomes showing statistically significant meta-analyses results.We identified 70 Cochrane systematic reviews of TCM, primarily acupuncture (n = 26) and Chinese herbal medicine (n = 42), and 1 each of moxibustion and t'ai chi. Nineteen (19) of 26 acupuncture reviews and 22/42 herbal medicine reviews concluded that there was not enough good quality trial evidence to make any conclusion about the efficacy of the evaluated treatment, while the remaining 7 acupuncture and 20 herbal medicine reviews and each of the moxibustion and t'ai chi reviews indicated a suggestion of benefit, which was qualified by a caveat about the poor quality and quantity of studies. Most reviews included many distinct interventions, controls, outcomes, and populations, and a large number of different comparisons were made, each with a distinct forest plot.Most Cochrane systematic reviews of TCM are inconclusive, due specifically to the poor methodology and heterogeneity of the studies reviewed. Some systematic reviews provide preliminary evidence of Chinese medicine's benefits to certain patient populations, underscoring the importance and appropriateness of further research. These preliminary findings should be considered tentative and need to be confirmed with rigorous randomized controlled trials.
| S-EPMC2856612 | biostudies-other
Project description:Meta-analyses conducted via the Cochrane Collaboration adhere to strict methodological and reporting standards aiming to minimize bias, maximize transparency/reproducibility, and improve the accuracy of summarized data. Whether this results in differences in the results reported by meta-analyses on the same topic conducted outside the Cochrane Collaboration is an open question.We conducted a matched-pair analysis with individual meta-analyses as the unit of analysis, comparing Cochrane and non-Cochrane reviews. Using meta-analyses from the cardiovascular literature, we identified pairs that matched on intervention and outcome. The pairs were contrasted in terms of how frequently results disagreed between the Cochrane and non-Cochrane reviews, whether effect sizes and statistical precision differed systematically, and how these differences related to the frequency of secondary citations of those reviews.Our search yielded 40 matched pairs of reviews. The two sets were similar in terms of which was first to publication, how many studies were included, and average sample sizes. The paired reviews included a total of 344 individual clinical trials: 111 (32.3%) studies were included only in a Cochrane review, 104 (30.2%) only in a non-Cochrane review, and 129 (37.5%) in both. Stated another way, 62.5% of studies were only included in one or the other meta-analytic literature. Overall, 37.5% of pairs had discrepant results. The most common involved shifts in the width of 95% confidence intervals that would yield a different statistical interpretation of the significance of results (7 pairs). Additionally, 20% differed in the direction of the summary effect size (5 pairs) or reported greater than a 2-fold difference in its magnitude (3 pairs). Non-Cochrane reviews reported significantly higher effect sizes (P< 0.001) and lower precision (P<0.001) than matched Cochrane reviews. Reviews reporting an effect size at least 2-fold greater than their matched pair were cited more frequently.Though results between topic-matched Cochrane and non-Cochrane reviews were quite similar, discrepant results were frequent, and the overlap of included studies was surprisingly low. Non-Cochrane reviews report larger effect sizes with lower precision than Cochrane reviews, indicating systematic differences, likely reflective of methodology, between the two types of reviews that could generate different interpretations of the interventions under question.
| S-EPMC4686011 | biostudies-literature
Project description:Behavioral ecologists frequently use observational methods, such as instantaneous scan sampling, to record the behavior of animals at discrete moments in time. We develop and apply multilevel, multinomial logistic regression models for analyzing such data. These statistical methods correspond to the multinomial character of the response variable while also accounting for the repeated observations of individuals that characterize behavioral datasets. Correlated random effects potentially reveal individual-level trade-offs across behaviors, allowing for models that reveal the extent to which individuals who regularly engage in one behavior also exhibit relatively more or less of another behavior. Using an example dataset, we demonstrate the estimation of these models using Hamiltonian Monte Carlo algorithms, as implemented in the RStan package in the R statistical environment. The supplemental files include a coding script and data that demonstrate auxiliary functions to prepare the data, estimate the models, summarize the posterior samples, and generate figures that display model predictions. We discuss possible extensions to our approach, including models with random slopes to allow individual-level behavioral strategies to vary over time and the need for models that account for temporal autocorrelation. These models can potentially be applied to a broad class of statistical analyses by behavioral ecologists, focusing on other polytomous response variables, such as behavior, habitat choice, or emotional states.
| S-EPMC5594044 | biostudies-literature
Project description:Alterations in the composition of the gut microbiota are associated with a number of gastrointestinal (GI) conditions, including diarrhea, inflammatory bowel diseases (IBD), and liver diseases. Probiotics, live microorganisms that may confer a health benefit to the host when consumed, are commonly used as a therapy for treating these GI conditions by means of modifying the composition or activity of the microbiota. The purpose of this review was to summarize the evidence on probiotics and GI conditions available from Cochrane, a nonprofit organization that produces rigorous and high-quality systematic reviews of health interventions. Findings from this review will help provide more precise guidance for clinical use of probiotics and to identify gaps in probiotic research related to GI conditions.
| S-EPMC5683921 | biostudies-literature
Project description:BackgroundSerious preventable surgical events still occur despite considerable efforts to improve patient safety. In addition to learning from retrospective analyses, prospective risk-assessment methods may help to decrease preventable events further by targeting perioperative hazards. The aim of this systematic review was to assess the methods used to identify perioperative patient safety risks prospectively, and to describe the risk areas targeted, the quality characteristics and feasibility of methods.MethodsMEDLINE, Embase, CINAHL and Cochrane databases were searched, adhering to PRISMA guidelines. All studies describing the development and results of prospective methods to identify perioperative patient safety risks were included and assessed on methodological quality. Exclusion criteria were interventional studies, studies targeting one specific issue, studies reporting on structural factors relating to fundamental hospital items, and non-original or case studies.ResultsThe electronic search resulted in 16 708 publications, but only 20 were included for final analysis, describing five prospective risk-assessment methods. Direct observation was used in most studies, often in combination. Direct (16 studies) and indirect (4 studies) observations identified (potential) adverse events (P)AEs, process flow disruptions, poor protocol compliance and poor practice performance. (Modified) Healthcare Failure Mode and Effect Analysis (HFMEA™) (5 studies) targeted potential process flow disruption failures, and direct (P)AE surveillance (3 studies) identified (P)AEs prospectively. Questionnaires (3 studies) identified poor protocol compliance, surgical flow disturbances and patients' willingness to ask questions about their care. Overall, quality characteristics and feasibility of the methods were poorly reported.ConclusionThe direct (in-person) observation appears to be the primary prospective risk-assessment method that currently may best help to target perioperative hazards. This is a reliable method and covers a broad spectrum of perioperative risk areas.
| S-EPMC7093778 | biostudies-literature