Dataset Information

A descriptive analysis of child-relevant systematic reviews in the Cochrane Database of Systematic Reviews.

ABSTRACT: Systematic reviews (SRs) are considered an important tool for decision-making. There has been no recent comprehensive identification or description of child-relevant SRs. A description of existing child-relevant SRs would help to identify the extent of available child-relevant evidence available in SRs and gaps in the evidence base where SRs are required. The objective of this study was to describe child-relevant SRs from the Cochrane Database of Systematic Reviews (CDSR, Issue 2, 2009).SRs were assessed for relevance using pre-defined criteria. Data were extracted and entered into an electronic form. Univariate analyses were performed to describe the SRs overall and by topic area.The search yielded 1666 SRs; 793 met the inclusion criteria. 38% of SRs were last assessed as up-to-date prior to 2007. Corresponding authors were most often from the UK (41%). Most SRs (59%) examined pharmacological interventions. 53% had at least one external source of funding. SRs included a median of 7 studies (IQR 3, 15) and 679 participants (IQR 179, 2833). Of all studies, 48% included only children, and 27% only adults. 94% of studies were published in peer-reviewed journals. Primary outcomes were specified in 72% of SRs. Allocation concealment and the Jadad scale were used in 97% and 25% of SRs, respectively. Adults and children were analyzed separately in 12% of SRs and as a subgroup analysis in 14%. Publication bias was assessed in only 14% of SRs. A meta-analysis was conducted in 68% of SRs with a median of 5 trials (IQR 3, 9) each. Variations in these characteristics were observed across topic areas.We described the methodological characteristics and rigour of child-relevant reviews in the CDSR. Many SRs are not up-to-date according to Cochrane criteria. Our study describes variation in conduct and reporting across SRs and reveals clinicians' ability to access child-specific data.

SUBMITTER: Bow S

PROVIDER: S-EPMC2881081 | biostudies-other | 2010 May

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

A descriptive analysis of child-relevant systematic reviews in the Cochrane Database of Systematic Reviews.

Bow Simon S Klassen Jeffrey J Chisholm Annabritt A Tjosvold Lisa L Thomson Denise D Klassen Terry P TP Moher David D Hartling Lisa L

BMC pediatrics 20100520

<h4>Background</h4>Systematic reviews (SRs) are considered an important tool for decision-making. There has been no recent comprehensive identification or description of child-relevant SRs. A description of existing child-relevant SRs would help to identify the extent of available child-relevant evidence available in SRs and gaps in the evidence base where SRs are required. The objective of this study was to describe child-relevant SRs from the Cochrane Database of Systematic Reviews (CDSR, Issu ...[more]

PMID: 20487565

Similar Datasets

Project description:BACKGROUND:Consumers, clinicians, policymakers and researchers require high quality evidence to guide decision-making in child health. Though Cochrane systematic reviews (SRs) are a well-established source of evidence, little is known about the characteristics of non-Cochrane child-relevant SRs. To complement published descriptions of Cochrane SRs, we aimed to characterize the epidemiologic, methodological, and reporting qualities of non-Cochrane child-relevant SRs published in 2014. METHODS:English-language child-relevant SRs of quantitative primary research published outside the Cochrane Library in 2014 were eligible for this descriptive analysis. A research librarian searched MEDLINE, CINAHL, Web of Science, and PubMed in August 2015. A single reviewer screened articles for inclusion; a second verified the excluded studies. Reviewers extracted: general characteristics of the review; included study characteristics; methodological approaches. We performed univariate analyses and presented the findings narratively. RESULTS:We identified 1598 child-relevant SRs containing a median (IQR) 19 (11, 33) studies. These originated primarily from high-income countries (n?=?1247, 78.0%) and spanned 47 of the 53 Cochrane Review Groups. Most synthesized therapeutic (n?=?753, 47.1%) or epidemiologic (n?=?701, 43.8%) evidence. Though 39.3% (n?=?628) of SRs included evidence related to children only, few were published in pediatric-specific journals (n?=?283, 17.7%). Reporting quality seemed poor based on the items we assessed; few reviews mentioned an a-priori protocol (n?=?246, 15.4%) or registration (n?=?111, 6.9%), and only 23.4% (n?=?374) specified a primary outcome. Many SRs relied solely on evidence from non-RCTs (n?=?796, 49.8%). Less than two-thirds (n?=?953, 59.6%) appraised the quality of included studies and assessments of the certainty of the body of evidence were rare (n?=?102, 6.4%). CONCLUSIONS:Child-relevant Cochrane SRs are a known source of high quality evidence in pediatrics. There exists, however, an abundance of evidence from non-Cochrane SRs that may be complementary. Our findings show that high-quality non-Cochrane SRs may not be practical nor easy for knowledge users to find. Improvements are needed to ensure that evidence syntheses published outside of the Cochrane Library adhere to the high standard of conduct and reporting characteristic of Cochrane SRs.

Project description:BackgroundSystematic reviews support health systems and clinical decision-making by identifying and summarizing all existing studies on a particular topic. In 2009, a comprehensive description of child-relevant systematic reviews published in the Cochrane Database of Systematic Reviews was compiled. This study aims to provide an update, and to describe these systematic reviews according to their content and methodological approaches.MethodsAll child-relevant systematic reviews published by the Cochrane Collaboration in the Cochrane Database of Systematic Reviews (CDSR) as of March, 2013 were identified and described in relation to their content and methodological approaches. This step equated to an update of the Child Health Field Review Register (CHFRR). The content of the updated CHFRR was compared to the published 2009 CHFRR description regarding clinical and methodological characteristics, using bivariate analyses. As the Cochrane Collaboration has recognized that disease burden should guide research prioritization, we extracted data from the Global and National Burden of Diseases and Injuries Among Children and Adolescents Between 1990 and 2013 study in order to map the distribution of the burden of disease in child health to the distribution of evidence across Review Groups in the CHFRR.ResultsOf the 5,520 potential Cochrane systematic reviews identified, 1,293 (23.4%) were child-relevant (an increase of 24% since 2009). Overall, these reviews included 16,738 primary studies. The most commonly represented Review Groups were Airways (11.5%), Cystic Fibrosis and Genetic Diseases (7.9%), Acute Respiratory Infections (7.8%), Developmental, Psychological and Learning Problems (6.7%), and Infectious Diseases (6.2%). Corresponding authors were most often from Europe (51%), North America (15%), and Australia (15%). The majority of systematic reviews examined pharmacological interventions alone (52% compared to 59% in 2009). Out of 611 reviews that were assessed as up-to-date, GRADE was used in 204 (35%) reviews to assess the overall quality of the evidence, which was often moderate (35.6%) or low (37.8%) for primary outcomes. Ninety percent of reviews that were assessed as up to date used the Cochrane Risk of Bias tool, or a modified version, to assess methodological quality. Most reviews conducted one or more meta-analyses (73%). Among the 25 leading causes of death globally, the Review Groups associated with the largest number of causes were: 1) Infectious Diseases, 2) Anaesthesia, Critical, and Emergency Care, 3) Injuries, 4) Pregnancy and Childbirth (PC), and 5) Neonatal. There were large discrepancies between the number of causes of mortality that each Review Group was associated with and the total amount of evidence each Review Group contributed to the CHFRR. Ninety-eight percent of the causes of mortality in 2013 were from developing nations, but only 224 (17.3%) reviews had corresponding authors from developing countries.ConclusionThe content and methodological characteristics of child-relevant systematic reviews in the Cochrane CHFRR have been described in detail. There were modest advances in methods between 2009 and 2013. Systematic reviews contained in the CDSR offer an important resource for researcher's, clinicians and policy makers by synthesizing an extensive body of primary research. Further content analysis will allow the identification of clinical topics of greatest priority for future systematic reviews in child health.

Project description:BackgroundMany meta-analyses contain only a small number of studies, which makes it difficult to estimate the extent of between-study heterogeneity. Bayesian meta-analysis allows incorporation of external evidence on heterogeneity, and offers advantages over conventional random-effects meta-analysis. To assist in this, we provide empirical evidence on the likely extent of heterogeneity in particular areas of health care.MethodsOur analyses included 14?886 meta-analyses from the Cochrane Database of Systematic Reviews. We classified each meta-analysis according to the type of outcome, type of intervention comparison and medical specialty. By modelling the study data from all meta-analyses simultaneously, using the log odds ratio scale, we investigated the impact of meta-analysis characteristics on the underlying between-study heterogeneity variance. Predictive distributions were obtained for the heterogeneity expected in future meta-analyses.ResultsBetween-study heterogeneity variances for meta-analyses in which the outcome was all-cause mortality were found to be on average 17% (95% CI 10-26) of variances for other outcomes. In meta-analyses comparing two active pharmacological interventions, heterogeneity was on average 75% (95% CI 58-95) of variances for non-pharmacological interventions. Meta-analysis size was found to have only a small effect on heterogeneity. Predictive distributions are presented for nine different settings, defined by type of outcome and type of intervention comparison. For example, for a planned meta-analysis comparing a pharmacological intervention against placebo or control with a subjectively measured outcome, the predictive distribution for heterogeneity is a log-normal (-2.13, 1.58(2)) distribution, which has a median value of 0.12. In an example of meta-analysis of six studies, incorporating external evidence led to a smaller heterogeneity estimate and a narrower confidence interval for the combined intervention effect.ConclusionsMeta-analysis characteristics were strongly associated with the degree of between-study heterogeneity, and predictive distributions for heterogeneity differed substantially across settings. The informative priors provided will be very beneficial in future meta-analyses including few studies.

Project description:BackgroundSystematic reviews and meta-analysis of time-to-event outcomes are frequently published within the Cochrane Database of Systematic Reviews (CDSR). However, these outcomes are handled differently across meta-analyses. They can be analysed on the hazard ratio (HR) scale or can be dichotomized and analysed as binary outcomes using effect measures such as odds ratios (OR) or risk ratios (RR). We investigated the impact of reanalysing meta-analyses from the CDSR that used these different effect measures.MethodsWe extracted two types of meta-analysis data from the CDSR: either recorded in a binary form only ("binary"), or in binary form together with observed minus expected and variance statistics ("OEV"). We explored how results for time-to-event outcomes originally analysed as "binary" change when analysed using the complementary log-log (clog-log) link on a HR scale. For the data originally analysed as HRs ("OEV"), we compared these results to analysing them as binary on a HR scale using the clog-log link or using a logit link on an OR scale.ResultsThe pooled HR estimates were closer to 1 than the OR estimates in the majority of meta-analyses. Important differences in between-study heterogeneity between the HR and OR analyses were also observed. These changes led to discrepant conclusions between the OR and HR scales in some meta-analyses. Situations under which the clog-log link performed better than logit link and vice versa were apparent, indicating that the correct choice of the method does matter. Differences between scales arise mainly when event probability is high and may occur via differences in between-study heterogeneity or via increased within-study standard error in the OR relative to the HR analyses.ConclusionsWe identified that dichotomising time-to-event outcomes may be adequate for low event probabilities but not for high event probabilities. In meta-analyses where only binary data are available, the complementary log-log link may be a useful alternative when analysing time-to-event outcomes as binary, however the exact conditions need further exploration. These findings provide guidance on the appropriate methodology that should be used when conducting such meta-analyses.

Project description:BackgroundPrevious research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews.MethodsWe included systematic reviews of health interventions in humans published in English. We analysed 75 Cochrane reviews from May and June 2020 and a random sample of non-Cochrane reviews published in the same period and retrieved from Medline. We linked reviews with protocols and study registrations. We collected information on preparing, piloting, and performing data extraction and on use of software to assist review conduct (automation tools). Data were extracted by one author, with 20% extracted in duplicate. Data were analysed descriptively.ResultsOf the 152 included reviews, 77 reported use of a standardized extraction form (51%); 42 provided information on the type of form used (28%); 24 on piloting (16%); 58 on what data was collected (38%); 133 on the extraction method (88%); 107 on resolving disagreements (70%); 103 on methods to obtain additional data or information (68%); 52 on procedures to avoid data errors (34%); and 47 on methods to deal with multiple study reports (31%). Items were more frequently reported in Cochrane than non-Cochrane reviews. The data extraction form used was published in 10 reviews (7%). Use of software was rarely reported except for statistical analysis software and use of RevMan and GRADEpro GDT in Cochrane reviews. Covidence was the most frequent automation tool used: 18 reviews used it for study selection (12%) and 9 for data extraction (6%).ConclusionsReporting of data extraction methods in systematic reviews is limited, especially in non-Cochrane reviews. This includes core items of data extraction such as methods used to manage disagreements. Few reviews currently use software to assist data extraction and review conduct. Our results can serve as a baseline to assess the uptake of such tools in future analyses.

Project description:BACKGROUND:Meta-analysis combines multiple independent studies, which can increase power and provide better estimates. However, it is unclear how best to deal with studies with zero events; such studies are also known as double-zero-event studies (DZS). Several statistical methods have been proposed, but the agreement among different approaches has not been systematically assessed using real-world published systematic reviews. METHODS:The agreement of five commonly used methods (i.e., the inverse-variance, Mantel-Haenszel, Peto, Bayesian, and exact methods) was assessed using the Cohen's ? coefficients using 368 meta-analyses with rare events selected from the Cochrane Database of Systematic Reviews. Three continuity corrections, including the correction of a constant 0.5, the treatment arm continuity correction (TACC), and the empirical (EMP) correction, were used to handle DZS when applying inverse-variance and Mantel-Haenszel methods. RESULTS:When the proportion of DZS studies was lower than 50% in a meta-analysis, different methods had moderately high agreement. However, when this proportion was increased to be over 50%, the agreement among the methods decreased to different extents. For the Bayesian, exact, and Peto methods and the inverse-variance and Mantel-Haenszel methods using the EMP correction, their agreement coefficients with the inverse-variance and Mantel-Haenszel methods using a constant 0.5 and TACC decreased from larger than 0.70 to smaller than 0.30. In contrast, the agreement coefficients only decreased slightly among the Bayesian, exact, and Peto methods and the inverse-variance and Mantel-Haenszel methods using the EMP correction. CONCLUSIONS:To utilize all available information and reduce research waste and avoid overestimating the effect, meta-analysts should incorporate DZS, rather than simply removing them. The Peto and other conventional methods with continuity correction should be avoided when the proportion of DZS is extremely high. The exact and Bayesian methods are highly recommended, except when none of the included studies have an event in one or both treatment arms.

Dataset Information

A descriptive analysis of child-relevant systematic reviews in the Cochrane Database of Systematic Reviews.

Publications

A descriptive analysis of child-relevant systematic reviews in the Cochrane Database of Systematic Reviews.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets