Dataset Information

Meta-analysis of rare binary events in treatment groups with unequal variability.

ABSTRACT: Meta-analysis has been widely used to synthesize information from related studies to achieve reliable findings. However, in studies of rare events, the event counts are often low or even zero, and so standard meta-analysis methods such as fixed-effect models with continuity correction may cause substantial bias in estimation. Recently, Bhaumik et al. developed a simple average estimator for the overall treatment effect based on a random effects model. They proved that the simple average method with the continuity correction factor 0.5 (SA_0.5) is the least biased for large samples and showed via simulation that it has superior performance when compared with other commonly used estimators. However, the random effects models used in previous work are restrictive because they all assume that the variability in the treatment group is equal to or always greater than that in the control group. Under a general framework that explicitly allows treatment groups with unequal variability but assumes no direction, we prove that SA_0.5 is still the least biased for large samples. Meanwhile, to account for a trade-off between the bias and variance in estimation, we consider the mean squared error to assess estimation efficiency and show that SA_0.5 fails to minimize the mean squared error. Under a new random effects model that accommodates groups with unequal variability, we thoroughly compare the performance of various methods for both large and small samples via simulation and draw conclusions about when to use which method in terms of bias, mean squared error, type I error, and confidence interval coverage. A data example of rosiglitazone meta-analysis is used to provide further comparison.

SUBMITTER: Li L

PROVIDER: S-EPMC5599377 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Meta-analysis of rare binary events in treatment groups with unequal variability.

Li Lie L Wang Xinlei X

Statistical methods in medical research 20170731 1

Meta-analysis has been widely used to synthesize information from related studies to achieve reliable findings. However, in studies of rare events, the event counts are often low or even zero, and so standard meta-analysis methods such as fixed-effect models with continuity correction may cause substantial bias in estimation. Recently, Bhaumik et al. developed a simple average estimator for the overall treatment effect based on a random effects model. They proved that the simple average method w ...[more]

PMID: 28760075

Similar Datasets

Project description:Background/aimsRegulatory approval of a drug or device involves an assessment of not only the benefits but also the risks of adverse events associated with the therapeutic agent. Although randomized controlled trials (RCTs) are the gold standard for evaluating effectiveness, the number of treated patients in a single RCT may not be enough to detect a rare but serious side effect of the treatment. Meta-analysis plays an important role in the evaluation of the safety of medical products and has advantage over analyzing a single RCT when estimating the rate of adverse events.MethodsIn this article, we compare 15 widely used meta-analysis models under both Bayesian and frequentist frameworks when outcomes are extremely infrequent or rare. We present extensive simulation study results and then apply these methods to a real meta-analysis that considers RCTs investigating the effect of rosiglitazone on the risks of myocardial infarction and of death from cardiovascular causes.ResultsOur simulation studies suggest that the beta hyperprior method modeling treatment group-specific parameters and accounting for heterogeneity performs the best. Most models ignoring between-study heterogeneity give poor coverage probability when such heterogeneity exists. In the data analysis, different methods provide a wide range of log odds ratio estimates between rosiglitazone and control treatments with a mixed conclusion on their statistical significance based on 95% confidence (or credible) intervals.ConclusionIn the rare event setting, treatment effect estimates obtained from traditional meta-analytic methods may be biased and provide poor coverage probability. This trend worsens when the data have large between-study heterogeneity. In general, we recommend methods that first estimate the summaries of treatment-specific risks across studies and then relative treatment effects based on the summaries when appropriate. Furthermore, we recommend fitting various methods, comparing the results and model performance, and investigating any significant discrepancies among them.

Project description:Meta-analysis of clinical trials targeting rare events face particular challenges when the data lack adequate number of events and are susceptible to high levels of heterogeneity. The standard meta-analysis methods (DerSimonian Laird (DL) and Mantel-Haenszel (MH)) often lead to serious distortions because of such data sparsity. Applications of the methods suited to specific incidence and heterogeneity characteristics are lacking, thus we compared nine available methods in a simulation study. We generated 360 meta-analysis scenarios where each considered different incidences, sample sizes, between-study variance (heterogeneity) and treatment allocation. We include globally recommended methods such as inverse-variance fixed/random-effect (IV-FE/RE), classical-MH, MH-FE, MH-DL, Peto, Peto-DL and the two extensions for MH bootstrapped-DL (bDL) and Peto-bDL. Performance was assessed on mean bias, mean error, coverage and power. In the absence of heterogeneity, the coverage and power when combined revealed small differences in meta-analysis involving rare and very rare events. The Peto-bDL method performed best, but only in smaller sample sizes involving rare events. For medium-to-larger sample sizes, MH-bDL was preferred. For meta-analysis involving very rare events, Peto-bDL was the best performing method which was sustained across all sample sizes. However, in meta-analysis with 20% or more heterogeneity, the coverage and power were insufficient. Performance based on mean bias and mean error was almost identical across methods. To conclude, in meta-analysis of rare binary outcomes, our results suggest that Peto-bDL is better in both rare and very rare event settings in meta-analysis with limited sample sizes. However, when heterogeneity is large, the coverage and power to detect rare events are insufficient. Whilst this study shows that some of the less studied methods appear to have good properties under sparse data scenarios, further work is needed to assess them against the more complex distributional-based methods to understand their overall performances.

Project description:BackgroundLoneliness, social isolation, and feeling disconnected from society are commonly experienced by parents of children with rare diseases and are, among others, important reasons for special supportive care needs. Social networking platforms are increasingly used for health communication, information exchange, and support. In the field of rare pediatric diseases, qualitative studies have shown that Facebook online support groups are utilized by and beneficial for persons affected by rare pediatric diseases. Nonetheless, the extent of this usage has not been investigated.ObjectiveThis study aims to provide a comprehensive quantitative analysis of the extent of Facebook usage as a tool for rare pediatric disease support groups and to explore factors that influence a disease's representation on Facebook. These results potentially offer important insights for future public health initiatives and give direction to further research that can give much needed support to parents of children with rare diseases.MethodsWe determined rare pediatric diseases using the inventory of the online portal Orphanet. Facebook support groups were identified by searching 5 synonymous disease descriptions using the group category search bar. Disease- and group-describing parameters were statistically analyzed using standard descriptive statistical methods.Results6398 Facebook support groups, representing 826 diseases (19.5% of all searched diseases), were found. 69% are private groups. Group type, size, activity (sum of posts, comments, and reactions calculated by Facebook), new memberships, and language varied largely between groups (member count: minimum 1, maximum 23,414; activity last 30 days: minimum 0, maximum 3606). The highest percentage of awareness and information groups was found for teratogenic diseases (18/68, 26%). The odds of finding a Facebook group increased according to the level of information available about the disease: known prevalence (odds ratio [OR] 3.98, 95% CI 3.39-4.66, P<.001), known disease type (OR 3.15, 95% CI 2.70-3.68, P<.001), and known inheritance mode (OR 2.06, 95% CI 1.68-2.52, P<.001) were all associated with higher odds of finding a Facebook group, as was dominant compared to nondominant inheritance (OR 2.05, 95% CI 1.74-3.42, P<.001). The number of groups per disease increased with higher prevalence.ConclusionsFacebook is widely used as a tool for support groups for rare pediatric diseases and continues to be relevant. Two-thirds of the groups are private groups, indicating group participants' need for privacy, which should be further explored. The advantages and limitations of Facebook as a tool for support groups in the field of rare diseases should be further investigated as it will allow health professionals to use Facebook more meaningfully in their counseling and guidance of affected individuals and their family members.

Project description:ObjectiveTo examine the association between antihypertensive treatment and specific adverse events.DesignSystematic review and meta-analysis.Eligibility criteriaRandomised controlled trials of adults receiving antihypertensives compared with placebo or no treatment, more antihypertensive drugs compared with fewer antihypertensive drugs, or higher blood pressure targets compared with lower targets. To avoid small early phase trials, studies were required to have at least 650 patient years of follow-up.Information sourcesSearches were conducted in Embase, Medline, CENTRAL, and the Science Citation Index databases from inception until 14 April 2020.Main outcome measuresThe primary outcome was falls during trial follow-up. Secondary outcomes were acute kidney injury, fractures, gout, hyperkalaemia, hypokalaemia, hypotension, and syncope. Additional outcomes related to death and major cardiovascular events were extracted. Risk of bias was assessed using the Cochrane risk of bias tool, and random effects meta-analysis was used to pool rate ratios, odds ratios, and hazard ratios across studies, allowing for between study heterogeneity (?2).ResultsOf 15?023 articles screened for inclusion, 58 randomised controlled trials were identified, including 280?638 participants followed up for a median of 3 (interquartile range 2-4) years. Most of the trials (n=40, 69%) had a low risk of bias. Among seven trials reporting data for falls, no evidence was found of an association with antihypertensive treatment (summary risk ratio 1.05, 95% confidence interval 0.89 to 1.24, ?2=0.009). Antihypertensives were associated with an increased risk of acute kidney injury (1.18, 95% confidence interval 1.01 to 1.39, ?2=0.037, n=15), hyperkalaemia (1.89, 1.56 to 2.30, ?2=0.122, n=26), hypotension (1.97, 1.67 to 2.32, ?2=0.132, n=35), and syncope (1.28, 1.03 to 1.59, ?2=0.050, n=16). The heterogeneity between studies assessing acute kidney injury and hyperkalaemia events was reduced when focusing on drugs that affect the renin angiotensin-aldosterone system. Results were robust to sensitivity analyses focusing on adverse events leading to withdrawal from each trial. Antihypertensive treatment was associated with a reduced risk of all cause mortality, cardiovascular death, and stroke, but not of myocardial infarction.ConclusionsThis meta-analysis found no evidence to suggest that antihypertensive treatment is associated with falls but found evidence of an association with mild (hyperkalaemia, hypotension) and severe adverse events (acute kidney injury, syncope). These data could be used to inform shared decision making between doctors and patients about initiation and continuation of antihypertensive treatment, especially in patients at high risk of harm because of previous adverse events or poor renal function.RegistrationPROSPERO CRD42018116860.

Dataset Information

Meta-analysis of rare binary events in treatment groups with unequal variability.

Publications

Meta-analysis of rare binary events in treatment groups with unequal variability.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets