Dataset Information

Statistical approaches to identify subgroups in meta-analysis of individual participant data: a simulation study.

ABSTRACT: BACKGROUND:Individual participant data meta-analysis (IPD-MA) is considered the gold standard for investigating subgroup effects. Frequently used regression-based approaches to detect subgroups in IPD-MA are: meta-regression, per-subgroup meta-analysis (PS-MA), meta-analysis of interaction terms (MA-IT), naive one-stage IPD-MA (ignoring potential study-level confounding), and centred one-stage IPD-MA (accounting for potential study-level confounding). Clear guidance on the analyses is lacking and clinical researchers may use approaches with suboptimal efficiency to investigate subgroup effects in an IPD setting. Therefore, our aim is to overview and compare the aforementioned methods, and provide recommendations over which should be preferred. METHODS:We conducted a simulation study where we generated IPD of randomised trials and varied the magnitude of subgroup effect (0, 25, 50% relative reduction), between-study treatment effect heterogeneity (none, medium, large), ecological bias (none, quantitative, qualitative), sample size (50,100,200), and number of trials (5,10) for binary, continuous and time-to-event outcomes. For each scenario, we assessed the power, false positive rate (FPR) and bias of aforementioned five approaches. RESULTS:Naive and centred IPD-MA yielded the highest power, whilst preserving acceptable FPR around the nominal 5% in all scenarios. Centred IPD-MA showed slightly less biased estimates than naïve IPD-MA. Similar results were obtained for MA-IT, except when analysing binary outcomes (where it yielded less power and FPR?

SUBMITTER: Belias M

PROVIDER: S-EPMC6720416 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Statistical approaches to identify subgroups in meta-analysis of individual participant data: a simulation study.

Belias Michail M Rovers Maroeska M MM Reitsma Johannes B JB Debray Thomas P A TPA IntHout Joanna J

BMC medical research methodology 20190902 1

<h4>Background</h4>Individual participant data meta-analysis (IPD-MA) is considered the gold standard for investigating subgroup effects. Frequently used regression-based approaches to detect subgroups in IPD-MA are: meta-regression, per-subgroup meta-analysis (PS-MA), meta-analysis of interaction terms (MA-IT), naive one-stage IPD-MA (ignoring potential study-level confounding), and centred one-stage IPD-MA (accounting for potential study-level confounding). Clear guidance on the analyses is la ...[more]

PMID: 31477023

Similar Datasets

Project description:BACKGROUND:Researchers and funders should consider the statistical power of planned Individual Participant Data (IPD) meta-analysis projects, as they are often time-consuming and costly. We propose simulation-based power calculations utilising a two-stage framework, and illustrate the approach for a planned IPD meta-analysis of randomised trials with continuous outcomes where the aim is to identify treatment-covariate interactions. METHODS:The simulation approach has four steps: (i) specify an underlying (data generating) statistical model for trials in the IPD meta-analysis; (ii) use readily available information (e.g. from publications) and prior knowledge (e.g. number of studies promising IPD) to specify model parameter values (e.g. control group mean, intervention effect, treatment-covariate interaction); (iii) simulate an IPD meta-analysis dataset of a particular size from the model, and apply a two-stage IPD meta-analysis to obtain the summary estimate of interest (e.g. interaction effect) and its associated p-value; (iv) repeat the previous step (e.g. thousands of times), then estimate the power to detect a genuine effect by the proportion of summary estimates with a significant p-value. RESULTS:In a planned IPD meta-analysis of lifestyle interventions to reduce weight gain in pregnancy, 14 trials (1183 patients) promised their IPD to examine a treatment-BMI interaction (i.e. whether baseline BMI modifies intervention effect on weight gain). Using our simulation-based approach, a two-stage IPD meta-analysis has <?60% power to detect a reduction of 1 kg weight gain for a 10-unit increase in BMI. Additional IPD from ten other published trials (containing 1761 patients) would improve power to over 80%, but only if a fixed-effect meta-analysis was appropriate. Pre-specified adjustment for prognostic factors would increase power further. Incorrect dichotomisation of BMI would reduce power by over 20%, similar to immediately throwing away IPD from ten trials. CONCLUSIONS:Simulation-based power calculations could inform the planning and funding of IPD projects, and should be used routinely.

Project description:BackgroundIndividual participant data (IPD) meta-analyses that obtain "raw" data from studies rather than summary data typically adopt a "two-stage" approach to analysis whereby IPD within trials generate summary measures, which are combined using standard meta-analytical methods. Recently, a range of "one-stage" approaches which combine all individual participant data in a single meta-analysis have been suggested as providing a more powerful and flexible approach. However, they are more complex to implement and require statistical support. This study uses a dataset to compare "two-stage" and "one-stage" models of varying complexity, to ascertain whether results obtained from the approaches differ in a clinically meaningful way.Methods and findingsWe included data from 24 randomised controlled trials, evaluating antiplatelet agents, for the prevention of pre-eclampsia in pregnancy. We performed two-stage and one-stage IPD meta-analyses to estimate overall treatment effect and to explore potential treatment interactions whereby particular types of women and their babies might benefit differentially from receiving antiplatelets. Two-stage and one-stage approaches gave similar results, showing a benefit of using anti-platelets (Relative risk 0.90, 95% CI 0.84 to 0.97). Neither approach suggested that any particular type of women benefited more or less from antiplatelets. There were no material differences in results between different types of one-stage model.ConclusionsFor these data, two-stage and one-stage approaches to analysis produce similar results. Although one-stage models offer a flexible environment for exploring model structure and are useful where across study patterns relating to types of participant, intervention and outcome mask similar relationships within trials, the additional insights provided by their usage may not outweigh the costs of statistical support for routine application in syntheses of randomised controlled trials. Researchers considering undertaking an IPD meta-analysis should not necessarily be deterred by a perceived need for sophisticated statistical methods when combining information from large randomised trials.

Project description:BackgroundIt remains unclear when standard systematic reviews and meta-analyses that rely on published aggregate data (AD) can provide robust clinical conclusions. We aimed to compare the results from a large cohort of systematic reviews and meta-analyses based on individual participant data (IPD) with meta-analyses of published AD, to establish when the latter are most likely to be reliable and when the IPD approach might be required.Methods and findingsWe used 18 cancer systematic reviews that included IPD meta-analyses: all of those completed and published by the Meta-analysis Group of the MRC Clinical Trials Unit from 1991 to 2010. We extracted or estimated hazard ratios (HRs) and standard errors (SEs) for survival from trial reports and compared these with IPD equivalents at both the trial and meta-analysis level. We also extracted or estimated the number of events. We used paired t tests to assess whether HRs and SEs from published AD differed on average from those from IPD. We assessed agreement, and whether this was associated with trial or meta-analysis characteristics, using the approach of Bland and Altman. The 18 systematic reviews comprised 238 unique trials or trial comparisons, including 37,082 participants. A HR and SE could be generated for 127 trials, representing 53% of the trials and approximately 79% of eligible participants. On average, trial HRs derived from published AD were slightly more in favour of the research interventions than those from IPD (HRAD to HRIPD ratio = 0.95, p = 0.007), but the limits of agreement show that for individual trials, the HRs could deviate substantially. These limits narrowed with an increasing number of participants (p < 0.001) or a greater number (p < 0.001) or proportion (p < 0.001) of events in the AD. On average, meta-analysis HRs from published AD slightly tended to favour the research interventions whether based on fixed-effect (HRAD to HRIPD ratio = 0.97, p = 0.088) or random-effects (HRAD to HRIPD ratio = 0.96, p = 0.044) models, but the limits of agreement show that for individual meta-analyses, agreement was much more variable. These limits tended to narrow with an increasing number (p = 0.077) or proportion of events (p = 0.11) in the AD. However, even when the information size of the AD was large, individual meta-analysis HRs could still differ from their IPD equivalents by a relative 10% in favour of the research intervention to 5% in favour of control. We utilised the results to construct a decision tree for assessing whether an AD meta-analysis includes sufficient information, and when estimates of effects are most likely to be reliable. A lack of power at the meta-analysis level may have prevented us identifying additional factors associated with the reliability of AD meta-analyses, and we cannot be sure that our results are generalisable to all outcomes and effect measures.ConclusionsIn this study we found that HRs from published AD were most likely to agree with those from IPD when the information size was large. Based on these findings, we provide guidance for determining systematically when standard AD meta-analysis will likely generate robust clinical conclusions, and when the IPD approach will add considerable value.

Project description:BackgroundFour studies previously indicated that the effect of malaria infection during pregnancy on the risk of low birthweight (LBW; <2,500 g) may depend upon maternal nutritional status. We investigated this dependence further using a large, diverse study population.Methods and findingsWe evaluated the interaction between maternal malaria infection and maternal anthropometric status on the risk of LBW using pooled data from 14,633 pregnancies from 13 studies (6 cohort studies and 7 randomized controlled trials) conducted in Africa and the Western Pacific from 1996-2015. Studies were identified by the Maternal Malaria and Malnutrition (M3) initiative using a convenience sampling approach and were eligible for pooling given adequate ethical approval and availability of essential variables. Study-specific adjusted effect estimates were calculated using inverse probability of treatment-weighted linear and log-binomial regression models and pooled using a random-effects model. The adjusted risk of delivering a baby with LBW was 8.8% among women with malaria infection at antenatal enrollment compared to 7.7% among uninfected women (adjusted risk ratio [aRR] 1.14 [95% confidence interval (CI): 0.91, 1.42]; N = 13,613), 10.5% among women with malaria infection at delivery compared to 7.9% among uninfected women (aRR 1.32 [95% CI: 1.08, 1.62]; N = 11,826), and 15.3% among women with low mid-upper arm circumference (MUAC <23 cm) at enrollment compared to 9.5% among women with MUAC ? 23 cm (aRR 1.60 [95% CI: 1.36, 1.87]; N = 9,008). The risk of delivering a baby with LBW was 17.8% among women with both malaria infection and low MUAC at enrollment compared to 8.4% among uninfected women with MUAC ? 23 cm (joint aRR 2.13 [95% CI: 1.21, 3.73]; N = 8,152). There was no evidence of synergism (i.e., excess risk due to interaction) between malaria infection and MUAC on the multiplicative (p = 0.5) or additive scale (p = 0.9). Results were similar using body mass index (BMI) as an anthropometric indicator of nutritional status. Meta-regression results indicated that there may be multiplicative interaction between malaria infection at enrollment and low MUAC within studies conducted in Africa; however, this finding was not consistent on the additive scale, when accounting for multiple comparisons, or when using other definitions of malaria and malnutrition. The major limitations of the study included availability of only 2 cross-sectional measurements of malaria and the limited availability of ultrasound-based pregnancy dating to assess impacts on preterm birth and fetal growth in all studies.ConclusionsPregnant women with malnutrition and malaria infection are at increased risk of LBW compared to women with only 1 risk factor or none, but malaria and malnutrition do not act synergistically.

Dataset Information

Statistical approaches to identify subgroups in meta-analysis of individual participant data: a simulation study.

Publications

Statistical approaches to identify subgroups in meta-analysis of individual participant data: a simulation study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets