Dataset Information

Limitations in Using Multiple Imputation to Harmonize Individual Participant Data for Meta-Analysis.

ABSTRACT: Individual participant data (IPD) meta-analysis is a meta-analysis in which the individual-level data for each study are obtained and used for synthesis. A common challenge in IPD meta-analysis is when variables of interest are measured differently in different studies. The term harmonization has been coined to describe the procedure of placing variables on the same scale in order to permit pooling of data from a large number of studies. Using data from an IPD meta-analysis of 19 adolescent depression trials, we describe a multiple imputation approach for harmonizing 10 depression measures across the 19 trials by treating those depression measures that were not used in a study as missing data. We then apply diagnostics to address the fit of our imputation model. Even after reducing the scale of our application, we were still unable to produce accurate imputations of the missing values. We describe those features of the data that made it difficult to harmonize the depression measures and provide some guidelines for using multiple imputation for harmonization in IPD meta-analysis.

SUBMITTER: Siddique J

PROVIDER: S-EPMC5572105 | biostudies-literature | 2018 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Limitations in Using Multiple Imputation to Harmonize Individual Participant Data for Meta-Analysis.

Siddique Juned J de Chavez Peter J PJ Howe George G Cruden Gracelyn G Brown C Hendricks CH

Prevention science : the official journal of the Society for Prevention Research 20180201 Suppl 1

Individual participant data (IPD) meta-analysis is a meta-analysis in which the individual-level data for each study are obtained and used for synthesis. A common challenge in IPD meta-analysis is when variables of interest are measured differently in different studies. The term harmonization has been coined to describe the procedure of placing variables on the same scale in order to permit pooling of data from a large number of studies. Using data from an IPD meta-analysis of 19 adolescent depr ...[more]

PMID: 28243827

Similar Datasets

Project description:BackgroundFour studies previously indicated that the effect of malaria infection during pregnancy on the risk of low birthweight (LBW; <2,500 g) may depend upon maternal nutritional status. We investigated this dependence further using a large, diverse study population.Methods and findingsWe evaluated the interaction between maternal malaria infection and maternal anthropometric status on the risk of LBW using pooled data from 14,633 pregnancies from 13 studies (6 cohort studies and 7 randomized controlled trials) conducted in Africa and the Western Pacific from 1996-2015. Studies were identified by the Maternal Malaria and Malnutrition (M3) initiative using a convenience sampling approach and were eligible for pooling given adequate ethical approval and availability of essential variables. Study-specific adjusted effect estimates were calculated using inverse probability of treatment-weighted linear and log-binomial regression models and pooled using a random-effects model. The adjusted risk of delivering a baby with LBW was 8.8% among women with malaria infection at antenatal enrollment compared to 7.7% among uninfected women (adjusted risk ratio [aRR] 1.14 [95% confidence interval (CI): 0.91, 1.42]; N = 13,613), 10.5% among women with malaria infection at delivery compared to 7.9% among uninfected women (aRR 1.32 [95% CI: 1.08, 1.62]; N = 11,826), and 15.3% among women with low mid-upper arm circumference (MUAC <23 cm) at enrollment compared to 9.5% among women with MUAC ? 23 cm (aRR 1.60 [95% CI: 1.36, 1.87]; N = 9,008). The risk of delivering a baby with LBW was 17.8% among women with both malaria infection and low MUAC at enrollment compared to 8.4% among uninfected women with MUAC ? 23 cm (joint aRR 2.13 [95% CI: 1.21, 3.73]; N = 8,152). There was no evidence of synergism (i.e., excess risk due to interaction) between malaria infection and MUAC on the multiplicative (p = 0.5) or additive scale (p = 0.9). Results were similar using body mass index (BMI) as an anthropometric indicator of nutritional status. Meta-regression results indicated that there may be multiplicative interaction between malaria infection at enrollment and low MUAC within studies conducted in Africa; however, this finding was not consistent on the additive scale, when accounting for multiple comparisons, or when using other definitions of malaria and malnutrition. The major limitations of the study included availability of only 2 cross-sectional measurements of malaria and the limited availability of ultrasound-based pregnancy dating to assess impacts on preterm birth and fetal growth in all studies.ConclusionsPregnant women with malnutrition and malaria infection are at increased risk of LBW compared to women with only 1 risk factor or none, but malaria and malnutrition do not act synergistically.

Project description:BackgroundIn non-randomized studies (NRSs) where a continuous outcome variable (e.g., depressive symptoms) is assessed at baseline and follow-up, it is common to observe imbalance of the baseline values between the treatment/exposure group and control group. This may bias the study and consequently a meta-analysis (MA) estimate. These estimates may differ across statistical methods used to deal with this issue. Analysis of individual participant data (IPD) allows standardization of methods across studies. We aimed to identify methods used in published IPD-MAs of NRSs for continuous outcomes, and to compare different methods to account for baseline values of outcome variables in IPD-MA of NRSs using two empirical examples from the Thyroid Studies Collaboration (TSC).MethodsFor the first aim we systematically searched in MEDLINE, EMBASE, and Cochrane from inception to February 2021 to identify published IPD-MAs of NRSs that adjusted for baseline outcome measures in the analysis of continuous outcomes. For the second aim, we applied analysis of covariance (ANCOVA), change score, propensity score and the naïve approach (ignores the baseline outcome data) in IPD-MA from NRSs on the association between subclinical hyperthyroidism and depressive symptoms and renal function. We estimated the study and meta-analytic mean difference (MD) and relative standard error (SE). We used both fixed- and random-effects MA.ResultsTen of 18 (56%) of the included studies used the change score method, seven (39%) studies used ANCOVA and one the propensity score (5%). The study estimates were similar across the methods in studies in which groups were balanced at baseline with regard to outcome variables but differed in studies with baseline imbalance. In our empirical examples, ANCOVA and change score showed study results on the same direction, not the propensity score. In our applications, ANCOVA provided more precise estimates, both at study and meta-analytical level, in comparison to other methods. Heterogeneity was higher when change score was used as outcome, moderate for ANCOVA and null with the propensity score.ConclusionANCOVA provided the most precise estimates at both study and meta-analytic level and thus seems preferable in the meta-analysis of IPD from non-randomized studies. For the studies that were well-balanced between groups, change score, and ANCOVA performed similarly.

Dataset Information

Limitations in Using Multiple Imputation to Harmonize Individual Participant Data for Meta-Analysis.

Publications

Limitations in Using Multiple Imputation to Harmonize Individual Participant Data for Meta-Analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets