Comparing the Overall Result and Interaction in Aggregate Data Meta-Analysis and Individual Patient Data Meta-Analysis.
Ontology highlight
ABSTRACT:
SUBMITTER: Huang Y
PROVIDER: S-EPMC4998822 | biostudies-literature | 2016 Apr
REPOSITORIES: biostudies-literature
Publications
Comparing the Overall Result and Interaction in Aggregate Data Meta-Analysis and Individual Patient Data Meta-Analysis.
Huang Yafang Y Tang Jinling J Tam Wilson Wai-San WW Mao Chen C Yuan Jinqiu J Di Mengyang M Yang Zuyao Z
Medicine 20160401 14
The aim of the study was to examine how well aggregate data meta-analyses (ADMAs) and individual patient data meta-analyses (IPDMAs) agree in their overall results and how frequently interactions are detected in IPDMAs and ADMAs.ADMA articles immediately published before the IPDMA and matching the research topic were identified. Agreement in the overall result was achieved if the estimate was in the same direction. The number of subgroup analyses, in particular that of significant interactions, ...[more]
Similar Datasets
Project description:Individual patient-data meta-analysis of randomized controlled trials is the gold standard for investigating how patient factors modify the effectiveness of treatment. Because participant data from primary studies might not be available, reliable alternatives using published data are needed. In this paper, I show that the maximum likelihood estimates of a participant-level linear random effects meta-analysis with a patient covariate-treatment interaction can be determined exactly from aggregate data when the model's variance components are known. I provide an equivalent aggregate-data EM algorithm and supporting software with the R package ipdmeta for the estimation of the "interaction meta-analysis" when the variance components are unknown. The properties of the methodology are assessed with simulation studies. The usefulness of the methods is illustrated with analyses of the effect modification of cholesterol and age on pravastatin in the multicenter placebo-controlled regression growth evaluation statin study. When a participant-level meta-analysis cannot be performed, aggregate-data interaction meta-analysis is a useful alternative for exploring individual-level sources of treatment effect heterogeneity.
| S-EPMC3590924 | biostudies-literature
Project description:Network meta-analysis can synthesize evidence from studies comparing multiple treatments for the same disease. Sometimes the treatments of a network are complex interventions, comprising several independent components in different combinations. A component network meta-analysis (CNMA) can be used to analyze such data and can in principle disentangle the individual effect of each component. However, components may interact with each other, either synergistically or antagonistically. Deciding which interactions, if any, to include in a CNMA model may be difficult, especially for large networks with many components. In this article, we present two Bayesian CNMA models that can be used to identify prominent interactions between components. Our models utilize Bayesian variable selection methods, namely the stochastic search variable selection and the Bayesian LASSO, and can benefit from the inclusion of prior information about important interactions. Moreover, we extend these models to combine data from studies providing aggregate information and studies providing individual patient data (IPD). We illustrate our models in practice using three real datasets, from studies in panic disorder, depression, and multiple myeloma. Finally, we describe methods for developing web-applications that can utilize results from an IPD-CNMA, to allow for personalized estimates of relative treatment effects given a patient's characteristics.
| S-EPMC9314605 | biostudies-literature
Project description:BackgroundNetwork meta-analysis methods extend the standard pair-wise framework to allow simultaneous comparison of multiple interventions in a single statistical model. Despite published work on network meta-analysis mainly focussing on the synthesis of aggregate data, methods have been developed that allow the use of individual patient-level data specifically when outcomes are dichotomous or continuous. This paper focuses on the synthesis of individual patient-level and summary time to event data, motivated by a real data example looking at the effectiveness of high compression treatments on the healing of venous leg ulcers.MethodsThis paper introduces a novel network meta-analysis modelling approach that allows individual patient-level (time to event with censoring) and summary-level data (event count for a given follow-up time) to be synthesised jointly by assuming an underlying, common, distribution of time to healing. Alternative model assumptions were tested within the motivating example. Model fit and adequacy measures were used to compare and select models.ResultsDue to the availability of individual patient-level data in our example we were able to use a Weibull distribution to describe time to healing; otherwise, we would have been limited to specifying a uniparametric distribution. Absolute effectiveness estimates were more sensitive than relative effectiveness estimates to a range of alternative specifications for the model.ConclusionsThe synthesis of time to event data considering individual patient-level data provides modelling flexibility, and can be particularly important when absolute effectiveness estimates, and not just relative effect estimates, are of interest.
| S-EPMC4236567 | biostudies-literature
Project description:Meta-analysis of individual patient data (IPD) is increasingly used to synthesize data from multiple trials. IPD meta-analysis offers several advantages over meta-analyzing aggregate data, including the capacity to individualize treatment recommendations. Trials usually collect information on many patient characteristics. Some of these covariates may strongly interact with treatment (and thus be associated with treatment effect modification) while others may have little effect. It is currently unclear whether a systematic approach to the selection of treatment-covariate interactions in an IPD meta-analysis can lead to better estimates of patient-specific treatment effects. We aimed to answer this question by comparing in simulations the standard approach to IPD meta-analysis (no variable selection, all treatment-covariate interactions included in the model) with six alternative methods: stepwise regression, and five regression methods that perform shrinkage on treatment-covariate interactions, that is, least absolute shrinkage and selection operator (LASSO), ridge, adaptive LASSO, Bayesian LASSO, and stochastic search variable selection. Exploring a range of scenarios, we found that shrinkage methods performed well for both continuous and dichotomous outcomes, for a variety of settings. In most scenarios, these methods gave lower mean squared error of the patient-specific treatment effect as compared with the standard approach and stepwise regression. We illustrate the application of these methods in two datasets from cardiology and psychiatry. We recommend that future IPD meta-analysis that aim to estimate patient-specific treatment effects using multiple effect modifiers should use shrinkage methods, whereas stepwise regression should be avoided.
| S-EPMC7898845 | biostudies-literature
Project description:BackgroundThe 2018 World Health Organization HIV guidelines were based on the results of a network meta-analysis (NMA) of published trials. This study employed individual patient-level data (IPD) and aggregate data (AgD) and meta-regression methods to assess the evidence supporting the WHO recommendations and whether they needed any refinements.MethodsAccess to IPD from three trials was granted through ClinicalStudyDataRequest.com (CSDR). Seven modelling approaches were applied and compared: 1) Unadjusted AgD network meta-analysis (NMA) - the original analysis; 2) AgD-NMA with meta-regression; 3) Two-stage IPD-AgD NMA; 4) Unadjusted one-stage IPD-AgD NMA; 5) One-stage IPD-AgD NMA with meta-regression (one-stage approach); 6) Two-stage IPD-AgD NMA with empirical-priors (empirical-priors approach); 7) Hierarchical meta-regression IPD-AgD NMA (HMR approach). The first two were the models used previously. Models were compared with respect to effect estimates, changes in the effect estimates, coefficient estimates, DIC and model fit, rankings and between-study heterogeneity.ResultsIPD were available for 2160 patients, representing 6.5% of the evidence base and 3 of 24 edges. The aspect of the model affected by the choice of modeling appeared to differ across outcomes. HMR consistently generated larger intervals, often with credible intervals (CrI) containing the null value. Discontinuations due to adverse events and viral suppression at 96 weeks were the only two outcomes for which the unadjusted AgD NMA would not be selected. For the first, the selected model shifted the principal comparison of interest from an odds ratio of 0.28 (95% CrI: 10.17, 0.44) to 0.37 (95% CrI: 0.23, 0.58). Throughout all outcomes, the regression estimates differed substantially between AgD and IPD methods, with the latter being more often larger in magnitude and statistically significant.ConclusionsOverall, the use of IPD often impacted the coefficient estimates, but not sufficiently as to necessitate altering the final recommendations of the 2018 WHO Guidelines. Future work should examine the features of a network where adjustments will have an impact, such as how much IPD is required in a given size of network.
| S-EPMC8008675 | biostudies-literature
Project description:BackgroundTestosterone is the standard treatment for male hypogonadism, but there is uncertainty about its cardiovascular safety due to inconsistent findings. We aimed to provide the most extensive individual participant dataset (IPD) of testosterone trials available, to analyse subtypes of all cardiovascular events observed during treatment, and to investigate the effect of incorporating data from trials that did not provide IPD.MethodsWe did a systematic review and meta-analysis of randomised controlled trials including IPD. We searched MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, MEDLINE Epub Ahead of Print, Embase, Science Citation Index, the Cochrane Controlled Trials Register, Cochrane Database of Systematic Reviews, and Database of Abstracts of Review of Effects for literature from 1992 onwards (date of search, Aug 27, 2018). The following inclusion criteria were applied: (1) men aged 18 years and older with a screening testosterone concentration of 12 nmol/L (350 ng/dL) or less; (2) the intervention of interest was treatment with any testosterone formulation, dose frequency, and route of administration, for a minimum duration of 3 months; (3) a comparator of placebo treatment; and (4) studies assessing the pre-specified primary or secondary outcomes of interest. Details of study design, interventions, participants, and outcome measures were extracted from published articles and anonymised IPD was requested from investigators of all identified trials. Primary outcomes were mortality, cardiovascular, and cerebrovascular events at any time during follow-up. The risk of bias was assessed using the Cochrane Risk of Bias tool. We did a one-stage meta-analysis using IPD, and a two-stage meta-analysis integrating IPD with data from studies not providing IPD. The study is registered with PROSPERO, CRD42018111005.Findings9871 citations were identified through database searches and after exclusion of duplicates and of irrelevant citations, 225 study reports were retrieved for full-text screening. 116 studies were subsequently excluded for not meeting the inclusion criteria in terms of study design and characteristics of intervention, and 35 primary studies (5601 participants, mean age 65 years, [SD 11]) reported in 109 peer-reviewed publications were deemed suitable for inclusion. Of these, 17 studies (49%) provided IPD (3431 participants, mean duration 9·5 months) from nine different countries while 18 did not provide IPD data. Risk of bias was judged to be low in most IPD studies (71%). Fewer deaths occurred with testosterone treatment (six [0·4%] of 1621) than placebo (12 [0·8%] of 1537) without significant differences between groups (odds ratio [OR] 0·46 [95% CI 0·17-1·24]; p=0·13). Cardiovascular risk was similar during testosterone treatment (120 [7·5%] of 1601 events) and placebo treatment (110 [7·2%] of 1519 events; OR 1·07 [95% CI 0·81-1·42]; p=0·62). Frequently occurring cardiovascular events included arrhythmia (52 of 166 vs 47 of 176), coronary heart disease (33 of 166 vs 33 of 176), heart failure (22 of 166 vs 28 of 176), and myocardial infarction (10 of 166 vs 16 of 176). Overall, patient age (interaction 0·97 [99% CI 0·92-1·03]; p=0·17), baseline testosterone (interaction 0·97 [0·82-1·15]; p=0·69), smoking status (interaction 1·68 [0·41-6·88]; p=0.35), or diabetes status (interaction 2·08 [0·89-4·82; p=0·025) were not associated with cardiovascular risk.InterpretationWe found no evidence that testosterone increased short-term to medium-term cardiovascular risks in men with hypogonadism, but there is a paucity of data evaluating its long-term safety. Long-term data are needed to fully evaluate the safety of testosterone.FundingNational Institute for Health Research Health Technology Assessment Programme.
| S-EPMC9184259 | biostudies-literature
Project description:IntroductionMeta-analysis traditionally uses aggregate data from published reports. Individual Participant Data (IPD) meta-analysis, which obtains and synthesizes participant-level data, is potentially more informative, but resource-intensive. The impact on the findings of meta-analyses using IPD in comparison with aggregate data has rarely been formally evaluated.MethodsWe conducted a secondary analysis of a Cochrane systematic review of skincare interventions for preventing eczema and food allergy in infants to identify the impact of the analytical choice on the review's findings. We used aggregate data meta-analysis only and contrasted the results against those of the originally published IPD meta-analysis. All meta-analysis used random effects inverse variance models. Certainty of evidence was evaluated using GRADE.ResultsThe pooled treatment effects for the Cochrane systematic review's co-primary outcomes of eczema and food allergy were similar in IPD meta-analysis (eczema RR 1.03, 95% CI 0.81, 1.31; I2 41%, 7 studies 3075 participants), and aggregate meta-analysis (eczema RR 1.01 95% CI 0.77, 1.33; I2 53%, 7 studies, 3089 participants). In aggregate meta-analysis, the statistical heterogeneity could not be explained but using IPD it was explained by one trial which used a different, bathing intervention. For IPD meta-analysis, risk of bias was assessed as lower and more adverse event data were available compared with aggregate meta-analysis. This resulted in higher certainty of evidence, especially for adverse events. IPD meta-analysis enabled analysis of treatment interactions by age and hereditary eczema risk; and analysis of the effect of treatment adherence using pooled complier-adjusted-causal-effect analysis, none of which was possible in aggregate meta-analysis.ConclusionsFor this systematic review, IPD did not significantly change primary outcome risk ratios compared with aggregate data meta-analysis. However, certainty of evidence, safety outcomes, subgroup and adherence analyses were significantly different using IPD. This demonstrates benefits of adopting an IPD approach to meta-analysis.
| S-EPMC9302682 | biostudies-literature
Project description:Our objective was to evaluate progression-free survival (PFS) and distant metastasis-free survival (DMFS) as surrogate end points for overall survival (OS) in randomized trials of chemotherapy in loco-regionally advanced nasopharyngeal carcinomas (NPCs). Individual patient data were obtained from 19 trials of the updated Meta-Analysis of Chemotherapy in Nasopharyngeal Carcinoma (MAC-NPC) plus one additional trial (total = 5144 patients). Surrogacy was evaluated at the individual level using a rank correlation coefficient ρ and at the trial level using a correlation coefficient R2 between treatment effects on the surrogate end point and OS. A sensitivity analysis was performed with two-year PFS/DMFS and five-year OS. PFS was strongly correlated with OS at the individual level (ρ = 0.93, 95% confidence interval [CI] = 0.93 to 0.94) and at the trial level (R2 = 0.95, 95% CI = 0.47 to 1.00). For DMFS, too, the individual-level correlation with OS was strong (ρ = 0.98, 95% CI = 0.98 to 0.98); at trial level, the correlation was high but the regression adjusted for measurement error could not be computed (unadjusted R2 = 0.96, 95% CI = 0.94 to 0.99). In the sensitivity analysis, two-year PFS was highly correlated with five-year OS at the individual level (ρ = 0.89, 95% CI = 0.88 to 0.90) and at the trial level (R2 = 0.85, 95% CI = 0.46 to 1.00); two-year DMFS was highly correlated with five-year OS at the individual level (ρ = 0.95, 95% CI = 0.94 to 0.95) and at the trial level (R2 = 0.78, 95% CI = 0.33 to 1.00). PFS and DMFS are valid surrogate end points for OS to assess treatment effect of chemotherapy in loco-regionally advanced NPC, while PFS can be measured earlier.
| S-EPMC6059121 | biostudies-literature
Project description:ImportanceThe 1-year standardized mortality ratio (SMR) of bullous pemphigoid (BP) has been reported as 2.15 to 7.56 and lower in the US than in Europe.ObjectiveTo estimate the worldwide 1-year SMR of BP.Data sourcesPubMed, Embase, Cochrane Library, Google Scholar, Lissa, and gray literature (eg, medRxiv) were screened for studies of BP published from inception to June 10, 2020, with review of reference lists.Study selectionRetrospective and prospective studies reporting 1-year all-cause mortality rate in patients with BP and providing age statistics (eg, mean [SD]).Data extraction and synthesisTwo reviewers independently extracted the data. The 1-year SMR was computed in studies reporting 1-year mortality by combining information on age obtained from studies with aggregate data and individual data. Risk of representativity, misclassification, and attrition bias were assessed by a custom tool.Main outcomes and measuresThe primary end point was the worldwide 1-year SMR. Secondary analysis included comparison of 1-year SMRs between continents in a meta-regression.ResultsThree studies were performed in the US (n = 260), 1 in South America (n = 45), 16 in Asia (n = 1903), and 36 in Europe (n = 10 132) for a total of 56 unique studies and 12 340 unique patients included in the meta-analysis (mean [SD] age, 77.3 [12.7] years; 55.9% women). The mean (SD) patient age in the United States was 75.6 (13.7) years; in Asia, 73.8 (13.6) years; and in Europe, 78.1 (12.3) years. The worldwide 1-year SMR was estimated at 2.93 (95% CI, 2.59-3.28; I2 = 85.6%) for all 56 studies. The 1-year SMR in the US was 2.40 (95% CI, 0.89-3.90; I2 = 86.3%) for 3 studies; in Asia, 3.53 (95% CI, 2.85-4.20; I2 = 86.3%) for 16 studies; and in Europe, 2.77 (95% CI, 2.35-3.19; I2 = 86.3%) for 36 studies. After adjustment on the expected 1-year mortality rate, the European 1-year SMR did not differ significantly from the 1-year SMR in the United States (-0.48 vs Europe; 95% CI, -2.09 to 1.14; P = .56) and Asia (0.51 vs Europe; 95% CI, -0.56 to 1.58; P = .35). Risk of attrition bias was high (>10% censorship) in 16 studies (28.6%), low in 16 (28.6%), and unclear in 24 (42.9%). Only 4 studies (7.1%) had a sampling method guaranteeing the representativity of BP cases in a population.Conclusions and relevanceAlthough heterogeneity was high and overall quality of follow-up was poor, this meta-analysis confirms the high mortality rate among patients with BP.
| S-EPMC7970384 | biostudies-literature
Project description:BackgroundAlthough acupuncture is widely used for chronic pain, there remains considerable controversy as to its value. We aimed to determine the effect size of acupuncture for 4 chronic pain conditions: back and neck pain, osteoarthritis, chronic headache, and shoulder pain.MethodsWe conducted a systematic review to identify randomized controlled trials (RCTs) of acupuncture for chronic pain in which allocation concealment was determined unambiguously to be adequate. Individual patient data meta-analyses were conducted using data from 29 of 31 eligible RCTs, with a total of 17 922 patients analyzed.ResultsIn the primary analysis, including all eligible RCTs, acupuncture was superior to both sham and no-acupuncture control for each pain condition (P < .001 for all comparisons). After exclusion of an outlying set of RCTs that strongly favored acupuncture, the effect sizes were similar across pain conditions. Patients receiving acupuncture had less pain, with scores that were 0.23 (95% CI, 0.13-0.33), 0.16 (95% CI, 0.07-0.25), and 0.15 (95% CI, 0.07-0.24) SDs lower than sham controls for back and neck pain, osteoarthritis, and chronic headache, respectively; the effect sizes in comparison to no-acupuncture controls were 0.55 (95% CI, 0.51-0.58), 0.57 (95% CI, 0.50-0.64), and 0.42 (95% CI, 0.37-0.46) SDs. These results were robust to a variety of sensitivity analyses, including those related to publication bias.ConclusionsAcupuncture is effective for the treatment of chronic pain and is therefore a reasonable referral option. Significant differences between true and sham acupuncture indicate that acupuncture is more than a placebo. However, these differences are relatively modest, suggesting that factors in addition to the specific effects of needling are important contributors to the therapeutic effects of acupuncture.
| S-EPMC3658605 | biostudies-literature