Retrieval of Individual Participant Data for Exercise Meta-Analyses May Not Be Worth the Time and Effort.
Ontology highlight
ABSTRACT: Purpose
While individual participant data (IPD) meta-analyses are considered the gold standard for meta-analysis, the feasibility of obtaining IPD may be problematic.Methods
Using data from a previous meta-analysis of 29 studies on exercise in adults with arthritis and other rheumatic diseases, the percentage of studies in which useable IPD was provided was calculated.Results
Eight of 29 authors (28%, 95% CI = 11% to 44%) provided IPD. Using logistic regression, neither year of publication (odds ratio = 1.05, 95% CI = 0.90 to 1.27, p = 0.58) nor country (odds ratio = 1.36, 95% CI = 0.20 to 10.9, p = 1.00) was significantly associated with the obtainment of IPD.Conclusions
The retrieval of IPD for exercise meta-analyses may not be worth the time and effort. However, further research is needed before any final recommendations can be made.
SUBMITTER: Kelley GA
PROVIDER: S-EPMC4802027 | biostudies-literature | 2016
REPOSITORIES: biostudies-literature
Publications
Retrieval of Individual Participant Data for Exercise Meta-Analyses May Not Be Worth the Time and Effort.
Kelley George A GA Kelley Kristi S KS
BioMed research international 20160308
<h4>Purpose</h4>While individual participant data (IPD) meta-analyses are considered the gold standard for meta-analysis, the feasibility of obtaining IPD may be problematic.<h4>Methods</h4>Using data from a previous meta-analysis of 29 studies on exercise in adults with arthritis and other rheumatic diseases, the percentage of studies in which useable IPD was provided was calculated.<h4>Results</h4>Eight of 29 authors (28%, 95% CI = 11% to 44%) provided IPD. Using logistic regression, neither y ...[more]
Similar Datasets
Project description:Objective To investigate whether the success rate of retrieving individual participant data (IPD) for use in IPD meta-analyses has increased over time, and to explore the characteristics associated with IPD retrieval.Design Systematic review of published IPD meta-analyses, supplemented by a reflection of the Cochrane Epilepsy Group's 20 years' experience of requesting IPD.Data sources Medline, CENTRAL, Scopus, Web of Science, CINAHL Plus, and PsycINFO.Eligibility criteria for study selection IPD meta-analyses of studies of all designs and all clinical areas published in English.Results 760 IPD meta-analyses which identified studies by systematic methods that had been published between 1987 and 2015 were included. Only 188 (25%) of these IPD meta-analyses retrieved 100% of the eligible IPD for analysis, with 324 (43%) of these IPD meta-analyses retrieving 80% or more of relevant IPD. There is insufficient evidence to suggest that IPD retrieval rates have improved over time. IPD meta-analyses that included only randomised trials, had an authorship policy, included fewer eligible participants, and were conducted outside of the Cochrane Database of Systematic Reviews were associated with a high or complete IPD retrieval rate. There was no association between the source of funding of the IPD meta-analyses and IPD retrieval rate. The IPD retrieval rate of the Cochrane Epilepsy Group has declined from 83% (up to 2005) to 65% (between 2012 and 2015) and the reported reasons for lack of data availability have changed in recent years.Conclusions IPD meta-analyses are considered to be the "gold standard" for the synthesis of data from clinical research studies; however, only 25% of published IPD meta-analyses have had access to all IPD.
| S-EPMC5733815 | biostudies-other
Project description:OBJECTIVES:To demonstrate how individual participant data (IPD) meta-analyses have impacted directly on the design and conduct of trials and highlight other advantages IPD might offer. STUDY DESIGN AND SETTING:Potential examples of the impact of IPD meta-analyses on trials were identified at an international workshop, attended by individuals with experience in the conduct of IPD meta-analyses and knowledge of trials in their respective clinical areas. Experts in the field who did not attend were asked to provide any further examples. We then examined relevant trial protocols, publications, and Web sites to verify the impacts of the IPD meta-analyses. A subgroup of workshop attendees sought further examples and identified other aspects of trial design and conduct that may inform IPD meta-analyses. RESULTS:We identified 52 examples of IPD meta-analyses thought to have had a direct impact on the design or conduct of trials. After screening relevant trial protocols and publications, we identified 28 instances where IPD meta-analyses had clearly impacted on trials. They have influenced the selection of comparators and participants, sample size calculations, analysis and interpretation of subsequent trials, and the conduct and analysis of ongoing trials, sometimes in ways that would not possible with systematic reviews of aggregate data. We identified additional potential ways that IPD meta-analyses could be used to influence trials. CONCLUSIONS:IPD meta-analysis could be better used to inform the design, conduct, analysis, and interpretation of trials.
| S-EPMC4635379 | biostudies-literature
Project description:When combining results across related studies, a multivariate meta-analysis allows the joint synthesis of correlated effect estimates from multiple outcomes. Joint synthesis can improve efficiency over separate univariate syntheses, may reduce selective outcome reporting biases, and enables joint inferences across the outcomes. A common issue is that within-study correlations needed to fit the multivariate model are unknown from published reports. However, provision of individual participant data (IPD) allows them to be calculated directly. Here, we illustrate how to use IPD to estimate within-study correlations, using a joint linear regression for multiple continuous outcomes and bootstrapping methods for binary, survival and mixed outcomes. In a meta-analysis of 10 hypertension trials, we then show how these methods enable multivariate meta-analysis to address novel clinical questions about continuous, survival and binary outcomes; treatment-covariate interactions; adjusted risk/prognostic factor effects; longitudinal data; prognostic and multiparameter models; and multiple treatment comparisons. Both frequentist and Bayesian approaches are applied, with example software code provided to derive within-study correlations and to fit the models.
| S-EPMC4847645 | biostudies-literature
Project description:IntroductionThe heterogeneity in people with borderline personality disorder (BPD) and the range of specialised psychotherapies means that people with certain BPD characteristics might benefit more or less from different types of psychotherapy. Identifying moderating characteristics of individuals is a key to refine and tailor standard treatments so they match the specificities of the individual participant. The objective of this is to improve the quality of care and the individual outcomes. We will do so by performing three systematic reviews with meta-analyses of individual participant data (IPD). The aim of these reviews is to investigate potential predictors and moderating patient characteristics on treatment outcomes for patients with BPD.Methods and analysisWe performed comprehensive searches in 22 databases and trial registries up to October 6th 2020. These will be updated with a top-up search up until June 2021. Our primary meta-analytic method will be the one-stage random-effects approach. To identify predictors, we will use the one-stage model that accounts for interaction between covariates and treatment allocation. Heterogeneity in case-mix will be assessed with a membership model based on a multinomial logistic regression where study membership is the outcome. A random-effects meta-analysis is chosen to account for expected levels of heterogeneity.Ethics and disseminationThe statistical analyses will be conducted on anonymised data that have already been approved by the respective ethical committees that originally assessed the included trials. The three IPD reviews will be published in high-impact factor journals and their results will be presented at international conferences and national seminars.Prospero registration numberCRD42021210688.
| S-EPMC8217922 | biostudies-literature
Project description:BackgroundNetwork meta-analyses using individual participant data (IPD-NMAs) have been increasingly used to compare the effects of multiple interventions. Although there have been many studies on statistical methods for IPD-NMAs, it is unclear whether there are statistical defects in published IPD-NMAs and whether the reporting of statistical analyses has improved. This study aimed to investigate statistical methods used and assess the reporting and methodological quality of IPD-NMAs.MethodsWe searched four bibliographic databases to identify published IPD-NMAs. The methodological quality was assessed using AMSTAR-2 and reporting quality assessed based on PRISMA-IPD and PRISMA-NMA. We performed stratified analyses and correlation analyses to explore the factors that might affect quality.ResultsWe identified 21 IPD-NMAs. Only 23.8% of the included IPD-NMAs reported statistical techniques used for missing participant data, 42.9% assessed the consistency, and none assessed the transitivity. None of the included IPD-NMAs reported sources of funding for trials included, only 9.5% stated pre-registration of protocols, and 28.6% assessed the risk of bias in individual studies. For reporting quality, compliance rates were lower than 50.0% for more than half of the items. Less than 15.0% of the IPD-NMAs reported data integrity, presented the network geometry, or clarified risk of bias across studies. IPD-NMAs with statistical or epidemiological authors often better assessed the inconsistency (P?=?0.017). IPD-NMAs with a priori protocol were associated with higher reporting quality in terms of search (P?=?0.046), data collection process (P?=?0.031), and syntheses of results (P?=?0.006).ConclusionsThe reporting of statistical methods and compliance rates of methodological and reporting items of IPD-NMAs were suboptimal. Authors of future IPD-NMAs should address the identified flaws and strictly adhere to methodological and reporting guidelines.
| S-EPMC7262764 | biostudies-literature
Project description:Dietary Reference Values (DRVs) for vitamin D have a key role in the prevention of vitamin D deficiency. However, despite adopting similar risk assessment protocols, estimates from authoritative agencies over the last 6 years have been diverse. This may have arisen from diverse approaches to data analysis. Modelling strategies for pooling of individual subject data from cognate vitamin D randomized controlled trials (RCTs) are likely to provide the most appropriate DRV estimates. Thus, the objective of the present work was to undertake the first-ever individual participant data (IPD)-level meta-regression, which is increasingly recognized as best practice, from seven winter-based RCTs (with 882 participants ranging in age from 4 to 90 years) of the vitamin D intake-serum 25-hydroxyvitamin D (25(OH)D) dose-response. Our IPD-derived estimates of vitamin D intakes required to maintain 97.5% of 25(OH)D concentrations >25, 30, and 50 nmol/L across the population are 10, 13, and 26 µg/day, respectively. In contrast, standard meta-regression analyses with aggregate data (as used by several agencies in recent years) from the same RCTs estimated that a vitamin D intake requirement of 14 µg/day would maintain 97.5% of 25(OH)D >50 nmol/L. These first IPD-derived estimates offer improved dietary recommendations for vitamin D because the underpinning modeling captures the between-person variability in response of serum 25(OH)D to vitamin D intake.
| S-EPMC5452199 | biostudies-literature
Project description:BackgroundIndividual participant data (IPD) meta-analyses that obtain "raw" data from studies rather than summary data typically adopt a "two-stage" approach to analysis whereby IPD within trials generate summary measures, which are combined using standard meta-analytical methods. Recently, a range of "one-stage" approaches which combine all individual participant data in a single meta-analysis have been suggested as providing a more powerful and flexible approach. However, they are more complex to implement and require statistical support. This study uses a dataset to compare "two-stage" and "one-stage" models of varying complexity, to ascertain whether results obtained from the approaches differ in a clinically meaningful way.Methods and findingsWe included data from 24 randomised controlled trials, evaluating antiplatelet agents, for the prevention of pre-eclampsia in pregnancy. We performed two-stage and one-stage IPD meta-analyses to estimate overall treatment effect and to explore potential treatment interactions whereby particular types of women and their babies might benefit differentially from receiving antiplatelets. Two-stage and one-stage approaches gave similar results, showing a benefit of using anti-platelets (Relative risk 0.90, 95% CI 0.84 to 0.97). Neither approach suggested that any particular type of women benefited more or less from antiplatelets. There were no material differences in results between different types of one-stage model.ConclusionsFor these data, two-stage and one-stage approaches to analysis produce similar results. Although one-stage models offer a flexible environment for exploring model structure and are useful where across study patterns relating to types of participant, intervention and outcome mask similar relationships within trials, the additional insights provided by their usage may not outweigh the costs of statistical support for routine application in syntheses of randomised controlled trials. Researchers considering undertaking an IPD meta-analysis should not necessarily be deterred by a perceived need for sophisticated statistical methods when combining information from large randomised trials.
| S-EPMC3463584 | biostudies-literature
Project description:Meta-analysis of individual participant data (IPD meta-analysis) has several advantages over meta-analysis using aggregated published data, including the possibility of using statistical methods such as a fine stratification analysis, interaction analysis between 2 risk factors, and absolute risk estimation. The Evidence for Cardiovascular Prevention from Observational Cohorts in Japan Study (EPOCH-JAPAN), which was initiated in 2005, is a collaborative research project for IPD meta-analysis and includes 13 participating cohort studies in Japan. We generated 2 pooled databases with data on all-cause mortality (n = 199 047) and cardiovascular outcomes (n = 90 528) and applied a stratified Cox model to account for the different baseline hazards between cohorts. The results of our analyses show the age- and sex-specific associations between all-cause and cardiovascular disease mortality and established cardiovascular risk factors (blood pressure, smoking, total cholesterol, proteinuria, and kidney function). During the 9 years of its existence, the results generated by EPOCH-JAPAN have had important implications for clinical medicine and public health policy in Japan. The project is expected to draw upon new analytical methods such as interaction analysis and absolute risk evaluation in the near future. We believe that, over the next decade, this project will continue to provide new insights that can be applied to research on other Asian populations.
| S-EPMC3956690 | biostudies-literature
Project description:Meta-analytic methods for combining data from multiple intervention trials are commonly used to estimate the effectiveness of an intervention. They can also be extended to study comparative effectiveness, testing which of several alternative interventions is expected to have the strongest effect. This often requires network meta-analysis (NMA), which combines trials involving direct comparison of two interventions within the same trial and indirect comparisons across trials. In this paper, we extend existing network methods for main effects to examining moderator effects, allowing for tests of whether intervention effects vary for different populations or when employed in different contexts. In addition, we study how the use of individual participant data may increase the sensitivity of NMA for detecting moderator effects, as compared with aggregate data NMA that employs study-level effect sizes in a meta-regression framework. A new NMA diagram is proposed. We also develop a generalized multilevel model for NMA that takes into account within-trial and between-trial heterogeneity and can include participant-level covariates. Within this framework, we present definitions of homogeneity and consistency across trials. A simulation study based on this model is used to assess effects on power to detect both main and moderator effects. Results show that power to detect moderation is substantially greater when applied to individual participant data as compared with study-level effects. We illustrate the use of this method by applying it to data from a classroom-based randomized study that involved two sub-trials, each comparing interventions that were contrasted with separate control groups. Copyright © 2016 John Wiley & Sons, Ltd.
| S-EPMC4893003 | biostudies-literature
Project description:Multiple imputation is a strategy for the analysis of incomplete data such that the impact of the missingness on the power and bias of estimates is mitigated. When data from multiple studies are collated, we can propose both within-study and multilevel imputation models to impute missing data on covariates. It is not clear how to choose between imputation models or how to combine imputation and inverse-variance weighted meta-analysis methods. This is especially important as often different studies measure data on different variables, meaning that we may need to impute data on a variable which is systematically missing in a particular study. In this paper, we consider a simulation analysis of sporadically missing data in a single covariate with a linear analysis model and discuss how the results would be applicable to the case of systematically missing data. We find in this context that ensuring the congeniality of the imputation and analysis models is important to give correct standard errors and confidence intervals. For example, if the analysis model allows between-study heterogeneity of a parameter, then we should incorporate this heterogeneity into the imputation model to maintain the congeniality of the two models. In an inverse-variance weighted meta-analysis, we should impute missing data and apply Rubin's rules at the study level prior to meta-analysis, rather than meta-analyzing each of the multiple imputations and then combining the meta-analysis estimates using Rubin's rules. We illustrate the results using data from the Emerging Risk Factors Collaboration.
| S-EPMC3963448 | biostudies-literature