Retrieval of Individual Participant Data for Exercise Meta-Analyses May Not Be Worth the Time and Effort.
Ontology highlight
ABSTRACT: Purpose
While individual participant data (IPD) meta-analyses are considered the gold standard for meta-analysis, the feasibility of obtaining IPD may be problematic.Methods
Using data from a previous meta-analysis of 29 studies on exercise in adults with arthritis and other rheumatic diseases, the percentage of studies in which useable IPD was provided was calculated.Results
Eight of 29 authors (28%, 95% CI = 11% to 44%) provided IPD. Using logistic regression, neither year of publication (odds ratio = 1.05, 95% CI = 0.90 to 1.27, p = 0.58) nor country (odds ratio = 1.36, 95% CI = 0.20 to 10.9, p = 1.00) was significantly associated with the obtainment of IPD.Conclusions
The retrieval of IPD for exercise meta-analyses may not be worth the time and effort. However, further research is needed before any final recommendations can be made.
SUBMITTER: Kelley GA
PROVIDER: S-EPMC4802027 | biostudies-literature | 2016
REPOSITORIES: biostudies-literature
Publications
Retrieval of Individual Participant Data for Exercise Meta-Analyses May Not Be Worth the Time and Effort.
Kelley George A GA Kelley Kristi S KS
BioMed research international 20160308
<h4>Purpose</h4>While individual participant data (IPD) meta-analyses are considered the gold standard for meta-analysis, the feasibility of obtaining IPD may be problematic.<h4>Methods</h4>Using data from a previous meta-analysis of 29 studies on exercise in adults with arthritis and other rheumatic diseases, the percentage of studies in which useable IPD was provided was calculated.<h4>Results</h4>Eight of 29 authors (28%, 95% CI = 11% to 44%) provided IPD. Using logistic regression, neither y ...[more]
Similar Datasets
Project description:Objective To investigate whether the success rate of retrieving individual participant data (IPD) for use in IPD meta-analyses has increased over time, and to explore the characteristics associated with IPD retrieval.Design Systematic review of published IPD meta-analyses, supplemented by a reflection of the Cochrane Epilepsy Group's 20 years' experience of requesting IPD.Data sources Medline, CENTRAL, Scopus, Web of Science, CINAHL Plus, and PsycINFO.Eligibility criteria for study selection IPD meta-analyses of studies of all designs and all clinical areas published in English.Results 760 IPD meta-analyses which identified studies by systematic methods that had been published between 1987 and 2015 were included. Only 188 (25%) of these IPD meta-analyses retrieved 100% of the eligible IPD for analysis, with 324 (43%) of these IPD meta-analyses retrieving 80% or more of relevant IPD. There is insufficient evidence to suggest that IPD retrieval rates have improved over time. IPD meta-analyses that included only randomised trials, had an authorship policy, included fewer eligible participants, and were conducted outside of the Cochrane Database of Systematic Reviews were associated with a high or complete IPD retrieval rate. There was no association between the source of funding of the IPD meta-analyses and IPD retrieval rate. The IPD retrieval rate of the Cochrane Epilepsy Group has declined from 83% (up to 2005) to 65% (between 2012 and 2015) and the reported reasons for lack of data availability have changed in recent years.Conclusions IPD meta-analyses are considered to be the "gold standard" for the synthesis of data from clinical research studies; however, only 25% of published IPD meta-analyses have had access to all IPD.
| S-EPMC5733815 | biostudies-other
Project description:OBJECTIVES:To demonstrate how individual participant data (IPD) meta-analyses have impacted directly on the design and conduct of trials and highlight other advantages IPD might offer. STUDY DESIGN AND SETTING:Potential examples of the impact of IPD meta-analyses on trials were identified at an international workshop, attended by individuals with experience in the conduct of IPD meta-analyses and knowledge of trials in their respective clinical areas. Experts in the field who did not attend were asked to provide any further examples. We then examined relevant trial protocols, publications, and Web sites to verify the impacts of the IPD meta-analyses. A subgroup of workshop attendees sought further examples and identified other aspects of trial design and conduct that may inform IPD meta-analyses. RESULTS:We identified 52 examples of IPD meta-analyses thought to have had a direct impact on the design or conduct of trials. After screening relevant trial protocols and publications, we identified 28 instances where IPD meta-analyses had clearly impacted on trials. They have influenced the selection of comparators and participants, sample size calculations, analysis and interpretation of subsequent trials, and the conduct and analysis of ongoing trials, sometimes in ways that would not possible with systematic reviews of aggregate data. We identified additional potential ways that IPD meta-analyses could be used to influence trials. CONCLUSIONS:IPD meta-analysis could be better used to inform the design, conduct, analysis, and interpretation of trials.
| S-EPMC4635379 | biostudies-literature
Project description:IntroductionThe heterogeneity in people with borderline personality disorder (BPD) and the range of specialised psychotherapies means that people with certain BPD characteristics might benefit more or less from different types of psychotherapy. Identifying moderating characteristics of individuals is a key to refine and tailor standard treatments so they match the specificities of the individual participant. The objective of this is to improve the quality of care and the individual outcomes. We will do so by performing three systematic reviews with meta-analyses of individual participant data (IPD). The aim of these reviews is to investigate potential predictors and moderating patient characteristics on treatment outcomes for patients with BPD.Methods and analysisWe performed comprehensive searches in 22 databases and trial registries up to October 6th 2020. These will be updated with a top-up search up until June 2021. Our primary meta-analytic method will be the one-stage random-effects approach. To identify predictors, we will use the one-stage model that accounts for interaction between covariates and treatment allocation. Heterogeneity in case-mix will be assessed with a membership model based on a multinomial logistic regression where study membership is the outcome. A random-effects meta-analysis is chosen to account for expected levels of heterogeneity.Ethics and disseminationThe statistical analyses will be conducted on anonymised data that have already been approved by the respective ethical committees that originally assessed the included trials. The three IPD reviews will be published in high-impact factor journals and their results will be presented at international conferences and national seminars.Prospero registration numberCRD42021210688.
| S-EPMC8217922 | biostudies-literature
Project description:When combining results across related studies, a multivariate meta-analysis allows the joint synthesis of correlated effect estimates from multiple outcomes. Joint synthesis can improve efficiency over separate univariate syntheses, may reduce selective outcome reporting biases, and enables joint inferences across the outcomes. A common issue is that within-study correlations needed to fit the multivariate model are unknown from published reports. However, provision of individual participant data (IPD) allows them to be calculated directly. Here, we illustrate how to use IPD to estimate within-study correlations, using a joint linear regression for multiple continuous outcomes and bootstrapping methods for binary, survival and mixed outcomes. In a meta-analysis of 10 hypertension trials, we then show how these methods enable multivariate meta-analysis to address novel clinical questions about continuous, survival and binary outcomes; treatment-covariate interactions; adjusted risk/prognostic factor effects; longitudinal data; prognostic and multiparameter models; and multiple treatment comparisons. Both frequentist and Bayesian approaches are applied, with example software code provided to derive within-study correlations and to fit the models.
| S-EPMC4847645 | biostudies-literature
Project description:BackgroundNetwork meta-analyses using individual participant data (IPD-NMAs) have been increasingly used to compare the effects of multiple interventions. Although there have been many studies on statistical methods for IPD-NMAs, it is unclear whether there are statistical defects in published IPD-NMAs and whether the reporting of statistical analyses has improved. This study aimed to investigate statistical methods used and assess the reporting and methodological quality of IPD-NMAs.MethodsWe searched four bibliographic databases to identify published IPD-NMAs. The methodological quality was assessed using AMSTAR-2 and reporting quality assessed based on PRISMA-IPD and PRISMA-NMA. We performed stratified analyses and correlation analyses to explore the factors that might affect quality.ResultsWe identified 21 IPD-NMAs. Only 23.8% of the included IPD-NMAs reported statistical techniques used for missing participant data, 42.9% assessed the consistency, and none assessed the transitivity. None of the included IPD-NMAs reported sources of funding for trials included, only 9.5% stated pre-registration of protocols, and 28.6% assessed the risk of bias in individual studies. For reporting quality, compliance rates were lower than 50.0% for more than half of the items. Less than 15.0% of the IPD-NMAs reported data integrity, presented the network geometry, or clarified risk of bias across studies. IPD-NMAs with statistical or epidemiological authors often better assessed the inconsistency (P?=?0.017). IPD-NMAs with a priori protocol were associated with higher reporting quality in terms of search (P?=?0.046), data collection process (P?=?0.031), and syntheses of results (P?=?0.006).ConclusionsThe reporting of statistical methods and compliance rates of methodological and reporting items of IPD-NMAs were suboptimal. Authors of future IPD-NMAs should address the identified flaws and strictly adhere to methodological and reporting guidelines.
| S-EPMC7262764 | biostudies-literature
Project description:Dietary Reference Values (DRVs) for vitamin D have a key role in the prevention of vitamin D deficiency. However, despite adopting similar risk assessment protocols, estimates from authoritative agencies over the last 6 years have been diverse. This may have arisen from diverse approaches to data analysis. Modelling strategies for pooling of individual subject data from cognate vitamin D randomized controlled trials (RCTs) are likely to provide the most appropriate DRV estimates. Thus, the objective of the present work was to undertake the first-ever individual participant data (IPD)-level meta-regression, which is increasingly recognized as best practice, from seven winter-based RCTs (with 882 participants ranging in age from 4 to 90 years) of the vitamin D intake-serum 25-hydroxyvitamin D (25(OH)D) dose-response. Our IPD-derived estimates of vitamin D intakes required to maintain 97.5% of 25(OH)D concentrations >25, 30, and 50 nmol/L across the population are 10, 13, and 26 µg/day, respectively. In contrast, standard meta-regression analyses with aggregate data (as used by several agencies in recent years) from the same RCTs estimated that a vitamin D intake requirement of 14 µg/day would maintain 97.5% of 25(OH)D >50 nmol/L. These first IPD-derived estimates offer improved dietary recommendations for vitamin D because the underpinning modeling captures the between-person variability in response of serum 25(OH)D to vitamin D intake.
| S-EPMC5452199 | biostudies-literature
Project description:BackgroundIndividual participant data (IPD) meta-analyses that obtain "raw" data from studies rather than summary data typically adopt a "two-stage" approach to analysis whereby IPD within trials generate summary measures, which are combined using standard meta-analytical methods. Recently, a range of "one-stage" approaches which combine all individual participant data in a single meta-analysis have been suggested as providing a more powerful and flexible approach. However, they are more complex to implement and require statistical support. This study uses a dataset to compare "two-stage" and "one-stage" models of varying complexity, to ascertain whether results obtained from the approaches differ in a clinically meaningful way.Methods and findingsWe included data from 24 randomised controlled trials, evaluating antiplatelet agents, for the prevention of pre-eclampsia in pregnancy. We performed two-stage and one-stage IPD meta-analyses to estimate overall treatment effect and to explore potential treatment interactions whereby particular types of women and their babies might benefit differentially from receiving antiplatelets. Two-stage and one-stage approaches gave similar results, showing a benefit of using anti-platelets (Relative risk 0.90, 95% CI 0.84 to 0.97). Neither approach suggested that any particular type of women benefited more or less from antiplatelets. There were no material differences in results between different types of one-stage model.ConclusionsFor these data, two-stage and one-stage approaches to analysis produce similar results. Although one-stage models offer a flexible environment for exploring model structure and are useful where across study patterns relating to types of participant, intervention and outcome mask similar relationships within trials, the additional insights provided by their usage may not outweigh the costs of statistical support for routine application in syntheses of randomised controlled trials. Researchers considering undertaking an IPD meta-analysis should not necessarily be deterred by a perceived need for sophisticated statistical methods when combining information from large randomised trials.
| S-EPMC3463584 | biostudies-literature
Project description:ImportanceFew people with lower extremity peripheral artery disease (PAD) participate in supervised treadmill exercise covered by the Center for Medicare and Medicaid Services. In people with PAD, the benefits of home-based walking exercise, relative to supervised exercise, remain unclear.ObjectiveTo study whether home-based walking exercise improves 6-minute walk (6MW) more than supervised treadmill exercise in people with PAD (defined as Ankle Brachial Index ≤0.90).Data sourcesData were combined from 5 randomized clinical trials of exercise therapy for PAD using individual participant data meta-analyses, published from 2009 to 2022.Study selectionOf the 5 clinical trials, 3 clinical trials compared supervised treadmill exercise to nonexercise control (N = 370) and 2 clinical trials compared an effective home-based walking exercise intervention to nonexercise control (N = 349).Data extraction and synthesisIndividual participant-level data from 5 randomized clinical trials led by 1 investigative team were combined. The 5 randomized clinical trials included 3 clinical trials of supervised treadmill exercise and 2 effective home-based walking exercise interventions.Main outcomes and measuresChange in 6MW distance, maximum treadmill walking distance, and Walking Impairment Questionnaire at 6-month follow-up. The supervised treadmill exercise intervention consisted of treadmill exercise in the presence of an exercise physiologist, conducted 3 days weekly for up to 50 minutes per session. Home-based walking exercise consisted of a behavioral intervention in which a coach helped participants walk for exercise in or around home for up to 5 days per week for 50 minutes per session.ResultsA total of 719 participants with PAD (mean [SD] age, 68.8 [9.5] years; 46.5% female) were included (349 in a home-based exercise clinical trial and 370 in a supervised exercise trial). Compared with nonexercise control, supervised treadmill exercise was associated with significantly improved 6MW by 32.9 m (95% CI, 20.6-45.6; P < .001) and home-based walking exercise was associated with significantly improved 6MW by 50.7 m (95% CI, 34.8-66.7; P < .001). Compared with supervised treadmill exercise, home-based walking exercise was associated with significantly greater improvement in 6MW distance (between-group difference: 23.8 m [95% CI, 3.6, 44.0; P = .02]) but significantly less improvement in maximum treadmill walking distance (between-group difference:-132.5 m [95% CI, -192.9 to -72.1; P < .001]).Conclusions and relevanceIn this individual participant data meta-analyses, compared with supervised exercise, home-based walking exercise was associated with greater improvement in 6MW in people with PAD. These findings support home-based walking exercise as a first-line therapy for walking limitations in PAD.
| S-EPMC10514734 | biostudies-literature
Project description:Meta-analysis of individual participant data (IPD meta-analysis) has several advantages over meta-analysis using aggregated published data, including the possibility of using statistical methods such as a fine stratification analysis, interaction analysis between 2 risk factors, and absolute risk estimation. The Evidence for Cardiovascular Prevention from Observational Cohorts in Japan Study (EPOCH-JAPAN), which was initiated in 2005, is a collaborative research project for IPD meta-analysis and includes 13 participating cohort studies in Japan. We generated 2 pooled databases with data on all-cause mortality (n = 199 047) and cardiovascular outcomes (n = 90 528) and applied a stratified Cox model to account for the different baseline hazards between cohorts. The results of our analyses show the age- and sex-specific associations between all-cause and cardiovascular disease mortality and established cardiovascular risk factors (blood pressure, smoking, total cholesterol, proteinuria, and kidney function). During the 9 years of its existence, the results generated by EPOCH-JAPAN have had important implications for clinical medicine and public health policy in Japan. The project is expected to draw upon new analytical methods such as interaction analysis and absolute risk evaluation in the near future. We believe that, over the next decade, this project will continue to provide new insights that can be applied to research on other Asian populations.
| S-EPMC3956690 | biostudies-literature
Project description:Whether the vaccine adjuvant potential of acute exercise is uniform among different populations, e.g., inactive persons, is unknown. This meta-analysis examines influenza vaccine antibody responses and the effect of physical activity, acute exercise, and their interaction. Inclusion criteria comprised randomized controlled trials with acute exercise intervention and influenza vaccination antibody measurements at baseline and 4-6 weeks, and participant baseline physical activity measurement; there were no exclusion criteria. Searching via six databases (Medline, Embase, CINAHL, Scopus, Web of Science, and Physiotherapy Evidence) and two clinical registries (WHO and NIH), nine studies were identified and assessed with the Cochrane revised risk-of-bias tool. Data analysis comprised one-stage random-effects generalized linear mixed-effects models with random intercept. Seven of nine identified studies, all of high risk of bias, provided data for 550 included participants. Clinical measures of antibody response tended to be higher in the acute-exercised participants compared to rested controls and physically active compared to inactive. Physical activity significantly increased H1 strain seroconversion (adjusted odds ratio (aOR) 1.69, 95%CI: 1.02-2.82) among all participants and titer response (aOR 1.20, 95%CI: 1.03-1.39) among the acute exercise group. Increasing age frequently reduced immunogenic responses whereas body mass index and sex had little-to-no effect. Adjuvant effects were more pronounced with interventions exercising the same arm in which the vaccination was administered. H1 response was increased by both physical activity and the acute exercise-physical activity interaction. Given the observed modifications by age and the subset analysis suggesting the benefit is more pronounced in older populations, future attention is due for acute exercise-PA interactions to impact vaccination response in the at-risk population of older adults. Further, we identify localized exercise as the likely most-effective protocol and encourage its use to augment the available evidence.
| S-EPMC9200169 | biostudies-literature