Dataset Information

Individual participant data meta-analysis of prognostic factor studies: state of the art?

ABSTRACT:

Background

Prognostic factors are associated with the risk of a subsequent outcome in people with a given disease or health condition. Meta-analysis using individual participant data (IPD), where the raw data are synthesised from multiple studies, has been championed as the gold-standard for synthesising prognostic factor studies. We assessed the feasibility and conduct of this approach.

Methods

A systematic review to identify published IPD meta-analyses of prognostic factors studies, followed by detailed assessment of a random sample of 20 articles published from 2006. Six of these 20 articles were from the IMPACT (International Mission for Prognosis and Analysis of Clinical Trials in traumatic brain injury) collaboration, for which additional information was also used from simultaneously published companion papers.

Results

Forty-eight published IPD meta-analyses of prognostic factors were identified up to March 2009. Only three were published before 2000 but thereafter a median of four articles exist per year, with traumatic brain injury the most active research field. Availability of IPD offered many advantages, such as checking modelling assumptions; analysing variables on their continuous scale with the possibility of assessing for non-linear relationships; and obtaining results adjusted for other variables. However, researchers also faced many challenges, such as large cost and time required to obtain and clean IPD; unavailable IPD for some studies; different sets of prognostic factors in each study; and variability in study methods of measurement. The IMPACT initiative is a leading example, and had generally strong design, methodological and statistical standards. Elsewhere, standards are not always as high and improvements in the conduct of IPD meta-analyses of prognostic factor studies are often needed; in particular, continuous variables are often categorised without reason; publication bias and availability bias are rarely examined; and important methodological details and summary results are often inadequately reported.

Conclusions

IPD meta-analyses of prognostic factors are achievable and offer many advantages, as displayed most expertly by the IMPACT initiative. However such projects face numerous logistical and methodological obstacles, and their conduct and reporting can often be substantially improved.

SUBMITTER: Abo-Zaid G

PROVIDER: S-EPMC3413577 | biostudies-literature | 2012 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Individual participant data meta-analysis of prognostic factor studies: state of the art?

Abo-Zaid Ghada G Sauerbrei Willi W Riley Richard D RD

BMC medical research methodology 20120424

<h4>Background</h4>Prognostic factors are associated with the risk of a subsequent outcome in people with a given disease or health condition. Meta-analysis using individual participant data (IPD), where the raw data are synthesised from multiple studies, has been championed as the gold-standard for synthesising prognostic factor studies. We assessed the feasibility and conduct of this approach.<h4>Methods</h4>A systematic review to identify published IPD meta-analyses of prognostic factors stud ...[more]

PMID: 22530717

Similar Datasets

Project description:BackgroundIn non-randomized studies (NRSs) where a continuous outcome variable (e.g., depressive symptoms) is assessed at baseline and follow-up, it is common to observe imbalance of the baseline values between the treatment/exposure group and control group. This may bias the study and consequently a meta-analysis (MA) estimate. These estimates may differ across statistical methods used to deal with this issue. Analysis of individual participant data (IPD) allows standardization of methods across studies. We aimed to identify methods used in published IPD-MAs of NRSs for continuous outcomes, and to compare different methods to account for baseline values of outcome variables in IPD-MA of NRSs using two empirical examples from the Thyroid Studies Collaboration (TSC).MethodsFor the first aim we systematically searched in MEDLINE, EMBASE, and Cochrane from inception to February 2021 to identify published IPD-MAs of NRSs that adjusted for baseline outcome measures in the analysis of continuous outcomes. For the second aim, we applied analysis of covariance (ANCOVA), change score, propensity score and the naïve approach (ignores the baseline outcome data) in IPD-MA from NRSs on the association between subclinical hyperthyroidism and depressive symptoms and renal function. We estimated the study and meta-analytic mean difference (MD) and relative standard error (SE). We used both fixed- and random-effects MA.ResultsTen of 18 (56%) of the included studies used the change score method, seven (39%) studies used ANCOVA and one the propensity score (5%). The study estimates were similar across the methods in studies in which groups were balanced at baseline with regard to outcome variables but differed in studies with baseline imbalance. In our empirical examples, ANCOVA and change score showed study results on the same direction, not the propensity score. In our applications, ANCOVA provided more precise estimates, both at study and meta-analytical level, in comparison to other methods. Heterogeneity was higher when change score was used as outcome, moderate for ANCOVA and null with the propensity score.ConclusionANCOVA provided the most precise estimates at both study and meta-analytic level and thus seems preferable in the meta-analysis of IPD from non-randomized studies. For the studies that were well-balanced between groups, change score, and ANCOVA performed similarly.

Project description:BackgroundPre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk during pregnancy is required to plan management. Although there are many published prediction models for pre-eclampsia, few have been validated in external data. Our objective was to externally validate published prediction models for pre-eclampsia using individual participant data (IPD) from UK studies, to evaluate whether any of the models can accurately predict the condition when used within the UK healthcare setting.MethodsIPD from 11 UK cohort studies (217,415 pregnant women) within the International Prediction of Pregnancy Complications (IPPIC) pre-eclampsia network contributed to external validation of published prediction models, identified by systematic review. Cohorts that measured all predictor variables in at least one of the identified models and reported pre-eclampsia as an outcome were included for validation. We reported the model predictive performance as discrimination (C-statistic), calibration (calibration plots, calibration slope, calibration-in-the-large), and net benefit. Performance measures were estimated separately in each available study and then, where possible, combined across studies in a random-effects meta-analysis.ResultsOf 131 published models, 67 provided the full model equation and 24 could be validated in 11 UK cohorts. Most of the models showed modest discrimination with summary C-statistics between 0.6 and 0.7. The calibration of the predicted compared to observed risk was generally poor for most models with observed calibration slopes less than 1, indicating that predictions were generally too extreme, although confidence intervals were wide. There was large between-study heterogeneity in each model's calibration-in-the-large, suggesting poor calibration of the predicted overall risk across populations. In a subset of models, the net benefit of using the models to inform clinical decisions appeared small and limited to probability thresholds between 5 and 7%.ConclusionsThe evaluated models had modest predictive performance, with key limitations such as poor calibration (likely due to overfitting in the original development datasets), substantial heterogeneity, and small net benefit across settings. The evidence to support the use of these prediction models for pre-eclampsia in clinical decision-making is limited. Any models that we could not validate should be examined in terms of their predictive performance, net benefit, and heterogeneity across multiple UK settings before consideration for use in practice.Trial registrationPROSPERO ID: CRD42015029349 .

Project description:Sequencing studies have shown that optimal vaginal microbiota (VMB) are lactobacilli-dominated and that anaerobes associated with bacterial vaginosis (BV-anaerobes) are commonly present. However, they overlooked a less prevalent but more pathogenic group of vaginal bacteria: the pathobionts that cause maternal and neonatal infections and pelvic inflammatory disease. We conducted an individual participant data meta-analysis of three VMB sequencing studies that included diverse groups of women in Rwanda, South Africa, and the Netherlands (2,044 samples from 1,163 women in total). We identified 40 pathobiont taxa but only six were non-minority taxa (at least 1% relative abundance in at least one sample) in all studies: Streptococcus (54% of pathobionts reads), Staphylococcus, Enterococcus, Escherichia/Shigella, Haemophilus, and Campylobacter. When all pathobionts were combined into one bacterial group, the VMB of 17% of women contained a relative abundance of at least 1%. We found a significant negative correlation between relative abundances (? = -0.9234), but not estimated concentrations (r = 0.0031), of lactobacilli and BV-anaerobes; and a significant positive correlation between estimated concentrations of pathobionts and BV-anaerobes (r = 0.1938) but not between pathobionts and lactobacilli (r = 0.0436; although lactobacilli declined non-significantly with increasing pathobionts proportions). VMB sequencing data were also classified into mutually exclusive VMB types. The overall mean bacterial load of the ?20% pathobionts VMB type (5.85 log10 cells/?l) was similar to those of the three lactobacilli-dominated VMB types (means 5.13-5.83 log10 cells/?l) but lower than those of the four anaerobic dysbiosis VMB types (means 6.11-6.87 log10 cells/?l). These results suggest that pathobionts co-occur with both lactobacilli and BV-anaerobes and do not expand as much as BV-anaerobes do in a dysbiotic situation. Pathobionts detection/levels were increased in samples with a Nugent score of 4-6 in both studies that conducted Nugent-scoring. Having pathobionts was positively associated with young age, non-Dutch origin, hormonal contraceptive use, smoking, antibiotic use in the 14 days prior to sampling, HIV status, and the presence of sexually transmitted pathogens, in at least one but not all studies; inconsistently associated with sexual risk-taking and unusual vaginal discharge reporting; and not associated with vaginal yeasts detection by microscopy. We recommend that future VMB studies quantify common vaginal pathobiont genera.

Project description:AimsTo investigate cross-sectional and longitudinal associations between personality and smoking, and test whether socio-demographic factors modify these associations.DesignCross-sectional and longitudinal individual-participant meta-analysis.SettingNine cohort studies from Australia, Germany, the United Kingdom and the United States.ParticipantsA total of 79 757 men and women (mean age = 50.8 years).MeasurementsPersonality traits of the five-factor model (extraversion, neuroticism, agreeableness, conscientiousness and openness to experience) were used as exposures. Outcomes were current smoking status (current smoker, ex-smoker and never smoker), smoking initiation, smoking relapse and smoking cessation. Associations between personality and smoking were modelled using logistic and multinomial logistic regression, and study-specific findings were combined using random-effect meta-analysis.FindingsCurrent smoking was associated with higher extraversion [odds ratio per 1 standard deviation increase in the score: 1.16; 95% confidence interval (CI) = 1.08-1.24], higher neuroticism (1.19; 95% CI = 1.13-1.26) and lower conscientiousness (95% CI = 0.88; 0.83-0.94). Among non-smokers, smoking initiation during the follow-up period was predicted prospectively by higher extraversion (1.22; 95% CI = 1.04-1.43) and lower conscientiousness (0.80; 95% CI = 0.68-0.93), whereas higher neuroticism (1.16; 95% CI = 1.04-1.30) predicted smoking relapse among ex-smokers. Among smokers, smoking cessation was negatively associated with neuroticism (0.91; 95% CI = 0.87-0.96). Socio-demographic variables did not appear to modify the associations between personality and smoking.ConclusionsAdult smokers have higher extraversion, higher neuroticism and lower conscientiousness personality scores than non-smokers. Initiation into smoking is associated positively with higher extraversion and lower conscientiousness, while relapse to smoking among ex-smokers is associated with higher neuroticism.

Dataset Information

Individual participant data meta-analysis of prognostic factor studies: state of the art?

Background

Methods

Results

Conclusions

Publications

Individual participant data meta-analysis of prognostic factor studies: state of the art?

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets