Dataset Information

Deriving percentage study weights in multi-parameter meta-analysis models: with application to meta-regression, network meta-analysis and one-stage individual participant data models.

ABSTRACT: Many meta-analysis models contain multiple parameters, for example due to multiple outcomes, multiple treatments or multiple regression coefficients. In particular, meta-regression models may contain multiple study-level covariates, and one-stage individual participant data meta-analysis models may contain multiple patient-level covariates and interactions. Here, we propose how to derive percentage study weights for such situations, in order to reveal the (otherwise hidden) contribution of each study toward the parameter estimates of interest. We assume that studies are independent, and utilise a decomposition of Fisher's information matrix to decompose the total variance matrix of parameter estimates into study-specific contributions, from which percentage weights are derived. This approach generalises how percentage weights are calculated in a traditional, single parameter meta-analysis model. Application is made to one- and two-stage individual participant data meta-analyses, meta-regression and network (multivariate) meta-analysis of multiple treatments. These reveal percentage study weights toward clinically important estimates, such as summary treatment effects and treatment-covariate interactions, and are especially useful when some studies are potential outliers or at high risk of bias. We also derive percentage study weights toward methodologically interesting measures, such as the magnitude of ecological bias (difference between within-study and across-study associations) and the amount of inconsistency (difference between direct and indirect evidence in a network meta-analysis).

SUBMITTER: Riley RD

PROVIDER: S-EPMC6146321 | biostudies-literature | 2018 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Deriving percentage study weights in multi-parameter meta-analysis models: with application to meta-regression, network meta-analysis and one-stage individual participant data models.

Riley Richard D RD Ensor Joie J Jackson Dan D Burke Danielle L DL

Statistical methods in medical research 20170206 10

Many meta-analysis models contain multiple parameters, for example due to multiple outcomes, multiple treatments or multiple regression coefficients. In particular, meta-regression models may contain multiple study-level covariates, and one-stage individual participant data meta-analysis models may contain multiple patient-level covariates and interactions. Here, we propose how to derive percentage study weights for such situations, in order to reveal the (otherwise hidden) contribution of each ...[more]

PMID: 28162044

Similar Datasets

Project description:BackgroundPre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk during pregnancy is required to plan management. Although there are many published prediction models for pre-eclampsia, few have been validated in external data. Our objective was to externally validate published prediction models for pre-eclampsia using individual participant data (IPD) from UK studies, to evaluate whether any of the models can accurately predict the condition when used within the UK healthcare setting.MethodsIPD from 11 UK cohort studies (217,415 pregnant women) within the International Prediction of Pregnancy Complications (IPPIC) pre-eclampsia network contributed to external validation of published prediction models, identified by systematic review. Cohorts that measured all predictor variables in at least one of the identified models and reported pre-eclampsia as an outcome were included for validation. We reported the model predictive performance as discrimination (C-statistic), calibration (calibration plots, calibration slope, calibration-in-the-large), and net benefit. Performance measures were estimated separately in each available study and then, where possible, combined across studies in a random-effects meta-analysis.ResultsOf 131 published models, 67 provided the full model equation and 24 could be validated in 11 UK cohorts. Most of the models showed modest discrimination with summary C-statistics between 0.6 and 0.7. The calibration of the predicted compared to observed risk was generally poor for most models with observed calibration slopes less than 1, indicating that predictions were generally too extreme, although confidence intervals were wide. There was large between-study heterogeneity in each model's calibration-in-the-large, suggesting poor calibration of the predicted overall risk across populations. In a subset of models, the net benefit of using the models to inform clinical decisions appeared small and limited to probability thresholds between 5 and 7%.ConclusionsThe evaluated models had modest predictive performance, with key limitations such as poor calibration (likely due to overfitting in the original development datasets), substantial heterogeneity, and small net benefit across settings. The evidence to support the use of these prediction models for pre-eclampsia in clinical decision-making is limited. Any models that we could not validate should be examined in terms of their predictive performance, net benefit, and heterogeneity across multiple UK settings before consideration for use in practice.Trial registrationPROSPERO ID: CRD42015029349 .

Project description:BackgroundWhile recommended by international societal guidelines in the paediatric population, the use of venoarterial extracorporeal membrane oxygenation (VA ECMO) as mechanical circulatory support for refractory septic shock in adults is controversial. We aimed to characterise the outcomes of adults with septic shock requiring VA ECMO, and identify factors associated with survival.MethodsWe searched Pubmed, Embase, Scopus and Cochrane databases from inception until 1st June 2021, and included all relevant publications reporting on > 5 adult patients requiring VA ECMO for septic shock. Study quality and certainty in evidence were assessed using the appropriate Joanna Briggs Institute checklist, and the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach, respectively. The primary outcome was survival to hospital discharge, and secondary outcomes included intensive care unit length of stay, duration of ECMO support, complications while on ECMO, and sources of sepsis. Random-effects meta-analysis (DerSimonian and Laird) were conducted.Data synthesisWe included 14 observational studies with 468 patients in the meta-analysis. Pooled survival was 36.4% (95% confidence interval [CI]: 23.6%-50.1%). Survival among patients with left ventricular ejection fraction (LVEF) < 20% (62.0%, 95%-CI: 51.6%-72.0%) was significantly higher than those with LVEF > 35% (32.1%, 95%-CI: 8.69%-60.7%, p = 0.05). Survival reported in studies from Asia (19.5%, 95%-CI: 13.0%-26.8%) was notably lower than those from Europe (61.0%, 95%-CI: 48.4%-73.0%) and North America (45.5%, 95%-CI: 16.7%-75.8%). GRADE assessment indicated high certainty of evidence for pooled survival.ConclusionsWhen treated with VA ECMO, the majority of patients with septic shock and severe sepsis-induced myocardial depression survive. However, VA ECMO has poor outcomes in adults with septic shock without severe left ventricular depression. VA ECMO may be a viable treatment option in carefully selected adult patients with refractory septic shock.

Dataset Information

Deriving percentage study weights in multi-parameter meta-analysis models: with application to meta-regression, network meta-analysis and one-stage individual participant data models.

Publications

Deriving percentage study weights in multi-parameter meta-analysis models: with application to meta-regression, network meta-analysis and one-stage individual participant data models.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets