Predicting personalised absolute treatment effects in individual participant data meta-analysis: An introduction to splines.
Ontology highlight
ABSTRACT:
SUBMITTER: Belias M
PROVIDER: S-EPMC9303665 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundA model that can predict treatment response for a patient with specific baseline characteristics would help decision-making in personalized medicine. The aim of the study is to develop such a model in the treatment of rheumatoid arthritis (RA) patients who receive certolizumab (CTZ) plus methotrexate (MTX) therapy, using individual participant data meta-analysis (IPD-MA).MethodsWe will search Cochrane CENTRAL, PubMed, and Scopus as well as clinical trial registries, drug regulatory agency reports, and the pharmaceutical company websites from their inception onwards to obtain randomized controlled trials (RCTs) investigating CTZ plus MTX compared with MTX alone in treating RA. We will request the individual-level data of these trials from an independent platform (http://vivli.org). The primary outcome is efficacy defined as achieving either remission (based on ACR-EULAR Boolean or index-based remission definition) or low disease activity (based on either of the validated composite disease activity measures). The secondary outcomes include ACR50 (50% improvement based on ACR core set variables) and adverse events. We will use a two-stage approach to develop the prediction model. First, we will construct a risk model for the outcomes via logistic regression to estimate the baseline risk scores. We will include baseline demographic, clinical, and biochemical features as covariates for this model. Next, we will develop a meta-regression model for treatment effects, in which the stage 1 risk score will be used both as a prognostic factor and as an effect modifier. We will calculate the probability of having the outcome for a new patient based on the model, which will allow estimation of the absolute and relative treatment effect. We will use R for our analyses, except for the second stage which will be performed in a Bayesian setting using R2Jags.DiscussionThis is a study protocol for developing a model to predict treatment response for RA patients receiving CTZ plus MTX in comparison with MTX alone, using a two-stage approach based on IPD-MA. The study will use a new modeling approach, which aims at retaining the statistical power. The model may help clinicians individualize treatment for particular patients.Systematic review registrationPROSPERO registration number pending (ID#157595).
| S-EPMC7477831 | biostudies-literature
Project description:BackgroundPre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk during pregnancy is required to plan management. Although there are many published prediction models for pre-eclampsia, few have been validated in external data. Our objective was to externally validate published prediction models for pre-eclampsia using individual participant data (IPD) from UK studies, to evaluate whether any of the models can accurately predict the condition when used within the UK healthcare setting.MethodsIPD from 11 UK cohort studies (217,415 pregnant women) within the International Prediction of Pregnancy Complications (IPPIC) pre-eclampsia network contributed to external validation of published prediction models, identified by systematic review. Cohorts that measured all predictor variables in at least one of the identified models and reported pre-eclampsia as an outcome were included for validation. We reported the model predictive performance as discrimination (C-statistic), calibration (calibration plots, calibration slope, calibration-in-the-large), and net benefit. Performance measures were estimated separately in each available study and then, where possible, combined across studies in a random-effects meta-analysis.ResultsOf 131 published models, 67 provided the full model equation and 24 could be validated in 11 UK cohorts. Most of the models showed modest discrimination with summary C-statistics between 0.6 and 0.7. The calibration of the predicted compared to observed risk was generally poor for most models with observed calibration slopes less than 1, indicating that predictions were generally too extreme, although confidence intervals were wide. There was large between-study heterogeneity in each model's calibration-in-the-large, suggesting poor calibration of the predicted overall risk across populations. In a subset of models, the net benefit of using the models to inform clinical decisions appeared small and limited to probability thresholds between 5 and 7%.ConclusionsThe evaluated models had modest predictive performance, with key limitations such as poor calibration (likely due to overfitting in the original development datasets), substantial heterogeneity, and small net benefit across settings. The evidence to support the use of these prediction models for pre-eclampsia in clinical decision-making is limited. Any models that we could not validate should be examined in terms of their predictive performance, net benefit, and heterogeneity across multiple UK settings before consideration for use in practice.Trial registrationPROSPERO ID: CRD42015029349 .
| S-EPMC7604970 | biostudies-literature
Project description:ObjectiveTo investigate if cerebroplacental ratio (CPR) adds to the predictive value of umbilical artery pulsatility index (UA PI) alone - standard of practice - for adverse perinatal outcome in singleton pregnancies.Design and settingMeta-analysis based on individual participant data (IPD).Population or sampleTen centres provided 17 data sets for 21 661 participants, 18 731 of which could be included. Sample sizes per data set ranged from 207 to 9215 individuals. Patient populations varied from uncomplicated to complicated pregnancies.MethodsIn a collaborative, pooled analysis, we compared the prognostic value of combining CPR with UA PI, versus UA PI only and CPR only, with a one-stage IPD approach. After multiple imputation of missing values, we used multilevel multivariable logistic regression to develop prediction models. We evaluated the classification performance of all models with receiver operating characteristics analysis. We performed subgroup analyses according to gestational age, birthweight centile and estimated fetal weight centile.Main outcome measuresComposite adverse perinatal outcome, defined as perinatal death, caesarean section for fetal distress or neonatal unit admission.ResultsAdverse outcomes occurred in 3423 (18%) participants. The model with UA PI alone resulted in an area under the curve (AUC) of 0.775 (95% CI 0.709-0.828) and with CPR alone in an AUC of 0.778 (95% CI 0.715-0.831). Addition of CPR to the UA PI model resulted in an increase in the AUC of 0.003 points (0.778, 95% CI 0.714-0.831). These results were consistent across all subgroups.ConclusionsCerebroplacental ratio added no predictive value for adverse perinatal outcome beyond UA PI, when assessing singleton pregnancies, irrespective of gestational age or fetal size.Tweetable abstractDoppler measurement of cerebroplacental ratio in clinical practice has limited added predictive value to umbilical artery alone.
| S-EPMC7818434 | biostudies-literature
Project description:When combining results across related studies, a multivariate meta-analysis allows the joint synthesis of correlated effect estimates from multiple outcomes. Joint synthesis can improve efficiency over separate univariate syntheses, may reduce selective outcome reporting biases, and enables joint inferences across the outcomes. A common issue is that within-study correlations needed to fit the multivariate model are unknown from published reports. However, provision of individual participant data (IPD) allows them to be calculated directly. Here, we illustrate how to use IPD to estimate within-study correlations, using a joint linear regression for multiple continuous outcomes and bootstrapping methods for binary, survival and mixed outcomes. In a meta-analysis of 10 hypertension trials, we then show how these methods enable multivariate meta-analysis to address novel clinical questions about continuous, survival and binary outcomes; treatment-covariate interactions; adjusted risk/prognostic factor effects; longitudinal data; prognostic and multiparameter models; and multiple treatment comparisons. Both frequentist and Bayesian approaches are applied, with example software code provided to derive within-study correlations and to fit the models.
| S-EPMC4847645 | biostudies-literature
Project description:BackgroundSome studies have suggested a link between antihypertensive medication and cancer, but the evidence is so far inconclusive. Thus, we aimed to investigate this association in a large individual patient data meta-analysis of randomised clinical trials.MethodsWe searched PubMed, MEDLINE, The Cochrane Central Register of Controlled Trials, and ClinicalTrials.gov from Jan 1, 1966, to Sept 1, 2019, to identify potentially eligible randomised controlled trials. Eligible studies were randomised controlled trials comparing one blood pressure lowering drug class with a placebo, inactive control, or other blood pressure lowering drug. We also required that trials had at least 1000 participant years of follow-up in each treatment group. Trials without cancer event information were excluded. We requested individual participant data from the authors of eligible trials. We pooled individual participant-level data from eligible trials and assessed the effects of angiotensin-converting enzyme inhibitors (ACEIs), angiotensin II receptor blockers (ARBs), β blockers, calcium channel blockers, and thiazide diuretics on cancer risk in one-stage individual participant data and network meta-analyses. Cause-specific fixed-effects Cox regression models, stratified by trial, were used to calculate hazard ratios (HRs). The primary outcome was any cancer event, defined as the first occurrence of any cancer diagnosed after randomisation. This study is registered with PROSPERO (CRD42018099283).Findings33 trials met the inclusion criteria, and included 260 447 participants with 15 012 cancer events. Median follow-up of included participants was 4·2 years (IQR 3·0-5·0). In the individual participant data meta-analysis comparing each drug class with all other comparators, no associations were identified between any antihypertensive drug class and risk of any cancer (HR 0·99 [95% CI 0·95-1·04] for ACEIs; 0·96 [0·92-1·01] for ARBs; 0·98 [0·89-1·07] for β blockers; 1·01 [0·95-1·07] for thiazides), with the exception of calcium channel blockers (1·06 [1·01-1·11]). In the network meta-analysis comparing drug classes against placebo, we found no excess cancer risk with any drug class (HR 1·00 [95% CI 0·93-1·09] for ACEIs; 0·99 [0·92-1·06] for ARBs; 0·99 [0·89-1·11] for β blockers; 1·04 [0·96-1·13] for calcium channel blockers; 1·00 [0·90-1·10] for thiazides).InterpretationWe found no consistent evidence that antihypertensive medication use had any effect on cancer risk. Although such findings are reassuring, evidence for some comparisons was insufficient to entirely rule out excess risk, in particular for calcium channel blockers.FundingBritish Heart Foundation, National Institute for Health Research, Oxford Martin School.
| S-EPMC8024901 | biostudies-literature
Project description:BackgroundStratified medicine seeks to identify patients most likely to respond to treatment. Individual participant data (IPD) network meta-analysis (NMA) models have greater power than individual trials to identify treatment-covariate interactions (TCIs). Treatment-covariate interactions contain "within" and "across" trial interactions, where the across-trial interaction is more susceptible to confounding and ecological bias.MethodsWe considered a network of IPD from 37 trials (5922 patients) for cervical cancer (2394 events), where previous research identified disease stage as a potential interaction covariate. We compare 2 models for NMA with TCIs: (1) 2 effects separating within- and across-trial interactions and (2) a single effect combining within- and across-trial interactions. We argue for a visual assessment of consistency of within- and across-trial interactions and consider more detailed aspects of interaction modelling, eg, common vs trial-specific effects of the covariate. This leads us to propose a practical framework for IPD NMA with TCIs.ResultsFollowing our framework, we found no evidence in the cervical cancer network for a treatment-stage interaction on the basis of the within-trial interaction. The NMA provided additional power for an across-trial interaction over and above the pairwise evidence. Following our proposed framework, we found that the within- and across-trial interactions should not be combined.ConclusionAcross-trial interactions are susceptible to confounding and ecological bias. It is important to separate the sources of evidence to check their consistency and identify which sources of evidence are driving the conclusion. Our framework provides practical guidance for researchers, reducing the risk of unduly optimistic interpretation of TCIs.
| S-EPMC6159880 | biostudies-literature
Project description:BackgroundRisk-stratified management of fever with neutropenia (FN), allows intensive management of high-risk cases and early discharge of low-risk cases. No single, internationally validated, prediction model of the risk of adverse outcomes exists for children and young people. An individual patient data (IPD) meta-analysis was undertaken to devise one.MethodsThe 'Predicting Infectious Complications in Children with Cancer' (PICNICC) collaboration was formed by parent representatives, international clinical and methodological experts. Univariable and multivariable analyses, using random effects logistic regression, were undertaken to derive and internally validate a risk-prediction model for outcomes of episodes of FN based on clinical and laboratory data at presentation.ResultsData came from 22 different study groups from 15 countries, of 5127 episodes of FN in 3504 patients. There were 1070 episodes in 616 patients from seven studies available for multivariable analysis. Univariable analyses showed associations with microbiologically defined infection (MDI) in many items, including higher temperature, lower white cell counts and acute myeloid leukaemia, but not age. Patients with osteosarcoma/Ewings sarcoma and those with more severe mucositis were associated with a decreased risk of MDI. The predictive model included: malignancy type, temperature, clinically 'severely unwell', haemoglobin, white cell count and absolute monocyte count. It showed moderate discrimination (AUROC 0.723, 95% confidence interval 0.711-0.759) and good calibration (calibration slope 0.95). The model was robust to bootstrap and cross-validation sensitivity analyses.ConclusionsThis new prediction model for risk of MDI appears accurate. It requires prospective studies assessing implementation to assist clinicians and parents/patients in individualised decision making.
| S-EPMC4800297 | biostudies-literature
Project description:Meta-analytic methods for combining data from multiple intervention trials are commonly used to estimate the effectiveness of an intervention. They can also be extended to study comparative effectiveness, testing which of several alternative interventions is expected to have the strongest effect. This often requires network meta-analysis (NMA), which combines trials involving direct comparison of two interventions within the same trial and indirect comparisons across trials. In this paper, we extend existing network methods for main effects to examining moderator effects, allowing for tests of whether intervention effects vary for different populations or when employed in different contexts. In addition, we study how the use of individual participant data may increase the sensitivity of NMA for detecting moderator effects, as compared with aggregate data NMA that employs study-level effect sizes in a meta-regression framework. A new NMA diagram is proposed. We also develop a generalized multilevel model for NMA that takes into account within-trial and between-trial heterogeneity and can include participant-level covariates. Within this framework, we present definitions of homogeneity and consistency across trials. A simulation study based on this model is used to assess effects on power to detect both main and moderator effects. Results show that power to detect moderation is substantially greater when applied to individual participant data as compared with study-level effects. We illustrate the use of this method by applying it to data from a classroom-based randomized study that involved two sub-trials, each comparing interventions that were contrasted with separate control groups. Copyright © 2016 John Wiley & Sons, Ltd.
| S-EPMC4893003 | biostudies-literature
Project description:Multiple imputation is a strategy for the analysis of incomplete data such that the impact of the missingness on the power and bias of estimates is mitigated. When data from multiple studies are collated, we can propose both within-study and multilevel imputation models to impute missing data on covariates. It is not clear how to choose between imputation models or how to combine imputation and inverse-variance weighted meta-analysis methods. This is especially important as often different studies measure data on different variables, meaning that we may need to impute data on a variable which is systematically missing in a particular study. In this paper, we consider a simulation analysis of sporadically missing data in a single covariate with a linear analysis model and discuss how the results would be applicable to the case of systematically missing data. We find in this context that ensuring the congeniality of the imputation and analysis models is important to give correct standard errors and confidence intervals. For example, if the analysis model allows between-study heterogeneity of a parameter, then we should incorporate this heterogeneity into the imputation model to maintain the congeniality of the two models. In an inverse-variance weighted meta-analysis, we should impute missing data and apply Rubin's rules at the study level prior to meta-analysis, rather than meta-analyzing each of the multiple imputations and then combining the meta-analysis estimates using Rubin's rules. We illustrate the results using data from the Emerging Risk Factors Collaboration.
| S-EPMC3963448 | biostudies-literature
Project description:One-stage meta-analysis of individual participant data (IPD) poses several statistical and computational challenges. For time-to-event outcomes, the approach requires the estimation of complicated nonlinear mixed-effects models that are flexible enough to realistically capture the most important characteristics of the IPD. We present a model class that incorporates general normally distributed random effects into linear transformation models. We discuss extensions to model between-study heterogeneity in baseline risks and covariate effects and also relax the assumption of proportional hazards. Within the proposed framework, data with arbitrary random censoring patterns can be handled. The accompanying $\textsf{R}$ package tramME utilizes the Laplace approximation and automatic differentiation to perform efficient maximum likelihood estimation and inference in mixed-effects transformation models. We compare several variants of our model to predict the survival of patients with chronic obstructive pulmonary disease using a large data set of prognostic studies. Finally, a simulation study is presented that verifies the correctness of the implementation and highlights its efficiency compared to an alternative approach.
| S-EPMC9566326 | biostudies-literature