Dataset Information

Can statistical adjustment guided by causal inference improve the accuracy of effect estimation? A simulation and empirical research based on meta-analyses of case-control studies.

ABSTRACT:

Background

Statistical adjustment is often considered to control confounding bias in observational studies, especially case-control studies. However, different adjustment strategies may affect the estimation of odds ratios (ORs), and in turn affect the results of their pooled analyses. Our study is aimed to investigate how to deal with the statistical adjustment in case-control studies to improve the validity of meta-analyses.

Methods

Three types of adjustment strategies were evaluated including insufficient adjustment (not all preset confounders were adjusted), full adjustment (all confounders were adjusted under the guidance of causal inference), and improper adjustment (covariates other than confounders were adjusted). We carried out a series of Monte Carlo simulation experiments based on predesigned scenarios, and assessed the accuracy of effect estimations from meta-analyses of case-control studies by combining ORs calculated according to different adjustment strategies. Then we used the data from an empirical review to illustrate the replicability of the simulation results.

Results

For all scenarios with different strength of causal relations, combining ORs that were comprehensively adjusted for confounders would get the most precise effect estimation. By contrast, combining ORs that were not sufficiently adjusted for confounders or improperly adjusted for mediators or colliders would easily introduce bias in causal interpretation, especially when the true effect of exposure on outcome was weak or none. The findings of the simulation experiments were further verified by the empirical research.

Conclusions

Statistical adjustment guided by causal inference are recommended for effect estimation. Therefore, when conducting meta-analyses of case-control studies, the causal relationship formulated by exposure, outcome, and covariates should be firstly understood through a directed acyclic graph, and then reasonable original ORs could be extracted and combined by suitable methods.

SUBMITTER: Yan R

PROVIDER: S-EPMC7731571 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Can statistical adjustment guided by causal inference improve the accuracy of effect estimation? A simulation and empirical research based on meta-analyses of case-control studies.

Yan Ruohua R Liu Tianyi T Peng Yaguang Y Peng Xiaoxia X

BMC medical informatics and decision making 20201211 1

<h4>Background</h4>Statistical adjustment is often considered to control confounding bias in observational studies, especially case-control studies. However, different adjustment strategies may affect the estimation of odds ratios (ORs), and in turn affect the results of their pooled analyses. Our study is aimed to investigate how to deal with the statistical adjustment in case-control studies to improve the validity of meta-analyses.<h4>Methods</h4>Three types of adjustment strategies were eval ...[more]

PMID: 33308213

Similar Datasets

Project description:BACKGROUND:Genomic prediction (GP) is used in animal and plant breeding to help identify the best genotypes for selection. One of the most important measures of the effectiveness and reliability of GP in plant breeding is predictive accuracy. An accurate estimate of this measure is thus central to GP. Moreover, regression models are the models of choice for analyzing field trial data in plant breeding. However, models that use the classical likelihood typically perform poorly, often resulting in biased parameter estimates, when their underlying assumptions are violated. This typically happens when data are contaminated with outliers. These biases often translate into inaccurate estimates of heritability and predictive accuracy, compromising the performance of GP. Since phenotypic data are susceptible to contamination, improving the methods for estimating heritability and predictive accuracy can enhance the performance of GP. Robust statistical methods provide an intuitively appealing and a theoretically well justified framework for overcoming some of the drawbacks of classical regression, most notably the departure from the normality assumption. We compare the performance of robust and classical approaches to two recently published methods for estimating heritability and predictive accuracy of GP using simulation of several plausible scenarios of random and block data contamination with outliers and commercial maize and rye breeding datasets. RESULTS:The robust approach generally performed as good as or better than the classical approach in phenotypic data analysis and in estimating the predictive accuracy of heritability and genomic prediction under both the random and block contamination scenarios. Notably, it consistently outperformed the classical approach under the random contamination scenario. Analyses of the empirical maize and rye datasets further reinforce the stability and reliability of the robust approach in the presence of outliers or missing data. CONCLUSIONS:The proposed robust approach enhances the predictive accuracy of heritability and genomic prediction by minimizing the deleterious effects of outliers for a broad range of simulation scenarios and empirical breeding datasets. Accordingly, plant breeders should seriously consider regularly using the robust alongside the classical approach and increasing the number of replicates to three or more, to further enhance the accuracy of the robust approach.

Project description:BackgroundFour models are commonly used to adjust for energy intake when estimating the causal effect of a dietary component on an outcome: 1) the "standard model" adjusts for total energy intake, 2) the "energy partition model" adjusts for remaining energy intake, 3) the "nutrient density model" rescales the exposure as a proportion of total energy, and 4) the "residual model" indirectly adjusts for total energy by using a residual. It remains underappreciated that each approach evaluates a different estimand and only partially accounts for confounding by common dietary causes.ObjectivesWe aimed to clarify the implied causal estimand and interpretation of each model and evaluate their performance in reducing dietary confounding.MethodsSemiparametric directed acyclic graphs and Monte Carlo simulations were used to identify the estimands and interpretations implied by each model and explore their performance in the absence or presence of dietary confounding.ResultsThe "standard model" and the mathematically identical "residual model" estimate the average relative causal effect (i.e., a "substitution" effect) but provide biased estimates even in the absence of confounding. The "energy partition model" estimates the total causal effect but only provides unbiased estimates in the absence of confounding or when all other nutrients have equal effects on the outcome. The "nutrient density model" has an obscure interpretation but attempts to estimate the average relative causal effect rescaled as a proportion of total energy. Accurate estimates of both the total and average relative causal effects may instead be derived by simultaneously adjusting for all dietary components, an approach we term the "all-components model."ConclusionsLack of awareness of the estimand differences and accuracy of the 4 modeling approaches may explain some of the apparent heterogeneity among existing nutritional studies. This raises serious questions regarding the validity of meta-analyses where different estimands have been inappropriately pooled.

Dataset Information

Can statistical adjustment guided by causal inference improve the accuracy of effect estimation? A simulation and empirical research based on meta-analyses of case-control studies.

Background

Methods

Results

Conclusions

Publications

Can statistical adjustment guided by causal inference improve the accuracy of effect estimation? A simulation and empirical research based on meta-analyses of case-control studies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets