Dataset Information

Variable selection for zero-inflated and overdispersed data with application to health care demand in Germany.

ABSTRACT: In health services and outcome research, count outcomes are frequently encountered and often have a large proportion of zeros. The zero-inflated negative binomial (ZINB) regression model has important applications for this type of data. With many possible candidate risk factors, this paper proposes new variable selection methods for the ZINB model. We consider maximum likelihood function plus a penalty including the least absolute shrinkage and selection operator (LASSO), smoothly clipped absolute deviation (SCAD), and minimax concave penalty (MCP). An EM (expectation-maximization) algorithm is proposed for estimating the model parameters and conducting variable selection simultaneously. This algorithm consists of estimating penalized weighted negative binomial models and penalized logistic models via the coordinated descent algorithm. Furthermore, statistical properties including the standard error formulae are provided. A simulation study shows that the new algorithm not only has more accurate or at least comparable estimation, but also is more robust than the traditional stepwise variable selection. The proposed methods are applied to analyze the health care demand in Germany using the open-source R package mpath.

SUBMITTER: Wang Z

PROVIDER: S-EPMC5525141 | biostudies-literature | 2015 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Variable selection for zero-inflated and overdispersed data with application to health care demand in Germany.

Wang Zhu Z Ma Shuangge S Wang Ching-Yun CY

Biometrical journal. Biometrische Zeitschrift 20150608 5

In health services and outcome research, count outcomes are frequently encountered and often have a large proportion of zeros. The zero-inflated negative binomial (ZINB) regression model has important applications for this type of data. With many possible candidate risk factors, this paper proposes new variable selection methods for the ZINB model. We consider maximum likelihood function plus a penalty including the least absolute shrinkage and selection operator (LASSO), smoothly clipped absolu ...[more]

PMID: 26059498

Similar Datasets

Project description:Microorganisms play critical roles in human health and disease. They live in diverse communities in which they interact synergistically or antagonistically. Thus for estimating microbial associations with clinical covariates, such as treatment effects, joint (multivariate) statistical models are preferred. Multivariate models allow one to estimate and exploit complex interdependencies among multiple taxa, yielding more powerful tests of exposure or treatment effects than application of taxon-specific univariate analyses. Analysis of microbial count data also requires special attention because data commonly exhibit zero inflation, i.e., more zeros than expected from a standard count distribution. To meet these needs, we developed a Bayesian variable selection model for multivariate count data with excess zeros that incorporates information on the covariance structure of the outcomes (counts for multiple taxa), while estimating associations with the mean levels of these outcomes. Though there has been much work on zero-inflated models for longitudinal data, little attention has been given to high-dimensional multivariate zero-inflated data modeled via a general correlation structure. Through simulation, we compared performance of the proposed method to that of existing univariate approaches, for both the binary ("excess zero") and count parts of the model. When outcomes were correlated the proposed variable selection method maintained type I error while boosting the ability to identify true associations in the binary component of the model. For the count part of the model, in some scenarios the univariate method had higher power than the multivariate approach. This higher power was at a cost of a highly inflated false discovery rate not observed with the proposed multivariate method. We applied the approach to oral microbiome data from the Pediatric HIV/AIDS Cohort Oral Health Study and identified five (of 44) species associated with HIV infection.

Project description:IntroductionCount outcomes in tobacco research are often analyzed with the Poisson distribution. However, they often exhibit features such as overdispersion (variance larger than expected) and zero inflation (extra zeros) that violate model assumptions. Furthermore, longitudinal studies have repeated measures that generate correlated counts. Failure to account for overdispersion, zero inflation, and correlation can yield incorrect statistical inferences. Thus, it is important to familiarize researchers with proper models for such data.Aims and methodsPoisson and Negative Binomial models with correlated random effects with and without zero inflation are presented. The illustrative data comes from a study comparing a mindfulness training app (Craving to Quit [C2Q], n = 60) with a control app (experience sampling-only app, n = 66) on smoking frequency at 1, 3, and 6 months. Predictors include app, time, the app-by-time interaction, and baseline smoking. Each model is evaluated in terms of accounting for zero inflation, overdispersion, and correlation in the data. Emphasis is placed on evaluating model fit, subject-specific interpretation of effects, and choosing an appropriate model.ResultsThe hurdle Poisson model provided the best fit to the data. Smoking abstinence rates were 33%, 32%, and 28% at 1, 3, and 6 months, respectively, with variance larger than expected by a factor >7 at each follow-up. Individuals on C2Q were less likely to achieve abstinence across time but likely to smoke fewer cigarettes if smoking.ConclusionsThe models presented are specifically suited for analyzing correlated count outcomes and account for zero inflation and overdispersion. We provide guidance to researchers on the use of these models to better inform nicotine and tobacco research.ImplicationsIn tobacco research, count outcomes are often measured repeatedly on the same subject and thus correlated. Such outcomes often have many zeros and exhibit large variances relative to the mean. Analyzing such data require models specifically suited for correlated counts. The presented models and guidelines could improve the rigor of the analysis of correlated count data and thus increase the impact of studies in nicotine and tobacco research using such outcomes.

Project description:BackgroundTwo characteristics of commonly used outcomes in medical research are zero inflation and non-negative integers; examples include the number of hospital admissions or emergency department visits, where the majority of patients will have zero counts. Zero-inflated regression models were devised to analyze this type of data. However, the performance of zero-inflated regression models or the properties of data best suited for these analyses have not been thoroughly investigated.MethodsWe conducted a simulation study to evaluate the performance of two generalized linear models, negative binomial and zero-inflated negative binomial, for analyzing zero-inflated count data. Simulation scenarios assumed a randomized controlled trial design and varied the true underlying distribution, sample size, and rate of zero inflation. We compared the models in terms of bias, mean squared error, and coverage. Additionally, we used logistic regression to determine which data properties are most important for predicting the best-fitting model.ResultsWe first found that, regardless of the rate of zero inflation, there was little difference between the conventional negative binomial and its zero-inflated counterpart in terms of bias of the marginal treatment group coefficient. Second, even when the outcome was simulated from a zero-inflated distribution, a negative binomial model was favored above its ZI counterpart in terms of the Akaike Information Criterion. Third, the mean and skewness of the non-zero part of the data were stronger predictors of model preference than the percentage of zero counts. These results were not affected by the sample size, which ranged from 60 to 800.ConclusionsWe recommend that the rate of zero inflation and overdispersion in the outcome should not be the sole and main justification for choosing zero-inflated regression models. Investigators should also consider other data characteristics when choosing a model for count data. In addition, if the performance of the NB and ZINB regression models is reasonably comparable even with ZI outcomes, we advocate the use of the NB regression model due to its clear and straightforward interpretation of the results.

Dataset Information

Variable selection for zero-inflated and overdispersed data with application to health care demand in Germany.

Publications

Variable selection for zero-inflated and overdispersed data with application to health care demand in Germany.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets