Combining shrinkage and sparsity in conjugate vector autoregressive models.
Ontology highlight
ABSTRACT:
SUBMITTER: Hauzenberger N
PROVIDER: S-EPMC8048898 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In a number of applications, one has access to high-dimensional time series data on several related subjects. A motivating application area comes from the neuroimaging field, such as brain fMRI time series data, obtained from various groups of subjects (cases/controls) with a specific neurological disorder. The problem of regularized joint estimation of multiple related Vector Autoregressive (VAR) models is discussed, leveraging a group lasso penalty in addition to a regular lasso one, so as to increase statistical efficiency of the estimates by borrowing strength across the models. A modeling framework is developed that it allows for both group-level and subject-specific effects for related subjects, using a group lasso penalty to estimate the former. An estimation procedure is introduced, whose performance is illustrated on synthetic data and compared to other state-of-the-art methods. Moreover, the proposed approach is employed for the analysis of resting state fMRI data. In particular, a group-level descriptive analysis is conducted for brain inter-regional temporal effects of Attention Deficit Hyperactive Disorder (ADHD) patients as opposed to controls, with the data available from the ADHD-200 Global Competition repository.
| S-EPMC7079674 | biostudies-literature
Project description:Vector autoregressive (VAR) models aim to capture linear temporal interdependencies amongst multiple time series. They have been widely used in macroeconomics and financial econometrics and more recently have found novel applications in functional genomics and neuroscience. These applications have also accentuated the need to investigate the behavior of the VAR model in a high-dimensional regime, which provides novel insights into the role of temporal dependence for regularized estimates of the model's parameters. However, hardly anything is known regarding properties of the posterior distribution for Bayesian VAR models in such regimes. In this work, we consider a VAR model with two prior choices for the autoregressive coefficient matrix: a non-hierarchical matrix-normal prior and a hierarchical prior, which corresponds to an arbitrary scale mixture of normals. We establish posterior consistency for both these priors under standard regularity assumptions, when the dimension p of the VAR model grows with the sample size n (but still remains smaller than n). A special case corresponds to a shrinkage prior that introduces (group) sparsity in the columns of the model coefficient matrices. The performance of the model estimates are illustrated on synthetic and real macroeconomic data sets.
| S-EPMC6716151 | biostudies-literature
Project description:Predicting health outcomes from longitudinal health histories is of central importance to healthcare. Observational healthcare databases such as patient diary databases provide a rich resource for patient-level predictive modeling. In this paper, we propose a Bayesian hierarchical vector autoregressive (VAR) model to predict medical and psychological conditions using multivariate time series data. Compared to the existing patient-specific predictive VAR models, our model demonstrated higher accuracy in predicting future observations in terms of both point and interval estimates due to the pooling effect of the hierarchical model specification. In addition, by adopting an elastic-net prior, our model offers greater interpretability about the associations between variables of interest on both the population level and the patient level, as well as between-patient heterogeneity. We apply the model to two examples: 1) predicting substance use craving, negative affect and tobacco use among college students, and 2) predicting functional somatic symptoms and psychological discomforts.
| S-EPMC6294362 | biostudies-literature
Project description:In psychology, studying multivariate dynamical processes within a person is gaining ground. An increasingly often used method is vector autoregressive (VAR) modeling, in which each variable is regressed on all variables (including itself) at the previous time points. This approach reveals the temporal dynamics of a system of related variables across time. A follow-up question is how to analyze data of multiple persons in order to grasp similarities and individual differences in within-person dynamics. We focus on the case where these differences are qualitative in nature, implying that subgroups of persons can be identified. We present a method that clusters persons according to their VAR regression weights, and simultaneously fits a shared VAR model to all persons within a cluster. The performance of the algorithm is evaluated in a simulation study. Moreover, the method is illustrated by applying it to multivariate time series data on depression-related symptoms of young women.
| S-EPMC5054011 | biostudies-literature
Project description:Forecasting energy demand in general, and electricity demand in particular, requires the developing reliable forecasting tools that can be used to monitor the evolution of consumers' energy needs more accurately. The proposed new hybrid GM(1,1)-VAR(1) model is meant for that purpose. The latter is based on the Grey and Vector autoregressive approaches, and makes it possible to predict future demand, by taking into account economic and demographic determinants with an exponential growth trend. With an associated APE of 1.5, a MAPE of 1.628%, and an RMSE of 15.42, this new model thus presents better accuracy indicators than hybrid models of the same nature. Also, it proves to be as accurate as some recent hybrid artificial intelligence models. The model is thus a reliable forecasting tool that can be used to monitor the evolution of energy demand.•The Grey and Vector autoregressive models are coupled to improve their accuracy.•Five economic and demographic parameters are included in the new hybrid model.•This new model is a reliable forecasting tool for assessing energy demand.
| S-EPMC8374266 | biostudies-literature
Project description:Causal inference in multivariate time series is challenging because the sampling rate may not be as fast as the time scale of the causal interactions, so the observed series is a subsampled version of the desired series. Furthermore, series may be observed at different sampling rates, yielding mixed-frequency series. To determine instantaneous and lagged effects between series at the causal scale, we take a model-based approach that relies on structural vector autoregressive models. We present a unifying framework for parameter identifiability and estimation under subsampling and mixed frequencies when the noise, or shocks, is non-Gaussian. By studying the structural case, we develop identifiability and estimation methods for the causal structure of lagged and instantaneous effects at the desired time scale. We further derive an exact expectation-maximization algorithm for inference in both subsampled and mixed-frequency settings. We validate our approach in simulated scenarios and on a climate and an econometric dataset.
| S-EPMC6508036 | biostudies-literature
Project description:BackgroundIn the analysis of effects by cell treatment such as drug dosing, identifying changes on gene network structures between normal and treated cells is a key task. A possible way for identifying the changes is to compare structures of networks estimated from data on normal and treated cells separately. However, this approach usually fails to estimate accurate gene networks due to the limited length of time series data and measurement noise. Thus, approaches that identify changes on regulations by using time series data on both conditions in an efficient manner are demanded.MethodsWe propose a new statistical approach that is based on the state space representation of the vector autoregressive model and estimates gene networks on two different conditions in order to identify changes on regulations between the conditions. In the mathematical model of our approach, hidden binary variables are newly introduced to indicate the presence of regulations on each condition. The use of the hidden binary variables enables an efficient data usage; data on both conditions are used for commonly existing regulations, while for condition specific regulations corresponding data are only applied. Also, the similarity of networks on two conditions is automatically considered from the design of the potential function for the hidden binary variables. For the estimation of the hidden binary variables, we derive a new variational annealing method that searches the configuration of the binary variables maximizing the marginal likelihood.ResultsFor the performance evaluation, we use time series data from two topologically similar synthetic networks, and confirm that our proposed approach estimates commonly existing regulations as well as changes on regulations with higher coverage and precision than other existing approaches in almost all the experimental settings. For a real data application, our proposed approach is applied to time series data from normal Human lung cells and Human lung cells treated by stimulating EGF-receptors and dosing an anticancer drug termed Gefitinib. In the treated lung cells, a cancer cell condition is simulated by the stimulation of EGF-receptors, but the effect would be counteracted due to the selective inhibition of EGF-receptors by Gefitinib. However, gene expression profiles are actually different between the conditions, and the genes related to the identified changes are considered as possible off-targets of Gefitinib.ConclusionsFrom the synthetically generated time series data, our proposed approach can identify changes on regulations more accurately than existing methods. By applying the proposed approach to the time series data on normal and treated Human lung cells, candidates of off-target genes of Gefitinib are found. According to the published clinical information, one of the genes can be related to a factor of interstitial pneumonia, which is known as a side effect of Gefitinib.
| S-EPMC3587380 | biostudies-literature
Project description:Conventional analysis using quantile regression typically focuses on fitting the regression model at different quantiles separately. However, in situations where the quantile coefficients share some common feature, joint modeling of multiple quantiles to accommodate the commonality often leads to more efficient estimation. One example of common features is that a predictor may have a constant effect over one region of quantile levels but varying effects in other regions. To automatically perform estimation and detection of the interquantile commonality, we develop two penalization methods. When the quantile slope coefficients indeed do not change across quantile levels, the proposed methods will shrink the slopes towards constant and thus improve the estimation efficiency. We establish the oracle properties of the two proposed penalization methods. Through numerical investigations, we demonstrate that the proposed methods lead to estimations with competitive or higher efficiency than the standard quantile regression estimation in finite samples. Supplemental materials for the article are available online.
| S-EPMC3867140 | biostudies-literature
Project description:Linear-bilinear models, especially the additive main effects and multiplicative interaction (AMMI) model, are widely applicable to genotype-by-environment interaction (GEI) studies in plant breeding programs. These models allow a parsimonious modeling of GE interactions, retaining a small number of principal components in the analysis. However, one aspect of the AMMI model that is still debated is the selection criteria for determining the number of multiplicative terms required to describe the GE interaction pattern. Shrinkage estimators have been proposed as selection criteria for the GE interaction components. In this study, a Bayesian approach was combined with the AMMI model with shrinkage estimators for the principal components. A total of 55 maize genotypes were evaluated in nine different environments using a complete blocks design with three replicates. The results show that the traditional Bayesian AMMI model produces low shrinkage of singular values but avoids the usual pitfalls in determining the credible intervals in the biplot. On the other hand, Bayesian shrinkage AMMI models have difficulty with the credible interval for model parameters, but produce stronger shrinkage of the principal components, converging to GE matrices that have more shrinkage than those obtained using mixed models. This characteristic allowed more parsimonious models to be chosen, and resulted in models being selected that were similar to those obtained by the Cornelius F-test (? = 0.05) in traditional AMMI models and cross validation based on leave-one-out. This characteristic allowed more parsimonious models to be chosen and more GEI pattern retained on the first two components. The resulting model chosen by posterior distribution of singular value was also similar to those produced by the cross-validation approach in traditional AMMI models. Our method enables the estimation of credible interval for AMMI biplot plus the choice of AMMI model based on direct posterior distribution retaining more GEI pattern in the first components and discarding noise without Gaussian assumption as requested in F-based tests or deal with parametric problems as observed in traditional AMMI shrinkage method.
| S-EPMC4497624 | biostudies-literature
Project description:Distributed lag models (DLMs) have been widely used in environmental epidemiology to quantify the lagged effects of air pollution on an outcome of interest such as mortality or cardiovascular events. Generally speaking, DLMs can be applied to time-series data where the current measure of an independent variable and its lagged measures collectively affect the current measure of a dependent variable. The corresponding distributed lag (DL) function represents the relationship between the lags and the coefficients of the lagged exposure variables. Common choices include polynomials and splines. On one hand, such a constrained DLM specifies the coefficients as a function of lags and reduces the number of parameters to be estimated; hence, higher efficiency can be achieved. On the other hand, under violation of the assumption about the DL function, effect estimates can be severely biased. In this article, we propose a general framework for shrinking coefficient estimates from an unconstrained DLM, that are unbiased but potentially inefficient, toward the coefficient estimates from a constrained DLM to achieve a bias-variance trade-off. The amount of shrinkage can be determined in various ways, and we explore several such methods: empirical Bayes-type shrinkage, a hierarchical Bayes approach, and generalized ridge regression. We also consider a two-stage shrinkage approach that enforces the effect estimates to approach zero as lags increase. We contrast the various methods via an extensive simulation study and show that the shrinkage methods have better average performance across different scenarios in terms of mean squared error (MSE).We illustrate the methods by using data from the National Morbidity, Mortality, and Air Pollution Study (NMMAPS) to explore the association between PM$_{10}$, O$_3$, and SO$_2$ on three types of disease event counts in Chicago, IL, from 1987 to 2000.
| S-EPMC6454578 | biostudies-literature