Browse
Submit Data
Databases
API
Help

Dataset Information

34 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

A cautionary note on testing latent variable models.

ABSTRACT: The article tackles the practice of testing latent variable models. The analysis covered recently published studies from 11 psychology journals varying in orientation and impact. Seventy-five studies that matched the criterion of applying some of the latent modeling techniques were reviewed. Results indicate the presence of a general tendency to ignore the model test (?(2)) followed by the acceptance of approximate fit hypothesis without detailed model examination yielding relevant empirical evidence. Due to reduced sensitivity of such a procedure to confront theory with data, there is an almost invariable tendency to accept the theoretical model. This absence of model test consequences, manifested in frequently unsubstantiated neglect of evidence speaking against the model, thus implies the perilous question of whether such empirical testing of latent structures (the way it is widely applied) makes sense at all.

SUBMITTER: Ropovik I

PROVIDER: S-EPMC4635201 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

A cautionary note on testing latent variable models.

Ropovik Ivan I

Frontiers in psychology 20151106

The article tackles the practice of testing latent variable models. The analysis covered recently published studies from 11 psychology journals varying in orientation and impact. Seventy-five studies that matched the criterion of applying some of the latent modeling techniques were reviewed. Results indicate the presence of a general tendency to ignore the model test (χ(2)) followed by the acceptance of approximate fit hypothesis without detailed model examination yielding relevant empirical evi ...[more]

PMID: 26594192

Similar Datasets

A Cautionary Note on "A Cautionary Note on the Use of Ornstein Uhlenbeck Models in Macroevolutionary Studies".

Project description:Models based on the Ornstein-Uhlenbeck process have become standard for the comparative study of adaptation. Cooper et al. (2016) have cast doubt on this practice by claiming statistical problems with fitting Ornstein-Uhlenbeck models to comparative data. Specifically, they claim that statistical tests of Brownian motion may have too high Type I error rates and that such error rates are exacerbated by measurement error. In this note, we argue that these results have little relevance to the estimation of adaptation with Ornstein-Uhlenbeck models for three reasons. First, we point out that Cooper et al. (2016) did not consider the detection of distinct optima (e.g. for different environments), and therefore did not evaluate the standard test for adaptation. Second, we show that consideration of parameter estimates, and not just statistical significance, will usually lead to correct inferences about evolutionary dynamics. Third, we show that bias due to measurement error can be corrected for by standard methods. We conclude that Cooper et al. (2016) have not identified any statistical problems specific to Ornstein-Uhlenbeck models, and that their cautions against their use in comparative analyses are unfounded and misleading. [adaptation, Ornstein-Uhlenbeck model, phylogenetic comparative method.].

| S-EPMC10405355 | biostudies-literature

Treatment Effect Estimation Using Nonlinear Two-Stage Instrumental Variable Estimators: Another Cautionary Note.

Project description:ObjectiveTo examine the settings of simulation evidence supporting use of nonlinear two-stage residual inclusion (2SRI) instrumental variable (IV) methods for estimating average treatment effects (ATE) using observational data and investigate potential bias of 2SRI across alternative scenarios of essential heterogeneity and uniqueness of marginal patients.Study designPotential bias of linear and nonlinear IV methods for ATE and local average treatment effects (LATE) is assessed using simulation models with a binary outcome and binary endogenous treatment across settings varying by the relationship between treatment effectiveness and treatment choice.Principal findingsResults show that nonlinear 2SRI models produce estimates of ATE and LATE that are substantially biased when the relationships between treatment and outcome for marginal patients are unique from relationships for the full population. Bias of linear IV estimates for LATE was low across all scenarios.ConclusionsResearchers are increasingly opting for nonlinear 2SRI to estimate treatment effects in models with binary and otherwise inherently nonlinear dependent variables, believing that it produces generally unbiased and consistent estimates. This research shows that positive properties of nonlinear 2SRI rely on assumptions about the relationships between treatment effect heterogeneity and choice.

| S-EPMC5134142 | biostudies-literature

A cautionary note regarding count models of alcohol consumption in randomized controlled trials.

Project description:BackgroundAlcohol consumption is commonly used as a primary outcome in randomized alcohol treatment studies. The distribution of alcohol consumption is highly skewed, particularly in subjects with alcohol dependence.MethodsIn this paper, we will consider the use of count models for outcomes in a randomized clinical trial setting. These include the Poisson, over-dispersed Poisson, negative binomial, zero-inflated Poisson and zero-inflated negative binomial. We compare the Type-I error rate of these methods in a series of simulation studies of a randomized clinical trial, and apply the methods to the ASAP (Addressing the Spectrum of Alcohol Problems) trial.ResultsStandard Poisson models provide a poor fit for alcohol consumption data from our motivating example, and did not preserve Type-I error rates for the randomized group comparison when the true distribution was over-dispersed Poisson. For the ASAP trial, where the distribution of alcohol consumption featured extensive over-dispersion, there was little indication of significant randomization group differences, except when the standard Poisson model was fit.ConclusionAs with any analysis, it is important to choose appropriate statistical models. In simulation studies and in the motivating example, the standard Poisson was not robust when fit to over-dispersed count data, and did not maintain the appropriate Type-I error rate. To appropriately model alcohol consumption, more flexible count models should be routinely employed.

| S-EPMC1810542 | biostudies-literature

A cautionary note on the use of Ornstein Uhlenbeck models in macroevolutionary studies.

Project description:Phylogenetic comparative methods are increasingly used to give new insights into the dynamics of trait evolution in deep time. For continuous traits the core of these methods is a suite of models that attempt to capture evolutionary patterns by extending the Brownian constant variance model. However, the properties of these models are often poorly understood, which can lead to the misinterpretation of results. Here we focus on one of these models - the Ornstein Uhlenbeck (OU) model. We show that the OU model is frequently incorrectly favoured over simpler models when using Likelihood ratio tests, and that many studies fitting this model use datasets that are small and prone to this problem. We also show that very small amounts of error in datasets can have profound effects on the inferences derived from OU models. Our results suggest that simulating fitted models and comparing with empirical results is critical when fitting OU and other extensions of the Brownian model. We conclude by making recommendations for best practice in fitting OU models in phylogenetic comparative analyses, and for interpreting the parameters of the OU model.

| S-EPMC4949538 | biostudies-literature

Variable Assessment in Latent Class Models.

Project description:The latent class model provides an important platform for jointly modeling mixed-mode data - i.e., discrete and continuous data with various parametric distributions. Multiple mixed-mode variables are used to cluster subjects into latent classes. While the mixed-mode latent class analysis is a powerful tool for statisticians, few studies are focused on assessing the contribution of mixed-mode variables in discriminating latent classes. Novel measures are derived for assessing both absolute and relative impacts of mixed-mode variables in latent class analysis. Specifically, the expected posterior gradient and the Kolmogorov variation of the posterior distribution, as well as related properties are studied. Numerical results are presented to illustrate the measures.

| S-EPMC4043346 | biostudies-other

Bayesian variable selection for latent class models.

Project description:In this article, we develop a latent class model with class probabilities that depend on subject-specific covariates. One of our major goals is to identify important predictors of latent classes. We consider methodology that allows estimation of latent classes while allowing for variable selection uncertainty. We propose a Bayesian variable selection approach and implement a stochastic search Gibbs sampler for posterior computation to obtain model-averaged estimates of quantities of interest such as marginal inclusion probabilities of predictors. Our methods are illustrated through simulation studies and application to data on weight gain during pregnancy, where it is of interest to identify important predictors of latent weight gain classes.

| S-EPMC3035762 | biostudies-literature

A Note on Likelihood Ratio Tests for Models with Latent Variables.

Project description:The likelihood ratio test (LRT) is widely used for comparing the relative fit of nested latent variable models. Following Wilks' theorem, the LRT is conducted by comparing the LRT statistic with its asymptotic distribution under the restricted model, a [Formula: see text] distribution with degrees of freedom equal to the difference in the number of free parameters between the two nested models under comparison. For models with latent variables such as factor analysis, structural equation models and random effects models, however, it is often found that the [Formula: see text] approximation does not hold. In this note, we show how the regularity conditions of Wilks' theorem may be violated using three examples of models with latent variables. In addition, a more general theory for LRT is given that provides the correct asymptotic theory for these LRTs. This general theory was first established in Chernoff (J R Stat Soc Ser B (Methodol) 45:404-413, 1954) and discussed in both van der Vaart (Asymptotic statistics, Cambridge, Cambridge University Press, 2000) and Drton (Ann Stat 37:979-1012, 2009), but it does not seem to have received enough attention. We illustrate this general theory with the three examples.

| S-EPMC7826319 | biostudies-literature

Microglial cells in astroglial cultures: a cautionary note.

Project description:Primary rodent astroglial-enriched cultures are the most popular model to study astroglial biology in vitro. From the original methods described in the 1970's a great number of minor modifications have been incorporated into these protocols by different laboratories. These protocols result in cultures in which the astrocyte is the predominant cell type, but astrocytes are never 100% of cells in these preparations. The aim of this review is to bring attention to the presence of microglia in astroglial cultures because, in my opinion, the proportion of and the role that microglial cells play in astroglial cultures are often underestimated. The main problem with ignoring microglia in these cultures is that relatively minor amounts of microglia can be responsible for effects observed on cultures in which the astrocyte is the most abundant cell type. If the relative contributions of astrocytes and microglia are not properly assessed an observed effect can be erroneously attributed to the astrocytes. In order to illustrate this point the case of NO production in activated astroglial-enriched cultures is examined. Lipopolysaccharide (LPS) induces nitric oxide (NO) production in astroglial-enriched cultures and this effect is very often attributed to astrocytes. However, a careful review of the published data suggests that LPS-induced NO production in rodent astroglial-enriched cultures is likely to be mainly microglial in origin. This review considers cell culture protocol factors that can affect the proportion of microglial cells in astroglial cultures, strategies to minimize the proportion of microglia in these cultures, and specific markers that allow the determination of such microglial proportions.

| S-EPMC2140055 | biostudies-literature

Noisy preferences in risky choice: A cautionary note.

Project description:We examine the effects of multiple sources of noise in risky decision making. Noise in the parameters that characterize an individual's preferences can combine with noise in the response process to distort observed choice proportions. Thus, underlying preferences that conform to expected value maximization can appear to show systematic risk aversion or risk seeking. Similarly, core preferences that are consistent with expected utility theory, when perturbed by such noise, can appear to display nonlinear probability weighting. For this reason, modal choices cannot be used simplistically to infer underlying preferences. Quantitative model fits that do not allow for both sorts of noise can lead to wrong conclusions. (PsycINFO Database Record

| S-EPMC5619393 | biostudies-literature

Zero-inflated models for adjusting varying exposures: a cautionary note on the pitfalls of using offset.

Project description:Zero-inflated count data are frequently encountered in public health and epidemiology research. Two-parts model is often used to model the excessive zeros, which are a mixture of two components: a point mass at zero and a count distribution, such as a Poisson distribution. When the rate of events per unit exposure is of interest, offset is commonly used to account for the varying extent of exposure, which is essentially a predictor whose regression coefficient is fixed at one. Such an assumption of exposure effect is, however, quite restrictive for many practical problems. Further, for zero-inflated models, offset is often only included in the count component of the model. However, the probability of excessive zero component could also be affected by the amount of 'exposure'. We, therefore, proposed incorporating the varying exposure as a covariate rather than an offset term in both the probability of excessive zeros and conditional counts components of the zero-inflated model. A real example is used to illustrate the usage of the proposed methods, and simulation studies are conducted to assess the performance of the proposed methods for a broad variety of situations.

| S-EPMC9042155 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data