Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Nonlinear variable selection with continuous outcome: a fully nonparametric incremental forward stagewise approach.

ABSTRACT: We present a method of variable selection for the sparse generalized additive model. The method doesn't assume any specific functional form, and can select from a large number of candidates. It takes the form of incremental forward stagewise regression. Given no functional form is assumed, we devised an approach termed "roughening" to adjust the residuals in the iterations. In simulations, we show the new method is competitive against popular machine learning approaches. We also demonstrate its performance using some real datasets. The method is available as a part of the nlnet package on CRAN (https://cran.r-project.org/package=nlnet).

SUBMITTER: Yu T

PROVIDER: S-EPMC6309280 | biostudies-literature | 2018 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Nonlinear variable selection with continuous outcome: a fully nonparametric incremental forward stagewise approach.

Yu Tianwei T

Statistical analysis and data mining 20180619 4

We present a method of variable selection for the sparse generalized additive model. The method doesn't assume any specific functional form, and can select from a large number of candidates. It takes the form of incremental forward stagewise regression. Given no functional form is assumed, we devised an approach termed "roughening" to adjust the residuals in the iterations. In simulations, we show the new method is competitive against popular machine learning approaches. We also demonstrate its ...[more]

PMID: 30595785

Similar Datasets

Generalized monotone incremental forward stagewise method for modeling count data: application predicting micronuclei frequency.

Project description:The cytokinesis-block micronucleus (CBMN) assay can be used to quantify micronucleus (MN) formation, the outcome measured being MN frequency. MN frequency has been shown to be both an accurate measure of chromosomal instability/DNA damage and a risk factor for cancer. Similarly, the Agilent 4×44k human oligonucleotide microarray can be used to quantify gene expression changes. Despite the existence of accepted methodologies to quantify both MN frequency and gene expression, very little is known about the association between the two. In modeling our count outcome (MN frequency) using gene expression levels from the high-throughput assay as our predictor variables, there are many more variables than observations. Hence, we extended the generalized monotone incremental forward stagewise method for predicting a count outcome for high-dimensional feature settings.

| S-EPMC4415688 | biostudies-literature

Forward variable selection for random forest models

Project description: Not available

| S-EPMC10503461 | biostudies-literature

Variable Selection for Nonparametric Quantile Regression via Smoothing Spline AN OVA.

Project description:Quantile regression provides a more thorough view of the effect of covariates on a response. Nonparametric quantile regression has become a viable alternative to avoid restrictive parametric assumption. The problem of variable selection for quantile regression is challenging, since important variables can influence various quantiles in different ways. We tackle the problem via regularization in the context of smoothing spline ANOVA models. The proposed sparse nonparametric quantile regression (SNQR) can identify important variables and provide flexible estimates for quantiles. Our numerical study suggests the promising performance of the new procedure in variable selection and function estimation. Supplementary materials for this article are available online.

| S-EPMC3926212 | biostudies-literature

Nonparametric Variable Selection for Predictive Models and Subpopulations in Clinical Trials.

Project description:Most clinical trials have heterogeneous treatment effect among patient individuals. It is desirable to identify a patient subpopulation, which has a stronger treatment effect than the rest of patients, so that researchers will be able to determine who will benefit the most or the least from the treatment and design treatment strategies accordingly. This paper develops a nonparametric method for predicting clinical response and identifying subpopulations. The method first selects predictors using kernel-based local regression and a forward procedure via F-tests. It then defines subpopulations with enhanced treatment effects based on the selected predictors and the nonparametric model of the clinical response. Simulation examples and a pharmacogenomics study of bortezomib in multiple myeloma demonstrate the proposed method and show favorable performances compared to other existing methods. The proposed method provides an alternative way to define subpopulations and is not limited by parametric models and their possible misspecification for the clinical response.

| S-EPMC4258189 | biostudies-literature

Instrumental variable analysis with a nonlinear exposure-outcome relationship.

Project description:BACKGROUND:Instrumental variable methods can estimate the causal effect of an exposure on an outcome using observational data. Many instrumental variable methods assume that the exposure-outcome relation is linear, but in practice this assumption is often in doubt, or perhaps the shape of the relation is a target for investigation. We investigate this issue in the context of Mendelian randomization, the use of genetic variants as instrumental variables. METHODS:Using simulations, we demonstrate the performance of a simple linear instrumental variable method when the true shape of the exposure-outcome relation is not linear. We also present a novel method for estimating the effect of the exposure on the outcome within strata of the exposure distribution. This enables the estimation of localized average causal effects within quantile groups of the exposure or as a continuous function of the exposure using a sliding window approach. RESULTS:Our simulations suggest that linear instrumental variable estimates approximate a population-averaged causal effect. This is the average difference in the outcome if the exposure for every individual in the population is increased by a fixed amount. Estimates of localized average causal effects reveal the shape of the exposure-outcome relation for a variety of models. These methods are used to investigate the relations between body mass index and a range of cardiovascular risk factors. CONCLUSIONS:Nonlinear exposure-outcome relations should not be a barrier to instrumental variable analyses. When the exposure-outcome relation is not linear, either a population-averaged causal effect or the shape of the exposure-outcome relation can be estimated.

| S-EPMC4222800 | biostudies-literature

A Forward and Backward Stagewise Algorithm for Nonconvex Loss Functions with Adaptive Lasso.

Project description:Penalization is a popular tool for multi- and high-dimensional data. Most of the existing computational algorithms have been developed for convex loss functions. Nonconvex loss functions can sometimes generate more robust results and have important applications. Motivated by the BLasso algorithm, this study develops the Forward and Backward Stagewise (Fabs) algorithm for nonconvex loss functions with the adaptive Lasso (aLasso) penalty. It is shown that each point along the Fabs paths is a δ-approximate solution to the aLasso problem and the Fabs paths converge to the stationary points of the aLasso problem when δ goes to zero, given that the loss function has second-order derivatives bounded from above. This study exemplifies the Fabs with an application to the penalized smooth partial rank (SPR) estimation, for which there is still a lack of effective algorithm. Extensive numerical studies are conducted to demonstrate the benefit of penalized SPR estimation using Fabs, especially under high-dimensional settings. Application to the smoothed 0-1 loss in binary classification is introduced to demonstrate its capability to work with other differentiable nonconvex loss function.

| S-EPMC6181148 | biostudies-literature

knnAUC: an open-source R package for detecting nonlinear dependence between one continuous variable and one binary variable.

Project description:BACKGROUND:Testing the dependence of two variables is one of the fundamental tasks in statistics. In this work, we developed an open-source R package (knnAUC) for detecting nonlinear dependence between one continuous variable X and one binary dependent variables Y (0 or 1). RESULTS:We addressed this problem by using knnAUC (k-nearest neighbors AUC test, the R package is available at https://sourceforge.net/projects/knnauc/ ). In the knnAUC software framework, we first resampled a dataset to get the training and testing dataset according to the sample ratio (from 0 to 1), and then constructed a k-nearest neighbors algorithm classifier to get the yhat estimator (the probability of y?=?1) of testy (the true label of testing dataset). Finally, we calculated the AUC (area under the curve of receiver operating characteristic) estimator and tested whether the AUC estimator is greater than 0.5. To evaluate the advantages of knnAUC compared to seven other popular methods, we performed extensive simulations to explore the relationships between eight different methods and compared the false positive rates and statistical power using both simulated and real datasets (Chronic hepatitis B datasets and kidney cancer RNA-seq datasets). CONCLUSIONS:We concluded that knnAUC is an efficient R package to test non-linear dependence between one continuous variable and one binary dependent variable especially in computational biology area.

| S-EPMC6249767 | biostudies-literature

Outcome-adaptive lasso: Variable selection for causal inference.

Project description:Methodological advancements, including propensity score methods, have resulted in improved unbiased estimation of treatment effects from observational data. Traditionally, a "throw in the kitchen sink" approach has been used to select covariates for inclusion into the propensity score, but recent work shows including unnecessary covariates can impact both the bias and statistical efficiency of propensity score estimators. In particular, the inclusion of covariates that impact exposure but not the outcome, can inflate standard errors without improving bias, while the inclusion of covariates associated with the outcome but unrelated to exposure can improve precision. We propose the outcome-adaptive lasso for selecting appropriate covariates for inclusion in propensity score models to account for confounding bias and maintaining statistical efficiency. This proposed approach can perform variable selection in the presence of a large number of spurious covariates, that is, covariates unrelated to outcome or exposure. We present theoretical and simulation results indicating that the outcome-adaptive lasso selects the propensity score model that includes all true confounders and predictors of outcome, while excluding other covariates. We illustrate covariate selection using the outcome-adaptive lasso, including comparison to alternative approaches, using simulated data and in a survey of patients using opioid therapy to manage chronic pain.

| S-EPMC5591052 | biostudies-literature

A spatio-temporal nonparametric Bayesian variable selection model of fMRI data for clustering correlated time courses.

Project description:In this paper we present a novel wavelet-based Bayesian nonparametric regression model for the analysis of functional magnetic resonance imaging (fMRI) data. Our goal is to provide a joint analytical framework that allows to detect regions of the brain which exhibit neuronal activity in response to a stimulus and, simultaneously, infer the association, or clustering, of spatially remote voxels that exhibit fMRI time series with similar characteristics. We start by modeling the data with a hemodynamic response function (HRF) with a voxel-dependent shape parameter. We detect regions of the brain activated in response to a given stimulus by using mixture priors with a spike at zero on the coefficients of the regression model. We account for the complex spatial correlation structure of the brain by using a Markov random field (MRF) prior on the parameters guiding the selection of the activated voxels, therefore capturing correlation among nearby voxels. In order to infer association of the voxel time courses, we assume correlated errors, in particular long memory, and exploit the whitening properties of discrete wavelet transforms. Furthermore, we achieve clustering of the voxels by imposing a Dirichlet process (DP) prior on the parameters of the long memory process. For inference, we use Markov Chain Monte Carlo (MCMC) sampling techniques that combine Metropolis-Hastings schemes employed in Bayesian variable selection with sampling algorithms for nonparametric DP models. We explore the performance of the proposed model on simulated data, with both block- and event-related design, and on real fMRI data.

| S-EPMC4076058 | biostudies-literature

Nonlinear changes in selection on a mating display across a continuous thermal gradient.

Project description:Understanding how animal communication varies across time and space is critical to understanding how animal signals have evolved and how they function. Changes in temperature, which occur across both time and space, can alter both the courtship and mate choice behaviour of ectothermic animals. In this study, we examine the effect of daily thermal variation on courtship and mate choice in the wolf spider Schizocosa floridana, which produces a complex song with vibrations from three distinct body parts. We test the hypothesis that different components of S. floridana's courtship respond differently to daily changes in temperature and that corresponding mate choice patterns lead to complex, overlapping shifts in selection on the display itself. By manipulating the thermal environment of courting and choosing pairs, we found that several song components increased in production rate with increased temperature, whereas others decreased, or did not respond at all. We also found evidence that selection on courtship shifts with temperature in several ways, with some display components experiencing directional selection at higher temperatures, but not at lower temperatures. Our findings make it clear that understanding the effect of environmental variation on communication is critical to understanding how selection operates on mate choice and how signals, particularly complex signals, evolve.

| S-EPMC6661355 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data