Unknown

Dataset Information

0

The Cluster Elastic Net for High-Dimensional Regression With Unknown Variable Grouping.


ABSTRACT: In the high-dimensional regression setting, the elastic net produces a parsimonious model by shrinking all coefficients towards the origin. However, in certain settings, this behavior might not be desirable: if some features are highly correlated with each other and associated with the response, then we might wish to perform less shrinkage on the coefficients corresponding to that subset of features. We propose the cluster elastic net, which selectively shrinks the coefficients for such variables towards each other, rather than towards the origin. Instead of assuming that the clusters are known a priori, the cluster elastic net infers clusters of features from the data, on the basis of correlation among the variables as well as association with the response. These clusters are then used in order to more accurately perform regression. We demonstrate the theoretical advantages of our proposed approach, and explore its performance in a simulation study, and in an application to HIV drug resistance data. Supplementary Materials are available online.

SUBMITTER: Witten DM 

PROVIDER: S-EPMC4011669 | biostudies-literature | 2014 Feb

REPOSITORIES: biostudies-literature

altmetric image

Publications

The Cluster Elastic Net for High-Dimensional Regression With Unknown Variable Grouping.

Witten Daniela M DM   Shojaie Ali A   Zhang Fan F  

Technometrics : a journal of statistics for the physical, chemical, and engineering sciences 20140201 1


In the high-dimensional regression setting, the elastic net produces a parsimonious model by shrinking all coefficients towards the origin. However, in certain settings, this behavior might not be desirable: if some features are highly correlated with each other and associated with the response, then we might wish to perform less shrinkage on the coefficients corresponding to that subset of features. We propose the <i>cluster elastic net</i>, which selectively shrinks the coefficients for such v  ...[more]

Similar Datasets

| S-EPMC8640025 | biostudies-literature
| S-EPMC8596493 | biostudies-literature
| S-EPMC6180486 | biostudies-literature
| S-EPMC6519238 | biostudies-literature
| S-EPMC5939227 | biostudies-literature
| S-EPMC4094402 | biostudies-literature
| S-EPMC8825615 | biostudies-literature
| S-EPMC7026376 | biostudies-literature
| S-EPMC6193274 | biostudies-literature
| S-EPMC4142445 | biostudies-literature