Unknown

Dataset Information

0

A general approach to simultaneous model fitting and variable elimination in response models for biological data with many more variables than observations.


ABSTRACT:

Background

With the advent of high throughput biotechnology data acquisition platforms such as micro arrays, SNP chips and mass spectrometers, data sets with many more variables than observations are now routinely being collected. Finding relationships between response variables of interest and variables in such data sets is an important problem akin to finding needles in a haystack. Whilst methods for a number of response types have been developed a general approach has been lacking.

Results

The major contribution of this paper is to present a unified methodology which allows many common (statistical) response models to be fitted to such data sets. The class of models includes virtually any model with a linear predictor in it, for example (but not limited to), multiclass logistic regression (classification), generalised linear models (regression) and survival models. A fast algorithm for finding sparse well fitting models is presented. The ideas are illustrated on real data sets with numbers of variables ranging from thousands to millions. R code implementing the ideas is available for download.

Conclusion

The method described in this paper enables existing work on response models when there are less variables than observations to be leveraged to the situation when there are many more variables than observations. It is a powerful approach to finding parsimonious models for such datasets. The method is capable of handling problems with millions of variables and a large variety of response types within the one framework. The method compares favourably to existing methods such as support vector machines and random forests, but has the advantage of not requiring separate variable selection steps. It is also works for data types which these methods were not designed to handle. The method usually produces very sparse models which make biological interpretation simpler and more focused.

SUBMITTER: Kiiveri HT 

PROVIDER: S-EPMC2390543 | biostudies-literature | 2008 Apr

REPOSITORIES: biostudies-literature

altmetric image

Publications

A general approach to simultaneous model fitting and variable elimination in response models for biological data with many more variables than observations.

Kiiveri Harri T HT  

BMC bioinformatics 20080415


<h4>Background</h4>With the advent of high throughput biotechnology data acquisition platforms such as micro arrays, SNP chips and mass spectrometers, data sets with many more variables than observations are now routinely being collected. Finding relationships between response variables of interest and variables in such data sets is an important problem akin to finding needles in a haystack. Whilst methods for a number of response types have been developed a general approach has been lacking.<h4  ...[more]

Similar Datasets

| S-EPMC5290149 | biostudies-literature
| S-EPMC4218779 | biostudies-literature
| S-EPMC4884197 | biostudies-literature
| S-EPMC4941943 | biostudies-literature
| S-EPMC3869725 | biostudies-literature
| S-EPMC7214020 | biostudies-literature
| S-EPMC7653908 | biostudies-literature
| S-EPMC3848918 | biostudies-literature
| S-EPMC6138660 | biostudies-literature
| S-EPMC6933098 | biostudies-literature