Study design in high-dimensional classification analysis.
Ontology highlight
ABSTRACT:
SUBMITTER: Sanchez BN
PROVIDER: S-EPMC5031947 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In many application areas, data are collected on a categorical response and high-dimensional categorical predictors, with the goals being to build a parsimonious model for classification while doing inferences on the important predictors. In settings such as genomics, there can be complex interactions among the predictors. By using a carefully-structured Tucker factorization, we define a model that can characterize any conditional probability, while facilitating variable selection and modeling of higher-order interactions. Following a Bayesian approach, we propose a Markov chain Monte Carlo algorithm for posterior computation accommodating uncertainty in the predictors to be included. Under near low rank assumptions, the posterior distribution for the conditional probability is shown to achieve close to the parametric rate of contraction even in ultra high-dimensional settings. The methods are illustrated using simulation examples and biomedical applications.
| S-EPMC6980791 | biostudies-literature
Project description:Endometriosis, an estrogen-dependent, progesterone-resistant, inflammatory disorder affects 10% of reproductive-age women. It is diagnosed and staged at surgery, resulting in an 11-year latency from symptom onset to diagnosis, underscoring the need for less invasive, less expensive approaches. Since the uterine lining (endometrium) in women with endometriosis has altered molecular profiles, we tested whether molecular classification of this tissue can distinguish and stage disease. We developed classifiers using genomic data from n=148 archived endometrial samples from women with endometriosis or without endometriosis (normal controls or with other common uterine/pelvic pathologies) across the menstrual cycle and evaluated their performance on independent sample sets. Classifiers were trained separately on samples in specific hormonal milieu, using margin tree classification, and accuracies were scored on independent validation samples. Classification of samples from women with endometriosis or no endometriosis involved two binary decisions each based on expression of specific genes. These first distinguished presence or absence of uterine/pelvic pathology and then no endometriosis from endometriosis, with the latter further classified according to severity (minimal/mild or moderate/severe). Best performing classifiers identified endometriosis with 90-100% accuracy, were cycle phase-specific or independent, and utilized relatively few genes to determine disease and severity. Differential gene expression and pathway analyses revealed immune activation, altered steroid and thyroid hormone signaling/metabolism and growth factor signaling in endometrium of women with endometriosis. Similar findings were observed with other disorders versus controls. Thus, classifier analysis of genomic data from endometrium can detect and stage pelvic endometriosis with high accuracy, dependent or independent of hormonal milieu. We propose that limited classifier candidate-genes are of high value in developing diagnostics and identifying therapeutic targets. Discovery of endometrial molecular differences in the presence of endometriosis and other uterine/pelvic pathologies raises the broader biological question of their impact on the steroid hormone response and normal functions of this tissue. We analyzed endometrial samples from n=148 women without or with endometriosis and/or other uterine/pelvic pathologies, using whole genome microarrays.
2014-10-01 | E-GEOD-51981 | biostudies-arrayexpress
Project description:Partial least squares (PLS) is a well known dimension reduction method which has been recently adapted for high dimensional classification problems in genome biology. We develop sparse versions of the recently proposed two PLS-based classification methods using sparse partial least squares (SPLS). These sparse versions aim to achieve variable selection and dimension reduction simultaneously. We consider both binary and multicategory classification. We provide analytical and simulation-based insights about the variable selection properties of these approaches and benchmark them on well known publicly available datasets that involve tumor classification with high dimensional gene expression data. We show that incorporation of SPLS into a generalized linear model (GLM) framework provides higher sensitivity in variable selection for multicategory classification with unbalanced sample sizes between classes. As the sample size increases, the two-stage approach provides comparable sensitivity with better specificity in variable selection. In binary classification and multicategory classification with balanced sample sizes, the two-stage approach provides comparable variable selection and prediction accuracy as the GLM version and is computationally more efficient.
| S-EPMC2861314 | biostudies-literature
Project description:Endometriosis, an estrogen-dependent, progesterone-resistant, inflammatory disorder affects 10% of reproductive-age women. It is diagnosed and staged at surgery, resulting in an 11-year latency from symptom onset to diagnosis, underscoring the need for less invasive, less expensive approaches. Since the uterine lining (endometrium) in women with endometriosis has altered molecular profiles, we tested whether molecular classification of this tissue can distinguish and stage disease. We developed classifiers using genomic data from n=148 archived endometrial samples from women with endometriosis or without endometriosis (normal controls or with other common uterine/pelvic pathologies) across the menstrual cycle and evaluated their performance on independent sample sets. Classifiers were trained separately on samples in specific hormonal milieu, using margin tree classification, and accuracies were scored on independent validation samples. Classification of samples from women with endometriosis or no endometriosis involved two binary decisions each based on expression of specific genes. These first distinguished presence or absence of uterine/pelvic pathology and then no endometriosis from endometriosis, with the latter further classified according to severity (minimal/mild or moderate/severe). Best performing classifiers identified endometriosis with 90-100% accuracy, were cycle phase-specific or independent, and utilized relatively few genes to determine disease and severity. Differential gene expression and pathway analyses revealed immune activation, altered steroid and thyroid hormone signaling/metabolism and growth factor signaling in endometrium of women with endometriosis. Similar findings were observed with other disorders versus controls. Thus, classifier analysis of genomic data from endometrium can detect and stage pelvic endometriosis with high accuracy, dependent or independent of hormonal milieu. We propose that limited classifier candidate-genes are of high value in developing diagnostics and identifying therapeutic targets. Discovery of endometrial molecular differences in the presence of endometriosis and other uterine/pelvic pathologies raises the broader biological question of their impact on the steroid hormone response and normal functions of this tissue.
2014-10-01 | GSE51981 | GEO
Project description:Diagonal discriminant rules have been successfully used for high-dimensional classification problems, but suffer from the serious drawback of biased discriminant scores. In this article, we propose improved diagonal discriminant rules with bias-corrected discriminant scores for high-dimensional classification. We show that the proposed discriminant scores dominate the standard ones under the quadratic loss function. Analytical results on why the bias-corrected rules can potentially improve the predication accuracy are also provided. Finally, we demonstrate the improvement of the proposed rules over the original ones through extensive simulation studies and real case studies.
| S-EPMC3164859 | biostudies-other
Project description:High-dimensionality data is rapidly becoming the norm for biomedical sciences and many other analytical disciplines. Not only is the collection and processing time for such data becoming problematic, but it has become increasingly difficult to form a comprehensive appreciation of high-dimensionality data. Though data analysis methods for coping with multivariate data are well-documented in technical fields such as computer science, little effort is currently being expended to condense data vectors that exist beyond the realm of physical space into an easily interpretable and aesthetic form. To address this important need, we have developed Plurigon, a data visualization and classification tool for the integration of high-dimensionality visualization algorithms with a user-friendly, interactive graphical interface. Unlike existing data visualization methods, which are focused on an ensemble of data points, Plurigon places a strong emphasis upon the visualization of a single data point and its determining characteristics. Multivariate data vectors are represented in the form of a deformed sphere with a distinct topology of hills, valleys, plateaus, peaks, and crevices. The gestalt structure of the resultant Plurigon object generates an easily-appreciable model. User interaction with the Plurigon is extensive; zoom, rotation, axial and vector display, feature extraction, and anaglyph stereoscopy are currently supported. With Plurigon and its ability to analyze high-complexity data, we hope to see a unification of biomedical and computational sciences as well as practical applications in a wide array of scientific disciplines. Increased accessibility to the analysis of high-dimensionality data may increase the number of new discoveries and breakthroughs, ranging from drug screening to disease diagnosis to medical literature mining.
| S-EPMC3717481 | biostudies-literature
Project description:Epistasis or gene-gene interaction has gained increasing attention in studies of complex diseases. Its presence as an ubiquitous component of genetic architecture of common human diseases has been contemplated. However, the detection of gene-gene interaction is difficult due to combinatorial explosion.We present a novel feature selection method incorporating variable interaction. Three gene expression datasets are analyzed to illustrate our method, although it can also be applied to other types of high-dimensional data. The quality of variables selected is evaluated in two ways: first by classification error rates, then by functional relevance assessed using biological knowledge. We show that the classification error rates can be significantly reduced by considering interactions. Secondly, a sizable portion of genes identified by our method for breast cancer metastasis overlaps with those reported in gene-to-system breast cancer (G2SBC) database as disease associated and some of them have interesting biological implication. In summary, interaction-based methods may lead to substantial gain in biological insights as well as more accurate prediction.
| S-EPMC3577111 | biostudies-literature
Project description:Although CSF analysis routinely enables the diagnosis of neurological diseases, it is mainly used for the gross distinction between infectious, autoimmune inflammatory, and degenerative disorders of the CNS. To investigate, whether a multi-dimensional cellular blood and CSF characterization can support the diagnosis of clinically similar neurological diseases, we analysed 546 patients with autoimmune neuroinflammatory, degenerative, or vascular conditions in a cross-sectional retrospective study. By combining feature selection with dimensionality reduction and machine learning approaches we identified pan-disease parameters that were altered across all autoimmune neuroinflammatory CNS diseases and differentiated them from other neurological conditions and inter-autoimmunity classifiers that subdifferentiate variants of CNS-directed autoimmunity. Pan-disease as well as diseases-specific changes formed a continuum, reflecting clinical disease evolution. A validation cohort of 231 independent patients confirmed that combining multiple parameters into composite scores can assist the classification of neurological patients. Overall, we showed that the integrated analysis of blood and CSF parameters improves the differential diagnosis of neurological diseases, thereby facilitating early treatment decisions.
| S-EPMC8557345 | biostudies-literature
Project description:MotivationA complex disease is usually driven by a number of genes interwoven into networks, rather than a single gene product. Network comparison or differential network analysis has become an important means of revealing the underlying mechanism of pathogenesis and identifying clinical biomarkers for disease classification. Most studies, however, are limited to network correlations that mainly capture the linear relationship among genes, or rely on the assumption of a parametric probability distribution of gene measurements. They are restrictive in real application.ResultsWe propose a new Joint density based non-parametric Differential Interaction Network Analysis and Classification (JDINAC) method to identify differential interaction patterns of network activation between two groups. At the same time, JDINAC uses the network biomarkers to build a classification model. The novelty of JDINAC lies in its potential to capture non-linear relations between molecular interactions using high-dimensional sparse data as well as to adjust confounding factors, without the need of the assumption of a parametric probability distribution of gene measurements. Simulation studies demonstrate that JDINAC provides more accurate differential network estimation and lower classification error than that achieved by other state-of-the-art methods. We apply JDINAC to a Breast Invasive Carcinoma dataset, which includes 114 patients who have both tumor and matched normal samples. The hub genes and differential interaction patterns identified were consistent with existing experimental studies. Furthermore, JDINAC discriminated the tumor and normal sample with high accuracy by virtue of the identified biomarkers. JDINAC provides a general framework for feature selection and classification using high-dimensional sparse omics data.Availability and implementationR scripts available at https://github.com/jijiadong/JDINAC.Contactlxie@iscb.org.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC5870609 | biostudies-literature
Project description:Endometriosis (E), an estrogen-dependent, progesterone-resistant, inflammatory disorder, affects 10% of reproductive-age women. It is diagnosed and staged at surgery, resulting in an 11-year latency from symptom onset to diagnosis, underscoring the need for less invasive, less expensive approaches. Because the uterine lining (endometrium) in women with E has altered molecular profiles, we tested whether molecular classification of this tissue can distinguish and stage disease. We developed classifiers using genomic data from n = 148 archived endometrial samples from women with E or without E (normal controls or with other common uterine/pelvic pathologies) across the menstrual cycle and evaluated their performance on independent sample sets. Classifiers were trained separately on samples in specific hormonal milieu, using margin tree classification, and accuracies were scored on independent validation samples. Classification of samples from women with E or no E involved 2 binary decisions, each based on expression of specific genes. These first distinguished presence or absence of uterine/pelvic pathology and then no E from E, with the latter further classified according to severity (minimal/mild or moderate/severe). Best performing classifiers identified E with 90%-100% accuracy, were cycle phase-specific or independent, and used relatively few genes to determine disease and severity. Differential gene expression and pathway analyses revealed immune activation, altered steroid and thyroid hormone signaling/metabolism, and growth factor signaling in endometrium of women with E. Similar findings were observed with other disorders vs controls. Thus, classifier analysis of genomic data from endometrium can detect and stage pelvic E with high accuracy, dependent or independent of hormonal milieu. We propose that limited classifier candidate genes are of high value in developing diagnostics and identifying therapeutic targets. Discovery of endometrial molecular differences in the presence of E and other uterine/pelvic pathologies raises the broader biological question of their impact on the steroid hormone response and normal functions of this tissue.
| S-EPMC4239429 | biostudies-literature