Multicategory angle-based large-margin classification.
Ontology highlight
ABSTRACT:
SUBMITTER: Zhang C
PROVIDER: S-EPMC4629508 | biostudies-literature | 2014 Sep
REPOSITORIES: biostudies-literature
Publications
Multicategory angle-based large-margin classification.
Biometrika 20140723 3
Large-margin classifiers are popular methods for classification. Among existing simultaneous multicategory large-margin classifiers, a common approach is to learn <i>k</i> different functions for a <i>k</i>-class problem with a sum-to-zero constraint. Such a formulation can be inefficient. We propose a new multicategory angle-based large-margin classification framework. The proposed angle-based classifiers consider a simplex-based prediction rule without the sum-to-zero constraint, and enjoy mor ...[more]
Similar Datasets
Project description:The Support Vector Machine (SVM) is a very popular classification tool with many successful applications. It was originally designed for binary problems with desirable theoretical properties. Although there exist various Multicategory SVM (MSVM) extensions in the literature, some challenges remain. In particular, most existing MSVMs make use of k classification functions for a k-class problem, and the corresponding optimization problems are typically handled by existing quadratic programming solvers. In this paper, we propose a new group of MSVMs, namely the Reinforced Angle-based MSVMs (RAMSVMs), using an angle-based prediction rule with k - 1 functions directly. We prove that RAMSVMs can enjoy Fisher consistency. Moreover, we show that the RAMSVM can be implemented using the very efficient coordinate descent algorithm on its dual problem. Numerical experiments demonstrate that our method is highly competitive in terms of computational speed, as well as classification prediction performance. Supplemental materials for the article are available online.
| S-EPMC5120762 | biostudies-literature
Project description:Due to heterogeneity for many chronic diseases, precise personalized medicine, also known as precision medicine, has drawn increasing attentions in the scientific community. One main goal of precision medicine is to develop the most effective tailored therapy for each individual patient. To that end, one needs to incorporate individual characteristics to detect a proper individual treatment rule (ITR), by which suitable decisions on treatment assignments can be made to optimize patients' clinical outcome. For binary treatment settings, outcome weighted learning (OWL) and several of its variations have been proposed recently to estimate the ITR by optimizing the conditional expected outcome given patients' information. However, for multiple treatment scenarios, it remains unclear how to use OWL effectively. It can be shown that some direct extensions of OWL for multiple treatments, such as one-versus-one and one-versus-rest methods, can yield suboptimal performance. In this paper, we propose a new learning method, named Multicategory Outcome weighted Margin-based Learning (MOML), for estimating ITR with multiple treatments. Our proposed method is very general and covers OWL as a special case. We show Fisher consistency for the estimated ITR, and establish convergence rate properties. Variable selection using the sparse l 1 penalty is also considered. Analysis of simulated examples and a type 2 diabetes mellitus observational study are used to demonstrate competitive performance of the proposed method.
| S-EPMC7731977 | biostudies-literature
Project description:Representing data in hyperbolic space can effectively capture latent hierarchical relationships. To enable accurate classification of points in hyperbolic space while respecting their hyperbolic geometry, we introduce hyperbolic SVM, a hyperbolic formulation of support vector machine classifiers, and describe its theoretical connection to the Euclidean counterpart. We also generalize Euclidean kernel SVM to hyperbolic space, allowing nonlinear hyperbolic decision boundaries and providing a geometric interpretation for a certain class of indefinite kernels. Hyperbolic SVM improves classification accuracy in simulation and in real-world problems involving complex networks and word embeddings. Our work enables end-to-end analyses based on the inherent hyperbolic geometry of the data without resorting to ill-fitting tools developed for Euclidean space.
| S-EPMC7434093 | biostudies-literature
Project description:As a characteristic edible fungus with a high nutritional value and medicinal effect, the Bachu mushroom has a broad market. To distinguish among Bachu mushrooms with high value and other fungi effectively and accurately, as well as to explore a universal identification method, this study proposed a method to identify Bachu mushrooms by Fourier Transform Infrared Spectroscopy (FT-IR) combined with machine learning. In this experiment, two kinds of common edible mushrooms, Lentinus edodes and club fungi, were selected and classified with Bachu mushrooms. Due to the different distribution of nutrients in the caps and stalks, the caps and stalks were studied in this experiment. By comparing the average normalized infrared spectra of the caps and stalks of the three types of fungi, we found differences in their infrared spectra, indicating that the latter can be used to classify and identify the three types of fungi. We also used machine learning to process the spectral data. The overall steps of data processing are as follows: use partial least squares (PLS) to extract spectral features, select the appropriate characteristic number, use different classification algorithms for classification, and finally determine the best algorithm according to the classification results. Among them, the basis of selecting the characteristic number was the cumulative variance interpretation rate. To improve the reliability of the experimental results, this study also used the classification results to verify the feasibility. The classification algorithms used in this study were the support vector machine (SVM), backpropagation neural network (BPNN) and k-nearest neighbors (KNN) algorithm. The results showed that the three algorithms achieved good results in the multivariate classification of the caps and stalks data. Moreover, the cumulative variance explanation rate could be used to select the characteristic number. Finally, by comparing the classification results of the three algorithms, the classification effect of KNN was found to be the best. Additionally, the classification results were as follows: according to the caps data classification, the accuracy was 99.06%; according to the stalks data classification, the accuracy was 99.82%. This study showed that infrared spectroscopy combined with a machine learning algorithm has the potential to be applied to identify Bachu mushrooms and the cumulative variance explanation rate can be used to select the characteristic number. This method can also be used to identify other types of edible fungi and has a broad application prospect.
| S-EPMC7444812 | biostudies-literature
Project description:Recent advances in next-generation DNA sequencing enable rapid high-throughput quantitation of microbial community composition in human samples, opening up a new field of microbiomics. One of the promises of this field is linking abundances of microbial taxa to phenotypic and physiological states, which can inform development of new diagnostic, personalized medicine, and forensic modalities. Prior research has demonstrated the feasibility of applying machine learning methods to perform body site and subject classification with microbiomic data. However, it is currently unknown which classifiers perform best among the many available alternatives for classification with microbiomic data.In this work, we performed a systematic comparison of 18 major classification methods, 5 feature selection methods, and 2 accuracy metrics using 8 datasets spanning 1,802 human samples and various classification tasks: body site and subject classification and diagnosis.We found that random forests, support vector machines, kernel ridge regression, and Bayesian logistic regression with Laplace priors are the most effective machine learning techniques for performing accurate classification from these microbiomic data.
| S-EPMC3960509 | biostudies-literature
Project description:Optical Music Recognition (OMR) has received increasing attention in recent years. In this paper, we propose a classifier based on a new method named Directed Acyclic Graph-Large margin Distribution Machine (DAG-LDM). The DAG-LDM is an improvement of the Large margin Distribution Machine (LDM), which is a binary classifier that optimizes the margin distribution by maximizing the margin mean and minimizing the margin variance simultaneously. We modify the LDM to the DAG-LDM to solve the multi-class music symbol classification problem. Tests are conducted on more than 10000 music symbol images, obtained from handwritten and printed images of music scores. The proposed method provides superior classification capability and achieves much higher classification accuracy than the state-of-the-art algorithms such as Support Vector Machines (SVMs) and Neural Networks (NNs).
| S-EPMC4795649 | biostudies-literature
Project description:Large margin classifiers have been shown to be very useful in many applications. The Support Vector Machine is a canonical example of large margin classifiers. Despite their flexibility and ability in handling high dimensional data, many large margin classifiers have serious drawbacks when the data are noisy, especially when there are outliers in the data. In this paper, we propose a new weighted large margin classification technique. The weights are chosen adaptively with data. The proposed classifiers are shown to be robust to outliers and thus are able to produce more accurate classification results.
| S-EPMC3867158 | biostudies-literature
Project description:AimThis study aimed to investigate circumferential resection margin (CRM) as a prognostic factor for long-term oncologic survival after rectal cancer surgery.MethodsPatients diagnosed with malignant rectal cancer between 1 January 2010 and 31 December 2014, from the Surveillance, Epidemiology, and End Results (SEER) program were identified for this study. The patients were divided into five CRM groups to compare the baseline characteristics and assess cancer-specific survival (CSS): 0-1 mm, 1.1-2.0 mm, 2.1-5.0 mm, 5.1-10.0 mm, and >10 mm. The main endpoint was CSS.ResultsCircumferential resection margin ?1 mm was independently associated with 99% increased risk of cancer-specific mortality in rectal cancer [hazard ratio (HR) = 1.990, 95% confidence interval (CI) = 1.613-2.454, P < 0.001, using CRM (1.1-2.0 mm) as a reference]. CRM (5.1-10.0 mm) was independently associated with 29.2% decreased risk of cancer-specific mortality [HR = 0.708, 95% CI = 0.525-0.954, P = 0.152, using group (2.1-5.0 mm) as reference]. CRM ?2 mm or ?0.4 mm was not obviously associated with CSS.Conclusionscircumferential resection margin is an independent prognostic factor in rectal cancer. Surgeons should try to maximize the CRM. Rectal cancer patients with CRM ?1 mm should receive more postoperative attention depending on individual situation. Also, CRM should be accurately measured in millimeters in a preoperative magnetic resonance imaging or pathological report, rather than simply described as "involved" or "clear."
| S-EPMC6089167 | biostudies-literature
Project description:BackgroundAccurate diagnosis of pneumonia is vital for effective disease management and mortality reduction, but it can be easily confused with other conditions on chest computed tomography (CT) due to an overlap in imaging features. We aimed to develop and validate a deep learning (DL) model based on chest CT for accurate classification of viral pneumonia (VP), bacterial pneumonia (BP), fungal pneumonia (FP), pulmonary tuberculosis (PTB), and no pneumonia (NP) conditions.MethodsIn total, 1,776 cases from five hospitals in different regions were retrospectively collected from September 2019 to June 2023. All cases were enrolled according to inclusion and exclusion criteria, and ultimately 1,611 cases were used to develop the DL model with 5-fold cross-validation, with 165 cases being used as the external test set. Five radiologists blindly reviewed the images from the internal and external test sets first without and then with DL model assistance. Precision, recall, F1-score, weighted F1-average, and area under the curve (AUC) were used to evaluate the model performance.ResultsThe F1-scores of the DL model on the internal and external test sets were, respectively, 0.947 [95% confidence interval (CI): 0.936-0.958] and 0.933 (95% CI: 0.916-0.950) for VP, 0.511 (95% CI: 0.487-0.536) and 0.591 (95% CI: 0.557-0.624) for BP, 0.842 (95% CI: 0.824-0.860) and 0.848 (95% CI: 0.824-0.873) for FP, 0.843 (95% CI: 0.826-0.861) and 0.795 (95% CI: 0.767-0.822) for PTB, and 0.975 (95% CI: 0.968-0.983) and 0.976 (95% CI: 0.965-0.986) for NP, with a weighted F1-average of 0.883 (95% CI: 0.867-0.898) and 0.846 (95% CI: 0.822-0.871), respectively. The model performed well and showed comparable performance in both the internal and external test sets. The F1-score of the DL model was higher than that of radiologists, and with DL model assistance, radiologists achieved a higher F1-score. On the external test set, the F1-score of the DL model (F1-score 0.848; 95% CI: 0.824-0.873) was higher than that of the radiologists (F1-score 0.541; 95% CI: 0.507-0.575) as was its precision for the other three pneumonia conditions (all P values <0.001). With DL model assistance, the F1-score for FP (F1-score 0.541; 95% CI: 0.507-0.575) was higher than that achieved without assistance (F1-score 0.778; 95% CI: 0.750-0.807) as was its precision for the other three pneumonia conditions (all P values <0.001).ConclusionsThe DL approach can effectively classify pneumonia and can help improve radiologists' performance, supporting the full integration of DL results into the routine workflow of clinicians.
| S-EPMC10722067 | biostudies-literature
Project description:Holographic 3D display is highly desirable for numerous applications ranging from medical treatments to military affairs. However, it is challenging to simultaneously achieve large viewing angle and high-fidelity color reconstruction due to the intractable constraints of existing technology. Here, we conceptually propose and experimentally demonstrate a simple and feasible pathway of using a well-designed color liquid crystal grating to overcome the inevitable chromatic aberration and enlarge the holographic viewing angle, thus enabling large-viewing-angle and color holographic 3D display. The use of color liquid crystal grating allows performing secondary diffraction modulation on red, green and blue reproduced images simultaneously and extending the viewing angle in the holographic 3D display system. In principle, a chromatic aberration-free hologram generation mechanism in combination with the color liquid crystal grating is proposed to pave the way for on such a superior holographic 3D display. The proposed system shows a color viewing angle of ~50.12°, which is about 7 times that of the traditional system with a single spatial light modulator. This work presents a paradigm for achieving desirable holographic 3D display, and is expected to provide a new way for the wide application of holographic display.
| S-EPMC10788332 | biostudies-literature