Variational quantum approximate support vector machine with inference transfer.
Ontology highlight
ABSTRACT:
SUBMITTER: Park S
PROVIDER: S-EPMC9968349 | biostudies-literature | 2023 Feb
REPOSITORIES: biostudies-literature
Publications
Variational quantum approximate support vector machine with inference transfer.
Park Siheon S Park Daniel K DK Rhee June-Koo Kevin JK
Scientific reports 20230225 1
A kernel-based quantum classifier is the most practical and influential quantum machine learning technique for the hyper-linear classification of complex data. We propose a Variational Quantum Approximate Support Vector Machine (VQASVM) algorithm that demonstrates empirical sub-quadratic run-time complexity with quantum operations feasible even in NISQ computers. We experimented our algorithm with toy example dataset on cloud-based NISQ machines as a proof of concept. We also numerically investi ...[more]
Similar Datasets
Project description:While Bayesian functional mixed models have been shown effective to model functional data with various complex structures, their application to extremely high-dimensional data is limited due to computational challenges involved in posterior sampling. We introduce a new computational framework that enables ultra-fast approximate inference for high-dimensional data in functional form. This framework adopts parsimonious basis to represent functional observations, which facilitates efficient compression and parallel computing in basis space. Instead of performing expensive Markov chain Monte Carlo sampling, we approximate the posterior distribution using variational Bayes and adopt a fast iterative algorithm to estimate parameters of the approximate distribution. Our approach facilitates a fast multiple testing procedure in basis space, which can be used to identify significant local regions that reflect differences across groups of samples. We perform two simulation studies to assess the performance of approximate inference, and demonstrate applications of the proposed approach by using a proteomic mass spectrometry dataset and a brain imaging dataset. Supplementary materials are available online.
| S-EPMC10441618 | biostudies-literature
Project description:Variational Bayes (VB) inference algorithm is used widely to estimate both the parameters and the unobserved hidden variables in generative statistical models. The algorithm-inspired by variational methods used in computational physics-is iterative and can get easily stuck in local minima, even when classical techniques, such as deterministic annealing (DA), are used. We study a VB inference algorithm based on a nontraditional quantum annealing approach-referred to as quantum annealing variational Bayes (QAVB) inference-and show that there is indeed a quantum advantage to QAVB over its classical counterparts. In particular, we show that such better performance is rooted in key quantum mechanics concepts: i) The ground state of the Hamiltonian of a quantum system-defined from the given data-corresponds to an optimal solution for the minimization problem of the variational free energy at very low temperatures; ii) such a ground state can be achieved by a technique paralleling the quantum annealing process; and iii) starting from this ground state, the optimal solution to the VB problem can be achieved by increasing the heat bath temperature to unity, and thereby avoiding local minima introduced by spontaneous symmetry breaking observed in classical physics based VB algorithms. We also show that the update equations of QAVB can be potentially implemented using ⌈logK⌉ qubits and 𝒪(K) operations per step, where K is the number of values hidden categorical variables can take. Thus, QAVB can match the time complexity of existing VB algorithms, while delivering higher performance.
| S-EPMC10400996 | biostudies-literature
Project description:Coalescent methods are proven and powerful tools for population genetics, phylogenetics, epidemiology, and other fields. A promising avenue for the analysis of large genomic alignments, which are increasingly common, is coalescent hidden Markov model (coalHMM) methods, but these methods have lacked general usability and flexibility. We introduce a novel method for automatically learning a coalHMM and inferring the posterior distributions of evolutionary parameters using black-box variational inference, with the transition rates between local genealogies derived empirically by simulation. This derivation enables our method to work directly with three or four taxa and through a divide-and-conquer approach with more taxa. Using a simulated data set resembling a human-chimp-gorilla scenario, we show that our method has comparable or better accuracy to previous coalHMM methods. Both species divergence times and population sizes were accurately inferred. The method also infers local genealogies, and we report on their accuracy. Furthermore, we discuss a potential direction for scaling the method to larger data sets through a divide-and-conquer approach. This accuracy means our method is useful now, and by deriving transition rates by simulation, it is flexible enough to enable future implementations of various population models.
| S-EPMC8559707 | biostudies-literature
Project description:Recent technological advances may lead to the development of small scale quantum computers capable of solving problems that cannot be tackled with classical computers. A limited number of algorithms has been proposed and their relevance to real world problems is a subject of active investigation. Analysis of many-body quantum system is particularly challenging for classical computers due to the exponential scaling of Hilbert space dimension with the number of particles. Hence, solving problems relevant to chemistry and condensed matter physics are expected to be the first successful applications of quantum computers. In this paper, we propose another class of problems from the quantum realm that can be solved efficiently on quantum computers: model inference for nuclear magnetic resonance (NMR) spectroscopy, which is important for biological and medical research. Our results are based on three interconnected studies. Firstly, we use methods from classical machine learning to analyze a dataset of NMR spectra of small molecules. We perform a stochastic neighborhood embedding and identify clusters of spectra, and demonstrate that these clusters are correlated with the covalent structure of the molecules. Secondly, we propose a simple and efficient method, aided by a quantum simulator, to extract the NMR spectrum of any hypothetical molecule described by a parametric Heisenberg model. Thirdly, we propose a simple variational Bayesian inference procedure for extracting Hamiltonian parameters of experimentally relevant NMR spectra.
| S-EPMC7643990 | biostudies-literature
Project description:The shared random effects joint model is one of the most widely used approaches to study the associations between longitudinal biomarkers and a survival outcome and make dynamic risk predictions using the longitudinally measured biomarkers. Various types of joint models have been developed under different settings in the past decades. One major limitation of joint models is that they could be computationally expensive for complex models where the number of the shared random effects is large. Moreover, the inferential accuracy of joint models could also be diminished for complex models due to approximation errors. However, complex models are frequently needed in practice, for example, when the longitudinal biomarkers have nonlinear trajectories over time or the number of longitudinal biomarkers of interest is large. In this article, we propose a novel Gaussian variational approximate inference approach for fitting joint models, which significantly improves computational efficiency while maintaining inferential accuracy. We conduct extensive simulation studies to evaluate the performance of our proposed method and compare it to existing methods. The performance of our proposed method is further demonstrated on a dataset of patients with primary biliary cirrhosis.
| S-EPMC10099947 | biostudies-literature
Project description:Linear and generalized linear scalar-on-function modeling have been commonly used to understand the relationship between a scalar response variable (e.g. continuous, binary outcomes) and functional predictors. Such techniques are sensitive to model misspecification when the relationship between the response variable and the functional predictors is complex. On the other hand, support vector machines (SVMs) are among the most robust prediction models but do not take account of the high correlations between repeated measurements and cannot be used for irregular data. In this work, we propose a novel method to integrate functional principal component analysis with SVM techniques for classification and regression to account for the continuous nature of functional data and the nonlinear relationship between the scalar response variable and the functional predictors. We demonstrate the performance of our method through extensive simulation experiments and two real data applications: the classification of alcoholics using electroencephalography signals and the prediction of glucobrassicin concentration using near-infrared reflectance spectroscopy. Our methods especially have more advantages when the measurement errors in functional predictors are relatively large.
| S-EPMC11639177 | biostudies-literature
Project description:We propose a photon-counting-statistics-based imaging process for quantum imaging where background photon noise can be distinguished and eliminated by photon mode estimation from the multi-mode Bose-Einstein distribution. Photon-counting statistics show multi-mode behavior in a practical, low-cost single-photon-level quantum imaging system with a short coherence time and a long measurement time interval. Different mode numbers in photon-counting probability distributions from single-photon illumination and background photon noise can be classified by a machine learning technique such as a support vector machine (SVM). The proposed photon-counting statistics-based support vector machine (PSSVM) learns the difference in the photon-counting distribution of each pixel to distinguish between photons from the source and the background photon noise to improve the image quality. We demonstrated quantum imaging of a binary-image object with photon illumination from a spontaneous parametric down-conversion (SPDC) source. The experiment results show that the PSSVM applied quantum image improves a peak signal-to-noise ratio (PSNR) gain of 2.89dB and a structural similarity index measure (SSIM) gain of 27.7% compared to the conventional direct single-photon imaging.
| S-EPMC9534992 | biostudies-literature
Project description:This paper focuses on the feature gene selection for cancer classification, which employs an optimization algorithm to select a subset of the genes. We propose a binary quantum-behaved particle swarm optimization (BQPSO) for cancer feature gene selection, coupling support vector machine (SVM) for cancer classification. First, the proposed BQPSO algorithm is described, which is a discretized version of original QPSO for binary 0-1 optimization problems. Then, we present the principle and procedure for cancer feature gene selection and cancer classification based on BQPSO and SVM with leave-one-out cross validation (LOOCV). Finally, the BQPSO coupling SVM (BQPSO/SVM), binary PSO coupling SVM (BPSO/SVM), and genetic algorithm coupling SVM (GA/SVM) are tested for feature gene selection and cancer classification on five microarray data sets, namely, Leukemia, Prostate, Colon, Lung, and Lymphoma. The experimental results show that BQPSO/SVM has significant advantages in accuracy, robustness, and the number of feature genes selected compared with the other two algorithms.
| S-EPMC5013239 | biostudies-literature
Project description:Knowledge distillation has been used to capture the knowledge of a teacher model and distill it into a student model with some desirable characteristics such as being smaller, more efficient, or more generalizable. In this paper, we propose a framework for distilling the knowledge of a powerful discriminative model such as a neural network into commonly used graphical models known to be more interpretable (e.g., topic models, autoregressive Hidden Markov Models). Posterior of latent variables in these graphical models (e.g., topic proportions in topic models) is often used as feature representation for predictive tasks. However, these posterior-derived features are known to have poor predictive performance compared to the features learned via purely discriminative approaches. Our framework constrains variational inference for posterior variables in graphical models with a similarity preserving constraint. This constraint distills the knowledge of the discriminative model into the graphical model by ensuring that input pairs with (dis)similar representation in the teacher model also have (dis)similar representation in the student model. By adding this constraint to the variational inference scheme, we guide the graphical model to be a reasonable density model for the data while having predictive features which are as close as possible to those of a discriminative model. To make our framework applicable to a wide range of graphical models, we build upon the Automatic Differentiation Variational Inference (ADVI), a black-box inference framework for graphical models. We demonstrate the effectiveness of our framework on two real-world tasks of disease subtyping and disease trajectory modeling.
| S-EPMC9455583 | biostudies-literature
Project description:Quantum sensing based on exotic quantum states is appealing for practical metrology applications and fundamental studies. However, these quantum states are vulnerable to noise and the resulting quantum enhancement is weakened in practice. Here, we experimentally demonstrate a quantum-enhanced sensing scheme with a bosonic probe, by exploring the large Hilbert space of the bosonic mode and developing both the approximate quantum error correction and the quantum jump tracking approaches. In a practical radiometry scenario, we attain a 5.3 dB enhancement of sensitivity, which reaches 9.1 × 10-4 Hz-1/2 when measuring the excitation population of a receiver mode. Our results demonstrate the potential of quantum sensing with near-term quantum technologies, not only shedding new light on the quantum advantage of sensing, but also stimulating further efforts on bosonic quantum technologies.
| S-EPMC9184621 | biostudies-literature