Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Barren plateaus in quantum neural network training landscapes.

ABSTRACT: Many experimental proposals for noisy intermediate scale quantum devices involve training a parameterized quantum circuit with a classical optimization loop. Such hybrid quantum-classical algorithms are popular for applications in quantum simulation, optimization, and machine learning. Due to its simplicity and hardware efficiency, random circuits are often proposed as initial guesses for exploring the space of quantum states. We show that the exponential dimension of Hilbert space and the gradient estimation complexity make this choice unsuitable for hybrid quantum-classical algorithms run on more than a few qubits. Specifically, we show that for a wide class of reasonable parameterized quantum circuits, the probability that the gradient along any reasonable direction is non-zero to some fixed precision is exponentially small as a function of the number of qubits. We argue that this is related to the 2-design characteristic of random circuits, and that solutions to this problem must be studied.

SUBMITTER: McClean JR

PROVIDER: S-EPMC6240101 | biostudies-literature | 2018 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Barren plateaus in quantum neural network training landscapes.

McClean Jarrod R JR Boixo Sergio S Smelyanskiy Vadim N VN Babbush Ryan R Neven Hartmut H

Nature communications 20181116 1

Many experimental proposals for noisy intermediate scale quantum devices involve training a parameterized quantum circuit with a classical optimization loop. Such hybrid quantum-classical algorithms are popular for applications in quantum simulation, optimization, and machine learning. Due to its simplicity and hardware efficiency, random circuits are often proposed as initial guesses for exploring the space of quantum states. We show that the exponential dimension of Hilbert space and the gradi ...[more]

PMID: 30446662

Similar Datasets

Noise-induced barren plateaus in variational quantum algorithms.

Project description:Variational Quantum Algorithms (VQAs) may be a path to quantum advantage on Noisy Intermediate-Scale Quantum (NISQ) computers. A natural question is whether noise on NISQ devices places fundamental limitations on VQA performance. We rigorously prove a serious limitation for noisy VQAs, in that the noise causes the training landscape to have a barren plateau (i.e., vanishing gradient). Specifically, for the local Pauli noise considered, we prove that the gradient vanishes exponentially in the number of qubits n if the depth of the ansatz grows linearly with n. These noise-induced barren plateaus (NIBPs) are conceptually different from noise-free barren plateaus, which are linked to random parameter initialization. Our result is formulated for a generic ansatz that includes as special cases the Quantum Alternating Operator Ansatz and the Unitary Coupled Cluster Ansatz, among others. For the former, our numerical heuristics demonstrate the NIBP phenomenon for a realistic hardware noise model.

| S-EPMC8630047 | biostudies-literature

Cost function dependent barren plateaus in shallow parametrized quantum circuits.

Project description:Variational quantum algorithms (VQAs) optimize the parameters θ of a parametrized quantum circuit V(θ) to minimize a cost function C. While VQAs may enable practical applications of noisy quantum computers, they are nevertheless heuristic methods with unproven scaling. Here, we rigorously prove two results, assuming V(θ) is an alternating layered ansatz composed of blocks forming local 2-designs. Our first result states that defining C in terms of global observables leads to exponentially vanishing gradients (i.e., barren plateaus) even when V(θ) is shallow. Hence, several VQAs in the literature must revise their proposed costs. On the other hand, our second result states that defining C with local observables leads to at worst a polynomially vanishing gradient, so long as the depth of V(θ) is [Formula: see text]. Our results establish a connection between locality and trainability. We illustrate these ideas with large-scale simulations, up to 100 qubits, of a quantum autoencoder implementation.

| S-EPMC7979934 | biostudies-literature

Training deep quantum neural networks.

Project description:Neural networks enjoy widespread success in both research and industry and, with the advent of quantum technology, it is a crucial challenge to design quantum neural networks for fully quantum learning tasks. Here we propose a truly quantum analogue of classical neurons, which form quantum feedforward neural networks capable of universal quantum computation. We describe the efficient training of these networks using the fidelity as a cost function, providing both classical and efficient quantum implementations. Our method allows for fast optimisation with reduced memory requirements: the number of qudits required scales with only the width, allowing deep-network optimisation. We benchmark our proposal for the quantum task of learning an unknown unitary and find remarkable generalisation behaviour and a striking robustness to noisy training data.

| S-EPMC7010779 | biostudies-literature

Quantum superposition inspired spiking neural network.

Project description:Despite advances in artificial intelligence models, neural networks still cannot achieve human performance, partly due to differences in how information is encoded and processed compared with human brain. Information in an artificial neural network (ANN) is represented using a statistical method and processed as a fitting function, enabling handling of structural patterns in image, text, and speech processing. However, substantial changes to the statistical characteristics of the data, for example, reversing the background of an image, dramatically reduce the performance. Here, we propose a quantum superposition spiking neural network (QS-SNN) inspired by quantum mechanisms and phenomena in the brain, which can handle reversal of image background color. The QS-SNN incorporates quantum theory with brain-inspired spiking neural network models from a computational perspective, resulting in more robust performance compared with traditional ANN models, especially when processing noisy inputs. The results presented here will inform future efforts to develop brain-inspired artificial intelligence.

| S-EPMC8348858 | biostudies-literature

Training Optimization for Gate-Model Quantum Neural Networks.

Project description:Gate-based quantum computations represent an essential to realize near-term quantum computer architectures. A gate-model quantum neural network (QNN) is a QNN implemented on a gate-model quantum computer, realized via a set of unitaries with associated gate parameters. Here, we define a training optimization procedure for gate-model QNNs. By deriving the environmental attributes of the gate-model quantum network, we prove the constraint-based learning models. We show that the optimal learning procedures are different if side information is available in different directions, and if side information is accessible about the previous running sequences of the gate-model QNN. The results are particularly convenient for gate-model quantum computer implementations.

| S-EPMC6722103 | biostudies-literature

CODEX, a neural network approach to explore signaling dynamics landscapes.

Project description:Current studies of cell signaling dynamics that use live cell fluorescent biosensors routinely yield thousands of single-cell, heterogeneous, multi-dimensional trajectories. Typically, the extraction of relevant information from time series data relies on predefined, human-interpretable features. Without a priori knowledge of the system, the predefined features may fail to cover the entire spectrum of dynamics. Here we present CODEX, a data-driven approach based on convolutional neural networks (CNNs) that identifies patterns in time series. It does not require a priori information about the biological system and the insights into the data are built through explanations of the CNNs' predictions. CODEX provides several views of the data: visualization of all the single-cell trajectories in a low-dimensional space, identification of prototypic trajectories, and extraction of distinctive motifs. We demonstrate how CODEX can provide new insights into ERK and Akt signaling in response to various growth factors, and we recapitulate findings in p53 and TGFβ-SMAD2 signaling.

| S-EPMC8034356 | biostudies-literature

Topological incommensurate magnetization plateaus in quasi-periodic quantum spin chains.

Project description:Uncovering topologically nontrivial states in nature is an intriguing and important issue in recent years. While most studies are based on the topological band insulators, the topological state in strongly correlated low-dimensional systems has not been extensively explored due to the failure of direct explanation from the topological band insulator theory on such systems and the origin of the topological property is unclear. Here we report the theoretical discovery of strongly correlated topological states in quasi-periodic Heisenberg spin chain systems corresponding to a series of incommensurate magnetization plateaus under the presence of the magnetic field, which are uniquely determined by the quasi-periodic structure of exchange couplings. The topological features of plateau states are demonstrated by the existence of non-trivial spin-flip edge excitations, which can be well characterized by nonzero topological invariants defined in a two-dimensional parameter space. Furthermore, we demonstrate that the topological invariant of the plateau state can be read out from a generalized Streda formula and the spin-flip excitation spectrum exhibits a similar structure of the Hofstadter's butterfly spectrum for the two-dimensional quantum Hall system on a lattice.

| S-EPMC4326960 | biostudies-other

Deep neural network for water/fat separation: Supervised training, unsupervised training, and no training.

Project description:PurposeTo use a deep neural network (DNN) for solving the optimization problem of water/fat separation and to compare supervised and unsupervised training.MethodsThe current T2∗ -IDEAL algorithm for solving water/fat separation is dependent on initialization. Recently, DNN has been proposed to solve water/fat separation without the need for suitable initialization. However, this approach requires supervised training of DNN using the reference water/fat separation images. Here we propose 2 novel DNN water/fat separation methods: 1) unsupervised training of DNN (UTD) using the physical forward problem as the cost function during training, and 2) no training of DNN using physical cost and backpropagation to directly reconstruct a single dataset. The supervised training of DNN, unsupervised training of DNN, and no training of DNN methods were compared with the reference T2∗ -IDEAL.ResultsAll DNN methods generated consistent water/fat separation results that agreed well with T2∗ -IDEAL under proper initialization.ConclusionThe water/fat separation problem can be solved using unsupervised deep neural networks.

| S-EPMC7809709 | biostudies-literature

Molecular imaging with neural training of identification algorithm (neural network localization identification).

Project description:Superresolution localization microscopy strongly relies on robust identification algorithms for accurate reconstruction of the biological systems it is used to measure. The fields of machine learning and computer vision have provided promising solutions for automated object identification, but usually rely on well represented training sets to learn object features. However, using a static training set can result in the learned identification algorithm making mistakes on data that is not well represented by the training set. Here, we present a method for training an artificial neural network without providing a training set in advance. This method uses the data to be analyzed, and the fitting algorithm to train an artificial neural network tailored to that data set. We show that the same artificial neural network can learn to identify at least two types of molecular emissions: the regular point spread functions (PSFs), and the astigmatism PSF. Simulations indicate that this method can be extremely reliable in extracting molecular emission signatures. Additionally, we implemented the artificial neural network calculation to be performed on a graphics processing unit (GPU) for massively parallelized calculation which drastically reduces the time required for the identification process. By implementing the neural identification on a GPU, we allow this method of identification to be used in a real time analysis algorithm. RESEARCH HIGHLIGHTS: Here, we present a machine learning algorithm for identifying point-spread functions without the need for an a priori training set. We show that this method can detect over 90% of molecules with less than 1% false positive identification in simulations. We further show that because this algorithm does not make assumptions of about the shape of molecular emission, it is compatible with models beyond the symmetric 2D Gaussian.

| S-EPMC6240359 | biostudies-literature

Neural network retuning and neural predictors of learning success associated with cello training.

Project description:The auditory and motor neural systems are closely intertwined, enabling people to carry out tasks such as playing a musical instrument whose mapping between action and sound is extremely sophisticated. While the dorsal auditory stream has been shown to mediate these audio-motor transformations, little is known about how such mapping emerges with training. Here, we use longitudinal training on a cello as a model for brain plasticity during the acquisition of specific complex skills, including continuous and many-to-one audio-motor mapping, and we investigate individual differences in learning. We trained participants with no musical background to play on a specially designed MRI-compatible cello and scanned them before and after 1 and 4 wk of training. Activation of the auditory-to-motor dorsal cortical stream emerged rapidly during the training and was similarly activated during passive listening and cello performance of trained melodies. This network activation was independent of performance accuracy and therefore appears to be a prerequisite of music playing. In contrast, greater recruitment of regions involved in auditory encoding and motor control over the training was related to better musical proficiency. Additionally, pre-supplementary motor area activity and its connectivity with the auditory cortex during passive listening before training was predictive of final training success, revealing the integrative function of this network in auditory-motor information processing. Together, these results clarify the critical role of the dorsal stream and its interaction with auditory areas in complex audio-motor learning.

| S-EPMC6042146 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data