Corpus ID: 235390865

Quantum Natural Gradient for Variational Bayes

@inproceedings{Lopatnikova2021QuantumNG,
  title={Quantum Natural Gradient for Variational Bayes},
  author={A. Lopatnikova and Minh-Ngoc Tran},
  year={2021}
}
Variational Bayes (VB) is a critical method in machine learning and statistics, underpinning the recent success of Bayesian deep learning. The natural gradient is an essential component of efficient VB estimation, but it is prohibitively computationally expensive in high dimensions. We propose a hybrid quantum-classical algorithm to improve the scaling properties of natural gradient computation and make VB a truly computationally efficient method for Bayesian inference in highdimensional… Expand
1 Citations

Figures from this paper

Qsun: an open-source platform towards practical quantum machine learning applications
Currently, quantum hardware is restrained by noises and qubit numbers. Thus, a quantum virtual machine that simulates operations of a quantum computer on classical computers is a vital tool forExpand

References

SHOWING 1-10 OF 75 REFERENCES
Quantum extension of variational Bayes inference
Variational Bayes (VB) inference is one of the most important algorithms in machine learning and widely used in engineering and industry. However, VB is known to suffer from the problem of localExpand
Bayesian deep learning on a quantum computer
TLDR
This work leverages a quantum algorithm designed for Gaussian processes and develops a new algorithm for Bayesian deep learning on quantum computers, providing at least a polynomial speedup over classical algorithms. Expand
Simultaneous Perturbation Stochastic Approximation of the Quantum Fisher Information
The Quantum Fisher Information (QFI) is a central metric in promising algorithms, such as Quantum Natural Gradient Descent and Variational Quantum Imaginary Time Evolution. Computing the full QFIExpand
The theory of variational hybrid quantum-classical algorithms
Many quantumalgorithms have daunting resource requirements when compared towhat is available today. To address this discrepancy, a quantum-classical hybrid optimization scheme known as ‘theExpand
Evaluating analytic gradients on quantum hardware
An important application for near-term quantum computing lies in optimization tasks, with applications ranging from quantum chemistry and drug discovery to machine learning. In many settings --- mostExpand
Variational Bayes on Manifolds
TLDR
An efficient manifold-based VB algorithm that exploits both the geometric structure of the constraint parameter space and the information geometry of the manifold of VB approximating probability distributions and compares favourably to existing VB methods are developed. Expand
Quantum gradient descent and Newton's method for constrained polynomial optimization
Optimization problems in disciplines such as machine learning are commonly solved with iterative methods. Gradient descent algorithms find local minima by moving along the direction of steepestExpand
Low-Depth Gradient Measurements Can Improve Convergence in Variational Hybrid Quantum-Classical Algorithms.
TLDR
Within a natural black-box setting, a quantum variational algorithm that measures analytic gradients of the objective function with a low-depth circuit and performs stochastic gradient descent provably converges to an optimum faster than any algorithm that only measures the objectivefunction itself. Expand
Quantum gradient descent for linear systems and least squares
Quantum machine learning and optimization are exciting new areas that have been brought forward by the breakthrough quantum algorithm of Harrow, Hassidim, and Lloyd for solving systems of linearExpand
Variational Bayes With Intractable Likelihood
TLDR
The proposed VB method is generic in the sense that it can be applied to almost all statistical models without requiring too much model-based derivation, which is a drawback of many existing VB algorithms. Expand
...
1
2
3
4
5
...