Corpus ID: 221150441

Reinforcement Learning with Quantum Variational Circuits

  title={Reinforcement Learning with Quantum Variational Circuits},
  author={Owen Lockwood and Mei Si},
The development of quantum computational techniques has advanced greatly in recent years, parallel to the advancements in techniques for deep reinforcement learning. This work explores the potential for quantum computing to facilitate reinforcement learning problems. Quantum computing approaches offer important potential improvements in time and space complexity over traditional algorithms because of its ability to exploit the quantum phenomena of superposition and entanglement. Specifically… Expand

Figures from this paper

Optimizing Quantum Variational Circuits with Deep Reinforcement Learning
It is found that reinforcement learning augmented optimizers consistently outperform gradient descent in noisy environments. Expand
Variational Quantum Reinforcement Learning via Evolutionary Optimization
This work proposes a hybrid framework where the quantum RL agents are equipped with hybrid tensor networkvariational quantum circuit (TN-VQC) architecture to handle inputs with dimensions exceeding the number of qubits, and demonstrates the quantum advantage of parameter saving using the amplitude encoding. Expand
Playing Atari with Hybrid Quantum-Classical Reinforcement Learning
Despite the successes of recent works in quantum reinforcement learning, there are still severe limitations on its applications due to the challenge of encoding large observation spaces into quantumExpand
Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning
Quantum machine learning (QML) has been identified as one of the key fields that could reap advantages from near-term quantum devices, next to optimization and quantum chemistry. Research in thisExpand
Photonic Quantum Policy Learning in OpenAI Gym
This work introduces proximal policy optimization for photonic variational quantum agents and the effect of the data re-uploading to solve a classical continuous control problem using continuous-variable quantum machine learning. Expand
Variational Quantum Circuits for Machine Learning. An Application for the Detection of Weak Signals
In this study, an implementation of a quantum circuit based on support vector machines (SVMs) is described for the resolution of classification problems, specially designed for the noisy intermediate-scale quantum (NISQ) computers that are currently available. Expand
A Quantum 3D Convolutional Neural Network with Application in Video Classification
Quantum computing seeks to exploit the properties of quantum mechanics to perform computations at a fraction of the cost compared to the classical computing methods. Recently, quantum methods forExpand
Hybrid Quantum-Classical Graph Convolutional Network
This research provides a hybrid quantum-classical graph convolutional network (QGCNN) for learning HEP data that demonstrates an advantage over classical multilayer perceptron and convolutionAL neural networks in the aspect of number of parameters. Expand
Quantum Self-Supervised Learning
This work proposes a hybrid quantum-classical neural network architecture for contrastive selfsupervised learning and test its effectiveness in proof-of-principle experiments, observing a numerical advantage for the learning of visual representations using small-scale quantum neural networks over equivalently structured classical networks. Expand
An end-to-end trainable hybrid classical-quantum classifier
It is shown that compared to the principal component analysis, a tensor network based on the matrix product state with low bond dimensions performs better as a feature extractor for the input data of the variational quantum circuit in the binary and ternary classification of MNIST and Fashion-MNIST datasets. Expand


Variational Quantum Circuits for Deep Reinforcement Learning
This work reshapes classical deep reinforcement learning algorithms like experience replay and target network into a representation of variational quantum circuits, and uses a quantum information encoding scheme to reduce the number of model parameters compared to classical neural networks. Expand
Reinforcement Learning with Deep Quantum Neural Networks
  • Wei Hu, James Hu
  • Computer Science
  • Journal of Quantum Information Science
  • 2019
The findings suggest that having more layers in deep quantum RL can enhance the learning outcome, and compared to one layer, using three layer quantum networks improves the learning of both algorithms in terms of rewards collected. Expand
TensorFlow Quantum: A Software Framework for Quantum Machine Learning
This framework offers high-level abstractions for the design and training of both discriminative and generative quantum models under TensorFlow and supports high-performance quantum circuit simulators. Expand
Evaluating analytic gradients on quantum hardware
An important application for near-term quantum computing lies in optimization tasks, with applications ranging from quantum chemistry and drug discovery to machine learning. In many settings --- mostExpand
Parameterized quantum circuits as machine learning models
This Review presents components of parameterized quantum circuits and discusses their application to a variety of data-driven tasks such as supervised learning and generative modeling. Expand
Quantum convolutional neural networks
A quantum circuit-based algorithm inspired by convolutional neural networks is shown to successfully perform quantum phase recognition and devise quantum error correcting codes when applied to arbitrary input quantum states. Expand
Quantum Generative Adversarial Networks for learning and loading random distributions
This work uses quantum Generative Adversarial Networks (qGANs) to facilitate efficient learning and loading of generic probability distributions - implicitly given by data samples - into quantum states and can enable the use of potentially advantageous quantum algorithms, such as Quantum Amplitude Estimation. Expand
Quantum Multiple Q-Learning
In this paper, a collection of value-based quantum reinforcement learning algorithms are introduced which use Grover’s algorithm to update the policy, which is stored as a superposition of qubitsExpand
Quantum supremacy using a programmable superconducting processor
Quantum supremacy is demonstrated using a programmable superconducting processor known as Sycamore, taking approximately 200 seconds to sample one instance of a quantum circuit a million times, which would take a state-of-the-art supercomputer around ten thousand years to compute. Expand
Quantum Computing in the NISQ era and beyond
Noisy Intermediate-Scale Quantum (NISQ) technology will be available in the near future, and the 100-qubit quantum computer will not change the world right away - but it should be regarded as a significant step toward the more powerful quantum technologies of the future. Expand