# Coherent transport of quantum states by deep reinforcement learning

@article{Porotti2019CoherentTO, title={Coherent transport of quantum states by deep reinforcement learning}, author={Riccardo Porotti and Dario Tamascelli and Marcello Restelli and Enrico Prati}, journal={Communications Physics}, year={2019}, volume={2}, pages={1-9} }

Some problems in physics can be handled only after a suitable ansatz solution has been guessed, proving to be resilient to generalization. The coherent transport of a quantum state by adiabatic passage through an array of semiconductor quantum dots is an excellent example of such a problem, where it is necessary to introduce a so-called counterintuitive control sequence. Instead, the deep reinforcement learning (DRL) technique has proven to be able to solve very complex sequential decision…

## 57 Citations

Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements

- Physics
- 2021

Quantum control has been of increasing interest in recent years, e.g. for tasks like state initialization and stabilization. Feedback-based strategies are particularly powerful, but also hard to…

Measurement-Based Feedback Quantum Control with Deep Reinforcement Learning for a Double-Well Nonlinear Potential.

- Computer SciencePhysical review letters
- 2021

This work applies deep reinforcement learning (DRL), where an artificial neural agent explores and learns to control the quantum evolution of a highly nonlinear system (double well), driving the system toward the ground state with high fidelity.

A reinforcement learning approach for quantum state engineering

- PhysicsQuantum Mach. Intell.
- 2020

This work shows how classical reinforcement learning (RL) could be used as a tool for quantum state engineering (QSE), and provides a systematic algorithmic approach for using RL for quantum protocols that deal with a non-trivial continuous state space.

Noise-Robust End-to-End Quantum Control using Deep Autoregressive Policy Networks

- Computer ScienceArXiv
- 2020

This work presents a hybrid policy gradient algorithm capable of simultaneously optimizing continuous and discrete degrees of freedom in an uncertainty-resilient way, modeled by a deep autoregressive neural network to capture causality.

Gradient Ascent Pulse Engineering with Feedback

- Computer Science
- 2022

Efficient approaches to quantum control and feedback are essential for quantum technologies, from sensing to quantum computation. Pure control tasks have been successfully solved using optimization…

Model-Free Quantum Control with Reinforcement Learning

- Computer SciencePhysical Review X
- 2022

This work proposes a circuit-based approach for training a reinforcement learning agent on quantum control tasks in a model-free way, allowing complete elimination of model bias and the adaptation of quantum control policies to the specific system in which they are deployed.

A framework for deep energy-based reinforcement learning with quantum speed-up

- Computer ScienceArXiv
- 2019

A unifying framework that connects deep learning and projective simulation, opening the route to quantum improvements in deep reinforcement learning.

Experimental Deep Reinforcement Learning for Error-Robust Gate-Set Design on a Superconducting Quantum Computer

- Computer SciencePRX Quantum
- 2021

This work experimentally demonstrates that a fully autonomous deep reinforcement learning agent can design single qubit gates up to 3× faster than default DRAG operations without additional leakage error, and shows robustness against calibration drifts over weeks, and benchmark the performance ofDeep reinforcement learning derived gates against other black box optimization techniques, showing that deep reinforcementLearning can achieve comparable or marginally superior performance, even with limited hardware access.

Quantum circuit optimization with deep reinforcement learning

- Computer Science, Physics
- 2021

It is demonstrated how an agent, realized by a deep convolutional neural network, can autonomously learn generic strategies to optimize arbitrary circuits on a specific architecture, where the optimization target can be chosen freely by the user.

## References

SHOWING 1-10 OF 81 REFERENCES

Reinforcement Learning in Different Phases of Quantum Control

- Physics, Computer SciencePhysical Review X
- 2018

This work implements cutting-edge Reinforcement Learning techniques and shows that their performance is comparable to optimal control methods in the task of finding short, high-fidelity driving protocol from an initial to a target state in non-integrable many-body quantum systems of interacting qubits.

When does reinforcement learning stand out in quantum control? A comparative study on state preparation

- Computer Sciencenpj Quantum Information
- 2019

A comparative study on the efficacy of three reinforcement learning algorithms: tabular Q- learning, deep Q-learning, and policy gradient, as well as two non-machine-learning methods: stochastic gradient descent and Krotov algorithms, in the problem of preparing a desired quantum state is performed.

Reinforcement Learning with Neural Networks for Quantum Feedback

- Computer SciencePhysical Review X
- 2018

This work shows how a network-based "agent" can discover complete quantum-error-correction strategies, protecting a collection of qubits against noise, and develops two ideas: two-stage learning with teacher/student networks and a reward quantifying the capability to recover the quantum information stored in a multi-qubit system.

Universal Quantum Control through Deep Reinforcement Learning

- Computer ScienceAIAA Scitech 2019 Forum
- 2019

A control framework is proposed and an analytic leakage bound is derived to simultaneously optimize the quantum gate-time and gate-fidelity against both leakage and stochastic control errors for a broad family of two-qubit-unitary gates important for quantum simulation of many-electron systems.

Reconstruction of a Photonic Qubit State with Reinforcement Learning

- PhysicsAdvanced Quantum Technologies
- 2019

This protocol offers a tool for reconstructing an unknown quantum state when only limited copies are provided, and can also be extended to higher dimensions, multipartite, and mixed quantum state scenarios.

Measurement-based adaptation protocol with quantum reinforcement learning

- Computer SciencePhysical Review A
- 2018

This work proposes an algorithm based on successive measurements to adapt one quantum state to a reference unknown state, in the sense of achieving maximum overlap, and extends the formalism to d-dimensional states, paving the way for the development of quantum reinforcement learning protocols using quantum data, and the future deployment of semi-autonomous quantum systems.

Taking gradients through experiments: LSTMs and memory proximal policy optimization for black-box quantum control

- Computer ScienceISC Workshops
- 2018

A variant of the proximal policy optimization (PPO) algorithm called the memory proximalpolicy optimization (MPPO) is introduced which is based on the structure of the reinforcement learning problems arising in quantum physics and argues that agents parameterized by long short-term memory networks trained via stochastic policy gradients yield a general method to solving them.

Optimizing Quantum Error Correction Codes with Reinforcement Learning

- Computer ScienceQuantum
- 2019

This work considers a reinforcement learning agent tasked with modifying a family of surface code quantum memories until a desired logical error rate is reached, and demonstrates that agents trained on one setting are able to successfully transfer their experience to different settings.

Active learning machine learns to create new quantum experiments

- PhysicsProceedings of the National Academy of Sciences
- 2018

An autonomous learning model is presented which learns to design complex photonic quantum experiments that produce high-dimensional entangled multiphoton states, which are of high interest in modern quantum experiments and improves the efficiency of their realization.

Incoherent Control of Quantum Systems With Wavefunction-Controllable Subspaces via Quantum Reinforcement Learning

- PhysicsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)
- 2008

An incoherent control scheme for accomplishing the state control of a class of quantum systems which have wavefunction-controllable subspaces is proposed, which provides an alternative quantum engineering strategy for locally controllable quantum systems.