Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting
@article{Lale2020AdaptiveCA, title={Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting}, author={Sahin Lale and K. Azizzadenesheli and B. Hassibi and Anima Anandkumar}, journal={arXiv: Learning}, year={2020} }
We study the problem of adaptive control in partially observable linear quadratic Gaussian control systems, where the model dynamics are unknown a priori. We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of optimism in the face of uncertainty, to effectively minimize the overall control cost. We employ the predictor state evolution representation of the system dynamics and deploy a recently proposed closed-loop system identification method, estimation, and… CONTINUE READING
Topics from this paper
4 Citations
Logarithmic Regret Bound in Partially Observable Linear Dynamical Systems
- Computer Science, Mathematics
- NeurIPS
- 2020
- 17
- PDF
Explore More and Improve Regret in Linear Quadratic Regulators
- Computer Science, Mathematics
- ArXiv
- 2020
- 3
- PDF
Online Regulation of Unstable LTI Systems from a Single Trajectory
- Computer Science, Engineering
- ArXiv
- 2020
- 3
- PDF
Learning Partially Observed Linear Dynamical Systems from Logarithmic Number of Samples
- Computer Science, Engineering
- ArXiv
- 2020
- PDF
References
SHOWING 1-10 OF 50 REFERENCES
Regret Bounds for Robust Adaptive Control of the Linear Quadratic Regulator
- Computer Science, Mathematics
- NeurIPS
- 2018
- 125
- PDF
Logarithmic Regret Bound in Partially Observable Linear Dynamical Systems
- Computer Science, Mathematics
- NeurIPS
- 2020
- 17
- PDF
Regret Minimization in Partially Observable Linear Quadratic Control
- Computer Science, Mathematics
- ArXiv
- 2020
- 9
- PDF
Regret Bounds for the Adaptive Control of Linear Quadratic Systems
- Mathematics, Computer Science
- COLT
- 2011
- 184
- Highly Influential
- PDF
Thompson Sampling for Linear-Quadratic Control Problems
- Computer Science, Mathematics
- AISTATS
- 2017
- 37
- PDF
Model-Free Linear Quadratic Control via Reduction to Expert Prediction
- Computer Science, Mathematics
- AISTATS
- 2019
- 58
- PDF
Certainty Equivalence is Efficient for Linear Quadratic Control
- Computer Science, Mathematics
- NeurIPS
- 2019
- 43
- PDF
Improved Regret Bounds for Thompson Sampling in Linear Quadratic Control Problems
- Mathematics, Computer Science
- ICML
- 2018
- 54
- PDF