Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks

@article{Modares2013AdaptiveOC,
  title={Adaptive Optimal Control of Unknown Constrained-Input Systems Using Policy Iteration and Neural Networks},
  author={Hamidreza Modares and Frank L. Lewis and Mohammad-Bagher Naghibi Sistani},
  journal={IEEE Transactions on Neural Networks and Learning Systems},
  year={2013},
  volume={24},
  pages={1513-1525}
}
This paper presents an online policy iteration (PI) algorithm to learn the continuous-time optimal control solution for unknown constrained-input systems. The proposed PI algorithm is implemented on an actor-critic structure where two neural networks (NNs) are tuned online and simultaneously to generate the optimal bounded control policy. The requirement of complete knowledge of the system dynamics is obviated by employing a novel NN identifier in conjunction with the actor and critic NNs. It… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 120 CITATIONS, ESTIMATED 82% COVERAGE

Active Complementary Control for Affine Nonlinear Control Systems With Actuator Faults

  • IEEE Transactions on Cybernetics
  • 2017
VIEW 7 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics

  • IEEE Transactions on Cybernetics
  • 2016
VIEW 5 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Adaptive Near-Optimal Control of Uncertain Systems With Application to Underactuated Surface Vessels

  • IEEE Transactions on Control Systems Technology
  • 2018
VIEW 7 EXCERPTS
CITES RESULTS & BACKGROUND
HIGHLY INFLUENCED

Direct Adaptive Optimal Control for Uncertain Continuous-Time LTI Systems Without Persistence of Excitation

  • IEEE Transactions on Circuits and Systems II: Express Briefs
  • 2018
VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Memory-Efficient Filter-Based Approximate Optimal Regulation of Unknown LTI Systems Using Initial Excitation

  • 2018 IEEE Conference on Decision and Control (CDC)
  • 2018
VIEW 5 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Suboptimal Scheduling in Switched Systems With Continuous-Time Dynamics: A Least Squares Approach

  • IEEE Transactions on Neural Networks and Learning Systems
  • 2018
VIEW 5 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Adaptive Critic Nonlinear Robust Control: A Survey

  • IEEE Transactions on Cybernetics
  • 2017
VIEW 6 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Event-Driven Adaptive Robust Control of Nonlinear Systems With Uncertainties Through NDP Strategy

  • IEEE Transactions on Systems, Man, and Cybernetics: Systems
  • 2017
VIEW 4 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Smooth Neuroadaptive PI Tracking Control of Nonlinear Systems With Unknown and Nonsmooth Actuation Characteristics

  • IEEE Transactions on Neural Networks and Learning Systems
  • 2017
VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2014
2019

CITATION STATISTICS

  • 13 Highly Influenced Citations

  • Averaged 21 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-10 OF 43 REFERENCES

Robust Adaptive Control

VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Neural networks for control and system identification

  • Proceedings of the 28th IEEE Conference on Decision and Control,
  • 1989
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Experience Replay for Real-Time Reinforcement Learning Control

  • IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews)
  • 2012