Adaptive Dynamic Programming: An Introduction

  title={Adaptive Dynamic Programming: An Introduction},
  author={Fei-Yue Wang and Huaguang Zhang and Derong Liu},
  journal={IEEE Computational Intelligence Magazine},
In this article, we introduce some recent research trends within the field of adaptive/approximate dynamic programming (ADP), including the variations on the structure of ADP schemes, the development of ADP algorithms and applications of ADP schemes. For ADP algorithms, the point of focus is that iterative algorithms of ADP can be sorted into two classes: one class is the iterative algorithm with initial stable policy; the other is the one without the requirement of initial stable policy. It is… CONTINUE READING
Highly Influential
This paper has highly influenced 13 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 793 citations. REVIEW CITATIONS
283 Citations
101 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 283 extracted citations

794 Citations

Citations per Year
Semantic Scholar estimates that this publication has 794 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 101 references

Adaptive critic neural network for feedforward compensation

  • J. Campos, F. L. Lewis
  • Proc. American Control Conf., San Diego, CA, June…
  • 1999
Highly Influential
4 Excerpts

Approximate solutions to the timeinvariant Hamilton-Jacobi-Bellman equation

  • R. W. Beard, G. N. Saridis
  • J. Optim. Theory Appl., vol. 96, no. 3, pp. 589…
  • 1998
Highly Influential
3 Excerpts

Approximate dynamic programming for real-time control and neural modeling

  • P. J. Werbos
  • Handbook of Intelligent Control: Neural, Fuzzy…
  • 1992
Highly Influential
8 Excerpts

Advanced forecasting methods for global crisis warning and models of intelligence

  • P. J. Werbos
  • Gen. Syst. Yearbk., vol. 22, pp. 25–38, 1977.
  • 1977
Highly Influential
4 Excerpts

Similar Papers

Loading similar papers…