Convergence Properties of Policy Iteration

  title={Convergence Properties of Policy Iteration},
  author={Manuel S. Santos and John Rust},
  journal={SIAM J. Control and Optimization},
This paper analyzes asymptotic convergence properties of policy iteration in a class of stationary, infinite-horizon Markovian decision problems that arise in optimal growth theory. These problems have continuous state and control variables and must therefore be discretized in order to compute an approximate solution. The discretization may render inapplicable known convergence results for policy iteration such as those of Puterman and Brumelle [Math. Oper. Res., 4 (1979), pp. 60–69]. Under… CONTINUE READING


Publications citing this paper.
Showing 1-10 of 22 extracted citations


Publications referenced by this paper.
Showing 1-2 of 2 references

Some Functional Equations in the Theory of Dynamic Programming.

Proceedings of the National Academy of Sciences of the United States of America • 1953
View 5 Excerpts
Highly Influenced

Numerical solution of dynamic economic models

J. B. Taylor, M. Woodford

Similar Papers

Loading similar papers…