Planning by Incremental Dynamic Programming

  title={Planning by Incremental Dynamic Programming},
  author={R. Sutton},
  • R. Sutton
  • Published in ML 1991
  • Computer Science
  • Abstract This paper presents the basic results and ideas of dynamic programming as they relate most directly to the concerns of planning in AI. [...] Key Method These incremental planning methods are based on continually updating an evaluation function and the situation-action mapping of a reactive system. Actions are generated by the reactive system and thus involve minimal delay, while the incremental planning process guarantees that the actions and evaluation function will eventually be optimal—no matter how…Expand Abstract

    Topics from this paper.

    Reinforcement Learning: An Introduction
    • 25,539
    • PDF
    Control Strategies for a Stochastic Planner
    • 58
    • Highly Influenced
    • PDF
    Planning algorithms
    • 5,316
    • PDF
    Reinforcement Learning: A Survey
    • 6,392
    • PDF
    Optimal motion planning for multiple robots having independent goals
    • 272
    Analysis of Some Incremental Variants of Policy Iteration: First Steps Toward Understanding Actor-Cr
    • 54


    Publications referenced by this paper.
    Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming
    • 1,372
    • PDF
    An Analysis of Time-Dependent Planning
    • 1,003
    • PDF
    Real-Time Heuristic Search
    • R. Korf
    • Mathematics, Computer Science
    • 1990
    • 1,004
    Universal Plans for Reactive Robots in Unpredictable Environments
    • 608
    • PDF
    Efficient memory-based learning for robot control
    • 308
    • PDF
    Some Studies in Machine Learning Using the Game of Checkers
    • 2,098
    • PDF
    Becoming Increasingly Reactive
    • 149
    • PDF
    Integrating, Execution, Planning, and Learning in Soar for External Environments
    • 164
    • PDF
    Learning and Sequential Decision Making
    • 130
    Self-improving reactive agents: case studies of reinforcement learning frameworks
    • 71
    • PDF