Model Approximation for HEXQ Hierarchical Reinforcement Learning

@inproceedings{Hengst2004ModelAF,
  title={Model Approximation for HEXQ Hierarchical Reinforcement Learning},
  author={B. Hengst},
  booktitle={ECML},
  year={2004}
}
  • B. Hengst
  • Published in ECML 2004
  • Computer Science
HEXQ is a reinforcement learning algorithm that discovers hierarchical structure automatically. The generated task hierarchy represents the problem at different levels of abstraction. In this paper we extend HEXQ with heuristics that automatically approximate the structure of the task hierarchy. Construction, learning and execution time, as well as storage requirements of a task hierarchy may be significantly reduced and traded off against solution quality. 
14 Citations
Hierarchical Approaches
  • B. Hengst
  • Computer Science
  • Reinforcement Learning
  • 2012
  • 18
  • PDF
Planning with Abstract Learned Models While Learning Transferable Subtasks
  • 4
  • PDF
Online Planning for Large Markov Decision Processes with Hierarchical Decomposition
  • 32
  • PDF
Graph-Based Skill Acquisition For Reinforcement Learning
  • 6
Bat Q-learning Algorithm
  • 10
  • Highly Influenced
  • PDF
...
1
2
...

References

SHOWING 1-10 OF 12 REFERENCES
Discovering Hierarchy in Reinforcement Learning with HEXQ
  • 226
  • PDF
Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
  • 1,326
  • PDF
State abstraction for programmable reinforcement learning agents
  • 251
  • PDF
Hierarchical control and learning for markov decision processes
  • 261
Temporal abstraction in reinforcement learning
  • 255
Introduction to Reinforcement Learning
  • 5,397
Reinforcement Learning: An Introduction
  • 27,793
  • PDF
Bounded Parameter Markov Decision Processes
  • 108
  • Highly Influential
Artificial Intelligence: A Modern Approach
  • 24,779
  • PDF
Markov Decision Processes: Discrete Stochastic Dynamic Programming
  • M. Puterman
  • Mathematics, Computer Science
  • Wiley Series in Probability and Statistics
  • 1994
  • 10,664
...
1
2
...