Corpus ID: 5588386

Discovering Hierarchy in Reinforcement Learning with HEXQ

@inproceedings{Hengst2002DiscoveringHI,
  title={Discovering Hierarchy in Reinforcement Learning with HEXQ},
  author={B. Hengst},
  booktitle={ICML},
  year={2002}
}
  • B. Hengst
  • Published in ICML 2002
  • Computer Science
An open problem in reinforcement learning is discovering hierarchical structure. HEXQ, an algorithm which automatically attempts to decompose and solve a model-free factored MDP hierarchically is described. By searching for aliased Markov sub-space regions based on the state variables the algorithm uses temporal and state abstraction to construct a hierarchy of interlinked smaller MDPs. 
226 Citations
Model Approximation for HEXQ Hierarchical Reinforcement Learning
  • 14
  • PDF
Finding Hidden Hierarchy in Reinforcement Learning
  • Highly Influenced
Hierarchical Assignment of Behaviours to Subpolicies
  • 1
  • Highly Influenced
  • PDF
Variable Resolution Hierarchical RL
  • 1
  • PDF
TeXDYNA: Hierarchical Reinforcement Learning in Factored MDPs
  • 3
  • Highly Influenced
  • PDF
Partial Order Hierarchical Reinforcement Learning
  • B. Hengst
  • Mathematics, Computer Science
  • Australasian Conference on Artificial Intelligence
  • 2008
  • 5
  • PDF
Discovering hierarchy in reinforcement learning
  • 23
  • PDF
Safe State Abstraction and Discounting in Hierarchical Reinforcement Learning
  • 3
  • PDF
A hierarchical approach to efficient reinforcement learning in deterministic domains
  • 23
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 15 REFERENCES
An Overview of MAXQ Hierarchical Reinforcement Learning
  • 112
  • Highly Influential
Generating Hierarchical Structure in Reinforcement Learning from State Variables
  • B. Hengst
  • Mathematics, Computer Science
  • PRICAI
  • 2000
  • 22
  • PDF
Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
  • 1,326
  • Highly Influential
  • PDF
Hierarchical Learning in Stochastic Domains: Preliminary Results
  • 218
Hierarchical control and learning for markov decision processes
  • 261
Decomposition Techniques for Planning in Stochastic Domains
  • 178
  • PDF
Decision-Theoretic Planning: Structural Assumptions and Computational Leverage
  • 1,220
  • PDF
Hierarchical Solution of Markov Decision Processes using Macro-actions
  • 301
  • PDF
Technical Note: Q-Learning
  • 2,757
  • PDF
Adaptive Control Processes: A Guided Tour.
  • 1,951
...
1
2
...