An Analytic Characterization of Model Minimization in Factored Markov Decision Processes

Abstract

Model minimization in Factored Markov Decision Processes (FMDPs) is concerned with finding the most compact partition of the state space such that all states in the same block are action-equivalent. This is an important problem because it can potentially transform a large FMDP into an equivalent but much smaller one, whose solution can be readily used to… (More)

Topics

  • Presentations referencing similar topics