Monte-Carlo Planning in Large POMDPs

@inproceedings{Silver2010MonteCarloPI,
  title={Monte-Carlo Planning in Large POMDPs},
  author={David Silver and Joel Veness},
  booktitle={NIPS},
  year={2010}
}
This paper introduces a Monte-Carlo algorithm for online planning in large POMDPs. The algorithm combines a Monte-Carlo update of the agent’s belief state with a Monte-Carlo tree search from the current belief state. The new algorithm, POMCP, has two important properties. First, MonteCarlo sampling is used to break the curse of dimensionality both during belief state updates and during planning. Second, only a black box simulator of the POMDP is required, rather than explicit probability… CONTINUE READING
Highly Influential
This paper has highly influenced 99 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 592 citations. REVIEW CITATIONS
347 Citations
14 References
Similar Papers

Citations

Publications citing this paper.

592 Citations

050100'11'13'15'17
Citations per Year
Semantic Scholar estimates that this publication has 592 citations based on the available data.

See our FAQ for additional information.

Similar Papers

Loading similar papers…