Corpus ID: 220845650

Munchausen Reinforcement Learning

@article{Vieillard2020MunchausenRL,
  title={Munchausen Reinforcement Learning},
  author={Nino Vieillard and Olivier Pietquin and M. Geist},
  journal={ArXiv},
  year={2020},
  volume={abs/2007.14430}
}

Nino Vieillard, Olivier Pietquin, M. Geist

Published 2020

Computer Science, Mathematics

ArXiv

Bootstrapping is a core mechanism in Reinforcement Learning (RL). Most algorithms, based on temporal differences, replace the true value of a transiting state by their current estimate of this value. Yet, another estimate could be leveraged to bootstrap RL: the current policy. Our core contribution stands in a very simple idea: adding the scaled log-policy to the immediate reward. We show that slightly modifying Deep Q-Network (DQN) in that way provides an agent that is competitive with… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed