Curiosity-Driven Exploration by Self-Supervised Prediction

  title={Curiosity-Driven Exploration by Self-Supervised Prediction},
  author={Deepak Pathak and Pulkit Agrawal and Alexei A. Efros and Trevor Darrell},
  journal={2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)},
In many real-world scenarios, rewards extrinsic to the agent are extremely sparse, or absent altogether. In such cases, curiosity can serve as an intrinsic reward signal to enable the agent to explore its environment and learn skills that might be useful later in its life. We formulate curiosity as the error in an agent's ability to predict the consequence of its own actions in a visual feature space learned by a self-supervised inverse dynamics model. Our formulation scales to high-dimensional… CONTINUE READING
Highly Cited
This paper has 126 citations. REVIEW CITATIONS

2 Figures & Tables



Citations per Year

127 Citations

Semantic Scholar estimates that this publication has 127 citations based on the available data.

See our FAQ for additional information.