Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation
@article{Gamrian2019TransferLF, title={Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation}, author={Shani Gamrian and Y. Goldberg}, journal={ArXiv}, year={2019}, volume={abs/1806.07377} }
Despite the remarkable success of Deep RL in learning control policies from raw pixels, the resulting models do not generalize. We demonstrate that a trained agent fails completely when facing small visual changes, and that fine-tuning---the common transfer learning paradigm---fails to adapt to these changes, to the extent that it is faster to re-train the model from scratch. We show that by separating the visual transfer task from the control policy we achieve substantially better sample… CONTINUE READING
Supplemental Content
Github Repo
Via Papers with Code
Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation
Figures, Tables, and Topics from this paper
30 Citations
Automatic Data Augmentation for Generalization in Deep Reinforcement Learning
- Computer Science
- ArXiv
- 2020
- 8
- PDF
Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch
- Computer Science, Mathematics
- UAI
- 2020
- PDF
Off-Dynamics Reinforcement Learning: Training for Transfer with Domain Classifiers
- Computer Science, Mathematics
- ArXiv
- 2020
- 2
- PDF
Playing Games in the Dark: An approach for cross-modality transfer in reinforcement learning
- Computer Science
- AAMAS
- 2020
- 2
- PDF
Network Randomization: A Simple Technique for Generalization in Deep Reinforcement Learning
- Computer Science
- ICLR
- 2020
- 20
Visual Analogies between Atari Games for Studying Transfer Learning in RL
- Mathematics, Computer Science
- ArXiv
- 2018
- 2
- PDF
Improving Generalization in Reinforcement Learning with Mixture Regularization
- Computer Science, Mathematics
- NeurIPS
- 2020
- PDF
References
SHOWING 1-10 OF 48 REFERENCES
DARLA: Improving Zero-Shot Transfer in Reinforcement Learning
- Computer Science, Mathematics
- ICML
- 2017
- 198
- PDF
Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning
- Computer Science
- ICML
- 2017
- 141
- PDF
Schema Networks: Zero-shot Transfer with a Generative Causal Model of Intuitive Physics
- Computer Science
- ICML
- 2017
- 144
- PDF
DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
- Computer Science
- 2017 IEEE International Conference on Computer Vision (ICCV)
- 2017
- 973
- PDF
Multitask Reinforcement Learning for Zero-shot Generalization with Subtask Dependencies
- Computer Science
- NIPS 2018
- 2018
- 7
One-Shot Reinforcement Learning for Robot Navigation with Interactive Replay
- Computer Science
- ArXiv
- 2017
- 36
- PDF
Deep Learning of Representations for Unsupervised and Transfer Learning
- Computer Science
- ICML Unsupervised and Transfer Learning
- 2012
- 839
- PDF