Neural Task Programming: Learning to Generalize Across Hierarchical Tasks
@article{Xu2018NeuralTP, title={Neural Task Programming: Learning to Generalize Across Hierarchical Tasks}, author={Danfei Xu and Suraj Nair and Yuke Zhu and J. Gao and Animesh Garg and Li Fei-Fei and S. Savarese}, journal={2018 IEEE International Conference on Robotics and Automation (ICRA)}, year={2018}, pages={1-8} }
In this work, we propose a novel robot learning framework called Neural Task Programming (NTP), which bridges the idea of few-shot learning from demonstration and neural program induction. [...] Key Method These specifications are fed to a hierarchical neural program, where bottom-level programs are callable subroutines that interact with the environment. We validate our method in three robot manipulation tasks. NTP achieves strong generalization across sequential tasks that exhibit hierarchal and compositional…Expand Abstract
Supplemental Videos
Figures and Topics from this paper
86 Citations
Neural Task Graphs: Generalizing to Unseen Tasks From a Single Video Demonstration
- Computer Science
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- 2019
- 40
- PDF
TACO: Learning Task Decomposition via Temporal Alignment for Control
- Computer Science, Mathematics
- ICML
- 2018
- 28
- PDF
One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks
- Computer Science, Mathematics
- ArXiv
- 2018
- 25
- PDF
TRASS: Time Reversal as Self-Supervision
- Computer Science
- 2020 IEEE International Conference on Robotics and Automation (ICRA)
- 2020
Learning to Imagine Manipulation Goals for Robot Task Planning
- Computer Science, Mathematics
- ArXiv
- 2017
- 1
- PDF
Plan Arithmetic: Compositional Plan Vectors for Multi-Task Control
- Computer Science, Mathematics
- ArXiv
- 2019
- 2
- PDF
Transferable Task Execution from Pixels through Deep Planning Domain Learning
- Computer Science
- 2020 IEEE International Conference on Robotics and Automation (ICRA)
- 2020
- 3
- PDF
Meta Reinforcement Learning with Autonomous Inference of Subtask Dependencies
- Computer Science, Mathematics
- ICLR
- 2020
- 3
- Highly Influenced
- PDF
References
SHOWING 1-10 OF 58 REFERENCES
Learning modular neural network policies for multi-task and multi-robot transfer
- Computer Science, Mathematics
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- 2017
- 184
- Highly Influential
- PDF
Making Neural Programming Architectures Generalize via Recursion
- Computer Science, Mathematics
- ICLR
- 2017
- 106
- PDF
Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation
- Computer Science, Mathematics
- NIPS
- 2016
- 590
- PDF
Learning Sequences of Controllers for Complex Manipulation Tasks
- Engineering, Computer Science
- ArXiv
- 2013
- 10
Target-driven visual navigation in indoor scenes using deep reinforcement learning
- Computer Science
- 2017 IEEE International Conference on Robotics and Automation (ICRA)
- 2017
- 730
- PDF