Neural Modular Control for Embodied Question Answering

@inproceedings{Das2018NeuralMC,
  title={Neural Modular Control for Embodied Question Answering},
  author={Abhishek Das and Georgia Gkioxari and Stefan Lee and Devi Parikh and Dhruv Batra},
  booktitle={CoRL},
  year={2018}
}
We present a modular approach for learning policies for navigation over long planning horizons from language input. Our hierarchical policy operates at multiple timescales, where the higher-level master policy proposes subgoals to be executed by specialized sub-policies. Our choice of subgoals is compositional and semantic, i.e. they can be sequentially combined in arbitrary orderings, and assume humaninterpretable descriptions (e.g. ‘exit room’, ‘find kitchen’, ‘find refrigerator’, etc.). We… CONTINUE READING
33
Twitter Mentions

Figures, Tables, and Topics from this paper.

Citations

Publications citing this paper.
SHOWING 1-10 OF 14 CITATIONS

Revisiting EmbodiedQA: A Simple Baseline and Beyond

VIEW 12 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Blindfold Baselines for Embodied QA

VIEW 5 EXCERPTS
CITES METHODS, RESULTS & BACKGROUND
HIGHLY INFLUENCED

A Survey of Reinforcement Learning Informed by Natural Language

Jelena Luketina, Nantas Nardelli, +5 authors Tim Rocktäschel
  • ArXiv
  • 2019
VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Embodied Visual Recognition

  • ArXiv
  • 2019
VIEW 2 EXCERPTS
CITES BACKGROUND

References

Publications referenced by this paper.
SHOWING 1-10 OF 39 REFERENCES

Embodied Question Answering

  • 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  • 2018

IQA: Visual Question Answering in Interactive Environments

  • 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  • 2018

VirtualHome: Simulating Household Activities Via Programs

  • 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  • 2018

Similar Papers

Loading similar papers…