Learning Interpretable Spatial Operations in a Rich 3D Blocks World

@inproceedings{Bisk2017LearningIS,
  title={Learning Interpretable Spatial Operations in a Rich 3D Blocks World},
  author={Yonatan Bisk and Kevin J. Shih and Yejin Choi and Daniel Marcu},
  booktitle={AAAI},
  year={2017}
}
In this paper, we study the problem of mapping natural language instructions to complex spatial actions in a 3D blocks world. We first introduce a new dataset that pairs complex 3D spatial operations to rich natural language descriptions that require complex spatial and pragmatic interpretations such as "mirroring", "twisting", and "balancing". This dataset, built on the simulation environment of Bisk, Yuret, and Marcu (2016), attains language that is significantly richer and more complex… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 18 CITATIONS

Improving Grounded Natural Language Understanding through Human-Robot Dialog

Jesse Thomason, Aishwarya Padmakumar, +6 authors Raymond J. Mooney
  • 2019 International Conference on Robotics and Automation (ICRA)
  • 2019
VIEW 1 EXCERPT
CITES BACKGROUND

Prospection: Interpretable plans from language by predicting the future

  • 2019 International Conference on Robotics and Automation (ICRA)
  • 2019
VIEW 2 EXCERPTS
CITES METHODS & BACKGROUND

Why Build an Assistant in Minecraft?

  • ArXiv
  • 2019
VIEW 2 EXCERPTS
CITES BACKGROUND

References

Publications referenced by this paper.