Learning Interpretable Spatial Operations in a Rich 3D Blocks World

  title={Learning Interpretable Spatial Operations in a Rich 3D Blocks World},
  author={Yonatan Bisk and Kevin J. Shih and Yejin Choi and Daniel Marcu},
In this paper, we study the problem of mapping natural language instructions to complex spatial actions in a 3D blocks world. We first introduce a new dataset that pairs complex 3D spatial operations to rich natural language descriptions that require complex spatial and pragmatic interpretations such as “mirroring”, “twisting”, and “balancing”. This dataset, built on the simulation environment of Bisk, Yuret, and Marcu (2016), attains language that is significantly richer and more complex… CONTINUE READING
Recent Discussions
This paper has been referenced on Twitter 16 times over the past 90 days. VIEW TWEETS
6 Citations
40 References
Similar Papers


Publications referenced by this paper.
Showing 1-10 of 40 references

Similar Papers

Loading similar papers…