Gated-Attention Architectures for Task-Oriented Language Grounding

@inproceedings{Chaplot2018GatedAttentionAF,
  title={Gated-Attention Architectures for Task-Oriented Language Grounding},
  author={Devendra Singh Chaplot and Kanthashree Mysore Sathyendra and Rama Kumar Pasumarthi and Dheeraj Rajagopal and Ruslan R. Salakhutdinov},
  booktitle={AAAI},
  year={2018}
}
To perform tasks specified by natural language instructions, autonomous agents need to extract semantically meaningful representations of language and map it to visual elements and actions in the environment. This problem is called task-oriented language grounding. We propose an end-to-end trainable neural architecture for task-oriented language grounding in 3D environments which assumes no prior linguistic or perceptual knowledge and requires only raw pixels from the environment and the… CONTINUE READING

Figures, Tables, and Topics from this paper.

Citations

Publications citing this paper.
SHOWING 1-10 OF 60 CITATIONS, ESTIMATED 35% COVERAGE

Attention Based Natural Language Grounding by Navigating Virtual Environment

  • 2019 IEEE Winter Conference on Applications of Computer Vision (WACV)
  • 2018
VIEW 7 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Mapping Instructions to Actions in 3D Environments with Visual Goal Prediction

VIEW 7 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

BABYAI: FIRST STEPS TOWARDS GROUNDED LAN-

VIEW 5 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2017
2019

CITATION STATISTICS

  • 14 Highly Influenced Citations

  • Averaged 23 Citations per year over the last 3 years

  • 60% Increase in citations per year in 2018 over 2017

References

Publications referenced by this paper.
SHOWING 1-10 OF 38 REFERENCES

Reinforcement Learning: An Introduction

  • IEEE Transactions on Neural Networks
  • 1988
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

ViZDoom: A Doom-based AI research platform for visual reinforcement learning

  • 2016 IEEE Conference on Computational Intelligence and Games (CIG)
  • 2016
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

An Invitation to Imitation

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

Similar Papers

Loading similar papers…