Corpus ID: 57761103

Self-Monitoring Navigation Agent via Auxiliary Progress Estimation

@article{Ma2019SelfMonitoringNA,
  title={Self-Monitoring Navigation Agent via Auxiliary Progress Estimation},
  author={Chih-Yao Ma and Jiasen Lu and Zuxuan Wu and G. Al-Regib and Z. Kira and R. Socher and Caiming Xiong},
  journal={ArXiv},
  year={2019},
  volume={abs/1901.03035}
}
  • Chih-Yao Ma, Jiasen Lu, +4 authors Caiming Xiong
  • Published 2019
  • Computer Science
  • ArXiv
  • The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments. [...] Key Method In this paper, we introduce a self-monitoring agent with two complementary components: (1) visual-textual co-grounding module to locate the instruction completed in the past, the instruction required for the next action, and the next moving direction from surrounding images and (2) progress monitor to ensure the grounded instruction correctly reflects the…Expand Abstract
    58 Citations

    Figures, Tables, and Topics from this paper.

    Explore Further: Topics Discussed in This Paper

    Sub-Instruction Aware Vision-and-Language Navigation
    • 4
    • Highly Influenced
    • PDF
    Take the Scenic Route: Improving Generalization in Vision-and-Language Navigation
    • 2
    • PDF
    Active Visual Information Gathering for Vision-Language Navigation
    Vision-Language Navigation With Self-Supervised Auxiliary Reasoning Tasks
    • 20
    • Highly Influenced
    • PDF
    The Regretful Agent: Heuristic-Aided Navigation Through Progress Estimation
    • 43
    • PDF
    BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps
    • 6
    • PDF
    Tactical Rewind: Self-Correction via Backtracking in Vision-And-Language Navigation
    • 44
    • Highly Influenced
    • PDF
    Chasing Ghosts: Instruction Following as Bayesian State Tracking
    • 12
    • PDF
    Vision-Language Navigation Policy Learning and Adaptation.
    • 1
    • PDF

    References

    SHOWING 1-10 OF 58 REFERENCES
    The Regretful Agent: Heuristic-Aided Navigation Through Progress Estimation
    • 43
    • PDF
    Target-driven visual navigation in indoor scenes using deep reinforcement learning
    • 691
    • PDF
    Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
    • 114
    • PDF
    Vision-and-Language Navigation: Interpreting Visually-Grounded Navigation Instructions in Real Environments
    • 288
    • Highly Influential
    • PDF
    Visual Representations for Semantic Target Driven Navigation
    • 57
    • PDF
    Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences
    • 138
    • PDF
    Speaker-Follower Models for Vision-and-Language Navigation
    • 110
    • Highly Influential
    • PDF
    Learning to Navigate in Cities Without a Map
    • 127
    • PDF
    Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation
    • 70
    • Highly Influential
    • PDF
    Visual Semantic Planning Using Deep Successor Representations
    • 83
    • PDF