Corpus ID: 208291181

Learning to Learn Words from Narrated Video

@article{Surs2019LearningTL,
  title={Learning to Learn Words from Narrated Video},
  author={D{\'i}dac Sur{\'i}s and Dave Epstein and Huai-zhong Ji and Shih-Fu Chang and Carl Vondrick},
  journal={ArXiv},
  year={2019},
  volume={abs/1911.11237}
}
  • Dídac Surís, Dave Epstein, +2 authors Carl Vondrick
  • Published in ArXiv 2019
  • Computer Science
  • When we travel, we often encounter new scenarios we have never experienced before, with new sights and new words that describe them. We can use our language-learning ability to quickly learn these new words and correlate them with the visual world. In contrast, language models often do not robustly generalize to novel words and compositions. We propose a framework that learns how to learn text representations from visual context. Experiments show that our approach significantly outperforms the… CONTINUE READING

    Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 55 REFERENCES

    UNITER: Learning UNiversal Image-TExt Representations

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL