Segment-Phrase Table for Semantic Segmentation, Visual Entailment and Paraphrasing

@article{Izadinia2015SegmentPhraseTF,
  title={Segment-Phrase Table for Semantic Segmentation, Visual Entailment and Paraphrasing},
  author={Hamid Izadinia and Fereshteh Sadeghi and S. Divvala and Hannaneh Hajishirzi and Yejin Choi and A. Farhadi},
  journal={2015 IEEE International Conference on Computer Vision (ICCV)},
  year={2015},
  pages={10-18}
}
We introduce Segment-Phrase Table (SPT), a large collection of bijective associations between textual phrases and their corresponding segmentations. Leveraging recent progress in object recognition and natural language semantics, we show how we can successfully build a high-quality segment-phrase table using minimal human supervision. More importantly, we demonstrate the unique value unleashed by this rich bimodal resource, for both vision as well as natural language understanding. First, we… Expand
Visual Denotations for Recognizing Textual Entailment
Visual Denotations for Recognizing Textual
Learning to detect visual relations
Detecting Unseen Visual Relations Using Analogies
A Continuously Growing Dataset of Sentential Paraphrases
Reasoning About Fine-Grained Attribute Phrases Using Reference Games
Estimating the information gap between textual and visual representations
  • C. Henning, R. Ewerth
  • Computer Science
  • International Journal of Multimedia Information Retrieval
  • 2017
...
1
2
...

References

SHOWING 1-10 OF 43 REFERENCES
From captions to visual concepts and back
A Survey of Paraphrasing and Textual Entailment Methods
VisKE: Visual knowledge extraction and question answering by visual verification of relation phrases
Deep Fragment Embeddings for Bidirectional Image Sentence Mapping
Deep Visual-Semantic Alignments for Generating Image Descriptions
  • A. Karpathy, Li Fei-Fei
  • Computer Science, Medicine
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2017
Combining Language and Vision with a Multimodal Skip-gram Model
Grounded Compositional Semantics for Finding and Describing Images with Sentences
Show and tell: A neural image caption generator
Enriching Visual Knowledge Bases via Object Discovery and Segmentation
...
1
2
3
4
5
...