Image Captioning with Unseen Objects

@article{Demirel2019ImageCW,
  title={Image Captioning with Unseen Objects},
  author={Berkan Demirel and Ramazan Gokberk Cinbis and Nazli Ikizler-Cinbis},
  journal={ArXiv},
  year={2019},
  volume={abs/1908.00047}
}
Image caption generation is a long standing and challenging problem at the intersection of computer vision and natural language processing. A number of recently proposed approaches utilize a fully supervised object recognition model within the captioning approach. Such models, however, tend to generate sentences which only consist of objects predicted by the recognition models, excluding instances of the classes without labelled training examples. In this paper, we propose a new challenging… CONTINUE READING

Figures, Tables, and Topics from this paper.

References

Publications referenced by this paper.
SHOWING 1-10 OF 70 REFERENCES

You Only Look Once: Unified, Real-Time Object Detection

  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2015
VIEW 8 EXCERPTS
HIGHLY INFLUENTIAL

Neural Baby Talk

  • 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
  • 2018
VIEW 10 EXCERPTS
HIGHLY INFLUENTIAL

Deep Compositional Captioning: Describing Novel Object Categories without Paired Training Data

  • 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2015
VIEW 9 EXCERPTS
HIGHLY INFLUENTIAL

Captioning Images with Diverse Objects

  • 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • 2016
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

BabyTalk: Understanding and Generating Simple Image Descriptions

  • IEEE Trans. Pattern Anal. Mach. Intell.
  • 2013
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

CornerNet: Detecting Objects as Paired Keypoints

  • International Journal of Computer Vision
  • 2019
VIEW 2 EXCERPTS
HIGHLY INFLUENTIAL