VisualCOMET: Reasoning About the Dynamic Context of a Still Image

@inproceedings{Park2020VisualCOMETRA,
  title={VisualCOMET: Reasoning About the Dynamic Context of a Still Image},
  author={J. Park and Chandra Bhagavatula and R. Mottaghi and A. Farhadi and Yejin Choi},
  booktitle={ECCV},
  year={2020}
}
Even from a single frame of a still image, people can reason about the dynamic story of the image before, after, and beyond the frame. For example, given an image of a man struggling to stay afloat in water, we can reason that the man fell into the water sometime in the past, the intent of that man at the moment is to stay alive, and he will need help in the near future or else he will get washed away. We propose VisualComet, the novel framework of visual commonsense reasoning tasks to predict… Expand
7 Citations
Transformation Driven Visual Reasoning
  • PDF
Learning Contextual Causality from Time-consecutive Images
  • PDF
CLEVR_HYP: A Challenge Dataset and Baselines for Visual Question Answering with Hypothetical Actions over Images
  • PDF
KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation
  • 1
  • Highly Influenced
  • PDF
Understanding Few-Shot Commonsense Knowledge Models
  • 1
  • PDF
Understanding in Artificial Intelligence
  • PDF

References

SHOWING 1-10 OF 58 REFERENCES
From Recognition to Cognition: Visual Commonsense Reasoning
  • 203
  • PDF
Inferring the Why in Images
  • 30
  • PDF
Visual Dialog
  • 364
  • PDF
Learning Common Sense through Visual Abstraction
  • 67
  • PDF
VQA: Visual Question Answering
  • 2,177
  • PDF
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge
  • 55
  • PDF
Show and tell: A neural image caption generator
  • 3,792
  • PDF
Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks
  • 348
  • PDF
"What Happens If..." Learning to Predict the Effect of Forces in Images
  • 93
  • PDF
Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models
  • 419
  • PDF
...
1
2
3
4
5
...