Corpus ID: 1939935

Distributional semantics from text and images

  title={Distributional semantics from text and images},
  author={Elia Bruni and G. B. Tran and M. Baroni},
  • Elia Bruni, G. B. Tran, M. Baroni
  • Published 2011
  • Computer Science
  • We present a distributional semantic model combining text- and image-based features. We evaluate this multimodal semantic model on simulating similarity judgments, concept clustering and the BLESS benchmark. When integrated with the same core text-based model, image-based features are at least as good as further text-based features, and they capture different qualitative aspects of the tasks, suggesting that the two sources of information are complementary. 
    75 Citations
    Grounding Distributional Semantics in the Visual World
    • M. Baroni
    • Computer Science
    • Lang. Linguistics Compass
    • 2016
    • 40
    Models of Semantic Representation with Visual Attributes
    • 75
    • PDF
    Multimodal Fusion for Combining Textual and Visual Information in a Semantic Model
    • Highly Influenced
    Multimodal Distributional Semantics
    • 643
    • PDF
    Distributional semantics with eyes: using image analysis to improve computational representations of word meaning
    • 43
    • PDF
    Visually Grounded Meaning Representations
    • 35
    • PDF
    Representing Verbs with Visual Argument Vectors
    • PDF


    Contextual correlates of semantic similarity
    • 1,582
    Distributional Memory: A General Framework for Corpus-Based Semantics
    • 579
    • PDF
    Topics in semantic representation.
    • 911
    • PDF
    Visual Information in Semantic Representation
    • 112
    • PDF
    Unsupervised Learning by Probabilistic Latent Semantic Analysis
    • 2,377
    • PDF
    Evaluating bag-of-visual-words representations in scene classification
    • 846
    • PDF
    Criterion Functions for Document Clustering ∗ Experiments and Analysis
    • 529
    • PDF
    Visual categorization with bags of keypoints
    • 4,793
    • PDF