Of Words, Eyes and Brains: Correlating Image-Based Distributional Semantic Models with Neural Representations of Concepts
@inproceedings{Anderson2013OfWE, title={Of Words, Eyes and Brains: Correlating Image-Based Distributional Semantic Models with Neural Representations of Concepts}, author={A. Anderson and Elia Bruni and Ulisse Bordignon and Massimo Poesio and M. Baroni}, booktitle={EMNLP}, year={2013} }
Traditional distributional semantic models extract word meaning representations from cooccurrence patterns of words in text corpora. Recently, the distributional approach has been extended to models that record the cooccurrence of words with visual features in image collections. These image-based models should be complementary to text-based ones, providing a more cognitively plausible view of meaning grounded in visual perception. In this study, we test whether image-based models capture the… CONTINUE READING
38 Citations
An Integrated Neural Decoder of Linguistic and Experiential Meaning
- Medicine
- The Journal of Neuroscience
- 2019
- 8
- PDF
Interpretable Semantic Vectors from a Joint Model of Brain- and Text- Based Meaning
- Computer Science, Medicine
- ACL
- 2014
- 56
- PDF
Exploring Semantic Representation in Brain Activity Using Word Embeddings
- Computer Science
- EMNLP
- 2016
- 8
- Highly Influenced
- PDF
Decoding Brain Activity Associated with Literal and Metaphoric Sentence Comprehension Using Distributional Semantic Models
- Computer Science
- Transactions of the Association for Computational Linguistics
- 2020
- 1
- PDF
Reading visually embodied meaning from the brain: Visually grounded computational models decode visual-object mental imagery induced by written text
- Computer Science, Medicine
- NeuroImage
- 2015
- 53
- PDF
Visually Grounded and Textual Semantic Models Differentially Decode Brain Activity Associated with Concrete and Abstract Nouns
- Computer Science
- Transactions of the Association for Computational Linguistics
- 2017
- 44
- PDF
Multiple Regions of a Cortical Network Commonly Encode the Meaning of Words in Multiple Grammatical Positions of Read Sentences.
- Medicine, Computer Science
- Cerebral cortex
- 2019
- 19
- PDF
Corpora and Cognition: The Semantic Composition of Adjectives and Nouns in the Human Brain
- Computer Science
- 2015
- 2
- PDF
From Brain Space to Distributional Space: The Perilous Journeys of fMRI Decoding
- Computer Science
- ACL
- 2019
- 1
- Highly Influenced
- PDF
Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation
- Computer Science, Medicine
- Cerebral cortex
- 2017
- 60
- PDF
References
SHOWING 1-10 OF 47 REFERENCES
Distributional semantics with eyes: using image analysis to improve computational representations of word meaning
- Computer Science
- ACM Multimedia
- 2012
- 43
- PDF
Generating Text from Functional Brain Images
- Computer Science, Medicine
- Front. Hum. Neurosci.
- 2011
- 39
- PDF
Quantitative modeling of the neural representation of objects: How semantic feature norms can account for fMRI activation
- Mathematics, Computer Science
- NeuroImage
- 2011
- 52
- PDF
Predicting Human Brain Activity Associated with the Meanings of Nouns
- Psychology, Medicine
- Science
- 2008
- 1,025
- Highly Influential
- PDF
Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies.
- Psychology, Medicine
- Cerebral cortex
- 2009
- 2,547
- Highly Influential
- PDF
Selecting Corpus-Semantic Models for Neurolinguistic Decoding
- Computer Science
- *SEM@NAACL-HLT
- 2012
- 73
- PDF
Vector Space Models of Word Meaning and Phrase Meaning: A Survey
- Computer Science
- Lang. Linguistics Compass
- 2012
- 230
A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain
- Computer Science, Medicine
- Neuron
- 2012
- 614
- PDF