Learning Word Representations with Hierarchical Sparse Coding
@article{Yogatama2015LearningWR, title={Learning Word Representations with Hierarchical Sparse Coding}, author={Dani Yogatama and Manaal Faruqui and Chris Dyer and Noah A. Smith}, journal={ArXiv}, year={2015}, volume={abs/1406.2035} }
We propose a new method for learning word representations using hierarchical regularization in sparse coding inspired by the linguistic study of word meanings. We show an efficient learning algorithm based on stochastic proximal methods that is significantly faster than previous approaches, making it possible to perform hierarchical sparse coding on a corpus of billions of word tokens. Experiments on various benchmark tasks---word similarity ranking, analogies, sentence completion, and… CONTINUE READING
Supplemental Content
Figures, Tables, and Topics from this paper
46 Citations
Sparse Coding of Neural Word Embeddings for Multilingual Sequence Labeling
- Computer Science
- Transactions of the Association for Computational Linguistics
- 2017
- 15
- PDF
Clustering of words using dictionary-learnt word representations
- Computer Science
- 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI)
- 2016
- 8
- Highly Influenced
Sparse Bilingual Word Representations for Cross-lingual Lexical Entailment
- Computer Science
- HLT-NAACL
- 2016
- 26
- PDF
Sparsifying Word Representations for Deep Unordered Sentence Modeling
- Computer Science
- Rep4NLP@ACL
- 2016
- 3
- PDF
A Unified Framework for Jointly Learning Distributed Representations of Word and Attributes
- Computer Science
- ACML
- 2015
- 3
- PDF
Definition Modeling: Learning to Define Word Embeddings in Natural Language
- Computer Science
- AAAI
- 2017
- 43
- PDF
Sparse Lifting of Dense Vectors: Unifying Word and Sentence Representations
- Computer Science
- ArXiv
- 2019
- 3
- PDF
Investigating Language Universal and Specific Properties in Word Embeddings
- Computer Science
- ACL
- 2016
- 35
- PDF
References
SHOWING 1-10 OF 57 REFERENCES
Improving Word Representations via Global Context and Multiple Word Prototypes
- Computer Science
- ACL
- 2012
- 1,083
- PDF
Improving Vector Space Word Representations Using Multilingual Correlation
- Computer Science
- EACL
- 2014
- 506
- PDF
Distributed Representations of Words and Phrases and their Compositionality
- Computer Science, Mathematics
- NIPS
- 2013
- 20,483
- PDF
Word Representations: A Simple and General Method for Semi-Supervised Learning
- Computer Science
- ACL
- 2010
- 2,001
- PDF
Better Word Representations with Recursive Neural Networks for Morphology
- Computer Science
- CoNLL
- 2013
- 704
- PDF
Learning Effective and Interpretable Semantic Models using Non-Negative Sparse Embedding
- Computer Science
- COLING
- 2012
- 140
- PDF