Linguistic Regularities in Sparse and Explicit Word Representations

@inproceedings{Levy2014LinguisticRI,
  title={Linguistic Regularities in Sparse and Explicit Word Representations},
  author={Omer Levy and Yoav Goldberg},
  booktitle={CoNLL},
  year={2014}
}
Recent work has shown that neuralembedded word representations capture many relational similarities, which can be recovered by means of vector arithmetic in the embedded space. We show that Mikolov et al.’s method of first adding and subtracting word vectors, and then searching for a word similar to the result, is equivalent to searching for a word that maximizes a linear combination of three pairwise word similarities. Based on this observation, we suggest an improved method of recovering… CONTINUE READING

Similar Papers

Tables and Topics from this paper.

Citations

Publications citing this paper.
SHOWING 1-10 OF 306 CITATIONS

Troll detection by domain-adapting sentiment analysis

  • 2015 18th International Conference on Information Fusion (Fusion)
  • 2015
VIEW 5 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Can Domain Adaptation be Handled as Analogies?

VIEW 11 EXCERPTS
CITES RESULTS, BACKGROUND & METHODS
HIGHLY INFLUENCED

Sound Analogies with Phoneme Embeddings

VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Analysis of Italian Word Embeddings

VIEW 6 EXCERPTS
CITES BACKGROUND, METHODS & RESULTS
HIGHLY INFLUENCED

Comparing explicit and predictive distributional semantic models endowed with syntactic contexts

  • Language Resources and Evaluation
  • 2017
VIEW 13 EXCERPTS
CITES RESULTS, METHODS & BACKGROUND
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2012
2019

CITATION STATISTICS

  • 33 Highly Influenced Citations

  • Averaged 59 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-10 OF 36 REFERENCES

Distributional Semantics Beyond Words: Supervised Learning of Analogy and Paraphrase

  • Transactions of the Association for Computational Linguistics
  • 2013
VIEW 1 EXCERPT