Parallelizing Word2Vec in Multi-Core and Many-Core Architectures

Abstract

Word2vec is a widely used algorithm for extracting low-dimensional vector representations of words. State-of-the-art algorithms including those by Mikolov et al. [5, 6] have been parallelized for multi-core CPU architectures, but are based on vector-vector operations with “Hogwild" updates that are memory-bandwidth intensive and do not efficiently use… (More)

Topics

3 Figures and Tables

Cite this paper

@article{Ji2016ParallelizingWI, title={Parallelizing Word2Vec in Multi-Core and Many-Core Architectures}, author={Shihao Ji and Nadathur Satish and Sheng Li and Pradeep Dubey}, journal={CoRR}, year={2016}, volume={abs/1611.06172} }