Corpus ID: 225041191

Mixed-Precision Embedding Using a Cache

@article{Yang2020MixedPrecisionEU,
  title={Mixed-Precision Embedding Using a Cache},
  author={Jie Yang and Jianyu Huang and Jongsoo Park and P. Tang and A. Tulloch},
  journal={ArXiv},
  year={2020},
  volume={abs/2010.11305}
}
  • Jie Yang, Jianyu Huang, +2 authors A. Tulloch
  • Published 2020
  • Computer Science
  • ArXiv
    • In recommendation systems, practitioners observed that increase in the number of embedding tables and their sizes often leads to significant improvement in model performances. Given this and the business importance of these models to major internet companies, embedding tables for personalization tasks have grown to terabyte scale and continue to grow at a significant rate. Meanwhile, these large-scale models are often trained with GPUs where high-performance memory is a scarce resource, thus… CONTINUE READING
    View PDF on arXiv

    References

    SHOWING 1-10 OF 38 REFERENCES
    Training with Low-precision Embedding Tables
    • 5
    • PDF
    Post-Training 4-bit Quantization on Embedding Tables
    • 1
    • PDF
    Deep Learning Recommendation Model for Personalization and Recommendation Systems
    • 75
    • PDF
    Compression-aware Training of Deep Networks
    • 89
    • PDF
    Tensorized Embedding Layers for Efficient Model Compression
    • 23
    • PDF
    Block based Singular Value Decomposition approach to matrix factorization for recommender systems
    • 5
    • PDF
    Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems
    • 15
    • PDF
    Training with Quantization Noise for Extreme Model Compression
    • 19
    • PDF
    Training and Inference with Integers in Deep Neural Networks
    • 187
    • PDF
    Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware Implications
    • 57
    • PDF