Corpus ID: 216035831

Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation

@article{Wu2020IntegerQF,
  title={Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation},
  author={Hao Wu and P. Judd and Xiaojie Zhang and M. Isaev and P. Micikevicius},
  journal={ArXiv},
  year={2020},
  volume={abs/2004.09602}
}

Hao Wu, P. Judd, +2 authors P. Micikevicius

Published 2020

Computer Science, Mathematics

ArXiv

Quantization techniques can reduce the size of Deep Neural Networks and improve inference latency and throughput by taking advantage of high throughput integer instructions. In this paper we review the mathematical aspects of quantization parameters and evaluate their choices on a wide range of neural network models for different application domains, including vision, speech, and language. We focus on quantization techniques that are amenable to acceleration by processors with high-throughput… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed