Pieces of Eight: 8-bit Neural Machine Translation

@article{Quinn2018PiecesOE,
  title={Pieces of Eight: 8-bit Neural Machine Translation},
  author={Jerry Quinn and Miguel Ballesteros},
  journal={ArXiv},
  year={2018},
  volume={abs/1804.05038}
}
Neural machine translation has achieved levels of fluency and adequacy that would have been surprising a short time ago. Output quality is extremely relevant for industry purposes, however it is equally important to produce results in the shortest time possible, mainly for latency-sensitive applications and to control cloud hosting costs. In this paper we show the effectiveness of translating with 8-bit quantization for models that have been trained using 32-bit floating point values. Results… CONTINUE READING
4
Twitter Mentions

Citations

Publications citing this paper.

Similar Papers

Loading similar papers…