Corpus ID: 221082162

On Efficient Constructions of Checkpoints

@inproceedings{Chen2020OnEC,
  title={On Efficient Constructions of Checkpoints},
  author={Y. Chen and Z. Liu and Bin Ren and Xin Jin},
  booktitle={ICML},
  year={2020}
}

Y. Chen, Z. Liu, +1 author Xin Jin

Published in ICML 2020

Computer Science, Mathematics

Efficient construction of checkpoints/snapshots is a critical tool for training and diagnosing deep learning models. In this paper, we propose a lossy compression scheme for checkpoint constructions (called LC-Checkpoint). LC-Checkpoint simultaneously maximizes the compression rate and optimizes the recovery speed, under the assumption that SGD is used to train the model. LC-Checkpointuses quantization and priority promotion to store the most crucial information for SGD to recover, and then… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed