KD-Lib: A PyTorch library for Knowledge Distillation, Pruning and Quantization
- Het Shah, Avishree Khare, Neelay Shah, Khizir Siddiqui
- Computer ScienceArXiv
- 30 November 2020
KD-Lib is an open-source PyTorch based library, which contains state-of-the-art modular implementations of algorithms from the three families on top of multiple abstraction layers, with extended support for hyperparameter tuning using Optuna and Tensorboard for logging and monitoring.