Variational Pretraining for Semi-supervised Text Classification

@inproceedings{Gururangan2019VariationalPF,
  title={Variational Pretraining for Semi-supervised Text Classification},
  author={Suchin Gururangan and Tam Dang and Dallas Card and Noah A. Smith},
  booktitle={ACL},
  year={2019}
}
We introduce VAMPIRE, 1 a lightweight pretraining framework for effective text classification when data and computing resources are limited. [...] Key ResultWe accompany this paper with code to pretrain and use VAMPIRE embeddings in downstream tasks. Expand Abstract