Variational Pretraining for Semi-supervised Text Classification

  title={Variational Pretraining for Semi-supervised Text Classification},
  author={Suchin Gururangan and Tam Dang and Dallas Card and Noah A. Smith},
We introduce VAMPIRE, 1 a lightweight pretraining framework for effective text classification when data and computing resources are limited. [...] Key ResultWe accompany this paper with code to pretrain and use VAMPIRE embeddings in downstream tasks. Expand Abstract