• Publications
  • Influence
Variational Pretraining for Semi-supervised Text Classification
TLDR
VAMPIRE is introduced, a lightweight pretraining framework for effective text classification when data and computing resources are limited and it is found that fine-tuning to in-domain data is crucial to achieving decent performance from contextual embeddings when working with limited supervision. Expand