Corpus ID: 59523704

Learning and Evaluating General Linguistic Intelligence

@article{Yogatama2019LearningAE,
  title={Learning and Evaluating General Linguistic Intelligence},
  author={Dani Yogatama and Cyprien de Masson d'Autume and Jerome Connor and Tom{\'a}s Kocisk{\'y} and Mike Chrzanowski and Lingpeng Kong and A. Lazaridou and Wang Ling and L. Yu and Chris Dyer and P. Blunsom},
  journal={ArXiv},
  year={2019},
  volume={abs/1901.11373}
}
We define general linguistic intelligence as the ability to reuse previously acquired knowledge about a language's lexicon, syntax, semantics, and pragmatic conventions to adapt to new tasks quickly. Using this definition, we analyze state-of-the-art natural language understanding models and conduct an extensive empirical investigation to evaluate them against these criteria through a series of experiments that assess the task-independence of the knowledge being acquired by the learning process… Expand
89 Citations
oLMpics-On What Language Model Pre-training Captures
  • 72
  • PDF
Language Models are Unsupervised Multitask Learners
  • 2,679
  • PDF
Seeing past words: Testing the cross-modal capabilities of pretrained V&L models
  • Highly Influenced
  • PDF
Efficient Meta Lifelong-Learning with Limited Memory
  • 2
  • Highly Influenced
  • PDF
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems
  • 3
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 33 REFERENCES
Improving Language Understanding by Generative Pre-Training
  • 1,929
  • Highly Influential
  • PDF
A large annotated corpus for learning natural language inference
  • 1,731
  • PDF
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
  • 15,760
  • Highly Influential
  • PDF
Overcoming catastrophic forgetting in neural networks
  • 1,597
  • PDF
SQuAD: 100, 000+ Questions for Machine Comprehension of Text
  • 2,667
  • Highly Influential
  • PDF
Attention is All you Need
  • 16,989
  • PDF
Adversarial Examples for Evaluating Reading Comprehension Systems
  • 729
  • PDF
...
1
2
3
4
...