Moin Aminnaseri

Publications2
h-index2
Citations28
Highly Influential Citations3
Claim Author Page
Author pages are created from data sourced from our academic publisher partnerships and public sources.

Recommended Authors

  • Ashish Sabharwal
  • 175 Publications • 5,903 Citations
  • Tushar Khot
  • 88 Publications • 2,686 Citations
  • Samuel R. Bowman
  • 95 Publications • 15,289 Citations
  • Peter Clark
  • 184 Publications • 9,609 Citations
  • Publications
  • Influence
ParsiNLU: A Suite of Language Understanding Challenges for Persian
TLDR
This work introduces ParsiNLU, the first benchmark in Persian language that includes a range of language understanding tasks—reading comprehension, textual entailment, and so on, and presents the first results on state-of-the-art monolingual and multilingual pre-trained language models on this benchmark and compares them with human performance.
View on MIT Press
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
TLDR
Evaluation of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters finds that model performance and calibration both improve with scale, but are poor in absolute terms.
View PDF on arXiv