Probing Natural Language Inference Models through Semantic Fragments

@article{Richardson2019ProbingNL,
  title={Probing Natural Language Inference Models through Semantic Fragments},
  author={Kyle Richardson and Hai Na Hu and Lawrence S. Moss and Ashish Sabharwal},
  journal={ArXiv},
  year={2019},
  volume={abs/1909.07521}
}
Do state-of-the-art models for language understanding already have, or can they easily learn, abilities such as boolean coordination, quantification, conditionals, comparatives, and monotonicity reasoning (i.e., reasoning about word substitutions in sentential contexts)? While such phenomena are involved in natural language inference (NLI) and go beyond basic linguistic understanding, it is unclear the extent to which they are captured in existing NLI benchmarks and effectively learned by… CONTINUE READING