Corpus ID: 222067015

Measuring Systematic Generalization in Neural Proof Generation with Transformers

@article{Gontier2020MeasuringSG,
  title={Measuring Systematic Generalization in Neural Proof Generation with Transformers},
  author={Nicolas Gontier and Koustuv Sinha and Siva Reddy and C. Pal},
  journal={ArXiv},
  year={2020},
  volume={abs/2009.14786}
}

Nicolas Gontier, Koustuv Sinha, +1 author C. Pal

Published 2020

Computer Science, Mathematics

ArXiv

We are interested in understanding how well Transformer language models (TLMs) can perform reasoning tasks when trained on knowledge encoded in the form of natural language. We investigate their systematic generalization abilities on a logical reasoning task in natural language, which involves reasoning over relationships between entities grounded in first-order logical proofs. Specifically, we perform soft theorem-proving by leveraging TLMs to generate natural language proofs. We test the… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed