Corpus ID: 215737063

Overestimation of Syntactic Representationin Neural Language Models

@article{Kodner2020OverestimationOS,
  title={Overestimation of Syntactic Representationin Neural Language Models},
  author={Jordan Kodner and Nitish Gupta},
  journal={ArXiv},
  year={2020},
  volume={abs/2004.05067}
}
  • Jordan Kodner, Nitish Gupta
  • Published 2020
  • Computer Science
  • ArXiv
  • With the advent of powerful neural language models over the last few years, research attention has increasingly focused on what aspects of language they represent that make them so successful. Several testing methodologies have been developed to probe models' syntactic representations. One popular method for determining a model's ability to induce syntactic structure trains a model on strings generated according to a template then tests the model's ability to distinguish such strings from… CONTINUE READING

    Figures and Topics from this paper.

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 34 REFERENCES

    Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies

    VIEW 6 EXCERPTS
    HIGHLY INFLUENTIAL

    BLiMP: A Benchmark of Linguistic Minimal Pairs for English

    VIEW 8 EXCERPTS
    HIGHLY INFLUENTIAL