Neural language models as psycholinguistic subjects: Representations of syntactic state

@article{Futrell2019NeuralLM,
  title={Neural language models as psycholinguistic subjects: Representations of syntactic state},
  author={Richard Futrell and Ethan Wilcox and Takashi Morita and Peng Qian and Miguel Ballesteros and Roger Levy},
  journal={ArXiv},
  year={2019},
  volume={abs/1903.03260}
}
We deploy the methods of controlled psycholinguistic experimentation to shed light on the extent to which the behavior of neural network language models reflects incremental representations of syntactic state. To do so, we examine model behavior on artificial sentences containing a variety of syntactically complex structures. We test four models: two publicly available LSTM sequence models of English (Jozefowicz et al., 2016; Gulordava et al., 2018) trained on large datasets; an RNNG (Dyer et… CONTINUE READING

Similar Papers

Figures, Tables, and Topics from this paper.

References

Publications referenced by this paper.
SHOWING 1-10 OF 46 REFERENCES