• DOI:10.18653/v1/w18-3024
Corpus ID: 44111606

LSTMs Exploit Linguistic Attributes of Data

@inproceedings{Liu2018LSTMsEL,
  title={LSTMs Exploit Linguistic Attributes of Data},
  author={Nelson F. Liu and Omer Levy and Roy Schwartz and Chenhao Tan and Noah A. Smith},
  booktitle={Rep4NLP@ACL},
  year={2018}
}

Nelson F. Liu, Omer Levy, +2 authors Noah A. Smith

Published in Rep4NLP@ACL 2018

Computer Science

While recurrent neural networks have found success in a variety of natural language processing applications, they are general models of sequential data. We investigate how the properties of natural language data affect an LSTM's ability to learn a nonlinguistic task: recalling elements from its input. We find that models trained on natural language data are able to recall tokens from much longer sequences than models trained on non-language sequential data. Furthermore, we show that the LSTM… CONTINUE READING

View PDF on ArXiv

Save to Library

Create Alert

Cite

Launch Research Feed

Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv