A Primer on Neural Network Models for Natural Language Processing

@article{Goldberg2016APO,
  title={A Primer on Neural Network Models for Natural Language Processing},
  author={Y. Goldberg},
  journal={ArXiv},
  year={2016},
  volume={abs/1510.00726}
}
  • Y. Goldberg
  • Published 2016
  • Computer Science
  • ArXiv
  • Over the past few years, neural networks have re-emerged as powerful machine-learning models, yielding state-of-the-art results in fields such as image recognition and speech processing. More recently, neural network models started to be applied also to textual natural language signals, again with very promising results. This tutorial surveys neural network models from the perspective of natural language processing research, in an attempt to bring natural-language researchers up to speed with… CONTINUE READING
    625 Citations
    An analysis of convolutional neural networks for sentence classification
    • 14
    • PDF
    Neural Network Methods for Natural Language Processing
    • 375
    • PDF
    Empirical Exploration of Novel Architectures and Objectives for Language Models
    • 4
    • PDF
    Chapter 1 Analyzing Neural Network Optimization with Gradient Tracing
    • PDF
    Natural Language Understanding with Distributed Representation
    • 49
    • PDF
    The Roles of Language Models and Hierarchical Models in Neural Sequence-to-Sequence Prediction
    • 2
    • PDF
    Neural information retrieval: at the end of the early years
    • 66
    • Highly Influenced
    • PDF
    Rational Recurrences
    • 21
    • Highly Influenced
    • PDF

    References

    SHOWING 1-10 OF 200 REFERENCES
    LSTM Neural Networks for Language Modeling
    • 1,196
    • PDF
    Recurrent neural network based language model
    • 4,176
    • PDF
    Natural Language Understanding with Distributed Representation
    • 49
    • PDF
    A unified architecture for natural language processing: deep neural networks with multitask learning
    • 4,221
    • Highly Influential
    • PDF
    Character-Aware Neural Language Models
    • 1,247
    • PDF
    Learning Longer Memory in Recurrent Neural Networks
    • 191
    • PDF