Natural Language Processing (almost) from Scratch

  title={Natural Language Processing (almost) from Scratch},
  author={Ronan Collobert and Jason Weston and L{\'e}on Bottou and Michael Karlen and Koray Kavukcuoglu and Pavel P. Kuksa},
  journal={Journal of Machine Learning Research},
We propose a unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including: part-of-speech tagging, chunking, named entity recognition, and semantic role labeling. This versatility is achieved by trying to avoid task-specific engineering and therefore disregarding a lot of prior knowledge. Instead of exploiting man-made input features carefully optimized for each task, our system learns internal representations on the basis… CONTINUE READING
Highly Influential
This paper has highly influenced 470 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 4,194 citations. REVIEW CITATIONS
Related Discussions
This paper has been referenced on Twitter 94 times. VIEW TWEETS


Publications citing this paper.
Showing 1-10 of 2,758 extracted citations

Sentence-State LSTM for Text Representation

View 7 Excerpts
Highly Influenced

Syntactic Scaffolds for Semantic Structures

EMNLP • 2018
View 8 Excerpts
Highly Influenced

Leveraging morphological information via employing word hashing for sequence labeling

2017 International Conference on Progress in Informatics and Computing (PIC) • 2017
View 5 Excerpts
Highly Influenced

4,194 Citations

Citations per Year
Semantic Scholar estimates that this publication has 4,194 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 89 references

A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data

Journal of Machine Learning Research • 2005
View 4 Excerpts
Highly Influenced

Chunking with Support Vector Machines

NAACL • 2001
View 5 Excerpts
Highly Influenced

Voting Between Multiple Data Representations for Text Chunking

Canadian Conference on AI • 2005
View 3 Excerpts
Highly Influenced

Shallow Parsing with Conditional Random Fields

HLT-NAACL • 2003
View 6 Excerpts
Highly Influenced

Stochastic Gradient Learning in Neural Networks

eon BottouAT
View 4 Excerpts
Highly Influenced

Similar Papers

Loading similar papers…