Corpus ID: 686481

Character-Aware Neural Language Models

@inproceedings{Kim2016CharacterAwareNL,
  title={Character-Aware Neural Language Models},
  author={Yoon Kim and Yacine Jernite and D. Sontag and Alexander M. Rush},
  booktitle={AAAI},
  year={2016}
}
We describe a simple neural language model that relies only on character-level inputs. [...] Key Result The results suggest that on many languages, character inputs are sufficient for language modeling. Analysis of word representations obtained from the character composition part of the model reveals that the model is able to encode, from characters only, both semantic and orthographic information.Expand
1,300 Citations
Character-level language modeling with hierarchical recurrent neural networks
  • Kyuyeon Hwang, Wonyong Sung
  • Computer Science, Mathematics
  • 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2017
  • 40
  • PDF
Language Modeling for Morphologically Rich Languages: Character-Aware Modeling for Word-Level Prediction
  • 28
  • Highly Influenced
  • PDF
Gated Word-Character Recurrent Language Model
  • 79
  • PDF
Enhancing recurrent neural network-based language models by word tokenization
  • 3
Character and Subword-Based Word Representation for Neural Language Modeling Prediction
  • 11
  • Highly Influenced
  • PDF
Character-based Neural Machine Translation
  • 109
  • PDF
A Character-Word Compositional Neural Language Model for Finnish
  • 6
  • PDF
Character-based Neural Machine Translation
  • 237
  • Highly Influenced
  • PDF
Comparing Character-level Neural Language Models Using a Lexical Decision Task
  • 4
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 83 REFERENCES
SUBWORD LANGUAGE MODELING WITH NEURAL NETWORKS
  • 172
  • PDF
Learning Character-level Representations for Part-of-Speech Tagging
  • 475
  • PDF
Boosting Named Entity Recognition with Neural Character Embeddings
  • 194
  • PDF
LSTM Neural Networks for Language Modeling
  • 1,264
  • PDF
genCNN: A Convolutional Architecture for Word Sequence Prediction
  • 18
  • PDF
Context dependent recurrent neural network language model
  • 493
  • PDF
Co-learning of Word Representations and Morpheme Representations
  • 88
  • PDF
Better Word Representations with Recursive Neural Networks for Morphology
  • 725
  • Highly Influential
  • PDF
A Convolutional Neural Network for Modelling Sentences
  • 2,603
  • PDF
Sequence to Sequence Learning with Neural Networks
  • 12,109
  • PDF
...
1
2
3
4
5
...