Word Normalization in Twitter Using Finite-state Transducers

  title={Word Normalization in Twitter Using Finite-state Transducers},
  author={Jordi Porta and Jos{\'e}-Luis Sancho-G{\'o}mez},
This paper presents a linguistic approach based on weighted-finite state transducers for the lexical normalisation of Spanish Twitter messages. The system developed consists of transducers that are applied to out-of-vocabulary tokens. Transducers implement linguistic models of variation that generate sets of candidates according to a lexicon. A statistical language model is used to obtain the most probable sequence of words. The article includes a description of the components and an evaluation… CONTINUE READING
Highly Cited
This paper has 24 citations. REVIEW CITATIONS