Language Independent Morphological Analysis

@inproceedings{Yamashita2000LanguageIM,
  title={Language Independent Morphological Analysis},
  author={Tatsuo Yamashita and Yuji Matsumoto},
  booktitle={ANLP},
  year={2000}
}
This paper proposes a framework of language independent morphological analysis and mainly concentrate on tokenization, the first process of morphological analysis. Although tokenization is usually not regarded as a difficult task in most segmented languages such as English, there are a number of problems in achieving precise treatment of lexical entries. We first introduce the concept of morpho-fragments, which are intermediate units between characters and lexical entries. We describe our… CONTINUE READING
Highly Cited
This paper has 20 citations. REVIEW CITATIONS

From This Paper

Topics from this paper.

References

Publications referenced by this paper.
Showing 1-10 of 17 references

Japanese Morphological Analysis System ChaSen version 2.0 Manual

  • Yuji Matsumoto, Akira Kitauchi, Tatsuo Yamashita, Yoshitaka Hirano
  • NAIST Technical Report NAIST-ISTR99009,
  • 1999
1 Excerpt

Language independent tools for natural language processing

  • Tatsuo Ymashita, Msakazu Fujio, Yuji Matsumoto.
  • Proceedings of the Eighteenth International…
  • 1999
2 Excerpts

MOZ and LimaTK Manual NAIST Computational Linguistics Laboratory, <http://cl.aist-nara.ac.jp/-tatuo-y/ma/>, August

  • Tatsuo Yamashita
  • 1999
3 Excerpts

Lexicon based critical tokenization: An algorithm

  • Jon Mills.
  • Euralex'98, pages 213-220, August.
  • 1998
2 Excerpts

Similar Papers

Loading similar papers…