The Use of SVM for Chinese New Word Identification

@inproceedings{Li2004TheUO,
  title={The Use of SVM for Chinese New Word Identification},
  author={Hongqiao Li and Changning Huang and Jianfeng Gao and Xiaozhong Fan},
  booktitle={IJCNLP},
  year={2004}
}
  • Hongqiao Li, Changning Huang, +1 author Xiaozhong Fan
  • Published in IJCNLP 2004
  • Computer Science
  • We present a study of new word identification (NWI) to improve the performance of a Chinese word segmenter. In this paper the distribution and types of new words are discussed empirically. In particular, we focus on the new words of two surface patterns, which account for more than 80% of new words in our data sets: NW11 (two-character new word) and NW21 (a bi-character word followed with a single character). NWI is defined as a problem of binary classification. A statistical learning approach… CONTINUE READING

    Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

    Citations

    Publications citing this paper.
    SHOWING 1-10 OF 41 CITATIONS

    Apply text mining in analysis of patent document

    • Yuanhao Xu
    • Computer Science
    • 2009 IEEE 10th International Conference on Computer-Aided Industrial Design & Conceptual Design
    • 2009
    VIEW 7 EXCERPTS
    CITES BACKGROUND
    HIGHLY INFLUENCED

    Chinese Main Verb Identification: From Specification to Realization

    VIEW 9 EXCERPTS
    CITES METHODS & BACKGROUND

    Mining Web data for Chinese segmentation

    VIEW 1 EXCERPT
    HIGHLY INFLUENCED

    Chinese New Words Extraction Based on Machine Learning Approach

    VIEW 3 EXCERPTS
    CITES BACKGROUND & METHODS
    HIGHLY INFLUENCED

    Online Detection of Domain-Specific New Words in Text Streams

    VIEW 1 EXCERPT
    CITES BACKGROUND

    New Word Extraction From Chinese Financial Documents

    VIEW 2 EXCERPTS
    CITES BACKGROUND

    On the unsupervised analysis of domain-specific Chinese texts.

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 17 REFERENCES