A Novel Challenge Set for Hebrew Morphological Disambiguation and Diacritics Restoration

  title={A Novel Challenge Set for Hebrew Morphological Disambiguation and Diacritics Restoration},
  author={Avi Shmidman and Joshua Guedalia and Shaltiel Shmidman and Moshe Koppel and Reut Tsarfaty},
  • Avi Shmidman, Joshua Guedalia, +2 authors Reut Tsarfaty
  • Published in EMNLP 2020
  • Computer Science
  • One of the primary tasks of morphological parsers is the disambiguation of homographs. Particularly difficult are cases of unbalanced ambiguity, where one of the possible analyses is far more frequent than the others. In such cases, there may not exist sufficient examples of the minority analyses in order to properly evaluate performance, nor to train effective classifiers. In this paper we address the issue of unbalanced morphological ambiguities in Hebrew. We offer a challenge set for Hebrew… CONTINUE READING


    What's Wrong with Hebrew NLP? And How to Make it Right
    • 5
    • PDF
    An Unsupervised Morpheme-Based HMM for Hebrew Morphological Disambiguation
    • 70
    • PDF
    Disambiguation by short contexts
    • 126
    A Challenge Set and Methods for Noun-Verb Ambiguity
    • 10
    • PDF
    Supertagging: An Approach to Almost Parsing
    • 426
    • PDF
    A Fully Unsupervised Word Sense Disambiguation Method Using Dependency Knowledge
    • 66
    • PDF
    Handling Homographs in Neural Machine Translation
    • 30
    • PDF