Modeling of Long Distance Context Dependency

  title={Modeling of Long Distance Context Dependency},
  author={Guodong Zhou},
Ngram models are simple in language modeling and have been successfully used in speech recognition and other tasks. However, they can only capture the short distance context dependency within an n-words window where currently the largest practical n for a natural language is three while much of the context dependency in a natural language occurs beyond a… CONTINUE READING