ar X iv : c m p - lg / 9 80 10 01 v 2 1 5 Ja n 19 98 Hierarchical Non - Emitting Markov Models

Abstract

We describe a simple variant of the interpolated Markov model with nonemitting state transitions and prove that it is strictly more powerful than any Markov model. More importantly, the non-emitting model outperforms the classic interpolated model on natural language texts under a wide range of experimental conditions, with only a modest increase in computational requirements. The non-emitting model is also much less prone to overfitting.

Cite this paper

@inproceedings{Ristad1998arXI, title={ar X iv : c m p - lg / 9 80 10 01 v 2 1 5 Ja n 19 98 Hierarchical Non - Emitting Markov Models}, author={Eric Sven Ristad and Robert G. Thomas}, year={1998} }