Reduction of Maximum Entropy Models to Hidden Markov Models

We show that maximum entropy (maxent) models can be modeled with certain kinds of HMMs, allowing us to construct max­ ent models with hidden variables, hidden state sequences, or other characteristics. The models can be trained using the forward­ backward algorithm. While the results are primarily of theoretical interest, unifying ap­ parently unrelated… CONTINUE READING