Bayesian Grammar Induction for Language Modeling Bayesian Grammar Induction for Language Modeling

@inproceedings{Chen1995BayesianGI,
  title={Bayesian Grammar Induction for Language Modeling Bayesian Grammar Induction for Language Modeling},
  author={Stanley F. Chen},
  year={1995}
}
We describe a corpus-based induction algorithm for probabilistic context-free grammars. The algorithm employs a greedy heuristic search within a Bayesian framework, and a post-pass using the Inside-Outside algorithm. We compare the performance of our algorithm to n-gram models and the Inside-Outside algorithm in three language model-ing tasks. In two of these domains, our algorithm outperforms these other techniques, marking the rst time a grammar-based language model has surpassed n-gram… CONTINUE READING
8 Citations
5 References
Similar Papers

References

Publications referenced by this paper.
Showing 1-5 of 5 references

Trainable grammars for speech

  • J. K. Baker
  • 1979
2 Excerpts

The DRAGON system

  • J. K. Baker
  • 1975
2 Excerpts

Prediction and entropy

  • C. E. Shannon
  • 1951
2 Excerpts

Similar Papers

Loading similar papers…