Discriminative Language Modeling with Conditional Random Fields and the Perceptron Algorithm

  title={Discriminative Language Modeling with Conditional Random Fields and the Perceptron Algorithm},
  author={Brian Roark and Murat Saraclar and Michael Collins and Mark Johnson},
This paper describes discriminative language modeling for a large vocabulary speech recognition task. We contrast two parameter estimation methods: the perceptron algorithm, and a method based on conditional random fields (CRFs). The models are encoded as deterministic weighted finite state automata, and are applied by intersecting the automata with word-lattices that are the output from a baseline recognizer. The perceptron algorithm has the benefit of automatically selecting a relatively… CONTINUE READING
Highly Influential
This paper has highly influenced 15 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 176 citations. REVIEW CITATIONS

From This Paper

Figures, tables, results, and topics from this paper.

Key Quantitative Results

  • However, using the feature set output from the perceptron algorithm (initialized with their weights), CRF training provides an additional 0.5% reduction in word error rate, for a total 1.8% absolute reduction from the baseline of 39.2%.


Publications citing this paper.
Showing 1-10 of 123 extracted citations

Capitalizing Machine Translation

HLT-NAACL • 2006
View 5 Excerpts
Highly Influenced

Large Margin Neural Language Model

View 4 Excerpts
Highly Influenced

176 Citations

Citations per Year
Semantic Scholar estimates that this publication has 176 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 22 references

Similar Papers

Loading similar papers…