Automatic Evaluation of Spoken Dialogue

  title={Automatic Evaluation of Spoken Dialogue},
  author={SystemsWieland Eckert and Esther Levin and Roberto PieracciniAT and P Park},
We advocate an objective evaluation methodology for the automated evaluation of spoken dialogue systems that eliminates manual interaction and reduces annotation errors and personal bias. The evaluation is performed by observing interactions between the system and a simulated user. We argue that user simulation is an inexpensive and feasible method for optimizing a dialogue system in the lab. Using a simulated user we can conduct dialogues until the performance measure reaches a predetermined… CONTINUE READING
Highly Cited
This paper has 27 citations. REVIEW CITATIONS

From This Paper

Topics from this paper.


Publications citing this paper.
Showing 1-10 of 18 extracted citations


Publications referenced by this paper.
Showing 1-10 of 10 references

A voicecontrolled automatic telephone switchboardand directory information system

  • L. F. Lamel, J. L. Gauvain, +4 authors S. Rosset
  • 1996
1 Excerpt

E ectivehumancomputer cooperative spoken dialogue : The AGS demonstrator

  • M. D. GreeceSadek, A. Ferrieux, A. Cozannet, P. Bretier, F. Panaget
  • 1996

Overview of evaluation in speech and natural language

  • L. Hirschman, H. Thompson
  • 1996
2 Excerpts

Similar Papers

Loading similar papers…