DARPA communicator evaluation: progress from 2000 to 2001

  title={DARPA communicator evaluation: progress from 2000 to 2001},
  author={Marilyn A. Walker and Alexander I. Rudnicky and John S. Aberdeen and Elizabeth Owen Bratt and John S. Garofolo and Helen F. Hastie and Audrey N. Le and Bryan L. Pellom and Alexandros Potamianos and Rebecca J. Passonneau and Rashmi Prasad and Salim Roukos and Gregory A. Sanders and Stephanie Seneff and David Stallard},
This paper describes the evaluation methodology and results of the DARPA Communicator spoken dialog system evaluation experiments in 2000 and 2001. Nine spoken dialog systems in the travel planning domain participated in the experiments resulting in a total corpus of 1904 dialogs. We describe and compare the experimental design of the 2000 and 2001 DARPA evaluations. We describe how we established a performance baseline in 2001 for complex tasks. We present our overall approach to data… CONTINUE READING
Highly Cited
This paper has 39 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 27 extracted citations


Publications referenced by this paper.
Showing 1-10 of 11 references

Predictive ormance of dialog systems

  • onneau-Maynard, L. Devillers, S. Rosset
  • In Language Resources and luation Conference,
  • 2000

Predictive performance of dialog systems

  • L. Devillers H. Bonneau-Maynard
  • Language Resources and Evaluation Conference
  • 2000

Decisions with Multiple Objecs: Preferences and Value Tradeoffs

  • eeney, H. Raiffa
  • John Wiley,
  • 1976

Semantic and syntactic cts of remembering sentences: A review of some recent tintental research

  • J. M. Levelt, G. Kempen
  • editors, ies in Long Term Memory. John Wiley,
  • 1975

Recognition memory for syntactic and semantic ects of connected discourse

  • Sachs
  • PhD thesis, University of ifornia Berkeley,
  • 1967

Similar Papers

Loading similar papers…