Test and evaluation of a spoken dialogue system
@article{Gerbino1993TestAE, title={Test and evaluation of a spoken dialogue system}, author={Elisabetta Gerbino and P. Baggia and A. Ciaramella and C. Rullent}, journal={1993 IEEE International Conference on Acoustics, Speech, and Signal Processing}, year={1993}, volume={2}, pages={135-138 vol.2} }
The development of spoken dialogue systems (SDSs) requires the definition of evaluation metrics which can assess the performance of these systems at different levels and compare various SDSs. The authors present a first test, made with naive users, on an integrated dialogue system for telephone speech access to a remote data base. They describe the system architecture as well as the goals of the test, its features, the methodology used during the evaluation, and the results obtained. The SDS is… CONTINUE READING
Topics from this paper
9 Citations
Parameters for Quantifying the Interaction with Spoken Dialogue Telephone Services
- Computer Science
- SIGDIAL Workshop
- 2005
- 19
- PDF
Spontaneous speech dialogue system TOSBURG II and its evaluation
- Computer Science
- Speech Communication
- 1994
- 10
Assessment and Evaluation of Speech-Based Interactive Systems: From Manual Annotation to Automatic Usability Evaluation
- Computer Science
- 2010
- 3
Experience with the Philips automatic train timetable information system
- Engineering
- Proceedings of 2nd IEEE Workshop on Interactive Voice Technology for Telecommunications Applications
- 1994
- 35
References
SHOWING 1-8 OF 8 REFERENCES
Collection of Spontaneous Speech for the ATIS Domain and Comparative Analyses of Data Collected at MIT and TI
- Computer Science
- HLT
- 1991
- 13
- PDF
Comparison of discrete and continuous HMMs in a CSR task over the telephone
- Computer Science
- [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing
- 1991
- 7
Partial parsing as a robust parsing strategy
- Computer Science
- 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing
- 1993
- 25
A man-machine dialogue system for speech access to e-mail information using the telephone: implementation and first results
- Computer Science
- EUROSPEECH
- 1991
- 5
Interpretation of context-dependent utterances in man-machine dialogue
- Computer Science
- EUROSPEECH
- 1991
- 3