The dialogue breakdown detection challenge: Task description, datasets, and evaluation metrics

@inproceedings{Higashinaka2016TheDB,
  title={The dialogue breakdown detection challenge: Task description, datasets, and evaluation metrics},
  author={Ryuichiro Higashinaka and Kotaro Funakoshi and Yuka Kobayashi and Michimasa Inaba},
  booktitle={LREC},
  year={2016}
}
Dialogue breakdown detection is a promising technique in dialogue systems. To promote the research and development of such a technique, we organized a dialogue breakdown detection challenge where the task is to detect a system’s inappropriate utterances that lead to dialogue breakdowns in chat. This paper describes the design, datasets, and evaluation metrics for the challenge as well as the methods and results of the submitted runs of the participants. 
Highly Cited
This paper has 23 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.

Explore Further: Topics Discussed in This Paper

Citations

Publications citing this paper.
Showing 1-10 of 17 extracted citations

Improving Dialogue Continuity using Inter-Robot Interaction

2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) • 2018
View 3 Excerpts

References

Publications referenced by this paper.
Showing 1-10 of 19 references

A breakdown detection method based on taxonomy of errors in chat-oriented dialogue

T. Horii, M. Araki
In JSAI Technical Report (SIG-SLUD-75-B502), • 2015
View 1 Excerpt

Chat-oriented dialogue breakdown detection based on combination of various data

H. Sugiyama
In JSAI Technical Report (SIG-SLUD-75-B502), • 2015
View 1 Excerpt

Construction of automatic detector for dialogue breakdowns based on rules with keywords extraction

R. Taniguchi, Y. Kano
In JSAI Technical Report (SIG-SLUD-75-B502), • 2015
View 1 Excerpt

Construction of rnnbsed dialogue breakdown detector

M. Mizukami, K. Sugiyama, +3 authors S. Nakamura
In JSAI Technical Report (SIG-SLUD-75-B502), • 2015
View 1 Excerpt

Dialogue breakdown detection using long short-term memory recurrent neural network

M. Inaba, K. Takahashi
In JSAI Technical Report (SIG-SLUD-75B502), • 2015
View 1 Excerpt

Multitask learning of recurrent neural network for detecting breakdowns of dialog and language modeling

S. Kobayashi, Y. Unno, M. Fukuda
In JSAI Technical Report (SIG-SLUD-75-B502), • 2015
View 1 Excerpt

Similar Papers

Loading similar papers…