Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems
@article{Madotto2020LanguageMA, title={Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems}, author={Andrea Madotto and Zihan Liu}, journal={ArXiv}, year={2020}, volume={abs/2008.06239} }
Task-oriented dialogue systems use four connected modules, namely, Natural Language Understanding (NLU), a Dialogue State Tracking (DST), Dialogue Policy (DP) and Natural Language Generation (NLG). A research challenge is to learn each module with the least amount of samples (i.e., few-shots) given the high cost related to the data collection. The most common and effective technique to solve this problem is transfer learning, where large language models, either pre-trained on text or task… CONTINUE READING
Figures and Tables from this paper
3 Citations
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems
- Computer Science
- EMNLP
- 2020
- 3
- PDF
TicketTalk: Toward human-level performance with end-to-end, transaction-based dialog systems
- Computer Science
- ArXiv
- 2020
- 1
- PDF
Language Model is All You Need: Natural Language Understanding as Question Answering
- Computer Science
- ArXiv
- 2020
- 2
- PDF
References
SHOWING 1-10 OF 26 REFERENCES
Few-shot Natural Language Generation for Task-Oriented Dialog
- Computer Science
- EMNLP
- 2020
- 30
- Highly Influential
- PDF
Meta-Learning for Low-resource Natural Language Generation in Task-oriented Dialogue Systems
- Computer Science
- IJCAI
- 2019
- 38
- PDF
ToD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogues
- Computer Science
- EMNLP
- 2020
- 24
- Highly Influential
- PDF
Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systems
- Computer Science
- ACL
- 2019
- 115
- PDF
SOLOIST: Few-shot Task-Oriented Dialog with A Single Pre-trained Auto-regressive Model
- Computer Science
- ArXiv
- 2020
- 29
- Highly Influential
- PDF
MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselines
- Computer Science
- NLP4CONVAI
- 2020
- 13
- PDF