Corpus ID: 216868791

Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection

@article{Hardalov2020EnrichedPT,
  title={Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection},
  author={Momchil Hardalov and Ivan Koychev and Preslav Nakov},
  journal={ArXiv},
  year={2020},
  volume={abs/2004.14848}
}

Momchil Hardalov, Ivan Koychev, Preslav Nakov

Published 2020

Computer Science

ArXiv

Detecting the user's intent and finding the corresponding slots among the utterance's words are important tasks in natural language understanding. Their interconnected nature makes their joint modeling a standard part of training such models. Moreover, data scarceness and specialized vocabularies pose additional challenges. Recently, the advances in pre-trained language models, namely contextualized models such as ELMo and BERT have revolutionized the field by tapping the potential of training… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed