Confidence Modeling for Neural Semantic Parsing

@inproceedings{Quirk2018ConfidenceMF,
  title={Confidence Modeling for Neural Semantic Parsing},
  author={Chris Quirk and Mirella Lapata and Li Dong},
  booktitle={ACL},
  year={2018}
}
In this work we focus on confidence modeling for neural semantic parsers which are built upon sequence-to-sequence models. We outline three major causes of uncertainty, and design various metrics to quantify these factors. These metrics are then used to estimate confidence scores that indicate whether model predictions are likely to be correct. Beyond… CONTINUE READING