Do NLP Models Know Numbers? Probing Numeracy in Embeddings

@inproceedings{Wallace2019DoNM,
  title={Do NLP Models Know Numbers? Probing Numeracy in Embeddings},
  author={Eric Wallace and Yizhong Wang and Sujian Li and Sameer Singh and Matt Gardner},
  booktitle={EMNLP/IJCNLP},
  year={2019}
}
The ability to understand and work with numbers (numeracy) is critical for many complex reasoning tasks. Currently, most NLP models treat numbers in text in the same way as other tokens---they embed them as distributed vectors. Is this enough to capture numeracy? We begin by investigating the numerical reasoning capabilities of a state-of-the-art question answering model on the DROP dataset. We find this model excels on questions that require numerical reasoning, i.e., it already captures… CONTINUE READING

Citations

Publications citing this paper.

References

Publications referenced by this paper.
SHOWING 1-10 OF 29 REFERENCES

Neural Arithmetic Logic Units

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL