• Computer Science
  • Published in ArXiv 2019

Not All Claims are Created Equal: Choosing the Right Approach to Assess Your Hypotheses

@article{Azer2019NotAC,
  title={Not All Claims are Created Equal: Choosing the Right Approach to Assess Your Hypotheses},
  author={Erfan Sadeqi Azer and Daniel Khashabi and Ashish Sabharwal and Dan Roth},
  journal={ArXiv},
  year={2019},
  volume={abs/1911.03850}
}
Empirical research in Natural Language Processing (NLP) has adopted a narrow set of principles for assessing hypotheses, relying mainly on p-value computation, which suffers from several known issues. While alternative proposals have been well-debated and adopted in other fields, they remain rarely discussed or used within the NLP community. We address this gap by contrasting various hypothesis assessment techniques, especially those not commonly used in the field (such as evaluations based on… CONTINUE READING

References

Publications referenced by this paper.
SHOWING 1-10 OF 35 REFERENCES