Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets

@article{Liu2019InoculationBF,
  title={Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets},
  author={Nelson F. Liu and Roy Schwartz and Noah A. Smith},
  journal={CoRR},
  year={2019},
  volume={abs/1904.02668}
}
Several datasets have recently been constructed to expose brittleness in models trained on existing benchmarks. While model performance on these challenge datasets is significantly lower compared to the original benchmark, it is unclear what particular weaknesses they reveal. For example, a challenge dataset may be difficult because it targets phenomena that current models cannot capture, or because it simply exploits blind spots in a model’s specific training set. We introduce inoculation by… CONTINUE READING
Tweets
This paper has been referenced on Twitter 27 times. VIEW TWEETS

From This Paper

Figures and tables from this paper.

Citations

Publications citing this paper.

References

Publications referenced by this paper.
SHOWING 1-10 OF 19 REFERENCES

Similar Papers

Loading similar papers…