WINOGRANDE: An Adversarial Winograd Schema Challenge at Scale

@article{Sakaguchi2019WINOGRANDEAA,
  title={WINOGRANDE: An Adversarial Winograd Schema Challenge at Scale},
  author={Keisuke Sakaguchi and Ronan Le Bras and Chandra Bhagavatula and Yejin Choi},
  journal={ArXiv},
  year={2019},
  volume={abs/1907.10641}
}
The Winograd Schema Challenge (WSC), proposed by Levesque et al. (2011) as an alternative to the Turing Test, was originally designed as a pronoun resolution problem that cannot be solved based on statistical patterns in large text corpora. However, recent studies suggest that current WSC datasets, even when composed carefully by experts, are still prone to such biases that statistical methods can exploit. We introduce WINOGRANDE, a new collection of WSC problems that are adversarially… CONTINUE READING