WINOGRANDE: An Adversarial Winograd Schema Challenge at Scale

@inproceedings{Sakaguchi2020WINOGRANDEAA,
  title={WINOGRANDE: An Adversarial Winograd Schema Challenge at Scale},
  author={Keisuke Sakaguchi and Ronan Le Bras and Chandra Bhagavatula and Yejin Choi},
  booktitle={AAAI},
  year={2020}
}
The Winograd Schema Challenge (WSC), proposed by Levesque et al. (2011) as an alternative to the Turing Test, was originally designed as a pronoun resolution problem that cannot be solved based on statistical patterns in large text corpora. [...] Key Method Key to our approach is a novel adversarial filtering algorithm AFLITE for systematic bias reduction, combined with a careful crowdsourcing design. Despite the significant increase in training data, the performance of existing state-of-the-art methods remains…Expand
Precise Task Formalization Matters in Winograd Schema Evaluations
WinoWhy: A Deep Diagnosis of Essential Commonsense Knowledge for Answering Winograd Schema Challenge
A Review of Winograd Schema Challenge Datasets and Approaches
COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentences
G-DAug: Generative Data Augmentation for Commonsense Reasoning
An Analysis of Dataset Overlap on Winograd-Style Tasks
Unlearn Dataset Bias in Natural Language Inference by Fitting the Residual
Natural Perturbation for Robust Question Answering
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 50 REFERENCES
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference
A Simple Method for Commonsense Reasoning
Probing Neural Network Comprehension of Natural Language Arguments
...
1
2
3
4
5
...