Social IQA: Commonsense Reasoning about Social Interactions

@inproceedings{Sap2019SocialIC,
  title={Social IQA: Commonsense Reasoning about Social Interactions},
  author={Maarten Sap and Hannah Rashkin and Derek Chen and Ronan Le Bras and Yejin Choi},
  booktitle={EMNLP 2019},
  year={2019}
}
We introduce Social IQa, the first largescale benchmark for commonsense reasoning about social situations. Social IQa contains 38,000 multiple choice questions for probing emotional and social intelligence in a variety of everyday situations (e.g., Q: "Jordan wanted to tell Tracy a secret, so Jordan leaned towards Tracy. Why did Jordan do this?" A: "Make sure no one else could hear"). Through crowdsourcing, we collect commonsense questions along with correct and incorrect answers about social… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 13 CITATIONS

EntEval: A Holistic Evaluation Benchmark for Entity Representations

VIEW 2 EXCERPTS
CITES BACKGROUND

References

Publications referenced by this paper.
SHOWING 1-10 OF 40 REFERENCES

Choice of plausible alternatives: An evaluation of commonsense causal reasoning

  • Melissa Roemmele, Cosmin Adrian Bejan, Andrew S. Gordon.
  • AAAI Spring Symposium: Logical Formalizations of Commonsense Reasoning.
  • 2011
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Language Models are Unsupervised Multitask Learners

VIEW 1 EXCERPT
HIGHLY INFLUENTIAL

Annotation Artifacts in Natural Language Inference Data

VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Improving Language Understanding by Generative Pre-Training

VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Resolving Complex Cases of Definite Pronouns: The Winograd Schema Challenge

VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

The Winograd Schema Challenge

VIEW 6 EXCERPTS
HIGHLY INFLUENTIAL