Sam Bowman

Publications32
h-index4
Citations149
Highly Influential Citations26
Claim Author Page
Author pages are created from data sourced from our academic publisher partnerships and public sources.

Recommended Authors

  • Samuel R. Bowman
  • 93 Publications • 14,719 Citations
  • Yejin Choi
  • 227 Publications • 17,858 Citations
  • Luke Zettlemoyer
  • 224 Publications • 38,657 Citations
  • Nikita Nangia
  • 17 Publications • 3,005 Citations
  • Publications
  • Influence
Universal Dependencies 2.1
TLDR
The annotation scheme is based on (universal) Stanford dependencies, Google universal part-of-speech tags, and the Interset interlingua for morphosyntactic tagsets for morpho-lingual tagsets.
BBQ: A hand-built bias benchmark for question answering
TLDR
The Bias Benchmark for QA (BBQ), a dataset consisting of question-sets constructed by the authors that highlight attested social biases against people belonging to protected classes along nine different social dimensions relevant for U.S. English-speaking contexts, is introduced.
Crowdsourcing Beyond Annotation: Case Studies in Benchmark Data Collection
TLDR
This tutorial exposes NLP researchers to data collection crowdsourcing methods and principles that were carefully designed to achieve data with specific properties, for example to require logical inference, grounded reasoning or conversational understanding.
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
TLDR
It is found that asking workers to write explanations for their examples is an ineffective stand-alone strategy for boosting NLU example difficulty and that training crowdworkers, and then using an iterative process of collecting data, sending feedback, and qualifying workers based on expert judgments is an effective means of collecting challenging data.
Comparing Test Sets with Item Response Theory
TLDR
Quoref, HellaSwag, and MC-TACO are best suited for distinguishing among state-of-the-art models, while SNLI, MNLI, and CommitmentBank seem to be saturated for current strong models.
QuALITY: Question Answering with Long Input Texts, Yes!
TLDR
QuALITY, a multiple-choice QA dataset with context passages in English that have an average length of about 5,000 tokens, much longer than typical current models can process, is introduced to enable building and testing models on long-document comprehension.
NOPE: A Corpus of Naturally-Occurring Presuppositions in English
TLDR
This work introduces the Naturally-Occurring Presuppositions in English (NOPE) Corpus to investigate the context-sensitivity of 10 different types of presupposition triggers and to evaluate machine learning models’ ability to predict human inferences.
The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail
Researchers in NLP often frame and discuss research results in ways that serve to deemphasize the field’s successes, often in response to the field’s widespread hype. Though well-meaning, this has…
Reworking old vines in NSW
Mid-row and under-vine options
...
1
2
3
4
...