• Publications
  • Influence
Attention is All you Need
TLDR
We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Expand
  • 13,192
  • 3243
  • PDF
Natural Questions: A Benchmark for Question Answering Research
TLDR
We present the Natural Questions corpus, a question answering data set. Expand
  • 249
  • 34
  • PDF
WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia
TLDR
We present WIKIREADING, a large-scale natural language understanding task and publicly-available dataset with 18 million instances. Expand
  • 101
  • 15
  • PDF
Coarse-to-Fine Question Answering for Long Documents
TLDR
We present a framework for question answering that can efficiently scale to longer documents while maintaining or even improving performance of state-of-the-art models. Expand
  • 104
  • 9
  • PDF
Neural Program Search: Solving Programming Tasks from Description and Examples
TLDR
We present a Neural Program Search, an algorithm to generate programs from natural language description and a small number of input/output examples with efficient search algorithm guided by a Seq2Tree model. Expand
  • 31
  • 7
  • PDF
Improving Neural Program Synthesis with Inferred Execution Traces
TLDR
We use the insight that if encoder-decoder neural networks can synthesize programs from input/output examples, they should also be able to infer execution traces. Expand
  • 17
  • 4
  • PDF
TensorFlow Estimators: Managing Simplicity vs. Flexibility in High-Level Machine Learning Frameworks
TLDR
We present a framework for specifying, training, evaluating, and deploying machine learning models, and provide a library of utilities designed to speed up experimentation with model architectures. Expand
  • 17
  • 2
  • PDF
NAPS: Natural Program Synthesis Dataset
TLDR
We present a program synthesis-oriented dataset consisting of human written problem statements and solutions for these problems, accompanied by input/output examples. Expand
  • 6
  • 1
  • PDF
Glutathione S‐transferase M1 modulates allergen‐induced NF‐κB activation in asthmatic airway epithelium
Glutathione S‐transferase M1 (GSTM1) is a phase II enzyme and regulator of inflammatory signaling in airway epithelial cells. We have found upregulation of neutrophilic airway inflammation in atopicExpand
  • 7
Hierarchical Question Answering for Long Documents
TLDR
We present a framework for question answering that can efficiently scale to longer documents while maintaining or even improving performance of state-of-the-art models. Expand
  • 13
  • PDF