Deep Semantic Role Labeling: What Works and What's Next

@inproceedings{He2017DeepSR,
  title={Deep Semantic Role Labeling: What Works and What's Next},
  author={Luheng He and Kenton Lee and Mike Lewis and Luke Zettlemoyer},
  booktitle={ACL},
  year={2017}
}
We introduce a new deep learning model for semantic role labeling (SRL) that significantly improves the state of the art, along with detailed analyses to reveal its strengths and limitations. We use a deep highway BiLSTM architecture with constrained decoding, while observing a number of recent best practices for initialization and regularization. Our 8-layer ensemble model achieves 83.2 F1 on the CoNLL 2005 test set and 83.4 F1 on CoNLL 2012, roughly a 10% relative error reduction over the… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 188 CITATIONS

Machine Learning Models for Efficient and Robust Natural Language Processing

VIEW 6 EXCERPTS
CITES BACKGROUND, METHODS & RESULTS
HIGHLY INFLUENCED

Syntax-Aware Neural Semantic Role Labeling

VIEW 16 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS
HIGHLY INFLUENCED

Syntax-aware Neural Semantic Role Labeling with Supertags

VIEW 10 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Deep contextualized word representations

VIEW 6 EXCERPTS
CITES RESULTS, METHODS & BACKGROUND

Jointly Predicting Predicates and Arguments in Neural Semantic Role Labeling

VIEW 12 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS

Linguistically-Informed Self-Attention for Semantic Role Labeling

VIEW 15 EXCERPTS
CITES METHODS, BACKGROUND & RESULTS
HIGHLY INFLUENCED

Towards Semi-Supervised Learning for Deep Semantic Role Labeling

VIEW 15 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Aware LSTM model for Semantic Role Labeling

VIEW 8 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Deep Semantic Role Labeling with Self-Attention

VIEW 16 EXCERPTS
CITES RESULTS, METHODS & BACKGROUND
HIGHLY INFLUENCED

A Deep Bidirectional Highway Long Short-Term Memory Network Approach to Chinese Semantic Role Labeling

VIEW 6 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2016
2020

CITATION STATISTICS

  • 49 Highly Influenced Citations

  • Averaged 61 Citations per year from 2017 through 2019

  • 11% Increase in citations per year in 2019 over 2018

References

Publications referenced by this paper.
SHOWING 1-10 OF 30 REFERENCES

The Importance of Syntactic Parsing and Inference in Semantic Role Labeling

VIEW 9 EXCERPTS
HIGHLY INFLUENTIAL

Introduction to the conll-2005 shared task: Semantic role labeling

  • Xavier Carreras, Lluı́s Màrquez
  • In Proceedings of the Ninth Conference on Computational Natural Language Learning. Association for Computational Linguistics,
  • 2005
VIEW 4 EXCERPTS
HIGHLY INFLUENTIAL

A Theoretically Grounded Application of Dropout in Recurrent Neural Networks

VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Efficient Inference and Structured Learning for Semantic Role Labeling

VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Training Very Deep Networks

VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

ADADELTA: An Adaptive Learning Rate Method

VIEW 2 EXCERPTS
HIGHLY INFLUENTIAL