• Corpus ID: 20679535

Identifying Nominals with No Head Match Co-references Using Deep Learning

  title={Identifying Nominals with No Head Match Co-references Using Deep Learning},
  author={M. Stone and Rashmi Arora},
Identifying nominals with no head match is a long-standing challenge in coreference resolution with current systems performing significantly worse than humans. In this paper we present a new neural network architecture which outperforms the current state-of-the-art system on the English portion of the CoNLL 2012 Shared Task. This is done by using a logistic regression on features produced by two submodels, one of which is has the architecture proposed in [CM16a] while the other combines domain… 

Figures and Tables from this paper

Deep Exhaustive Model for Nested Named Entity Recognition
The results show that the model outperforms state-of-the-art models on nested and flat NER, achieving 77.1% and 78.4% respectively in terms of F-score, without any external knowledge resources.
A Neural Layered Model for Nested Named Entity Recognition
A novel neural model to identify nested entities by dynamically stacking flat NER layers that outperforms state-of-the-art feature-based systems on nested NER, achieving 74.7% and 72.2% on GENIA and ACE2005 datasets, respectively, in terms of F-score.


Improving Coreference Resolution by Learning Entity-Level Distributed Representations
A neural network based coreference system that produces high-dimensional vector representations for pairs of coreference clusters that learns when combining clusters is desirable and substantially outperforms the current state of the art on the English and Chinese portions of the CoNLL 2012 Shared Task dataset.
The Mention-Pair Model
  • Veronique Hoste
  • Computer Science
    Anaphora Resolution - Algorithms, Resources, and Applications
  • 2016
This chapter reviews the main building blocks of the mention-pair model: the construction of positive and negative instances and the related problem of data set skewness, the selection of informative features, and the choice of machine learner and clustering mechanism.
CoNLL-2012 Shared Task: Modeling Multilingual Unrestricted Coreference in OntoNotes
The OntoNotes annotation (coreference and other layers) is described and the parameters of the shared task including the format, pre-processing information, evaluation criteria, and presents and discusses the results achieved by the participating systems.
On Coreference Resolution Performance Metrics
The paper proposes a Constrained Entity-Alignment F-Measure (CEAF) for evaluating coreference resolution and shows that the best alignment is a maximum bipartite matching problem which can be solved by the Kuhn-Munkres algorithm.
The Life and Death of Discourse Entities: Identifying Singleton Mentions
A logistic regression model is built for predicting the singleton/coreferent distinction, drawing on linguistic insights about how discourse entity lifespans are affected by syntactic and semantic features.
A model-theoretic coreference scoring scheme
This note describes a scoring scheme for the coreference task in MUC6. It improves on the original approach by: (1) grounding the scoring scheme in terms of a model; (2) producing more intuitive
Algorithms for Scoring Coreference Chains
This paper presents several diierent scoring algorithms and detail their respective strengths and weaknesses for varying classes of processing and demonstrates that tasks like information extraction have very diiesrent needs from information retrieval in terms of how to score the performance of coreference annotation.
A Generative Entity-Mention Model for Linking Entities with Knowledge Base
This paper proposes a generative probabilistic model, called entity-mention model, which can leverage heterogenous entity knowledge (including popularity knowledge, name knowledge and context knowledge) for the entity linking task.
Deep reinforcement learning for mentionranking coreference models
  • In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing,
  • 2016
Readings in natural language processing. chapter Resolving Pronoun References, pages 339–352
  • 1986