Reference-Aware Language Models

@inproceedings{Yang2016ReferenceAwareLM,
  title={Reference-Aware Language Models},
  author={Zichao Yang and Phil Blunsom and Chris Dyer and Wang Ling},
  booktitle={EMNLP},
  year={2016}
}
  • Zichao Yang, Phil Blunsom, +1 author Wang Ling
  • Published in EMNLP 2016
  • Computer Science
  • We propose a general class of language models that treat reference as an explicit stochastic latent variable. This architecture allows models to create mentions of entities and their attributes by accessing external databases (required by, e.g., dialogue generation and recipe generation) and internal state (required by, e.g. language models which are aware of coreference). This facilitates the incorporation of information that can be accessed in predictable locations in databases or discourse… CONTINUE READING

    Create an AI-powered research feed to stay up to date with new papers like this posted to ArXiv

    Citations

    Publications citing this paper.
    SHOWING 1-10 OF 49 CITATIONS

    Entity Decisions in Neural Language Modelling: Approaches and Problems

    VIEW 5 EXCERPTS
    CITES RESULTS, METHODS & BACKGROUND
    HIGHLY INFLUENCED

    Neural Language Models with Explicit Coreference Decision

    VIEW 4 EXCERPTS
    CITES METHODS
    HIGHLY INFLUENCED

    Challenges in Data-to-Document Generation

    VIEW 7 EXCERPTS
    CITES METHODS & BACKGROUND
    HIGHLY INFLUENCED

    Enhanced Transformer Model for Data-to-Text Generation

    VIEW 4 EXCERPTS
    CITES BACKGROUND & METHODS
    HIGHLY INFLUENCED

    TOWARD CONTROLLABLE TEXT CONTENT MANIPU-

    • 2019
    VIEW 5 EXCERPTS
    CITES BACKGROUND & METHODS
    HIGHLY INFLUENCED

    Toward Unsupervised Text Content Manipulation

    VIEW 5 EXCERPTS
    CITES BACKGROUND & METHODS

    References

    Publications referenced by this paper.
    SHOWING 1-10 OF 27 REFERENCES

    Neural Machine Translation by Jointly Learning to Align and Translate

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL

    Long Short-Term Memory

    VIEW 10 EXCERPTS
    HIGHLY INFLUENTIAL

    A Neural Knowledge Language Model

    VIEW 3 EXCERPTS
    HIGHLY INFLUENTIAL

    A Network-based End-to-End Trainable Task-oriented Dialogue System

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL

    Deep Reinforcement Learning for Dialogue Generation

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL

    Pointer Sentinel Mixture Models

    VIEW 2 EXCERPTS
    HIGHLY INFLUENTIAL

    Neural Responding Machine for Short-Text Conversation

    VIEW 4 EXCERPTS
    HIGHLY INFLUENTIAL