Analogs of Linguistic Structure in Deep Representations

@inproceedings{Andreas2017AnalogsOL,
  title={Analogs of Linguistic Structure in Deep Representations},
  author={Jacob Andreas and Dan Klein},
  booktitle={EMNLP},
  year={2017}
}
We investigate the compositional structure of message vectors computed by a deep network trained on a communication game. By comparing truth-conditional representations of encoder-produced message vectors to human-produced referring expressions, we are able to identify aligned (vector, utterance) pairs with the same meaning. We then search for structured relationships among these aligned pairs to discover simple vector space transformations corresponding to negation, conjunction, and… CONTINUE READING
28
Twitter Mentions

Similar Papers

Figures, Tables, and Topics from this paper.