• DOI:10.18653/v1/2020.emnlp-main.552
Corpus ID: 216867892

Asking without Telling: Exploring Latent Ontologies in Contextual Representations

@article{Michael2020AskingWT,
  title={Asking without Telling: Exploring Latent Ontologies in Contextual Representations},
  author={Julian Michael and Jan A. Botha and Ian Tenney},
  journal={ArXiv},
  year={2020},
  volume={abs/2004.14513}
}

Julian Michael, Jan A. Botha, Ian Tenney

Published 2020

Computer Science

ArXiv

The success of pretrained contextual encoders, such as ELMo and BERT, has brought a great deal of interest in what these models learn: do they, without explicit supervision, learn to encode meaningful notions of linguistic structure? If so, how is this structure encoded? To investigate this, we introduce latent subclass learning (LSL): a modification to existing classifier-based probing methods that induces a latent categorization (or ontology) of the probe's inputs. Without access to fine… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed