DefSent: Sentence Embeddings using Definition Sentences
- Hayato Tsukagoshi, Ryohei Sasano, Koichi Takeda
- Computer ScienceAnnual Meeting of the Association for…
- 10 May 2021
DefSent is a sentence embedding method that uses definition sentences from a word dictionary, which performs comparably on unsupervised semantics textual similarity (STS) tasks and slightly better on SentEval tasks than conventional methods.
Comparison and Combination of Sentence Embeddings Derived from Different Supervision Signals
- Hayato Tsukagoshi, Ryohei Sasano, Koichi Takeda
- Computer ScienceSTARSEM
- 7 February 2022
This paper focuses on two types of sentence embedding methods with similar architectures and tasks: one fine-tunes pre-trained language models on the natural language inference task, and the other fine- TSPs on word prediction task from its definition sentence, and investigates their properties.