Corpus ID: 236493282

Term Expansion and FinBERT fine-tuning for Hypernym and Synonym Ranking of Financial Terms

@article{Chopra2021TermEA,
  title={Term Expansion and FinBERT fine-tuning for Hypernym and Synonym Ranking of Financial Terms},
  author={Ankush Chopra and Sohom Ghosh},
  journal={ArXiv},
  year={2021},
  volume={abs/2107.13764}
}
Hypernym and synonym matching are one of the mainstream Natural Language Processing (NLP) tasks. In this paper, we present systems that attempt to solve this problem. We designed these systems to participate in the FinSim-3, a shared task of FinNLP workshop at IJCAI-2021. The shared task is focused on solving this problem for the financial domain. We experimented with various transformer based pre-trained embeddings by fine-tuning these for either classification or phrase similarity tasks. We… Expand

Figures and Tables from this paper

References

SHOWING 1-10 OF 26 REFERENCES
The FinSim-2 2021 Shared Task: Learning Semantic Similarities for the Financial Domain
The FinSim-2 is a second edition of FinSim Shared Task on Learning Semantic Similarities for the Financial Domain, colocated with the FinWeb workshop. FinSim-2 proposed the challenge to automaticallyExpand
The FinSim 2020 Shared Task: Learning Semantic Representations for the Financial Domain
The FinSim 2020 shared task, colocated with the FinNLP workshop, offered the challenge to automatically learn effective and precise semantic models for the financial domain. Going beyond the mereExpand
GOAT at the FinSim-2 task: Learning Word Representations of Financial Data with Customized Corpus
TLDR
The experimental results demonstrate that these customized word embeddings can effectively improve the classification performance and achieve better results than the direct utilization of the provided word embedDings. Expand
Anuj at the FinSim Task: Anuj@FINSIM¡VLearning Semantic Representation of Financial Domain with Investopedia
TLDR
A hybrid approach that uses various NLP, machine learning, and deep learning models to develop a financial terms classifier is explained and use of a financial domain encyclopedia called Investopedia is explained to enrich terms for better context. Expand
FINSIM20 at the FinSim Task: Making Sense of Text in Financial Domain
TLDR
This paper tackles the FinSim 2020 shared task at IJCAIPRICAI 2020 with a semantic model which can automatically classify short phrases/terms from financial domain into the most relevant hypernym (or top-level) concept in an external ontology. Expand
IITK at the FinSim Task: Hypernym Detection in Financial Domain via Context-Free and Contextualized Word Embeddings
TLDR
This paper presents the approaches for the FinSim 2020 shared task on "Learning Semantic Representations for the Financial Domain", to classify financial terms into the most relevant hypernym (or top-level) concept in an external ontology. Expand
L3i_LBPAM at the FinSim-2 task: Learning Financial Semantic Similarities with Siamese Transformers
TLDR
The proposed methods outperformed the authors' baselines and proved the robustness of the models based on textual similarity siamese network. Expand
SemEval-2018 Task 9: Hypernym Discovery
TLDR
This paper put forward this task as a complementary benchmark for modeling hypernymy, a problem which has traditionally been cast as a binary classification task, taking a pair of candidate words as input. Expand
TCS_WITM_2021 @FinSim-2: Transformer based Models for Automatic Classification of Financial Terms
TLDR
A transformer-based BERT architecture that captures such contextual information from a set of domain specific raw documents and then performs a classification task to segregate domain terms into fixed number of class labels is proposed. Expand
SemEval-2016 Task 14: Semantic Taxonomy Enrichment
TLDR
Only one participating system outperformed the second, morecompetitive baseline that attaches a new term to the first word in its gloss with the appropriate part of speech, which indicates that techniques must be adapted to exploit the structure of glosses. Expand
...
1
2
3
...