• Corpus ID: 17998146

A Distributional Approach to Evaluating Ontology Learning Methods Using a Gold Standard

@inproceedings{Zavitsanos2008ADA,
  title={A Distributional Approach to Evaluating Ontology Learning Methods Using a Gold Standard},
  author={Elias Zavitsanos and Georgios Paliouras},
  year={2008}
}
We use two gold ontologies and the corresponding datasets:1.Genia ontology: comprises 45 concepts from thedomain of molecular biology2.LonelyPlanet ontology: comprises 60 concepts from thetourism domainWe want to measure the scaling of the measures byintroducing errors in the gold ontologies and by comparingthe resulting ontologies to the original ones. 
Gold Standard Evaluation of Ontology Learning Methods through Ontology Transformation and Alignment
This paper presents a method along with a set of measures for evaluating learned ontologies against gold ontologies. The proposed method transforms the ontology concepts and their properties into a
Evaluating Semantic Classes Used for Ontology Building and Learning from Texts
TLDR
This paper proposes an approach to automatically evaluate semantic classes of ontologies that offer lexical entries for concepts, based on the comparative paradigm (to a gold standard), and focuses on the evaluation of semantic class acquisition considered as a main step in the ontology acquisition process.
Assessing Iterations of an Automated Ontology Evaluation Procedure
TLDR
The experiments show that the automated evaluation procedure is sensitive enough to detect a deterioration of the miner output quality, however, this sensitivity cannot be reliably qualified as similar to the behaviour of human experts as the latter seem to disagree themselves largely on which passages (and triples) are relevant or not.
A survey of ontology learning techniques and applications
TLDR
The process of ontological learning and further classification of ontology learning techniques into three classes (linguistics, statistical and logical) is described and many algorithms under each category are discussed.
A Synthesis Survey of Ontology Evaluation Tools, Applications and Methods to Propose a Novel Branch in Evaluating the Structure of Ontologies: Graph-Independent Approach
TLDR
This paper attempts to propose a novel branch in structural analysis of ontology through analyzing current methods, which is called Graph-independent approach.
A Semantic Lexicon-Based Approach for Sense Disambiguation and Its WWW Application
TLDR
This work proposes a basic framework for resolving sense disambiguation through the use of Semantic Lexicon, a machine readable dictionary managing both word senses and lexico-semantic relations, and shows that polysemy reduction can be used to hint about the meaning of specific senses in given contexts.
Semantic Lexicon-Based Multi-agent System for Web Resources Markup
TLDR
A hierarchical multi-agent system that exploits one (or more) Semantic Lexicon for performing semantic markup of Web resources is presented, and the proposed conceptual architecture has been applied to real-world scenarios for test purposes, obtaining promising results.
Ontology Population and Enrichment: State of the Art
TLDR
This chapter presents a survey of the most relevant methods, techniques and tools used for the task of ontology learning, explaining how BOEMIE addresses problems observed in existing systems and contributes to issues that are not frequently considered by existing approaches.
Reflecting on a Process to Automatically Evaluate Ontological Material Generated Automatically
TLDR
This paper presents a meta-analysis of an automated ontology evaluation procedure as it has been applied in earlier tests, and it goes without saying that many of the principles touched upon can be applied in the context of ontology Evaluation as such, irrespective of it being automated or not.
Fingerprinting Lexical Contexts over the Web
TLDR
A novel technique to consider web site anchortexts as lexicalized descriptions of an individual ontology organized in the form of a graph of concept words to identify lexical contexts across the Web.
...
1
2
...

References

SHOWING 1-10 OF 14 REFERENCES
On How to Perform a Gold Standard Based Evaluation of Ontology Learning
TLDR
This paper presents a new taxonomic measure which overcomes the problems of current approaches for the evaluation of concept hierarchies and shows that there exist some measures sufficient for evaluating the lexical term layer.
Golden Standard Based Ontology Evaluation Using Instance Assignment
TLDR
An ontology evaluation approach based on comparing an ontology to a gold standard ontology, assuming that both ontologies are constructed over the same set of instances is proposed.
Ontology Learning for the Semantic Web
TLDR
The authors present an ontology learning framework that extends typical ontology engineering environments by using semiautomatic ontology construction tools and encompasses ontology import, extraction, pruning, refinement and evaluation.
Metrics for Evaluation of Ontology-based Information Extraction
TLDR
This paper discusses existing evaluation metrics, and proposes a new method for evaluating the ontology population task, which is general enough to be used in a variety of situations, yet more precise than many current metrics.
Measuring Similarity between Ontologies
TLDR
A set of ontology similarity measures and a multiple-phase empirical evaluation are presented for measuring the similarity between ontologies for the task of detecting and retrieving relevant ontologies.
Discovering Subsumption Hierarchies of Ontology Concepts from Text Corpora
This paper proposes a method for learning ontologies given a corpus of text documents. The method identifies concepts in documents and organizes them into a subsumption hierarchy, without
Learning domain ontologies for semantic Web service descriptions
TLDR
This paper developed a framework for (semi-)automatic ontology learning from textual sources attached to Web services that exploits the fact that these sources are expressed in a specific sublanguage, making them amenable to automatic analysis.
Ontology mapping: the state of the art
TLDR
This article comprehensively reviews and provides insights on the pragmatics of ontology mapping and elaborate on a theoretical approach for defining ontology mapped.
Similarity for Ontologies - A Comprehensive Framework
TLDR
A comprehensive framework for measuring similarity within and between ontologies as a basis for the interoperability across various application fields is presented and validated with several practical case studies to prove benefits of applying the approach compared to traditional similarity measures.
On the variational distance of independently repeated experiments
  • R. Renner
  • Mathematics, Computer Science
    ArXiv
  • 2005
TLDR
It is shown that the variational distance between the n-fold product distributions P^n and Q^n cannot grow faster than the square root of n.
...
1
2
...