Data Set Used
In this paper we draw a balance of GikiCLEF as far as its appropriateness for the evaluation of GIR systems is concerned. We measure its degree of dealing with geographic matter, and offer GIRA, the final resource, for GIR evaluation purposes.
In this paper we provide a full overview of GikiCLEF, an evaluation contest (track) that was specifically designed to expose and investigate cultural and linguistic issues involved in multimedia collections and searching. In GikiCLEF, 50 topics were developed by a multilingual team with non-English users in mind. Answers should be found in Wikipedia, but… (More)
In this paper we describe GikiCLEF, the first evaluation contest that, to our knowledge, was specifically designed to expose and investigate cultural and linguistic issues involved in multimedia collections and searching, and which was organized under the scope of CLEF 2009. We present the task, its motivation, the results of the participants and the GIRA… (More)
This overview paper is devoted to a critical assessment of GikiCLEF 2009, an evaluation contest specifically designed to expose and investigate cultural and linguistic issues in Wikipedia search, with eight participant systems and 17 runs. After providing a maximally short but self contained overview of the GikiCLEF task and participation, we present the… (More)
Merging different runs by analysing the result (3 to 6 runs) ¾Number of times an answer occurs in the results ¾The relevance of the support snippet regarding the question text ¾Automatic Selection achieves 55%-69% of the correct answers in the best possible selection ¾Combination of several runs did not produce better results than some of the individual… (More)
Esfinge is a general domain Portuguese question answering system which uses the information available on the Web as an additional resource when searching for answers. Other external resources and tools used are a broad coverage parser, a morphological analyser, a named entity recognizer and a Web-based database of word co-occurrences. In this fourth… (More)
Esfinge is a general domain Portuguese question answering system that participated in the last four editions of CLEF. This system uses the Web as a fundamental resource in its architecture, using information redundancy rather than sophisticated annotations of the document collections to retrieve answers. In this paper we describe experiments that took as… (More)