In this paper we draw a balance of GikiCLEF as far as its appropriateness for the evaluation of GIR systems is concerned. We measure its degree of dealing with geographic matter, and offer GIRA, the final resource, for GIR evaluation purposes.
In this paper we provide a full overview of GikiCLEF, an evaluation contest (track) that was specifically designed to expose and investigate cultural and linguistic issues involved in multimedia collections and searching. In GikiCLEF, 50 topics were developed by a multilingual team with non-English users in mind. Answers should be found in Wikipedia, but… (More)
In this paper we describe GikiCLEF, the first evaluation contest that, to our knowledge, was specifically designed to expose and investigate cultural and linguistic issues involved in multimedia collections and searching, and which was organized under the scope of CLEF 2009. We present the task, its motivation, the results of the participants and the GIRA… (More)
This overview paper is devoted to a critical assessment of GikiCLEF 2009, an evaluation contest specifically designed to expose and investigate cultural and linguistic issues in Wikipedia search, with eight participant systems and 17 runs. After providing a maximally short but self contained overview of the GikiCLEF task and participation, we present the… (More)
Merging different runs by analysing the result (3 to 6 runs) ¾Number of times an answer occurs in the results ¾The relevance of the support snippet regarding the question text ¾Automatic Selection achieves 55%-69% of the correct answers in the best possible selection ¾Combination of several runs did not produce better results than some of the individual… (More)
In this paper we describe SUPeRB, a digital librarian helper, which has two specific goals: update and maintain specific publication repositories; and assist in the publishing of publication records, for institutions and individual actors. It does this by gathering bibliographic data from web pages and documents in order to build a local repository of… (More)
Esfinge is a general domain Portuguese question answering system which uses the information available on the Web as an additional resource when searching for answers. Other external resources and tools used are a broad coverage parser, a morphological analyser, a named entity recognizer and a Web-based database of word co-occurrences. In this fourth… (More)
SUPeRB is a digital library helper that aims at updating and maintaining specific publication repositories, and assisting in the publishing of publication records, for institutions and individual actors. It gathers bibliographic data from Web pages and documents and integrates that data into a local repository of bibliographic data on a specific domain. By… (More)