A Comparative Evaluation of QA Systems over List Questions

  title={A Comparative Evaluation of QA Systems over List Questions},
  author={Patr{\'i}cia Nunes Gonçalves and Ant{\'o}nio Horta Branco},
The evaluation of a Question Answering system is a challenging task. In this paper we evaluate our system, LX-ListQuestion, a Web-based QA System that focuses on answering list questions. We compare our system against other QA Systems and the results were analyzed in two ways: (i) the quantitative evaluation of answers provides recall, precision and F-measure and (ii) the question coverage that indicate the usefulness of the system to the user by counting the number of questions for which the… 
1 Citations

When, Where, Who, What or Why? A Hybrid Model to Question Answering Systems

This work proposes a hybrid model that combines TF-IDF and word embedding in order to provide the answer type to text questions using small and large training sets, and shows that the proposed hybrid model statistically outperforms bag-of-words, TF- IDF, andword embedding approaches.



Open-Domain Web-Based List Question Answering with LX-ListQuestion

A QA Web Application, LX-ListQuestion that focuses on answering list questions where the answers are extracted and composed from several documents retrieved from the Web, exploits the redundancy of information available in the Internet, combined with word occurrence patterns to improve QA accuracy.

Evaluating Web-based Question Answering Systems

This paper presents a set of metrics that have been implemented in the authors' web-based Q&A system, namely NSIR, and shows the correlations between the different metrics.

Advances in Open Domain Question Answering

This book gives a comprehensive and detailed look at the current approaches to automated question answering, and will acquire in-depth practical knowledge of this critical new technology.

Real-Time Open-Domain QA on the Portuguese Web

This paper presents a system for real-time, open-domain question answering on the Web of documents written in Portuguese, prepared to handle factual questions and available as a freely accessible

Answering List Questions using Web as a corpus

This paper supports the demo of LXListQuestion, a Web Question Answering System that exploit the redundancy of information available in the Web to answer List Questions in the form of Word Cloud.

XisQuê: An Online QA Service for Portuguese

This paper describes XisQue, an online service for real-time, open-domain question answering (QA) on the Portuguese Web, which is described in detail in this paper.

Open-domain web-based multiple document : question answering for list questions with support for temporal restrictors

Tese de doutoramento, Informatica (Ciencias da Computacao), Universidade de Lisboa, Faculdade de Ciencias, 2015

Combining Rule-based and Statistical Methods for Named Entity Recognition in Portuguese

A tool for the recognition of expressions for named entities in Portuguese is presented that resorts to a rule-based approach when dealing with numbers, measures, time and addresses, and uses a hybrid approach when deals with names.

A lusofonia na Wikipédia em 150 tópicos

Este artigo descreve os topicos usados no Pagico, a primeira avaliacao conjunta em recolha de informacao centrada em topicos relacionados com a lusofonia, usando o material da Wikipedia em portugues.

Uma Abordagem ao Págico baseada no Processamento e Análise de Sintagmas dos Tópicos

Uma abordagem centrada na indexacao dos artigos da Wikipedia, na identificacao de sintagmas nas frases dos topicos dados, e no seu posterior processamento e analise, de forma a facilitar a correspondencia entre topicos e artigOS that lhes possam servir de resposta.