A Comparative Evaluation of QA Systems over List Questions

被引：1

作者：

Goncalves, Patricia Nunes ^{[1
]}

Branco, Antonio Horta ^{[1
]}

机构：

[1] Univ Lisbon, Dept Informat, Fac Ciencias Campo Grande, Edificio C6, P-1749016 Lisbon, Portugal

来源：

COMPUTATIONAL PROCESSING OF THE PORTUGUESE LANGUAGE (PROPOR 2016) | 2016年 / 9727卷

关键词：

QA Systems; List questions; Evaluation QA;

D O I：

10.1007/978-3-319-41552-9_11

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

The evaluation of a Question Answering system is a challenging task. In this paper we evaluate our system, LX-ListQuestion, a Web-based QA System that focuses on answering list questions. We compare our system against other QA Systems and the results were analyzed in two ways: (i) the quantitative evaluation of answers provides recall, precision and F-measure and (ii) the question coverage that indicate the usefulness of the system to the user by counting the number of questions for which the system provides at least one correct answer. The evaluation brings interesting results that points to a certain degree of complementary between different approaches.

引用

页码：115 / 121

页数：7

共 11 条

[1]

Branco A, 2008, LECT NOTES ARTIF INT, V5190, P232, DOI 10.1007/978-3-540-85980-2_27

[2]

Branco A, 2008, LECT NOTES COMPUT SC, V5290, P322, DOI 10.1007/978-3-540-88309-8_33

[3]

FERREIRA EDUARDO., 2007, Proceedings of the Workshop em Tecnologia da Informacao e de Linguagem Natural, P1615

[4]

Freitas C, 2012, LINGUAMATICA, V4, P9

[5]

Goncalves P., 2014, P 4 INT C WEBINTELLI

[6]

Goncalves P. P., 2015, THESIS

[7]

GONCALVES PATRICIA., 2014, Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics, P81

[8]

Radev D. R., 2002, LREC CITESEER, P1153

[9]

Rodrigues R, 2012, LINGUAMATICA, V4, P31

[10]

STRZALKOWSKI T, 2007, ADV OPEN DOMAIN QUES

← 1 2 →