Hybrid query expansion using lexical resources and word embeddings for sentence retrieval in question answering

被引:96
作者
Esposito, Massimo [1 ]
Damiano, Ernanuele [1 ]
Minutolo, Aniello [1 ]
De Pietro, Giuseppe [1 ]
Fujita, Hamido [2 ]
机构
[1] Natl Res Council Italy, Inst High Performance Comp & Networking ICAR, Naples, Italy
[2] Iwate Prefecture Univ, Takizawa, Iwate, Japan
关键词
Query expansion; Question-answering; Information retrieval; Lexical resources; Word embeddings; Sentence retrieval;
D O I
10.1016/j.ins.2019.12.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Question Answering (QA) systems based on Information Retrieval return precise answers to natural language questions, extracting relevant sentences from document collections. However, questions and sentences cannot be aligned terminologically, generating errors in the sentence retrieval. In order to augment the effectiveness in retrieving relevant sentences from documents, this paper proposes a hybrid Query Expansion (QE) approach, based on lexical resources and word embeddings, for QA systems. In detail, synonyms and hypernyms of relevant terms occurring in the question are first extracted from MultiWordNet and, then, contextualized to the document collection used in the QA system. Finally, the resulting set is ranked and filtered on the basis of wording and sense of the question, by employing a semantic similarity metric built on the top of a Word2Vec model. This latter is locally trained on an extended corpus pertaining the same topic of the documents used in the QA system. This QE approach is implemented into an existing QA system and experimentally evaluated, with respect to different possible configurations and selected baselines, for the Italian language and in the Cultural Heritage domain, assessing its effectiveness in retrieving sentences containing proper answers to questions belonging to four different categories. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:88 / 105
页数:18
相关论文
共 53 条
[1]  
ALMasri Mohannad, 2016, Advances in Information Retrieval. 38th European Conference on IR Research, ECIR 2016. Proceedings
[2]  
LNCS 9626, P709, DOI 10.1007/978-3-319-30671-1_57
[3]  
[Anonymous], P IEEE WORLD C COMP
[4]  
[Anonymous], P INT WORKSH TEXT BA
[5]  
[Anonymous], 2013, NIPS
[6]  
[Anonymous], P NEU IR 16 SIGIR WO
[7]  
[Anonymous], P INT C INT INT MULT
[8]  
[Anonymous], 2017, INT C P2P PARALLEL G
[9]   A neural probabilistic language model [J].
Bengio, Y ;
Ducharme, R ;
Vincent, P ;
Jauvin, C .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (06) :1137-1155
[10]   Grounding proposition stores for question answering over linked data [J].
Cabaleiro, Bernardo ;
Penas, Anselmo ;
Manandhar, Suresh .
KNOWLEDGE-BASED SYSTEMS, 2017, 128 :34-42