Question-Answering Pair Matching Based on Question Classification and Ensemble Sentence Embedding

被引:0
作者
Jang J.-S. [1 ]
Kwon H.-Y. [2 ]
机构
[1] Department of Computer Science and Engineering, Seoul National University of Science and Technology, Seoul
[2] Department of Industrial Engineering/Graduate School of Data Science, Seoul National University of Science and Technology, Seoul
来源
Computer Systems Science and Engineering | 2023年 / 46卷 / 03期
基金
新加坡国家研究基金会;
关键词
data augmentation; Question-answering; text classification model; text embedding;
D O I
10.32604/csse.2023.035570
中图分类号
学科分类号
摘要
Question-answering (QA) models find answers to a given question. The necessity of automatically finding answers is increasing because it is very important and challenging from the large-scale QA data sets. In this paper, we deal with the QA pair matching approach in QA models, which finds the most relevant question and its recommended answer for a given question. Existing studies for the approach performed on the entire dataset or datasets within a category that the question writer manually specifies. In contrast, we aim to automatically find the category to which the question belongs by employing the text classification model and to find the answer corresponding to the question within the category. Due to the text classification model, we can effectively reduce the search space for finding the answers to a given question. Therefore, the proposed model improves the accuracy of the QA matching model and significantly reduces the model inference time. Furthermore, to improve the performance of finding similar sentences in each category, we present an ensemble embedding model for sentences, improving the performance compared to the individual embedding models. Using real-world QA data sets, we evaluate the performance of the proposed QA matching model. As a result, the accuracy of our final ensemble embedding model based on the text classification model is 81.18%, which outperforms the existing models by 9.81%~14.16% point. Moreover, in terms of the model inference speed, our model is faster than the existing models by 2.61~5.07 times due to the effective reduction of search spaces by the text classification model. © 2023 CRL Publishing. All rights reserved.
引用
收藏
页码:3471 / 3489
页数:18
相关论文
共 50 条
  • [11] Sentence topics based knowledge acquisition for question answering
    Oh, Hyo-Jung
    Yun, Bo-Hyun
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2008, E91D (04): : 969 - 975
  • [12] Legal Knowledge Extraction for Knowledge Graph Based Question-Answering
    Sovrano, Francesco
    Palmirani, Monica
    Vitali, Fabio
    LEGAL KNOWLEDGE AND INFORMATION SYSTEMS, 2020, 334 : 143 - 153
  • [13] Evaluation of Question-Answering Based Text Summarization using LLM
    Ding, Junhua
    Huyen Nguyen
    Chen, Haihua
    2024 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE TESTING, AITEST, 2024, : 142 - 149
  • [14] Multi-sentence Question Segmentation and Compression for Question Answering
    Wang, Yixiu
    Wu, Yunfang
    Lv, Xueqiang
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2015, 2015, 9362 : 475 - 483
  • [15] Semantic computation in a Chinese Question-Answering system
    Sujian Li
    Jian Zhang
    Xiong Huang
    Shuo Bai
    Qun Liu
    Journal of Computer Science and Technology, 2002, 17 : 933 - 939
  • [16] Question-Answering with Logic Specific to Video Games
    Dumont, Corentin
    Tian, Ran
    Inui, Kentaro
    LREC 2016 - TENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2016, : 4637 - 4643
  • [17] Information selection strategies in question-answering tasks
    Cerdan, Raquel
    Gilabert, Ramiro
    Vidal-Abarca, Eduardo
    INFANCIA Y APRENDIZAJE, 2010, 33 (04): : 449 - 460
  • [18] The Design of Mobile Multimedia Question-Answering System
    Li, Jian-wei
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND SOFTWARE ENGINEERING (AISE 2014), 2014, : 546 - 551
  • [19] Question-Answering and Recommendation System on Cooking Recipes
    Manna, Riyanka
    Das, Dipankar
    Gelbukh, Alexander
    COMPUTACION Y SISTEMAS, 2021, 25 (01): : 223 - 235
  • [20] A Question-Answering Approach to Evaluating Legal Summaries
    Xu, Huihui
    Ashley, Kevin
    LEGAL KNOWLEDGE AND INFORMATION SYSTEMS, 2023, 379 : 293 - 298