Refined Answer Selection Method with Attentive Bidirectional Long Short-Term Memory Network and Self-Attention Mechanism for Intelligent Medical Service Robot

被引:10
作者
Wang, Deguang [1 ]
Liang, Ye [2 ]
Ma, Hengrui [1 ]
Xu, Fengqiang [1 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian 116028, Peoples R China
[2] Dalian Jiaotong Univ, Sch Comp Commun & Engn, Dalian 116028, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 05期
基金
中国国家自然科学基金;
关键词
answer selection; attentive bidirectional long short-term memory network; self-attention mechanism; artificial intelligence; natural language processing; medical service robot;
D O I
10.3390/app13053016
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Answer selection, as a crucial method for intelligent medical service robots, has become more and more important in natural language processing (NLP). However, there are still some critical issues in the answer selection model. On the one hand, the model lacks semantic understanding of long questions because of noise information in a question-answer (QA) pair. On the other hand, some researchers combine two or more neural network models to improve the quality of answer selection. However, these models focus on the similarity between questions and answers without considering background information. To this end, this paper proposes a novel refined answer selection method, which uses an attentive bidirectional long short-term memory (Bi-LSTM) network and a self-attention mechanism to solve these issues. First of all, this paper constructs the required knowledge-based text as background information and converts the questions and answers from words to vectors, respectively. Furthermore, the self-attention mechanism is adopted to extract the global features from the vectors. Finally, an attentive Bi-LSTM network is designed to address long-distance dependent learning problems and calculate the similarity between the question and answer with consideration of the background knowledge information. To verify the effectiveness of the proposed method, this paper constructs a knowledge-based QA dataset including multiple medical QA pairs and conducts a series of experiments on it. The experimental results reveal that the proposed approach could achieve impressive performance on the answer selection task and reach an accuracy of 71.4%, MAP of 68.8%, and decrease the BLUE indicator to 3.10.
引用
收藏
页数:16
相关论文
共 39 条
  • [31] Xu D., 2019, IEICE T FUNDAM ELE A, V1905, P10720
  • [32] Xu K, 2015, PR MACH LEARN RES, V37, P2048
  • [33] Yang Yi, 2015, P 2015 C EMP METH NA, P2013, DOI [10.18653/v1/d15-1237, DOI 10.18653/V1/D15-1237, 10.18653/v1/D15-1237]
  • [34] Ye D., 2018, P 3 IEEE INT C DATA, P18
  • [35] Yin W., 2016, Trans Assoc Comput Linguist, V4, P259, DOI [10.1162/tacl_a_00097, DOI 10.1162/TACLA00097]
  • [36] NAIRS: A Neural Attentive Interpretable Recommendation System
    Yu, Shuai
    Wang, Yongbo
    Yang, Min
    Li, Baocheng
    Qu, Qiang
    Shen, Jialie
    [J]. PROCEEDINGS OF THE TWELFTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM'19), 2019, : 786 - 789
  • [37] A Blockchain-Assisted Massive IoT Data Collection Intelligent Framework
    Zhang, Lupeng
    Li, Fengqi
    Wang, Pingchuan
    Su, Rui
    Chi, Zongzheng
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (16) : 14708 - 14722
  • [38] Chinese Medical Question Answer Matching Using End-to-End Character-Level Multi-Scale CNNs
    Zhang, Sheng
    Zhang, Xin
    Wang, Hui
    Cheng, Jiajun
    Li, Pei
    Ding, Zhaoyun
    [J]. APPLIED SCIENCES-BASEL, 2017, 7 (08):
  • [39] Zhuang Liu, 2021, Chinese Computational Linguistics: 20th China National Conference, CCL 2021, Proceedings. Lecture Notes in Computer Science, Lecture Notes in Artificial Intelligence (12869), P471, DOI 10.1007/978-3-030-84186-7_31