Refined Answer Selection Method with Attentive Bidirectional Long Short-Term Memory Network and Self-Attention Mechanism for Intelligent Medical Service Robot

被引:10
作者
Wang, Deguang [1 ]
Liang, Ye [2 ]
Ma, Hengrui [1 ]
Xu, Fengqiang [1 ]
机构
[1] Dalian Jiaotong Univ, Sch Software, Dalian 116028, Peoples R China
[2] Dalian Jiaotong Univ, Sch Comp Commun & Engn, Dalian 116028, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 05期
基金
中国国家自然科学基金;
关键词
answer selection; attentive bidirectional long short-term memory network; self-attention mechanism; artificial intelligence; natural language processing; medical service robot;
D O I
10.3390/app13053016
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Answer selection, as a crucial method for intelligent medical service robots, has become more and more important in natural language processing (NLP). However, there are still some critical issues in the answer selection model. On the one hand, the model lacks semantic understanding of long questions because of noise information in a question-answer (QA) pair. On the other hand, some researchers combine two or more neural network models to improve the quality of answer selection. However, these models focus on the similarity between questions and answers without considering background information. To this end, this paper proposes a novel refined answer selection method, which uses an attentive bidirectional long short-term memory (Bi-LSTM) network and a self-attention mechanism to solve these issues. First of all, this paper constructs the required knowledge-based text as background information and converts the questions and answers from words to vectors, respectively. Furthermore, the self-attention mechanism is adopted to extract the global features from the vectors. Finally, an attentive Bi-LSTM network is designed to address long-distance dependent learning problems and calculate the similarity between the question and answer with consideration of the background knowledge information. To verify the effectiveness of the proposed method, this paper constructs a knowledge-based QA dataset including multiple medical QA pairs and conducts a series of experiments on it. The experimental results reveal that the proposed approach could achieve impressive performance on the answer selection task and reach an accuracy of 71.4%, MAP of 68.8%, and decrease the BLUE indicator to 3.10.
引用
收藏
页数:16
相关论文
共 39 条
  • [1] Ahmed ST, 2023, IEEE INTERNET THINGS, V10, P18461, DOI [10.1007/978-981-99-6706-3_1, 10.1109/JIOT.2023.3243784]
  • [2] 6G enabled federated learning for secure IoMT resource recommendation and propagation analysis
    Ahmed, Syed Thouheed
    Kumar, V. Vinoth
    Singh, Krishna Kant
    Singh, Akansha
    Muthukumaran, V
    Gupta, Deepa
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2022, 102
  • [3] Bahdanau D., 2016, 3 INT C LEARN REPR I
  • [4] Bengio Y, 2001, ADV NEUR IN, V13, P932
  • [5] Co-attention fusion based deep neural network for Chinese medical answer selection
    Chen, Xichen
    Yang, Zuyuan
    Liang, Naiyao
    Li, Zhenni
    Sun, Weijun
    [J]. APPLIED INTELLIGENCE, 2021, 51 (10) : 6633 - 6646
  • [6] Collobert R, 2011, J MACH LEARN RES, V12, P2493
  • [7] Cu J.Y, 2020, STUDY ANSWER SELECTI
  • [8] Grail Q, 2021, 16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), P1792
  • [9] Non-Factoid Answer Selection in Indonesian Science Question Answering System using Long Short-Term Memory (LSTM)
    Hanifah, Alfi Fauzia
    Kusumaningrum, Retno
    [J]. 5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND COMPUTATIONAL INTELLIGENCE 2020, 2021, 179 : 736 - 746
  • [10] Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]