Co-attention fusion based deep neural network for Chinese medical answer selection

被引:7
作者
Chen, Xichen [1 ]
Yang, Zuyuan [1 ]
Liang, Naiyao [1 ]
Li, Zhenni [1 ]
Sun, Weijun [1 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Answer selection; Chinese natural language processing; Co-attention fusion mechanism; Neural networks;
D O I
10.1007/s10489-021-02212-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chinese selection is one of the most important subtasks in Chinese medical question-answer system. To obtain the representations of question and answer, an attractive method is to use the attentive pooling based deep neural network. However, this method suffers from the over-pooling problem. It generates attentive information by only using the related medical keywords, and neglects the local semantic information of sentences. In this paper, a novel co-attention fusion based deep neural network method is proposed. Our method solves the over-pooling problem by fusing local semantic information with attentive information. Because of the usage of the fusion mechanism, the proposed method tends to obtain more useful information for pooling and produce better representations for question and answer. For comparison, we create a new Chinese medical answer selection dataset in the epilepsy theme (i.e., cEpilepsyQA), and our method performs much better than the state-of-the-art methods. Also, the proposed method gets competitive results on the public Chinese medical answer selection datasets: cMedQA v1.0 and v2.0.
引用
收藏
页码:6633 / 6646
页数:14
相关论文
共 50 条
  • [21] NEURAL NETWORK WORLD: A NEURAL NETWORK BASED SELECTION METHOD FOR GENETIC ALGORITHMS
    Yalkin, Can
    Korkmaz, Emin Erkan
    [J]. NEURAL NETWORK WORLD, 2012, 22 (06) : 495 - 510
  • [22] SAFNet: A deep spatial attention network with classifier fusion for breast cancer detection
    Lu, Si-Yuan
    Wang, Shui-Hua
    Zhang, Yu-Dong
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 148
  • [23] Attention-based encoder-decoder model for answer selection in question answering
    Yuan-ping Nie
    Yi Han
    Jiu-ming Huang
    Bo Jiao
    Ai-ping Li
    [J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18 : 535 - 544
  • [24] Attention-based encoder-decoder model for answer selection in question answering
    Nie, Yuan-ping
    Han, Yi
    Huang, Jiu-ming
    Jiao, Bo
    Li, Ai-ping
    [J]. FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2017, 18 (04) : 535 - 544
  • [25] Hierarchical Attention based Neural Network for Explainable Recommendation
    Cong, Dawei
    Zhao, Yanyan
    Qin, Bing
    Han, Yu
    Zhang, Murray
    Liu, Alden
    Chen, Nat
    [J]. ICMR'19: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2019, : 373 - 381
  • [26] LSTM-CRF Neural Network With Gated Self Attention for Chinese NER
    Jin, Yanliang
    Xie, Jinfei
    Guo, Weisi
    Luo, Can
    Wu, Dijia
    Wang, Rui
    [J]. IEEE ACCESS, 2019, 7 : 136694 - 136703
  • [27] Deep Hybrid Neural Network With Attention Mechanism for Video Hash Retrieval Method
    Wu, Kaixing
    Xu, Li
    [J]. IEEE ACCESS, 2023, 11 : 47956 - 47966
  • [28] Automated retinopathy of prematurity screening using deep neural network with attention mechanism
    Peng, Yuanyuan
    Zhu, Weifang
    Chen, Feng
    Xiang, Daoman
    Chen, Xinjian
    [J]. MEDICAL IMAGING 2020: IMAGE PROCESSING, 2021, 11313
  • [29] Refined Answer Selection Method with Attentive Bidirectional Long Short-Term Memory Network and Self-Attention Mechanism for Intelligent Medical Service Robot
    Wang, Deguang
    Liang, Ye
    Ma, Hengrui
    Xu, Fengqiang
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [30] Stacking-Based Deep Neural Network: Deep Analytic Network for Pattern Classification
    Low, Cheng-Yaw
    Park, Jaewoo
    Teoh, Andrew Beng-Jin
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (12) : 5021 - 5034