Co-attention fusion based deep neural network for Chinese medical answer selection

被引:7
|
作者
Chen, Xichen [1 ]
Yang, Zuyuan [1 ]
Liang, Naiyao [1 ]
Li, Zhenni [1 ]
Sun, Weijun [1 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Answer selection; Chinese natural language processing; Co-attention fusion mechanism; Neural networks;
D O I
10.1007/s10489-021-02212-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chinese selection is one of the most important subtasks in Chinese medical question-answer system. To obtain the representations of question and answer, an attractive method is to use the attentive pooling based deep neural network. However, this method suffers from the over-pooling problem. It generates attentive information by only using the related medical keywords, and neglects the local semantic information of sentences. In this paper, a novel co-attention fusion based deep neural network method is proposed. Our method solves the over-pooling problem by fusing local semantic information with attentive information. Because of the usage of the fusion mechanism, the proposed method tends to obtain more useful information for pooling and produce better representations for question and answer. For comparison, we create a new Chinese medical answer selection dataset in the epilepsy theme (i.e., cEpilepsyQA), and our method performs much better than the state-of-the-art methods. Also, the proposed method gets competitive results on the public Chinese medical answer selection datasets: cMedQA v1.0 and v2.0.
引用
收藏
页码:6633 / 6646
页数:14
相关论文
共 50 条
  • [31] Multi-view rotating machinery fault diagnosis with adaptive co-attention fusion network
    Liu, Xiaorong
    Wang, Jie
    Meng, Sa
    Qiu, Xiwei
    Zhao, Guilin
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 122
  • [32] Co-attention network with label embedding for text classification
    Liu, Minqian
    Liu, Lizhao
    Cao, Junyi
    Du, Qing
    NEUROCOMPUTING, 2022, 471 : 61 - 69
  • [33] Dynamic Co-attention Network for Visual Question Answering
    Ebaid, Doaa B.
    Madbouly, Magda M.
    El-Zoghabi, Adel A.
    2021 8TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE (ISCMI 2021), 2021, : 125 - 129
  • [34] CCAN: Constraint Co-Attention Network for Instance Grasping
    Cai, Junhao
    Tao, Xuefeng
    Cheng, Hui
    Zhang, Zhanpeng
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 8353 - 8359
  • [35] Medical Named Entity Recognition Based on Multi-Feature and Co-Attention
    Xinning, L.I.U.
    Computer Engineering and Applications, 2024, 60 (06) : 188 - 198
  • [36] A novel co-attention computation block for deep learning based image co-segmentation
    Gong, Xiaopeng
    Liu, Xiabi
    Li, Yushuo
    Li, Huiyu
    IMAGE AND VISION COMPUTING, 2020, 101
  • [37] S2CANet: A self-supervised infrared and visible image fusion based on co-attention network
    Li, Dongyang
    Nie, Rencan
    Cao, Jinde
    Zhang, Gucheng
    Jin, Biaojian
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2024, 125
  • [38] A Static and Dynamic Co-attention Network for Social Recommendation
    Bian, Fan
    Yan, Lingyu
    Gao, Rong
    Zheng, Kunpeng
    Zhang, Yucheng
    Yang, Jie
    PROCEEDINGS OF THE THE 11TH IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS (IDAACS'2021), VOL 1, 2021, : 196 - 201
  • [39] TRAFMEL: Multimodal Entity Linking Based on Transformer Reranking and Multimodal Co-Attention Fusion
    Zhang, Xiaoming
    Meng, Kaikai
    Wang, Huiyong
    INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2024, 34 (06) : 973 - 997
  • [40] Multimodal Fusion with Co-Attention Networks for Fake News Detection
    Wu, Yang
    Zhan, Pengwei
    Zhang, Yunjian
    Wang, Liming
    Xu, Zhen
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2560 - 2569