Co-attention fusion based deep neural network for Chinese medical answer selection

被引:7
|
作者
Chen, Xichen [1 ]
Yang, Zuyuan [1 ]
Liang, Naiyao [1 ]
Li, Zhenni [1 ]
Sun, Weijun [1 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Answer selection; Chinese natural language processing; Co-attention fusion mechanism; Neural networks;
D O I
10.1007/s10489-021-02212-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chinese selection is one of the most important subtasks in Chinese medical question-answer system. To obtain the representations of question and answer, an attractive method is to use the attentive pooling based deep neural network. However, this method suffers from the over-pooling problem. It generates attentive information by only using the related medical keywords, and neglects the local semantic information of sentences. In this paper, a novel co-attention fusion based deep neural network method is proposed. Our method solves the over-pooling problem by fusing local semantic information with attentive information. Because of the usage of the fusion mechanism, the proposed method tends to obtain more useful information for pooling and produce better representations for question and answer. For comparison, we create a new Chinese medical answer selection dataset in the epilepsy theme (i.e., cEpilepsyQA), and our method performs much better than the state-of-the-art methods. Also, the proposed method gets competitive results on the public Chinese medical answer selection datasets: cMedQA v1.0 and v2.0.
引用
收藏
页码:6633 / 6646
页数:14
相关论文
共 50 条
  • [1] Co-attention fusion based deep neural network for Chinese medical answer selection
    Xichen Chen
    Zuyuan Yang
    Naiyao Liang
    Zhenni Li
    Weijun Sun
    Applied Intelligence, 2021, 51 : 6633 - 6646
  • [2] An efficient co-Attention Neural Network for Social Recommendation
    Li, Munan
    Tei, Kenji
    Fukazawa, Yoshiaki
    2019 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE (WI 2019), 2019, : 34 - 42
  • [3] Co-attention Based Feature Fusion Network for Spam Review Detection on Douban
    Cai, Huanyu
    Yu, Ke
    Zhou, Yuhao
    Wu, Xiaofei
    NEURAL PROCESSING LETTERS, 2022, 54 (06) : 5251 - 5271
  • [4] Co-attention Based Feature Fusion Network for Spam Review Detection on Douban
    Huanyu Cai
    Ke Yu
    Yuhao Zhou
    Xiaofei Wu
    Neural Processing Letters, 2022, 54 : 5251 - 5271
  • [5] Group-wise Deep Object Co-Segmentation with Co-Attention Recurrent Neural Network
    Li, Bo
    Sun, Zhengxing
    Li, Qian
    Wu, Yunjie
    Hu, Anqi
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8518 - 8527
  • [6] Co-Attention Fusion Network for Multimodal Skin Cancer Diagnosis
    He, Xiaoyu
    Wang, Yong
    Zhao, Shuang
    Chen, Xiang
    PATTERN RECOGNITION, 2023, 133
  • [7] Multimodal Fusion with Co-attention Mechanism
    Li, Pei
    Li, Xinde
    PROCEEDINGS OF 2020 23RD INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2020), 2020, : 607 - 614
  • [8] A co-attention based multi-modal fusion network for review helpfulness prediction
    Ren, Gang
    Diao, Lei
    Guo, Fanjia
    Hong, Taeho
    INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (01)
  • [9] Encoder Fusion Network with Co-Attention Embedding for Referring Image Segmentation
    Feng, Guang
    Hu, Zhiwei
    Zhang, Lihe
    Lu, Huchuan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15501 - 15510
  • [10] Detecting Robust Co-Saliency with Recurrent Co-Attention Neural Network
    Li, Bo
    Sun, Zhengxing
    Tang, Lv
    Sun, Yunhan
    Shi, Jinlong
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 818 - 825