An attention-based multi-task model for named entity recognition and intent analysis of Chinese online medical questions

被引:26
|
作者
Wu, Chaochen [1 ]
Luo, Guan [1 ]
Guo, Chao [2 ]
Ren, Yin [3 ]
Zheng, Anni [1 ]
Yang, Cheng [1 ]
机构
[1] Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] CAMS & PUMC, Dept Cardiol, Fuwai Hosp, Beijing 100037, Peoples R China
[3] Univ Chinese Acad Sci, 19A Yuquan Rd, Beijing 100049, Peoples R China
关键词
Natural language processing; Deep learning; Multi-task learning; Named entity recognition; Intent analysis; Interpretability;
D O I
10.1016/j.jbi.2020.103511
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose an attention-based multi-task neural network model for text classification and sequence tagging and then apply it to the named entity recognition and the intent analysis of Chinese online medical questions. We found that the use of both attention and multi-task learning improved the performance of these tasks. Our method achieved superior performance in named entity recognition and intent analysis compared with other baseline methods; the method is a light-weight solution that is suitable for deployment on small servers. Furthermore, we took advantage of the model's capabilities for these two tasks and built a simple question-answering system for cardiovascular issues. Users and service providers can monitor the logic of the answers generated by this system.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] An Attention-Based Approach for Chemical Compound and Drug Named Entity Recognition
    Yang P.
    Yang Z.
    Luo L.
    Lin H.
    Wang J.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2018, 55 (07): : 1548 - 1556
  • [42] Attention-based Multi-task Learning for Sensor Analytics
    Chen, Yujing
    Rangwala, Huzefa
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2187 - 2196
  • [43] A neural network multi-task learning approach to biomedical named entity recognition
    Gamal Crichton
    Sampo Pyysalo
    Billy Chiu
    Anna Korhonen
    BMC Bioinformatics, 18
  • [44] IMPROVING BIOMEDICAL NAMED ENTITY RECOGNITION WITH A UNIFIED MULTI-TASK MRC FRAMEWORK
    Tong, Yiqi
    Zhuang, Fuzhen
    Wang, Deqing
    Ying, Haochao
    Wang, Binling
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8332 - 8336
  • [45] Multi-Task Learning for Chemical Named Entity Recognition with Chemical Compound Paraphrasing
    Watanabe, Taiki
    Tamura, Akihiro
    Ninomiya, Takashi
    Makino, Takuya
    Iwakura, Tomoya
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6244 - 6249
  • [46] A neural network multi-task learning approach to biomedical named entity recognition
    Crichton, Gamal
    Pyysalo, Sampo
    Chiu, Billy
    Korhonen, Anna
    BMC BIOINFORMATICS, 2017, 18
  • [47] Named Entity Recognition in Russian Using Multi-Task LSTM-CRF
    Mazitov D.
    Alimova I.
    Tutubalina E.
    Journal of Mathematical Sciences, 2023, 273 (4) : 595 - 604
  • [48] Named Entity Recognition of Chinese Text Based on Attention Mechanism
    Shen, Tong-Ping
    Dumlao, Menchita
    Meng, Qing-Quan
    Zhan, Zhong-Hua
    Journal of Network Intelligence, 2023, 8 (02): : 505 - 518
  • [49] Medical Named Entity Recognition Based on Multi-Feature and Co-Attention
    Xinning, L.I.U.
    Computer Engineering and Applications, 2024, 60 (06) : 188 - 198
  • [50] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Ren, Lu
    Xu, Bo
    Lin, Hongfei
    Yang, Liang
    SOFT COMPUTING, 2021, 25 (22) : 14109 - 14118