An attention-based multi-task model for named entity recognition and intent analysis of Chinese online medical questions

被引:25
作者
Wu, Chaochen [1 ]
Luo, Guan [1 ]
Guo, Chao [2 ]
Ren, Yin [3 ]
Zheng, Anni [1 ]
Yang, Cheng [1 ]
机构
[1] Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] CAMS & PUMC, Dept Cardiol, Fuwai Hosp, Beijing 100037, Peoples R China
[3] Univ Chinese Acad Sci, 19A Yuquan Rd, Beijing 100049, Peoples R China
关键词
Natural language processing; Deep learning; Multi-task learning; Named entity recognition; Intent analysis; Interpretability;
D O I
10.1016/j.jbi.2020.103511
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose an attention-based multi-task neural network model for text classification and sequence tagging and then apply it to the named entity recognition and the intent analysis of Chinese online medical questions. We found that the use of both attention and multi-task learning improved the performance of these tasks. Our method achieved superior performance in named entity recognition and intent analysis compared with other baseline methods; the method is a light-weight solution that is suitable for deployment on small servers. Furthermore, we took advantage of the model's capabilities for these two tasks and built a simple question-answering system for cardiovascular issues. Users and service providers can monitor the logic of the answers generated by this system.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Ren, Lu
    Xu, Bo
    Lin, Hongfei
    Yang, Liang
    SOFT COMPUTING, 2021, 25 (22) : 14109 - 14118
  • [32] Attention-based interactive multi-level feature fusion for named entity recognition
    Xu, Yiwu
    Chen, Yun
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [33] ABML: attention-based multi-task learning for jointly humor recognition and pun detection
    Lu Ren
    Bo Xu
    Hongfei Lin
    Liang Yang
    Soft Computing, 2021, 25 : 14109 - 14118
  • [34] Attention-Based Multi-Task Learning in Pharmacovigilance
    Zhang, Shinan
    Dev, Shantanu
    Voyles, Joseph
    Rao, Anand S.
    PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 2324 - 2328
  • [35] ZH-NER: Chinese Named Entity Recognition with Adversarial Multi-task Learning and Self-Attentions
    Zhu, Peng
    Cheng, Dawei
    Yang, Fangzhou
    Luo, Yifeng
    Qian, Weining
    Zhou, Aoying
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT II, 2021, 12682 : 603 - 611
  • [36] An Attention-Based ID-CNNs-CRF Model for Named Entity Recognition on Clinical Electronic Medical Records
    Gao, Ming
    Xiao, Qifeng
    Wu, Shaochun
    Deng, Kun
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 : 231 - 242
  • [37] Multi-task Attention-Based Semi-supervised Learning for Medical Image Segmentation
    Chen, Shuai
    Bortsova, Gerda
    Juarez, Antonio Garcia-Uceda
    van Tulder, Gijs
    de Bruijne, Marleen
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 : 457 - 465
  • [38] Named Entity Recognition for Few-Shot Power Dispatch Based on Multi-Task
    Tan, Zhixiang
    Chen, Yan
    Liang, Zengfu
    Meng, Qi
    Lin, Dezhao
    ELECTRONICS, 2023, 12 (16)
  • [39] Complex Named Entity Recognition via Deep Multi-task Learning from Scratch
    Chen, Guangyu
    Liu, Tao
    Zhang, Deyuan
    Yu, Bo
    Wang, Baoxun
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT I, 2018, 11108 : 221 - 233
  • [40] TaughtNet: Learning Multi-Task Biomedical Named Entity Recognition From Single-Task Teachers
    Moscato, Vincenzo
    Postiglione, Marco
    Sansone, Carlo
    Sperli, Giancarlo
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (05) : 2512 - 2523