An attention-based multi-task model for named entity recognition and intent analysis of Chinese online medical questions

被引:26
|
作者
Wu, Chaochen [1 ]
Luo, Guan [1 ]
Guo, Chao [2 ]
Ren, Yin [3 ]
Zheng, Anni [1 ]
Yang, Cheng [1 ]
机构
[1] Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] CAMS & PUMC, Dept Cardiol, Fuwai Hosp, Beijing 100037, Peoples R China
[3] Univ Chinese Acad Sci, 19A Yuquan Rd, Beijing 100049, Peoples R China
关键词
Natural language processing; Deep learning; Multi-task learning; Named entity recognition; Intent analysis; Interpretability;
D O I
10.1016/j.jbi.2020.103511
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose an attention-based multi-task neural network model for text classification and sequence tagging and then apply it to the named entity recognition and the intent analysis of Chinese online medical questions. We found that the use of both attention and multi-task learning improved the performance of these tasks. Our method achieved superior performance in named entity recognition and intent analysis compared with other baseline methods; the method is a light-weight solution that is suitable for deployment on small servers. Furthermore, we took advantage of the model's capabilities for these two tasks and built a simple question-answering system for cardiovascular issues. Users and service providers can monitor the logic of the answers generated by this system.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] MTAAL: Multi-Task Adversarial Active Learning for Medical Named Entity Recognition and Normalization
    Zhou, Baohang
    Cai, Xiangrui
    Zhang, Ying
    Guo, Wenya
    Yuan, Xiaojie
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14586 - 14593
  • [22] AERNs: Attention-Based Entity Region Networks for Multi-Grained Named Entity Recognition
    Dai, Jianghai
    Feng, Chong
    Bai, Xuefeng
    Dai, Jinming
    Zhang, Huanhuan
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 408 - 415
  • [23] Leveraging Multi-task Learning for Biomedical Named Entity Recognition
    Mehmood, Tahir
    Gerevini, Alfonso
    Lavelli, Alberto
    Serina, Ivan
    ADVANCES IN ARTIFICIAL INTELLIGENCE, AI*IA 2019, 2019, 11946 : 431 - 444
  • [24] Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism
    Gao, Wenchao
    Li, Yu
    Guan, Xiaole
    Chen, Shiyu
    Zhao, Shanshan
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [25] DAMTRNN: A Delta Attention-Based Multi-task RNN for Intention Recognition
    Chen, Weitong
    Yue, Lin
    Li, Bohan
    Wang, Can
    Sheng, Quan Z.
    ADVANCED DATA MINING AND APPLICATIONS, ADMA 2019, 2019, 11888 : 373 - 388
  • [26] Attention-based LSTM with Multi-task Learning for Distant Speech Recognition
    Zhang, Yu
    Zhang, Pengyuan
    Yan, Yonghong
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 3857 - 3861
  • [27] A multi-head adjacent attention-based pyramid layered model for nested named entity recognition
    Cui, Shengmin
    Joe, Inwhee
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (03): : 2561 - 2574
  • [28] A multi-head adjacent attention-based pyramid layered model for nested named entity recognition
    Shengmin Cui
    Inwhee Joe
    Neural Computing and Applications, 2023, 35 : 2561 - 2574
  • [29] An Attention-Based Approach for Mongolian News Named Entity Recognition
    Tan, Mingyan
    Bao, Feilong
    Gao, Guanglai
    Wang, Weihua
    CHINESE COMPUTATIONAL LINGUISTICS, CCL 2019, 2019, 11856 : 424 - 435
  • [30] Attention-based interactive multi-level feature fusion for named entity recognition
    Xu, Yiwu
    Chen, Yun
    SCIENTIFIC REPORTS, 2025, 15 (01):