An attention-based multi-task model for named entity recognition and intent analysis of Chinese online medical questions

被引：25

作者：

Wu, Chaochen ^{[1
]}

Luo, Guan ^{[1
]}

Guo, Chao ^{[2
]}

Ren, Yin ^{[3
]}

Zheng, Anni ^{[1
]}

Yang, Cheng ^{[1
]}

机构：

[1] Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China

[2] CAMS & PUMC, Dept Cardiol, Fuwai Hosp, Beijing 100037, Peoples R China

[3] Univ Chinese Acad Sci, 19A Yuquan Rd, Beijing 100049, Peoples R China

来源：

JOURNAL OF BIOMEDICAL INFORMATICS | 2020年 / 108卷 / 108期

关键词：

Natural language processing; Deep learning; Multi-task learning; Named entity recognition; Intent analysis; Interpretability;

D O I：

10.1016/j.jbi.2020.103511

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

In this paper, we propose an attention-based multi-task neural network model for text classification and sequence tagging and then apply it to the named entity recognition and the intent analysis of Chinese online medical questions. We found that the use of both attention and multi-task learning improved the performance of these tasks. Our method achieved superior performance in named entity recognition and intent analysis compared with other baseline methods; the method is a light-weight solution that is suitable for deployment on small servers. Furthermore, we took advantage of the model's capabilities for these two tasks and built a simple question-answering system for cardiovascular issues. Users and service providers can monitor the logic of the answers generated by this system.

引用

页数：6

共 50 条

[21] An Empirical Study of Multi-domain and Multi-task Learning in Chinese Named Entity Recognition
Hu, Yun
Liao, Mingxue
Lv, Pin
Zheng, Changwen
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: DEEP LEARNING, PT II, 2019, 11728 : 743 - 754
[22] Biomedical named entity recognition with the combined feature attention and fully-shared multi-task learning
Zhiyu Zhang
Arbee L. P. Chen
BMC Bioinformatics, 23
[23] Leveraging Multi-task Learning for Biomedical Named Entity Recognition
Mehmood, Tahir
Gerevini, Alfonso
Lavelli, Alberto
Serina, Ivan
ADVANCES IN ARTIFICIAL INTELLIGENCE, AI*IA 2019, 2019, 11946 : 431 - 444
[24] A self-attention based neural architecture for Chinese medical named entity recognition
Wan, Qian
Liu, Jie
Wei, Luona
Ji, Bin
MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (04) : 3498 - 3511
[25] DAMTRNN: A Delta Attention-Based Multi-task RNN for Intention Recognition
Chen, Weitong
Yue, Lin
Li, Bohan
Wang, Can
Sheng, Quan Z.
ADVANCED DATA MINING AND APPLICATIONS, ADMA 2019, 2019, 11888 : 373 - 388
[26] A neural network multi-task learning approach to biomedical named entity recognition
Crichton, Gamal
Pyysalo, Sampo
Chiu, Billy
Korhonen, Anna
BMC BIOINFORMATICS, 2017, 18
[27] Attention-based Multi-task Learning for Sensor Analytics
Chen, Yujing
Rangwala, Huzefa
2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2187 - 2196
[28] Attention-based LSTM with Multi-task Learning for Distant Speech Recognition
Zhang, Yu
Zhang, Pengyuan
Yan, Yonghong
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 3857 - 3861
[29] A neural network multi-task learning approach to biomedical named entity recognition
Gamal Crichton
Sampo Pyysalo
Billy Chiu
Anna Korhonen
BMC Bioinformatics, 18
[30] An Attention-Based Approach for Mongolian News Named Entity Recognition
Tan, Mingyan
Bao, Feilong
Gao, Guanglai
Wang, Weihua
CHINESE COMPUTATIONAL LINGUISTICS, CCL 2019, 2019, 11856 : 424 - 435

← 1 2 3 4 5 →