Medical QA Oriented Multi-Task Learning Model for Question Intent Classification and Named Entity Recognition

被引:3
作者
Tohti, Turdi [1 ]
Abdurxit, Mamatjan [1 ]
Hamdulla, Askar [1 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Xinjiang Key Lab Signal Detect & Proc, Urumqi 830017, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; named entity recognition; intent classification; ALBERT; deep learning;
D O I
10.3390/info13120581
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intent classification and named entity recognition of medical questions are two key subtasks of the natural language understanding module in the question answering system. Most existing methods usually treat medical queries intent classification and named entity recognition as two separate tasks, ignoring the close relationship between the two tasks. In order to optimize the effect of medical queries intent classification and named entity recognition tasks, a multi-task learning model based on ALBERT-BILSTM is proposed for intent classification and named entity recognition of Chinese online medical questions. The multi-task learning model in this paper makes use of encoder parameter sharing, which enables the model's underlying network to take into account both named entity recognition and intent classification features. The model learns the shared information between the two tasks while maintaining its unique characteristics during the decoding phase. The ALBERT pre-training language model is used to obtain word vectors containing semantic information and the bidirectional LSTM network is used for training. A comparative experiment of different models was conducted on Chinese medical questions dataset. Experimental results show that the proposed multi-task learning method outperforms the benchmark method in terms of precision, recall and F-1 value. Compared with the single-task model, the generalization ability of the model has been improved.
引用
收藏
页数:13
相关论文
共 50 条
[21]   Multi-Task Multi-Attention Transformer for Generative Named Entity Recognition [J].
Mo, Ying ;
Liu, Jiahao ;
Tang, Hongyin ;
Wang, Qifan ;
Xu, Zenglin ;
Wang, Jingang ;
Quan, Xiaojun ;
Wu, Wei ;
Li, Zhoujun .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 :4171-4183
[22]   Learning with joint cross-document information via multi-task learning for named entity recognition [J].
Wang, Dongsheng ;
Fan, Hongjie ;
Liu, Junfei .
INFORMATION SCIENCES, 2021, 579 :454-467
[23]   ZH-NER: Chinese Named Entity Recognition with Adversarial Multi-task Learning and Self-Attentions [J].
Zhu, Peng ;
Cheng, Dawei ;
Yang, Fangzhou ;
Luo, Yifeng ;
Qian, Weining ;
Zhou, Aoying .
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT II, 2021, 12682 :603-611
[24]   A Double Adversarial Network Model for Multi-Domain and Multi-Task Chinese Named Entity Recognition [J].
Hu, Yun ;
Zheng, Changwen .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (07) :1744-1752
[25]   Survey on multi-task learning for object classification and recognition [J].
Li H. ;
Wang F. ;
Ding W. .
Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2022, 43 (01)
[26]   Multi-task Label-wise Transformer for Chinese Named Entity Recognition [J].
Wang, Xuelei ;
Xu, Xirong ;
Huang, Degen ;
Zhang, Ting .
ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (04)
[27]   IMPROVING BIOMEDICAL NAMED ENTITY RECOGNITION WITH A UNIFIED MULTI-TASK MRC FRAMEWORK [J].
Tong, Yiqi ;
Zhuang, Fuzhen ;
Wang, Deqing ;
Ying, Haochao ;
Wang, Binling .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :8332-8336
[28]   A Multi-Task BERT-BiLSTM-AM-CRF Strategy for Chinese Named Entity Recognition [J].
Xiaoyong Tang ;
Yong Huang ;
Meng Xia ;
Chengfeng Long .
Neural Processing Letters, 2023, 55 :1209-1229
[29]   Towards Malay named entity recognition: an open-source dataset and a multi-task framework [J].
Fu, Yingwen ;
Lin, Nankai ;
Yang, Zhihe ;
Jiang, Shengyi .
CONNECTION SCIENCE, 2023, 35 (01)
[30]   A Multi-Task BERT-BiLSTM-AM-CRF Strategy for Chinese Named Entity Recognition [J].
Tang, Xiaoyong ;
Huang, Yong ;
Xia, Meng ;
Long, Chengfeng .
NEURAL PROCESSING LETTERS, 2023, 55 (02) :1209-1229