Medical QA Oriented Multi-Task Learning Model for Question Intent Classification and Named Entity Recognition

被引:3
作者
Tohti, Turdi [1 ]
Abdurxit, Mamatjan [1 ]
Hamdulla, Askar [1 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Xinjiang Key Lab Signal Detect & Proc, Urumqi 830017, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; named entity recognition; intent classification; ALBERT; deep learning;
D O I
10.3390/info13120581
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Intent classification and named entity recognition of medical questions are two key subtasks of the natural language understanding module in the question answering system. Most existing methods usually treat medical queries intent classification and named entity recognition as two separate tasks, ignoring the close relationship between the two tasks. In order to optimize the effect of medical queries intent classification and named entity recognition tasks, a multi-task learning model based on ALBERT-BILSTM is proposed for intent classification and named entity recognition of Chinese online medical questions. The multi-task learning model in this paper makes use of encoder parameter sharing, which enables the model's underlying network to take into account both named entity recognition and intent classification features. The model learns the shared information between the two tasks while maintaining its unique characteristics during the decoding phase. The ALBERT pre-training language model is used to obtain word vectors containing semantic information and the bidirectional LSTM network is used for training. A comparative experiment of different models was conducted on Chinese medical questions dataset. Experimental results show that the proposed multi-task learning method outperforms the benchmark method in terms of precision, recall and F-1 value. Compared with the single-task model, the generalization ability of the model has been improved.
引用
收藏
页数:13
相关论文
共 50 条
[11]   TaughtNet: Learning Multi-Task Biomedical Named Entity Recognition From Single-Task Teachers [J].
Moscato, Vincenzo ;
Postiglione, Marco ;
Sansone, Carlo ;
Sperli, Giancarlo .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (05) :2512-2523
[12]   Multi-task learning for Chinese clinical named entity recognition with external knowledge [J].
Cheng, Ming ;
Xiong, Shufeng ;
Li, Fei ;
Liang, Pan ;
Gao, Jianbo .
BMC MEDICAL INFORMATICS AND DECISION MAKING, 2021, 21 (01)
[13]   Multi-task learning for Chinese clinical named entity recognition with external knowledge [J].
Ming Cheng ;
Shufeng Xiong ;
Fei Li ;
Pan Liang ;
Jianbo Gao .
BMC Medical Informatics and Decision Making, 21
[14]   Towards Hierarchical Categorical Named Entity Recognition via Injective Multi-task Learning Strategy [J].
Yuan, Xiaoguang ;
Dai, Chaofan ;
Wang, Youchen ;
Cheng, Yaokai ;
Yu, Zengwen ;
Du, Tianfeng .
2022 8TH INTERNATIONAL CONFERENCE ON BIG DATA AND INFORMATION ANALYTICS, BIGDIA, 2022, :232-238
[15]   Sentence-to-Label Generation Framework for Multi-task Learning of Japanese Sentence Classification and Named Entity Recognition [J].
Gan, Chengguang ;
Zhang, Qinghao ;
Mori, Tatsunori .
NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS, NLDB 2023, 2023, 13913 :257-270
[16]   An Empirical Study of Multi-domain and Multi-task Learning in Chinese Named Entity Recognition [J].
Hu, Yun ;
Liao, Mingxue ;
Lv, Pin ;
Zheng, Changwen .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: DEEP LEARNING, PT II, 2019, 11728 :743-754
[17]   Joint Cross-document Information for Named Entity Recognition with Multi-task Learning [J].
Wang, Dongsheng ;
Fan, Hongjie ;
Liu, Junfei .
2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, :1146-1150
[18]   Biomedical named entity recognition with the combined feature attention and fully-shared multi-task learning [J].
Zhiyu Zhang ;
Arbee L. P. Chen .
BMC Bioinformatics, 23
[19]   Biomedical named entity recognition with the combined feature attention and fully-shared multi-task learning [J].
Zhang, Zhiyu ;
Chen, Arbee L. P. .
BMC BIOINFORMATICS, 2022, 23 (01)
[20]   Recognizing Nested Named Entity in Biomedical Texts: A Neural Network Model with Multi-Task Learning [J].
Fei, Hao ;
Ren, Yafeng ;
Ji, Donghong .
2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, :376-381