Entity slot recognition based on data enhancement and character-word fusion features

被引:0
作者
Liu Z. [1 ,2 ]
Xu M. [1 ,2 ]
Wang C. [3 ]
机构
[1] Key Laboratory of Ministry of Education for Image Processing and Intelligent Control, Huazhong University of Science and Technology, Wuhan
[2] Wuhan Windoor Information Technology Company Ltd., Wuhan
来源
Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition) | 2022年 / 50卷 / 11期
关键词
bidirectional encoder representations from transformer (BERT); character-word fusion; data enhancement; entity slot recognition; information technology (IT) operation and maintenance;
D O I
10.13245/j.hust.221112
中图分类号
学科分类号
摘要
Aiming at the problem that the traditional entity slot recognition model based on character level representation could not make good use of word information,and the information technology (IT) operation and maintenance field would lack enough open data sets,an entity slot recognition method based on BERT_Word2vec_BiLSTM_CRF model was proposed,and the training data set of the model was extended by data enhancement.In this model,character vector representation obtained by bidirectional encoder representations from transformer (BERT) model and word vector representation obtained by Word2vec were fused,context encoding was carried out by bi-directional long short-term memory (BiLSTM) and decoding was carried out by conditional random field (CRF),and the final sequence annotation result was obtained.Experiment results on the data set provided by an enterprise show that the fusion of word-level features can further improve the recognition performance on the basis of BERT pre-training model,and the F1 value reaches 92.33%. © 2022 Huazhong University of Science and Technology. All rights reserved.
引用
收藏
页码:101 / 106
页数:5
相关论文
共 17 条
[1]  
XIAO J, VUKOVIC M., Juno:an intelligent chat service for IT service automation[C], Proc of International Conference on Service-Oriented Computing, pp. 486-490, (2018)
[2]  
ZHOU W, TANG L, ZENG C, Resolution recommendation for event tickets in service management[J], IEEE Transactions on Network and Service Management, 13, 4, pp. 954-967, (2016)
[3]  
WANG Q, ZENG C, IYENGAR S S, AISTAR:an intelligent system for online IT ticket automation recommendation[C], Proc of IEEE International Conference on Big Data (Big Data), pp. 1875-1884, (2018)
[4]  
MANDAL A,, MALHOTRA N,, AGARWAL S, Automated dispatch of helpdesk email tickets: pushing the limits with AI[C], Proc of the AAAI Conference on Artificial Intelligence, pp. 9381-9388, (2019)
[5]  
PARAMESH S P, SHREEDHARA K S., Automated it service desk systems using machine learning techniques [M], Data Analytics and Learning, pp. 331-346, (2019)
[6]  
44, 8, pp. 1-8, (2017)
[7]  
NURUZZAMAN M, HUSSAIN O K., IntelliBot:a dialogue-based chatbot for the insurance industry[J], Knowledge-Based Systems, 196, (2020)
[8]  
LI J, SUN A, HAN J, A survey on deep learning for named entity recognition[J], IEEE Transactions on Knowledge and Data Engineering, 34, 1, pp. 50-70, (2020)
[9]  
AN M,, CHANG Z,, FU L, A biological test questions naming entity recognition method for fusion triggers[C], Proc of the 33rd Chinese Control and Decision Conference (CCDC), pp. 2312-2316, (2021)
[10]  
50, 2, pp. 118-123, (2022)