Deep adaptation of CNN in Chinese named entity recognition

被引:0
作者
Lv, Yana [1 ,2 ]
Qin, Xutong [1 ,2 ]
Du, Xiuli [1 ,2 ,3 ]
Qiu, Shaoming [1 ,2 ]
机构
[1] Dalian Univ, Sch Informat Engn, Dalian, Peoples R China
[2] Dalian Univ, Commun & Network Lab, Dalian, Peoples R China
[3] Dalian Univ, Sch Informat Engn, Dalian, Liaoning, Peoples R China
关键词
BiLSTM-CRF; ChineseBERT; named entity recognition; natural language processing; neural network; sequence models;
D O I
10.1002/eng2.12614
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Named entity recognition (NER) is an important task in the field of natural language processing, but it is more challenging in Chinese because of the lack of natural delimiters. The traditional character-based Chinese NER model directly uses long short-term memory (LSTM), gated recurrent units, and other sequence models to extract sentence-level information from character sequences, resulting in the lack of word-level information in the model. Therefore, a Chinese NER model called ChineseBERT-CNNs-BiLSTM-CRF was proposed, which uses the ChineseBERT pretrained model as the embedding layer so that the vector representation of each Chinese character contained pinyin, glyph, and conventional character information. In addition, a CNN-based neural network structure called CNNs was presented to extract word-level information from character sequences and alleviate the problem of entity boundary recognition. BiLSTM was used to extract global features (i.e., sentence-level information) and predict the corresponding labels of character sequences. Further, conditional random field (CRF) was employed to impose certain rules on the prediction of BiLSTM to enhance the recognition effect of the model. The experimental results revealed that the F1 values of the model on MSRA, people's Daily, and Weibo datasets reached 95.76, 96.61, and 70.00%, respectively, highlighting the effectiveness of the model.
引用
收藏
页数:14
相关论文
共 50 条
[1]   Text-based emotion detection: Advances, challenges, and opportunities [J].
Acheampong, Francisca Adoma ;
Chen Wenyu ;
Nunoo-Mensah, Henry .
ENGINEERING REPORTS, 2020, 2 (07)
[2]   A review of Chinese named entity recognition [J].
Cheng, Jieren ;
Liu, Jingxin ;
Xu, Xinbin ;
Xia, Dongwan ;
Liu, Le ;
Sheng, Victor S. .
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (06) :2012-2030
[3]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[4]  
Diao S., 2020, ZEN PRE TRAINING CHI, P4729
[5]  
Grishman Ralph., 1995, 6 MESSAGE UNDERSTAND
[6]   Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals [J].
He, Gaole ;
Lan, Yunshi ;
Jiang, Jing ;
Zhao, Wayne Xin ;
Wen, Ji-Rong .
WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, :535-543
[7]  
He J., 2008, P 6 SIGHAN WORKSHOP
[8]  
Huang Zhiheng, 2015, CoRR
[9]  
Iyyer M, 2015, PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, P1681
[10]   A Survey on Knowledge Graphs: Representation, Acquisition, and Applications [J].
Ji, Shaoxiong ;
Pan, Shirui ;
Cambria, Erik ;
Marttinen, Pekka ;
Yu, Philip S. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) :494-514