Deep adaptation of CNN in Chinese named entity recognition

被引:0
作者
Lv, Yana [1 ,2 ]
Qin, Xutong [1 ,2 ]
Du, Xiuli [1 ,2 ,3 ]
Qiu, Shaoming [1 ,2 ]
机构
[1] Dalian Univ, Sch Informat Engn, Dalian, Peoples R China
[2] Dalian Univ, Commun & Network Lab, Dalian, Peoples R China
[3] Dalian Univ, Sch Informat Engn, Dalian, Liaoning, Peoples R China
关键词
BiLSTM-CRF; ChineseBERT; named entity recognition; natural language processing; neural network; sequence models;
D O I
10.1002/eng2.12614
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Named entity recognition (NER) is an important task in the field of natural language processing, but it is more challenging in Chinese because of the lack of natural delimiters. The traditional character-based Chinese NER model directly uses long short-term memory (LSTM), gated recurrent units, and other sequence models to extract sentence-level information from character sequences, resulting in the lack of word-level information in the model. Therefore, a Chinese NER model called ChineseBERT-CNNs-BiLSTM-CRF was proposed, which uses the ChineseBERT pretrained model as the embedding layer so that the vector representation of each Chinese character contained pinyin, glyph, and conventional character information. In addition, a CNN-based neural network structure called CNNs was presented to extract word-level information from character sequences and alleviate the problem of entity boundary recognition. BiLSTM was used to extract global features (i.e., sentence-level information) and predict the corresponding labels of character sequences. Further, conditional random field (CRF) was employed to impose certain rules on the prediction of BiLSTM to enhance the recognition effect of the model. The experimental results revealed that the F1 values of the model on MSRA, people's Daily, and Weibo datasets reached 95.76, 96.61, and 70.00%, respectively, highlighting the effectiveness of the model.
引用
收藏
页数:14
相关论文
共 50 条
[21]  
Liu ZX, 2010, LECT NOTES ARTIF INT, V6216, P634
[22]  
Logeswaran L, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P3449
[23]  
Meng Yuxian, 2019, ADV NEURAL INFORM PR, V32
[24]   Deep Learning-based Text Classification: A Comprehensive Review [J].
Minaee, Shervin ;
Kalchbrenner, Nal ;
Cambria, Erik ;
Nikzad, Narjes ;
Chenaghlu, Meysam ;
Gao, Jianfeng .
ACM COMPUTING SURVEYS, 2022, 54 (03)
[25]   Lexicon-pointed hybrid N-gram Features Extraction Model (LeNFEM) for sentence level sentiment analysis [J].
Mutinda, James ;
Mwangi, Waweru ;
Okeyo, George .
ENGINEERING REPORTS, 2021, 3 (08)
[26]   Named Entity Recognition using Conditional Random Fields [J].
Patil, Nita ;
Patil, Ajay ;
Pawar, B., V .
INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 :1181-1188
[27]   Phonetic-enriched text representation for Chinese sentiment analysis with reinforcement learning [J].
Peng, Haiyun ;
Ma, Yukun ;
Poria, Soujanya ;
Li, Yang ;
Cambria, Erik .
INFORMATION FUSION, 2021, 70 :88-99
[28]  
Peng Nanyun, 2015, P 2015 C EMP METH NA, P548
[29]  
Pennington J., 2014, Proceedings of the Empiricial Methods in Natural Language Processing EMNLP 2014, DOI 10.3115/v1/D14-1162
[30]  
Ruotian M., 2020, P 58 ANN M ASS COMP, P5951, DOI [10.18653/V1/2020.ACL-MAIN.528, 10.18653/v1/2020.acl-main.528]