Chinese Named Entity Recognition Based on Gated Graph Neural Network

被引:2
作者
Zhong, Qing [1 ]
Tang, Yan [1 ]
机构
[1] Southwest Univ, Sch Comp & Informat Sci, Chongqing, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I | 2021年 / 12815卷
关键词
Chinese named entity recognition; Gated graph neural network; BERT;
D O I
10.1007/978-3-030-82136-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most Chinese Named Entity Recognition (CNER) models based on deep learning are implemented based on long short-term memory networks (LSTM) and conditional random fields (CRF). The serialized structure of LSTM is easily affected by word ambiguity and lack of word boundary information. In this regard, we propose a Chinese named entity recognition model based on a gated graph neural network (GGNN).We use the BERT model to generate pre-training encoding vectors of characters, and introduce global nodes to capture the global information in the sentence. Finally, we exploits multiple interactions between the characters in the graph structure, all matching words, and the entire sentence to solve the problem of word ambiguity.The comparative experimental results on the three CNER datasets show that the GGNN model has a better effect on named entity recognition.
引用
收藏
页码:604 / 613
页数:10
相关论文
共 29 条
[1]  
[Anonymous], 2005, P HUMAN LANGUAGE TEC
[2]  
Battaglia Peter W, 2018, INT C LEARN REPR
[3]  
Cao P., 2018, P 2018 C EMP METH NA, P182, DOI [DOI 10.18653/V1/D18-1017, 10.18653/v1/d18-1017]
[4]  
Chen YB, 2015, PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, P167
[5]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[6]   Core techniques of question answering systems over knowledge bases: a survey [J].
Diefenbach, Dennis ;
Lopez, Vanessa ;
Singh, Kamal ;
Maret, Pierre .
KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 55 (03) :529-569
[7]   Character-Based LSTM-CRF with Radical-Level Features for Chinese Named Entity Recognition [J].
Dong, Chuanhai ;
Zhang, Jiajun ;
Zong, Chengqing ;
Hattori, Masanori ;
Di, Hui .
NATURAL LANGUAGE UNDERSTANDING AND INTELLIGENT APPLICATIONS (NLPCC 2016), 2016, 10102 :239-250
[8]   Hierarchical LSTM with char-subword-word tree-structure representation for Chinese named entity recognition [J].
Gong, Chen ;
Li, Zhenghua ;
Xia, Qingrong ;
Chen, Wenliang ;
Zhang, Min .
SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (10)
[9]  
Gori M, 2005, IEEE IJCNN, P729
[10]  
Gui T, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4982