TL-NER: A Transfer Learning Model for Chinese Named Entity Recognition

被引:23
作者
Peng, DunLu [1 ]
Wang, YinRui [1 ]
Liu, Cong [1 ]
Chen, Zhang [1 ]
机构
[1] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
基金
中国国家自然科学基金;
关键词
Transfer learning; Chinese named entity recognition; Natural language processing; Deep learning; IDENTIFICATION;
D O I
10.1007/s10796-019-09932-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most of the current research on Named Entity Recognition (NER) in the Chinese domain is based on the assumption that annotated data are adequate. However, in many scenarios, the sufficient amount of annotated data required for Chinese NER task is difficult to obtain, resulting in poor performance of machine learning methods. In view of this situation, this paper tries to excavate the information contained in the massive unlabeled raw text data and utilize it to enhance the performance of Chinese NER task. A deep learning model combined with Transfer Learning technique is proposed in this paper. This method can be leveraged in some domains where there is a large amount of unlabeled text data and a small amount of annotated data. The experiment results show that the proposed method performs well on different sized datasets, and this method also avoids errors that occur during the word segmentation process. We also evaluate the effect of transfer learning from different aspects through a series of experiments.
引用
收藏
页码:1291 / 1304
页数:14
相关论文
共 55 条
[31]  
Mou L, 2016, EMNLP, P479, DOI 10.18653/v1/D16-1046
[32]  
Nadeau D, 2007, LINGUIST INVESTIG, V30, P3
[33]   Emergency Vocabulary [J].
Nemeskey, David Mark ;
Kornai, Andras .
INFORMATION SYSTEMS FRONTIERS, 2018, 20 (05) :909-923
[34]   Learning and Transferring Mid-Level Image Representations using Convolutional Neural Networks [J].
Oquab, Maxime ;
Bottou, Leon ;
Laptev, Ivan ;
Sivic, Josef .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1717-1724
[35]   A Survey on Transfer Learning [J].
Pan, Sinno Jialin ;
Yang, Qiang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (10) :1345-1359
[36]  
Passos A, 2014, PROC 18 INT C COMPUT
[37]  
Peng NY, 2016, PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2016), VOL 2, P149
[38]  
Peng Nanyun, 2015, P 2015 C EMP METH NA, P548
[39]  
Qiu LK, 2015, AAAI CONF ARTIF INTE, P2440
[40]  
Rei M., 2016, P COLING 2016, P309