Multichannel LSTM-CRF for Named Entity Recognition in Chinese Social Media

被引:7
作者
Dong, Chuanhai [1 ,2 ]
Wu, Huijia [1 ,2 ]
Zhang, Jiajun [1 ,2 ]
Zong, Chengqing [1 ,2 ,3 ]
机构
[1] Natl Lab Pattern Recognit, CASIA, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] CAS Ctr Excellence Brain Sci & Intelligence Techn, Shanghai, Peoples R China
来源
CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA, CCL 2017 | 2017年 / 10565卷
关键词
Multichannel; Named entity recognition; Chinese social media;
D O I
10.1007/978-3-319-69005-6_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Named Entity Recognition (NER) is a tough task in Chinese social media due to a large portion of informal writings. Existing research uses only limited in-domain annotated data and achieves low performance. In this paper, we utilize both limited in-domain data and enough out-of-domain data using a domain adaptation method. We propose a multichannel LSTM-CRF model that employs different channels to capture general patterns, in-domain patterns and out-of-domain patterns in Chinese social media. The extensive experiments show that our model yields 9.8% improvement over previous state-of-the-art methods. We further find that a shared embedding layer is important and randomly initialized embeddings are better than the pretrained ones.
引用
收藏
页码:197 / 208
页数:12
相关论文
共 33 条
[21]  
He Hangfeng, 2016, ARXIV161104234
[22]  
Huang Z., 2015, ARXIV
[23]  
Kim Y.-B., 2016, P COLING, P387
[24]  
Levow G, 2006, P 5 SIGHAN WORKSH CH, P108
[25]  
Li L., 2006, P 5 SIGHAN WORKSHOP, P72
[26]  
Mikolov T., 2013, ADV NEURAL INFORM PR, P3111
[27]   A Survey on Transfer Learning [J].
Pan, Sinno Jialin ;
Yang, Qiang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (10) :1345-1359
[28]  
Peng N., 2016, ARXIV160802689
[29]  
Peng N., 2015, P 2015 C EMP METH NA, P548
[30]  
Peng NY, 2016, PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2016), VOL 2, P149