Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military

被引:10
作者
Liao, Fei [1 ]
Ma, Liangli [1 ]
Pei, Jingjing [2 ]
Tan, Linshan [2 ]
机构
[1] Naval Univ Engn, Coll Elect Engn, Wuhan 430033, Hubei, Peoples R China
[2] Force 91001, Beijing 100841, Peoples R China
来源
FUTURE INTERNET | 2019年 / 11卷 / 08期
基金
中国国家自然科学基金;
关键词
military named entity recognition; self-attention mechanism; BiLSTM;
D O I
10.3390/fi11080180
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge. In order to solve this problem, we propose a method employing a bidirectional long short-term memory (BiLSTM) neural network with a self-attention mechanism to identify the military entities automatically. We obtain distributed vector representations of the military corpus by unsupervised learning and the BiLSTM model combined with the self-attention mechanism is adopted to capture contextual information fully carried by the character vector sequence. The experimental results show that the self-attention mechanism can improve effectively the performance of MNER task. The F-score of the military documents and network military texts identification was 90.15% and 89.34%, respectively, which was better than other models.
引用
收藏
页数:11
相关论文
共 27 条
[1]  
[Anonymous], 2017, NEURIPS
[2]  
[Anonymous], 2009, PROCEED INGS 2009 NA
[3]  
Chiu J.P.C., 2016, Trans. Assoc. Comput. Linguist., V4, P357
[4]  
Cui X, 2016, PROCEEDINGS OF THE FIFTEENTH INTERNATIONAL SYMPOSIUM - MANAGEMENT SCIENCE AND ENGINEERING (2016), P207
[5]  
[冯蕴天 Feng Yuntian], 2015, [计算机科学, Computer Science], V42, P15
[6]   VITERBI ALGORITHM [J].
FORNEY, GD .
PROCEEDINGS OF THE IEEE, 1973, 61 (03) :268-278
[7]  
Gayen V., 2014, ARXIV14057397
[8]  
Grishman R., 1996, COLING 1996 VOL 1 16
[9]   Extracting Meaningful Entities from Human-Generated Tactical Reports [J].
Guo, Jinhong K. ;
Van Brackle, David ;
LoFaso, Nicolas ;
Hofmann, Martin O. .
COMPLEX ADAPTIVE SYSTEMS, 2015, 2015, 61 :72-79
[10]  
He J., 2008, P 6 SIGHAN WORKSH CH