Dispatched attention with multi-task learning for nested mention recognition

被引:32
作者
Fei, Hao [1 ]
Ren, Yafeng [2 ]
Ji, Donghong [1 ]
机构
[1] Wuhan Univ, Sch Cyber Sci & Engn, Minist Educ, Key Lab Aerosp Informat Secur & Trusted Comp, Wuhan, Peoples R China
[2] Guangdong Univ Foreign Studies, Lab Language Engn & Comp, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Nested mention; Named entity recognition; Attention mechanism; Neural network; Multi-task learning; Conditional random field;
D O I
10.1016/j.ins.2019.10.065
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Entity mentions usually contain other mention in the task of named entity recognition (NER). Nested entities pose challenge to the task of NER. Existing methods fail to sufficiently capture the boundaries information between nested entities, which limits the performance of the task. In this paper, we propose a dispatched attention neural model with multi-task learning for the task. In particular, given an input sentence, a bi-directional Long Short Term Memory (BiLSTM) encodes it as common contextualized hidden representation. Then position and syntax information are leveraged into attention network for capturing mention span features. The attention representation of each task is dispatched to subsequent task to exchange boundaries information for nested mentions. Finally, Conditional Random Fields (CRFs) are used to extract nested mentions in an inside-out order for each task. Results on ACE2005 and GENIA datasets show that the proposed model outperforms state-of-the-art systems, showing its effectiveness in detecting nested mentions. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:241 / 251
页数:11
相关论文
共 41 条
[1]  
Alex B, 2007, P BIONLP 07, P65
[2]  
[Anonymous], 2018, P 2018 C EMP METH NA
[3]  
[Anonymous], 2018, P 2 INT C E COMM E B
[4]  
[Anonymous], IEEE INTEL SYST
[5]  
[Anonymous], 2018, P 2018 C N AM CHAPT, DOI DOI 10.18653/V1/N18-1131
[6]  
[Anonymous], 2014, INT C LEARN REPR
[7]  
[Anonymous], 2012, J DATA INFOR MATION
[8]  
[Anonymous], 2010, JMLR WORKSH C P
[9]  
Beth Levin, 1993, English verb classes and alternations
[10]  
Bilan Ivan, 2018, ARXIV180703052