Improving distant supervision relation extraction with entity-guided enhancement feature

被引:1
作者
Wen, Haixu [1 ]
Zhu, Xinhua [1 ,2 ]
Zhang, Lanfang [3 ]
机构
[1] Guangxi Normal Univ, Sch Comp Sci & Informat Engn, Guilin 541004, Guangxi, Peoples R China
[2] Guangxi Normal Univ, Guangxi Key Lab Multisource Informat Min & Secur, Guilin 541004, Guangxi, Peoples R China
[3] Guangxi Normal Univ, Fac Educ, Guilin 541004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Distant supervision relation extraction; Entity representation; Piecewise convolutional neural network; Relation features; Gate pooling strategy; CLASSIFICATION; NOISE; TIME; DECOMPOSITION; VIBRATION; RAYLEIGH; SIGNALS; PATTERN; DOMAIN; MODEL;
D O I
10.1007/s00521-022-08051-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Selective attention in distant supervision extraction relation is advantageous to deal with incorrectly labeled sentences in a bag, but it does not help in cases where many sentence bags consist of only one sentence. To resolve the deficiencies, we propose an entity-guided enhancement feature neural network for distant supervision relation extraction. We discover that key relation features are typically found in both significant words and phrases, which can be captured by entity guidance. We first develop an entity-directed attention that measures the relevance between entities and two levels of semantic units from word and phrase to capture reliable relation features, which are used to enhance the entity representations. Furthermore, two multi-level augmented entity representations are transformed to a relation representation via a linear layer. Then we adopt a semantic fusion layer to fuse multiple semantic representations such as the sentence representation encoded by piecewise convolutional neural network, two multi-level augmented entity representations, and the relation representation to get final enhanced sentence representation. Finally, with the guidance of the relation representations, we introduce a gate pooling strategy to generate a bag-level representation and address the one-sentence bag problem occurring in selective attention. Extensive experiments demonstrate that our method outperforms the state-of-the-art methods.
引用
收藏
页码:7547 / 7560
页数:14
相关论文
共 42 条
  • [1] [Anonymous], 2015, P 2015 C EMP METH NA, DOI DOI 10.18653/V1/D15-1203
  • [2] [Anonymous], 2012, P 2012 JOINT C EMP M
  • [3] [Anonymous], 2006, Advances in Neural Information Processing Systems
  • [4] Ba J, 2016, ARXIV160706450
  • [5] Bollacker Kurt, 2008, Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, DOI [DOI 10.1145/1376616.1376746, 10.1145/1376616.1376746]
  • [6] Partial Domain Adaptation for Relation Extraction Based on Adversarial Learning
    Cao, Xiaofei
    Yang, Juan
    Meng, Xiangbin
    [J]. SEMANTIC WEB (ESWC 2020), 2020, 12123 : 89 - 104
  • [7] Christopoulou F, 2021, 2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), P11
  • [8] Culotta A, 2004, P 42 ANN M ASS COMP, P423, DOI [DOI 10.3115/1218955.1219009, 10.3115/1218955.1219009]
  • [9] Feng J, 2018, REINFORCEMENT LEARNI
  • [10] Guo ZJ, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P241