Representation iterative fusion based on heterogeneous graph neural network for joint entity and relation extraction

被引:114
作者
Zhao, Kang [1 ,2 ]
Xu, Hua [1 ]
Cheng, Yue [2 ]
Li, Xiaoteng [1 ,2 ]
Gao, Kai [2 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[2] Hebei Univ Sci & Technol, Sch Informat Sci & Engn, Shijiazhuang 050018, Hebei, Peoples R China
关键词
Relation extraction; Heterogeneous graph neural networks; Representation learning; Information extraction;
D O I
10.1016/j.knosys.2021.106888
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Joint entity and relation extraction is an essential task in information extraction, which aims to extract all relational triples from unstructured text. However, few existing works consider possible relations information between entities before extracting them, which may lead to the fact that most of the extracted entities cannot constitute valid triples. In this paper, we propose a representation iterative fusion based on heterogeneous graph neural networks for relation extraction (RIFRE). We model relations and words as nodes on the graph and fuse the two types of semantic nodes by the message passing mechanism iteratively to obtain nodes representation that is more suitable for relation extraction tasks. The model performs relation extraction after nodes representation is updated. We evaluate RIFRE on two public relation extraction datasets: NYT and WebNLG. The results show that RIFRE can effectively extract triples and achieve state-of-the-art performance.1 Moreover, RIFRE is also suitable for the relation classification task, and significantly outperforms the previous methods on SemEval 2010 Task 8 datasets. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 29 条
[1]   Joint extraction of entities and relations by a novel end-to-end model with a double-pointer module [J].
Bai, Chongyou ;
Pan, Limin ;
Luo, Senlin ;
Wu, Zhouting .
NEUROCOMPUTING, 2020, 377 :325-333
[2]  
Chan Y.S., 2011, P 49 ANN M ASS COMP, VVolume 1, P551
[3]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[4]  
Fu TJ, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P1409
[5]   Creating Training Corpora for NLG Micro-Planning [J].
Gardent, Claire ;
Shimorina, Anastasia ;
Narayan, Shashi ;
Perez-Beltrachini, Laura .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :179-188
[6]  
Hendrickx Iris, 2010, SemEval@ACL, P33, DOI DOI 10.3115/1621969.1621986
[7]   Improving Graph Convolutional Networks Based on Relation-Aware Attention for End-to-End Relation Extraction [J].
Hong, Yin ;
Liu, Yanxia ;
Yang, Suizhu ;
Zhang, Kaiwen ;
Wen, Aiqing ;
Hu, Jianjun .
IEEE ACCESS, 2020, 8 :51315-51323
[8]   Going out on a limb: Joint Extraction of Entity Mentions and Relations without Dependency Trees [J].
Katiyar, Arzoo ;
Cardie, Claire .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :917-928
[9]  
Liu J, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P3787
[10]  
Miwa M, 2014, Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, V2014, P1858, DOI DOI 10.3115/V1/D14-1200