Sequence to sequence learning for joint extraction of entities and relations

被引:8
|
作者
Liang, Zeyu [1 ]
Du, Junping [2 ]
机构
[1] Commun Univ China, Sch Data Sci & Intelligent Media, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing Key Lab Intelligent Telecommun Software &, Beijing 100876, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Sequence to sequence learning; Gate graph neural networks; Joint extraction of entities and relations;
D O I
10.1016/j.neucom.2022.05.074
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The relations of two entities contained in the sentence are often complicated. There exists multiple relation tuples which owns one or both the same entities among them. Extracting those overlapped multiple relation tuples faces great challenges. Most existing works employ the famous Seq2Seq model for joint extraction of entities and relations, which cannot handle the multiple relations properly due to the missing of graph structure information of the relations and entities in a sentence. In this paper, we propose Seq2Seq-RE, an end-to-end relation extraction model, which first utilizes the gate graph neural networks (GGNNs) for joint extraction of entities and relations. Unlike previous works, we take the interaction of entities and relations through a GGNNs-based sequence-to-sequence with attention mechanism for better extracting multiple relation tuples. Besides, our graph structure based on the forward-edge, backward-edge, self-edge, and dependency-edge. To our knowledge, we are the first to employ four types of edge into graph-based neural networks for joint extraction of entities and relations and conduct a comprehensive qualitative analysis to investigate what types of edges benefit our task. Experimental results show that our model surpasses the current strong baseline methods by 1.7% in NYT29 and 0.8% in NYT24 (F1 score). (c) 2022 Published by Elsevier B.V.
引用
收藏
页码:480 / 488
页数:9
相关论文
共 50 条
  • [1] Sequence to sequence learning for joint extraction of entities and relations
    Liang, Zeyu
    Du, Junping
    Neurocomputing, 2022, 501 : 480 - 488
  • [2] Joint Extraction of Entities and Relations Based on Hierarchical Sequence Labeling
    Tian J.
    Lü X.
    You X.
    Xiao G.
    Han J.
    Beijing Daxue Xuebao (Ziran Kexue Ban)/Acta Scientiarum Naturalium Universitatis Pekinensis, 2021, 57 (01): : 53 - 60
  • [3] Joint Extraction of Entities and Overlapping Relations Using Position-Attentive Sequence Labeling
    Dai, Dai
    Xiao, Xinyan
    Lyu, Yajuan
    Dou, Shan
    She, Qiaoqiao
    Wang, Haifeng
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 6300 - 6308
  • [4] Reinforcement Learning for Joint Extraction of Entities and Relations
    Liu, Wenpeng
    Cao, Yanan
    Liu, Yanbing
    Hu, Yue
    Tan, Jianlong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT II, 2018, 11140 : 263 - 272
  • [5] Joint Extraction of Entities and Relations Using Reinforcement Learning and Deep Learning
    Feng, Yuntian
    Zhang, Hongjun
    Hao, Wenning
    Chen, Gang
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2017, 2017
  • [6] Joint Extraction of Entities and Relations Based on Deep Learning: A Survey
    Zhang Y.-S.
    Liu S.-K.
    Liu Y.
    Ren L.
    Xin Y.-H.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (04): : 1093 - 1116
  • [7] CyberEntRel: Joint extraction of cyber entities and relations using deep learning
    Ahmed, Kashan
    Khurshid, Syed Khaldoon
    Hina, Sadaf
    COMPUTERS & SECURITY, 2024, 136
  • [8] A distributed joint extraction framework for sedimentological entities and relations with federated learning
    Wang, Tianheng
    Zheng, Ling
    Lv, Hairong
    Zhou, Chenghu
    Shen, Yunheng
    Qiu, Qinjun
    Li, Yan
    Li, Pufan
    Wang, Guorui
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [9] Joint Extraction of Entities and Relations in the News Domain
    Li, Zeyu
    Ma, Haoyang
    Lv, Yingying
    Shen, Hao
    ADVANCED DATA MINING AND APPLICATIONS (ADMA 2022), PT I, 2022, 13725 : 81 - 92
  • [10] A Unified Multi-Task Learning Framework for Joint Extraction of Entities and Relations
    Zhao, Tianyang
    Yan, Zhao
    Cao, Yunbo
    Li, Zhoujun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14524 - 14531