Document-Level Relation Extraction With Context Guided Mention Integration and Inter-Pair Reasoning

被引:2
作者
Zeng, Daojian [1 ,2 ]
Zhao, Chao [3 ]
Jiang, Chao [1 ]
Zhu, Jianling [1 ]
Dai, Jianhua [1 ]
机构
[1] Hunan Normal Univ, Hunan Prov Key Lab Intelligent Comp & Language Inf, Changsha 410081, Peoples R China
[2] Hunan Normal Univ, Inst AI & Targeted Int Commun, Changsha 410081, Peoples R China
[3] Changsha Dworld AI Tech Co Ltd, Changsha 410081, Peoples R China
关键词
Cognition; Task analysis; Encoding; Context modeling; Transformers; Information processing; Data mining; Document-level relation extraction; inter-pair reasoning; context guided cross-attention; entity pair graph; graph nerual network;
D O I
10.1109/TASLP.2023.3316454
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Document-level Relation Extraction (DRE) aims to recognize the relations between two entities. The entity may correspond to multiple mentions that span beyond the sentence boundary. Few previous studies have investigated the mention integration, which may be problematic because coreferential mentions do not equally contribute to a specific relation. Moreover, prior efforts mainly focus on reasoning at entity-level rather than capturing the global interactions between the entity pairs. In this article, we propose two novel techniques, Context Guided Mention Integration and Inter-pair Reasoning (CGM2IR), to improve DRE. Instead of simply applying average pooling, the contexts are utilized to guide the integration of coreferential mentions in a weighted sum manner. Additionally, inter-pair reasoning executes an iterative algorithm on the entity pair graph, so as to model the interdependency of relations. We evaluate our CGM2IR model on three widely used benchmark datasets, namely DocRED, CDR, and GDA. Experimental results show that our model outperforms previous strong baselines and achieves remarkable effectiveness.
引用
收藏
页码:3659 / 3666
页数:8
相关论文
共 37 条
[1]  
Beltagy I, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P3615
[2]  
Cai R, 2016, PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, P756
[3]  
Christopoulou F, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P4925
[4]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[5]  
Guo L, 2020, P 28 INT C COMP LING, P1630
[6]  
Li B., 2020, P 28 INT C COMP LING, P1551
[7]   BioCreative V CDR task corpus: a resource for chemical disease relation extraction [J].
Li, Jiao ;
Sun, Yueping ;
Johnson, Robin J. ;
Sciaky, Daniela ;
Wei, Chih-Hsuan ;
Leaman, Robert ;
Davis, Allan Peter ;
Mattingly, Carolyn J. ;
Wiegers, Thomas C. ;
Lu, Zhiyong .
DATABASE-THE JOURNAL OF BIOLOGICAL DATABASES AND CURATION, 2016,
[8]  
Li JY, 2021, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, P1359
[9]  
Liu YH, 2019, Arxiv, DOI [arXiv:1907.11692, DOI 10.48550/ARXIV.1907.11692]
[10]  
Loshchilov I., 2017, DECOUPLED WEIGHT DEC, DOI DOI 10.48550/ARXIV.1711.05101