Document-Level Relation Extraction with Local Relation and Global Inference

被引:1
|
作者
Liu, Yiming [1 ]
Shan, Hongtao [1 ]
Nie, Feng [2 ]
Zhang, Gaoyu [3 ]
Yuan, George Xianzhi [4 ,5 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
[2] Shanghai Lixin Univ Accounting & Finance, Sch Finance, Shanghai 201209, Peoples R China
[3] Shanghai Lixin Univ Accounting & Finance, Sch Informat Management, Shanghai 201209, Peoples R China
[4] Chongqing Univ Technol, Coll Sci, Chongqing 400054, Peoples R China
[5] Chengdu Univ, Business Sch, Chengdu 610106, Peoples R China
基金
中国国家自然科学基金;
关键词
document-level relation extraction; multi-hop reasoning; attention mechanism; BERT pre-trained model; Floyd algorithm;
D O I
10.3390/info14070365
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The current popular approach to the extraction of document-level relations is mainly based on either a graph structure or serialization model method for the inference, but the graph structure method makes the model complicated, while the serialization model method decreases the extraction accuracy as the text length increases. To address such problems, the goal of this paper is to develop a new approach for document-level relationship extraction by applying a new idea through the consideration of so-called "Local Relationship and Global Inference" (in short, LRGI), which means that we first encode the text using the BERT pre-training model to obtain a local relationship vector first by considering a local context pooling and bilinear group algorithm and then establishing a global inference mechanism based on Floyd's algorithm to achieve multi-path multi-hop inference and obtain the global inference vector, which allow us to extract multi-classified relationships with adaptive thresholding criteria. Taking the DocRED dataset as a testing set, the numerical results show that our proposed new approach (LRGI) in this paper achieves an accuracy of 0.73, and the value of F1 is 62.11, corresponding to 28% and 2% improvements by comparing with the classical document-level relationship extraction model (ATLOP), respectively.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Evidence-aware Document-level Relation Extraction
    Xu, Tianyu
    Hua, Wen
    Qu, Jianfeng
    Li, Zhixu
    Xu, Jiajie
    Liu, An
    Zhao, Lei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2311 - 2320
  • [32] A Hierarchical Network for Multimodal Document-Level Relation Extraction
    Kong, Lingxing
    Wang, Jiuliang
    Ma, Zheng
    Zhou, Qifeng
    Zhang, Jianbing
    He, Liang
    Chen, Jiajun
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 16, 2024, : 18408 - 18416
  • [33] A Document-Level Relation Extraction Framework with Dynamic Pruning
    Zhang, Hanyue
    Li, Li
    Shen, Jun
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VIII, 2023, 14261 : 13 - 25
  • [34] Rethinking Document-Level Relation Extraction: A Reality Check
    Li, Jing
    Wang, Yequan
    Zhang, Shuai
    Zhang, Min
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, 2023, : 5715 - 5730
  • [35] HistRED: A Historical Document-Level Relation Extraction Dataset
    Yang, Soyoung
    Choi, Minseok
    Cho, Youngwoo
    Choo, Jaegul
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 3207 - 3224
  • [36] Document-level Relation Extraction via Separate Relation Representation and Logical Reasoning
    Huang, Heyan
    Yuan, Changsen
    Liu, Qian
    Cao, Yixin
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (01)
  • [37] EIDER: Empowering Document-level Relation Extraction with Efficient Evidence Extraction and Inference-stage Fusion
    Xie, Yiqing
    Shen, Jiaming
    Li, Sha
    Mao, Yuning
    Han, Jiawei
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), 2022, : 257 - 268
  • [38] Correction: GAL: combining global and local contexts for interpersonal relation extraction toward document-level Chinese text
    Jiawei Ge
    Jiuxin Cao
    Yingxing Bao
    Biwei Cao
    Bo Liu
    Neural Computing and Applications, 2024, 36 (11) : 5733 - 5733
  • [39] Enhancing Document-Level Relation Extraction with Entity Pronoun Resolution and Relation Correlation
    Pi, Qiankun
    Lu, Jicang
    Sun, Yepeng
    Zhu, Taojie
    Xia, Yi
    Yang, Chenguang
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT II, NLPCC 2024, 2025, 15360 : 174 - 186
  • [40] Explicit Relation-Enhanced AMR for Document-Level Event Argument Extraction with Global-Local Attention
    Wang, Pushi
    Luo, Tao
    Wang, Xin
    Rao, Guozheng
    WEB AND BIG DATA, APWEB-WAIM 2024, PT I, 2024, 14961 : 105 - 120