Document-Level Relation Extraction with Additional Evidence and Entity Type Information

被引:0
作者
Li, Jinliang [1 ]
Wang, Junlei [1 ]
Li, Canyu [1 ]
Liu, Xiaojing [1 ]
Feng, Zaiwen [1 ,2 ,3 ,4 ]
Qin, Li [1 ,2 ,3 ,4 ]
Mayer, Wolfgang [5 ]
机构
[1] Huazhong Agr Univ, Coll Informat, Wuhan 430070, Peoples R China
[2] Huazhong Agr Univ, Key Lab Smart Farming Agr Animals, Wuhan 430070, Peoples R China
[3] Huazhong Agr Univ, Hubei Engn Technol Res Ctr Agr Big Data, Wuhan 430070, Peoples R China
[4] Huazhong Agr Univ, Engn Res Ctr Intelligent Technol Agr, Minist Educ, Wuhan 430070, Peoples R China
[5] Univ South Australia, Ind AI Res Ctr, Adelaide, SA 4057, Australia
来源
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT III, ICIC 2024 | 2024年 / 14877卷
关键词
Document-level relation extraction; Evidence retrieval; Entity type;
D O I
10.1007/978-981-97-5669-8_19
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Document-level relation extraction faces the challenges of longer text and more complex context than sentence-level relation extraction. In document-level relation extraction, the relation information of an entity pair is usually contained within one or several sentences. However, excessively long document text may lead the model to focus on irrelevant sentences containing wrong information. On the other hand, using only textual information for relation extraction may not be sufficient, some previous models used only text information for relation extraction, ignoring some features of entities themselves, such as entity types, which can be guidance to relation extraction. To address these issues, a Sentence-Token Attention (STA) layer is developed to integrate sentence-level information into tokens. With a supervised attention optimization, the STA layer enables entities to focus more on relevant sentences. After that, we use an evidence fusion method to fuse the sentence information with context embedding. In addition, we indirectly incorporate the entity type information into the entity embedding as guidance to relation classification. Compared with different models, it is found that our model performs better in both relation extraction and evidence retrieval tasks than previous works.
引用
收藏
页码:226 / 237
页数:12
相关论文
共 17 条
[1]  
[Anonymous], 2014, P COLING 2014 25 INT
[2]  
Cheng JP, 2016, Arxiv, DOI [arXiv:1601.06733, DOI 10.18653/V1/D16-1053, 10.18653/v1/D16-1053]
[3]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[4]  
Huang ZH, 2015, Arxiv, DOI [arXiv:1508.01991, 10.48550/ARXIV.1508.01991]
[5]  
Ma YM, 2023, 17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, P1971
[6]  
Miwa M, 2016, PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, P1105
[7]  
Tan Q, 2022, P 2022 C EMPIRICAL M, P8472
[8]  
Vaswani A, 2017, ADV NEUR IN, V30
[9]  
Wang H, 2019, Arxiv, DOI [arXiv:1909.11898, DOI 10.48550/ARXIV.1909.11898]
[10]   Deep learning-based relation extraction and knowledge graph-based representation of construction safety requirements [J].
Wang, Xiyu ;
El-Gohary, Nora .
AUTOMATION IN CONSTRUCTION, 2023, 147