Integration of Relation Filtering and Multi-Task Learning in GlobalPointer for Entity and Relation Extraction

被引:0
作者
Liu, Bin [1 ,2 ]
Tao, Jialin [1 ,2 ]
Chen, Wanyuan [1 ,2 ]
Zhang, Yijie [1 ,2 ]
Chen, Min [1 ,2 ]
He, Lei [1 ,2 ]
Tang, Dan [1 ,2 ]
机构
[1] Chengdu Univ Informat Technol, Sch Software Engn, Chengdu 610225, Peoples R China
[2] Sichuan Prov Engn Technol Res Ctr Support Software, Chengdu 610225, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 15期
关键词
knowledge graph; joint entity and relation extraction; overlapping triplets; multi-task learning;
D O I
10.3390/app14156832
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The rise of knowledge graphs has been instrumental in advancing artificial intelligence (AI) research. Extracting entity and relation triples from unstructured text is crucial for the construction of knowledge graphs. However, Chinese text has a complex grammatical structure, which may lead to the problem of overlapping entities. Previous pipeline models have struggled to address such overlap problems effectively, while joint models require entity annotations for each predefined relation in the set, which results in redundant relations. In addition, the traditional models often lead to task imbalance by overlooking the differences between tasks. To tackle these challenges, this research proposes a global pointer network based on relation prediction and loss function improvement (GPRL) for joint extraction of entities and relations. Experimental evaluations on the publicly available Chinese datasets DuIE2.0 and CMeIE demonstrate that the GPRL model achieves a 1.2-26.1% improvement in F1 score compared with baseline models. Further, experiments of overlapping classification conducted on CMeIE have also verified the effectiveness of overlapping triad extraction and ablation experiments. The model is helpful in identifying entities and relations accurately and can reduce redundancy by leveraging relation filtering and the global pointer network. In addition, the incorporation of a multi-task learning framework balances the loss functions of multiple tasks and enhances task interactions.
引用
收藏
页数:17
相关论文
共 46 条
[31]  
Tan L., 2021, Big Data Res, V7, P80
[32]   Research on joint model relation extraction method based on entity mapping [J].
Tang, Hongmei ;
Zhu, Dixiongxiao ;
Tang, Wenzhong ;
Wang, Shuai ;
Wang, Yanyang ;
Wang, Lihong .
PLOS ONE, 2024, 19 (02)
[33]  
Tongfeng Guan, 2020, Natural Language Processing and Chinese Computing. 9th CCF International Conference, NLPCC 2020. Proceedings. Lecture Notes in Artificial Intelligence Subseries of Lecture Notes in Computer Science (LNAI 12430), P270, DOI 10.1007/978-3-030-60450-9_22
[34]   Knowledge Graph Embedding: A Survey of Approaches and Applications [J].
Wang, Quan ;
Mao, Zhendong ;
Wang, Bin ;
Guo, Li .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2017, 29 (12) :2724-2743
[35]  
Wang Y., 2020, P COLING, P1572, DOI DOI 10.18653/V1/2020.COLING-MAIN.138
[36]  
Wei ZP, 2020, 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), P1476
[37]  
Xiao Lizhong, 2023, Computer Engineering and Applications, P77, DOI 10.3778/j.issn.1002-8331.2205-0325
[38]   A Study on Double-Headed Entities and Relations Prediction Framework for Joint Triple Extraction [J].
Xiao, Yanbing ;
Chen, Guorong ;
Du, Chongling ;
Li, Lang ;
Yuan, Yu ;
Zou, Jincheng ;
Liu, Jingcheng .
MATHEMATICS, 2023, 11 (22)
[39]  
Yu BW, 2020, Arxiv, DOI arXiv:1909.04273
[40]   A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures [J].
Yu, Yong ;
Si, Xiaosheng ;
Hu, Changhua ;
Zhang, Jianxun .
NEURAL COMPUTATION, 2019, 31 (07) :1235-1270