SimRE: Simple contrastive learning with soft logical rule for knowledge graph embedding

被引:8
作者
Zhang, Dong [1 ]
Rong, Zhe [1 ]
Xue, Chengyuan [1 ]
Li, Guanyu [1 ]
机构
[1] Dalian Maritime Univ, Informat Sci & Technol Coll, 1 Linghai Rd, Dalian 116000, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graph completion; Knowledge graph embedding; Contrastive learning; Logical rule; REPRESENTATION;
D O I
10.1016/j.ins.2023.120069
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Knowledge graphs serve as a pivotal framework for the structured representation of information regarding entities and relations. However, in the real world, these knowledge graphs are often incomplete and harboring missing facts. Knowledge graph completion (KGC) has emerged as a central research focus, entailing the automated prediction of these missing facts and garnering substantial scholarly attention in recent years. Text -based knowledge graph embedding methods have demonstrated considerable potential for tackling the challenges associated with KGC by employing pre -trained language models. However, their limitation lies in the lack of logical features, which constrains the efficacy of capturing intricate patterns within knowledge graphs. This paper proposed SimRE, a straightforward contrastive learning framework augmented with soft logic rules. SimRE introduces a self -supervised framework that leverages the input rule bodies to predict the corresponding rule heads through a contrastive objective. We introduced two rule sampling techniques to enhance the efficiency and accuracy of the model: in -batch rule negatives and pre -batch rule negatives. SimRE employs a simple method for integrating logical features with the text -based model. The experimental results on benchmark datasets demonstrate that the proposed approach outperforms state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 48 条
[1]   PKET-GCN: Prior knowledge enhanced time-varying graph convolution network for traffic flow prediction [J].
Bao, Yinxin ;
Liu, Jiali ;
Shen, Qinqin ;
Cao, Yang ;
Ding, Weiping ;
Shi, Quan .
INFORMATION SCIENCES, 2023, 634 :359-381
[2]  
Bellomarini L., 2023, Theory Pract. Log. Program., V23, P507
[3]  
Bordes A., 2013, ADV NEURAL INFORM PR, V26
[4]  
Chao LL, 2021, Arxiv, DOI arXiv:2011.03798
[5]   RLPath: a knowledge graph link prediction method using reinforcement learning based attentive relation path searching and representation learning [J].
Chen, Ling ;
Cui, Jun ;
Tang, Xing ;
Qian, Yuntao ;
Li, Yansheng ;
Zhang, Yongjun .
APPLIED INTELLIGENCE, 2022, 52 (04) :4715-4726
[6]   Incorporating anticipation embedding into reinforcement learning framework for multi-hop knowledge graph question answering [J].
Cui, Hai ;
Peng, Tao ;
Xiao, Feng ;
Han, Jiayu ;
Han, Ridong ;
Liu, Lu .
INFORMATION SCIENCES, 2023, 619 :745-761
[7]   Inductive Entity Representations from Text via Link Prediction [J].
Daza, Daniel ;
Cochez, Michael ;
Groth, Paul .
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, :798-808
[8]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
[9]  
Devlin J, 2019, Arxiv, DOI arXiv:1810.04805
[10]   Cross-Modal Contrastive Learning for Remote Sensing Image Classification [J].
Feng, Zhixi ;
Song, Liangliang ;
Yang, Shuyuan ;
Zhang, Xinyu ;
Jiao, Licheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61