Knowledge graph completion method based on hyperbolic representation learning and contrastive learning

被引:0
作者
Zhang, Xiaodong [1 ]
Wang, Meng [1 ]
Zhong, Xiuwen [1 ]
An, Feixu [2 ]
机构
[1] Nanjing Audit Univ, Sch Comp Sci, Nanjing 211815, Peoples R China
[2] Univ Toronto, Toronto, ON L5L 1C6, Canada
关键词
Knowledge graph completion; Hyperbolic representation learning; Comparison learning; Adversarial samples;
D O I
10.1016/j.eij.2023.100414
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph completion employs existing triples to deduce missing data, thereby enriching and enhancing graph completeness. Recent research has revealed that using hyperbolic representation learning in knowledge graph completion yields superior expressive and generalization capabilities. However, the long-tail problem and the presence of hyperbolic metrics make it challenging to effectively learn low-frequency entities or relations, resulting in embedding space distortion and impacting the original semantic relationships. Therefore, this paper proposes a knowledge graph completion method (Att-CL) that integrates hyperbolic representation learning and contrastive learning. In this approach, knowledge is embedded into a hyperbolic space, and samples with limited hierarchical characteristics and insufficient feature information are enhanced by introducing adversarial noise. The loss function of the embedded samples is backpropagated into embedding vectors, perturbations are adjusted in the gradient direction to promote smoothness and locality, and hyperparameters are introduced for fine-tuning the adversarial strength in the construction of adversarial samples for data augmentation to enhance model robustness. To mitigate data distortion due to hyperbolic metrics, a penalty term is introduced in the contrastive loss function to control the distances of the embedding vectors from the origin, thereby reducing the impact of the metrics and further improving the model's completion ability. Experimental results on the WN18RR and FB15K-237 benchmark datasets demonstrate significant improvements in metrics such as MRR, Hits@1, and Hits@3 compared to traditional knowledge graph completion models, providing ample evidence of the model's effectiveness.
引用
收藏
页数:10
相关论文
共 33 条
[1]  
Balazevic I, 2019, ADV NEUR IN, V32
[2]  
B‚cigneul G, 2019, Arxiv, DOI arXiv:1810.00760
[3]  
Bollacker KD., 2008, P ACM SIGMOD INT C M, P1247, DOI DOI 10.1145/1376616.1376746
[4]  
Bordes Antoine, 2013, Advances in neural information processing systems, V26
[5]  
Chami I, 2019, ADV NEUR IN, V32
[6]  
Chami I, 2020, Arxiv, DOI [arXiv:2005.00545, 10.48550/arXiv.2005.00545]
[7]   A review: Knowledge reasoning over knowledge graph [J].
Chen, Xiaojun ;
Jia, Shengbin ;
Xiang, Yang .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 141
[8]   Knowledge Graph Completion: A Review [J].
Chen, Zhe ;
Wang, Yuehan ;
Zhao, Bin ;
Cheng, Jing ;
Zhao, Xin ;
Duan, Zongtao .
IEEE ACCESS, 2020, 8 :192435-192456
[9]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
[10]  
Dhingra B, 2018, Arxiv, DOI arXiv:1806.04313