Knowledge graph completion method based on hyperbolic representation learning and contrastive learning

被引:0
|
作者
Zhang, Xiaodong [1 ]
Wang, Meng [1 ]
Zhong, Xiuwen [1 ]
An, Feixu [2 ]
机构
[1] Nanjing Audit Univ, Sch Comp Sci, Nanjing 211815, Peoples R China
[2] Univ Toronto, Toronto, ON L5L 1C6, Canada
关键词
Knowledge graph completion; Hyperbolic representation learning; Comparison learning; Adversarial samples;
D O I
10.1016/j.eij.2023.100414
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph completion employs existing triples to deduce missing data, thereby enriching and enhancing graph completeness. Recent research has revealed that using hyperbolic representation learning in knowledge graph completion yields superior expressive and generalization capabilities. However, the long-tail problem and the presence of hyperbolic metrics make it challenging to effectively learn low-frequency entities or relations, resulting in embedding space distortion and impacting the original semantic relationships. Therefore, this paper proposes a knowledge graph completion method (Att-CL) that integrates hyperbolic representation learning and contrastive learning. In this approach, knowledge is embedded into a hyperbolic space, and samples with limited hierarchical characteristics and insufficient feature information are enhanced by introducing adversarial noise. The loss function of the embedded samples is backpropagated into embedding vectors, perturbations are adjusted in the gradient direction to promote smoothness and locality, and hyperparameters are introduced for fine-tuning the adversarial strength in the construction of adversarial samples for data augmentation to enhance model robustness. To mitigate data distortion due to hyperbolic metrics, a penalty term is introduced in the contrastive loss function to control the distances of the embedding vectors from the origin, thereby reducing the impact of the metrics and further improving the model's completion ability. Experimental results on the WN18RR and FB15K-237 benchmark datasets demonstrate significant improvements in metrics such as MRR, Hits@1, and Hits@3 compared to traditional knowledge graph completion models, providing ample evidence of the model's effectiveness.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Learning Entity Type Embeddings for Knowledge Graph Completion
    Moon, Changsung
    Jones, Paul
    Samatova, Nagiza F.
    CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 2215 - 2218
  • [22] Knowledge graph completion model based on hyperbolic hierarchical attention network
    Luo, Jiaohuang
    Song, Changlong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (09) : 3893 - 3909
  • [23] Power Grid Knowledge Graph Completion with Complex Structure Learning
    Zheng, Zhou
    Guo, Jun
    Liao, Feilong
    Huang, Qiyao
    Zhang, Yingyue
    Zhao, Zhichao
    Lin, Chenxiang
    Zhang, Zhihong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT V, 2023, 14090 : 669 - 679
  • [24] Graph2Seq: Fusion Embedding Learning for Knowledge Graph Completion
    Li, Weidong
    Zhang, Xinyu
    Wang, Yaqian
    Yan, Zhihuan
    Peng, Rong
    IEEE ACCESS, 2019, 7 : 157960 - 157971
  • [25] Knowledge Graph Completion via Multi-feature Learning
    Zhang, Hanwen
    Yao, Juanjuan
    Zhu, Yi'an
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IV, ICIC 2024, 2024, 14878 : 269 - 280
  • [26] A lightweight hierarchical graph convolutional model for knowledge graph representation learning
    Zhang, Jinglin
    Shen, Bo
    APPLIED INTELLIGENCE, 2024, 54 (21) : 10695 - 10708
  • [27] Simple Knowledge Graph Completion Model Based on Differential Negative Sampling and Prompt Learning
    Duan, Li
    Wang, Jing
    Luo, Bing
    Sun, Qiao
    INFORMATION, 2023, 14 (08)
  • [28] Open knowledge graph completion with negative-aware representation learning and multi-source reliability inference
    Peng, Huang
    Zeng, Weixin
    Tang, Jiuyang
    Wang, Mao
    Huang, Hongbin
    Zhao, Xiang
    INFORMATION FUSION, 2025, 115
  • [29] Multi-view Contrastive Multiple Knowledge Graph Embedding for Knowledge Completion
    Kurokawa, Mori
    Yonekawa, Kei
    Haruta, Shuichiro
    Konishi, Tatsuya
    Asoh, Hideki
    Ono, Chihiro
    Hagiwara, Masafumi
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 1412 - 1418
  • [30] Improving Knowledge Graph Completion Using Soft Rules and Adversarial Learning
    TANG, Caifang
    RAO, Yuan
    YU, Hualei
    SUN, Ling
    CHENG, Jiamin
    WANG, Yutian
    CHINESE JOURNAL OF ELECTRONICS, 2021, 30 (04) : 623 - 633