Knowledge graph completion method based on hyperbolic representation learning and contrastive learning

被引:0
|
作者
Zhang, Xiaodong [1 ]
Wang, Meng [1 ]
Zhong, Xiuwen [1 ]
An, Feixu [2 ]
机构
[1] Nanjing Audit Univ, Sch Comp Sci, Nanjing 211815, Peoples R China
[2] Univ Toronto, Toronto, ON L5L 1C6, Canada
关键词
Knowledge graph completion; Hyperbolic representation learning; Comparison learning; Adversarial samples;
D O I
10.1016/j.eij.2023.100414
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Knowledge graph completion employs existing triples to deduce missing data, thereby enriching and enhancing graph completeness. Recent research has revealed that using hyperbolic representation learning in knowledge graph completion yields superior expressive and generalization capabilities. However, the long-tail problem and the presence of hyperbolic metrics make it challenging to effectively learn low-frequency entities or relations, resulting in embedding space distortion and impacting the original semantic relationships. Therefore, this paper proposes a knowledge graph completion method (Att-CL) that integrates hyperbolic representation learning and contrastive learning. In this approach, knowledge is embedded into a hyperbolic space, and samples with limited hierarchical characteristics and insufficient feature information are enhanced by introducing adversarial noise. The loss function of the embedded samples is backpropagated into embedding vectors, perturbations are adjusted in the gradient direction to promote smoothness and locality, and hyperparameters are introduced for fine-tuning the adversarial strength in the construction of adversarial samples for data augmentation to enhance model robustness. To mitigate data distortion due to hyperbolic metrics, a penalty term is introduced in the contrastive loss function to control the distances of the embedding vectors from the origin, thereby reducing the impact of the metrics and further improving the model's completion ability. Experimental results on the WN18RR and FB15K-237 benchmark datasets demonstrate significant improvements in metrics such as MRR, Hits@1, and Hits@3 compared to traditional knowledge graph completion models, providing ample evidence of the model's effectiveness.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A Knowledge Graph Completion Method Based on Fusing Association Information
    Wang, Yuhao
    Zhao, Erping
    Wang, Wei
    IEEE ACCESS, 2022, 10 : 50500 - 50507
  • [42] A contrastive knowledge graph embedding model with hierarchical attention and dynamic completion
    Bin Shang
    Yinliang Zhao
    Jun Liu
    Yifan Liu
    Chenxin Wang
    Neural Computing and Applications, 2023, 35 : 15005 - 15018
  • [43] PEJL: A path-enhanced joint learning approach for knowledge graph completion
    Lu, Xinyu
    Wang, Lifang
    Jiang, Zejun
    Liu, Shizhong
    Lin, Jiashi
    AIMS MATHEMATICS, 2023, 8 (09): : 20966 - 20988
  • [44] Knowledge Graph Completion by Jointly Learning Structural Features and Soft Logical Rules
    Li, Weidong
    Peng, Rong
    Li, Zhi
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (03) : 2724 - 2735
  • [45] Relational semantic-enhanced logic rule learning for knowledge graph completion
    Huang, Yuxin
    Zhao, Zhiyong
    Xiang, Yan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, : 3035 - 3048
  • [46] MetaP: Meta Pattern Learning for One-Shot Knowledge Graph Completion
    Jiang, Zhiyi
    Gao, Jianliang
    Lv, Xinqi
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 2232 - 2236
  • [47] Correlation embedding learning with dynamic semantic enhanced sampling for knowledge graph completion
    Haojie Nie
    Xiangguo Zhao
    Xin Bi
    Yuliang Ma
    George Y. Yuan
    World Wide Web, 2023, 26 : 2887 - 2907
  • [48] Correlation embedding learning with dynamic semantic enhanced sampling for knowledge graph completion
    Nie, Haojie
    Zhao, Xiangguo
    Bi, Xin
    Ma, Yuliang
    Yuan, George Y.
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05): : 2887 - 2907
  • [49] Type-Enhanced Temporal Knowledge Graph Representation Learning Model
    He P.
    Zhou G.
    Chen J.
    Zhang M.
    Ning Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (04): : 916 - 929
  • [50] Research on Knowledge Graph Completion Based upon Knowledge Graph Embedding
    Feng, Tuoyu
    Wu, Yongsheng
    Li, Libing
    2024 9TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS, ICCCS 2024, 2024, : 1335 - 1342