An attention mechanism and residual network based knowledge graph-enhanced recommender system

被引:2
|
作者
Li, Weisheng [1 ,2 ]
Zhong, Hao [1 ,2 ]
Zhou, Junming [1 ]
Chang, Chao [2 ,3 ]
Lin, Ronghua [1 ,2 ]
Tang, Yong [1 ,2 ]
机构
[1] South China Normal Univ, Sch Comp Sci, Guangzhou 510631, Peoples R China
[2] Pazhou Lab, Guangzhou 510330, Peoples R China
[3] Guangzhou Panyu Polytech, Sch Informat Engn, Guangzhou 511483, Peoples R China
关键词
Knowledge graph; Recommender system; Residual network; Attention mechanism;
D O I
10.1016/j.knosys.2024.112042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recommender systems enhanced by a knowledge graph (KG) have attained widespread popularity and attention in recent years. However, traditional KG -based recommender systems encounter the challenge gradient explosion as the network depth increases. Additionally, the abundance of unreliable paths in KG has a detrimental impact on feature representation learning. In this article, we propose a KG -enhanced recommender system based on residual network and attention mechanism, which can capture high -order connectivity and long-range dependencies of the KG. Specifically, a resource allocation approach is employed to calculate the resource amount, which is subsequently utilized to evaluate the path reliability of the KG. After completing path extraction, we employ an attention mechanism to capture semantic correlations and structural information. To leverage the KG for enhancing recommender systems, we design a deep residual network with shortcut connections, effectively amalgamating advanced and abstract features using deep neural networks. The introduction of shortcut connections not only facilitates the fitting of residual mappings but also mitigates potential issues such as gradient explosion and convergence difficulties due to excessive network depth. Extensive experiments conducted on three standard datasets over baseline methods have demonstrated the superiority of our proposed recommender system.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Knowledge Graph Enhanced Contextualized Attention-Based Network for Responsible User-Specific Recommendation
    Elahi, Ehsan
    Anwar, Sajid
    Shah, Babar
    Halim, Zahid
    Ullah, Abrar
    Rida, Imad
    Waqas, Muhammad
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2024, 15 (04)
  • [22] Relation extraction for manufacturing knowledge graphs based on feature fusion of attention mechanism and graph convolution network
    Du, Kaze
    Yang, Bo
    Wang, Shilong
    Chang, Yongsheng
    Li, Song
    Yi, Gang
    KNOWLEDGE-BASED SYSTEMS, 2022, 255
  • [23] Knowledge graph completion based on graph contrastive attention network
    Liu D.
    Fang Q.
    Zhang X.
    Hu J.
    Qian S.
    Xu C.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2022, 48 (08): : 1428 - 1435
  • [24] KGIE: Knowledge graph convolutional network for recommender system with interactive embedding
    Li, Mingqi
    Ma, Wenming
    Chu, Zihao
    KNOWLEDGE-BASED SYSTEMS, 2024, 295
  • [25] Improving recommender system via knowledge graph based exploring user preference
    Fan, Huilian
    Zhong, Yuanchang
    Zeng, Guangpu
    Ge, Chenhao
    APPLIED INTELLIGENCE, 2022, 52 (09) : 10032 - 10044
  • [26] Improving recommender system via knowledge graph based exploring user preference
    Huilian Fan
    Yuanchang Zhong
    Guangpu Zeng
    Chenhao Ge
    Applied Intelligence, 2022, 52 : 10032 - 10044
  • [27] Medical Entity Recognition Based on BiLSTM with Knowledge Graph and Attention Mechanism
    Wang, Qiaoling
    Liu, Yu
    Gu, Jinguang
    Fu, Haidong
    2021 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS 2021), 2021, : 149 - 157
  • [28] A deep embedding model for knowledge graph completion based on attention mechanism
    Huang, Jin
    Zhang, TingHua
    Zhu, Jia
    Yu, Weihao
    Tang, Yong
    He, Yang
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (15) : 9751 - 9760
  • [29] A deep learning knowledge graph neural network for recommender systems
    Kaur, Gurinder
    Liu, Fei
    Chen, Yi-Ping Phoebe
    MACHINE LEARNING WITH APPLICATIONS, 2023, 14
  • [30] A deep embedding model for knowledge graph completion based on attention mechanism
    Jin Huang
    TingHua Zhang
    Jia Zhu
    Weihao Yu
    Yong Tang
    Yang He
    Neural Computing and Applications, 2021, 33 : 9751 - 9760