Knowledge-guided Deep Reinforcement Learning for Interactive Recommendation

被引:359
作者
Chen, Xiaocong [1 ]
Huang, Chaoran [1 ]
Yao, Lina [1 ]
Wang, Xianzhi [2 ]
Liu, Wei [1 ]
Zhang, Wenjie [1 ]
机构
[1] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
[2] Univ Technol Sydney, Sch Comp Sci, Sydney, NSW, Australia
来源
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2020年
关键词
Recommender System; Reinforcement Learning; Deep Neural Network;
D O I
10.1109/ijcnn48605.2020.9207010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Interactive recommendation aims to learn from dynamic interactions between items and users to achieve responsiveness and accuracy. Reinforcement learning is inherently advantageous for coping with dynamic environments and thus has attracted increasing attention in interactive recommendation research. Inspired by knowledge-aware recommendation, we proposed Knowledge-Guided deep Reinforcement learning (KGRL) to harness the advantages of both reinforcement learning and knowledge graphs for interactive recommendation. This model is implemented upon the actor-critic network framework. It maintains a local knowledge network to guide decision-making and employs the attention mechanism to capture long-term semantics between items. We have conducted comprehensive experiments in a simulated online environment with six public real-world datasets and demonstrated the superiority of our model over several state-of-the-art methods.
引用
收藏
页数:8
相关论文
共 34 条
  • [11] Kang Wang- Cheng, 2018, 2018 IEEE INT C DAT
  • [12] Li Z., 2018, ADV NEURAL INFORM PR
  • [13] Lillicrap Timothy P, 2016, 4 INT C LEARN REPR
  • [14] Liu Yong, 2019, ARXIV190307826
  • [15] Human-level control through deep reinforcement learning
    Mnih, Volodymyr
    Kavukcuoglu, Koray
    Silver, David
    Rusu, Andrei A.
    Veness, Joel
    Bellemare, Marc G.
    Graves, Alex
    Riedmiller, Martin
    Fidjeland, Andreas K.
    Ostrovski, Georg
    Petersen, Stig
    Beattie, Charles
    Sadik, Amir
    Antonoglou, Ioannis
    King, Helen
    Kumaran, Dharshan
    Wierstra, Daan
    Legg, Shane
    Hassabis, Demis
    [J]. NATURE, 2015, 518 (7540) : 529 - 533
  • [16] Interactive Recommendation via Deep Neural Memory Augmented Contextual Bandits
    Shen, Yilin
    Deng, Yue
    Ray, Avik
    Jin, Hongxia
    [J]. 12TH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS), 2018, : 122 - 130
  • [17] Vaswani A, 2017, ADV NEUR IN, V30
  • [18] Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems
    Wang, Hongwei
    Zhang, Fuzheng
    Zhang, Mengdi
    Leskovec, Jure
    Zhao, Miao
    Li, Wenjie
    Wang, Zhongyuan
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 968 - 977
  • [19] Knowledge Graph Convolutional Networks for Recommender Systems
    Wang, Hongwei
    Zhao, Miao
    Xie, Xing
    Li, Wenjie
    Guo, Minyi
    [J]. WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 3307 - 3313
  • [20] Wang HZ, 2017, AAAI CONF ARTIF INTE, P2695