Knowledge-guided Deep Reinforcement Learning for Interactive Recommendation

被引:297
作者
Chen, Xiaocong [1 ]
Huang, Chaoran [1 ]
Yao, Lina [1 ]
Wang, Xianzhi [2 ]
Liu, Wei [1 ]
Zhang, Wenjie [1 ]
机构
[1] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
[2] Univ Technol Sydney, Sch Comp Sci, Sydney, NSW, Australia
来源
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2020年
关键词
Recommender System; Reinforcement Learning; Deep Neural Network;
D O I
10.1109/ijcnn48605.2020.9207010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Interactive recommendation aims to learn from dynamic interactions between items and users to achieve responsiveness and accuracy. Reinforcement learning is inherently advantageous for coping with dynamic environments and thus has attracted increasing attention in interactive recommendation research. Inspired by knowledge-aware recommendation, we proposed Knowledge-Guided deep Reinforcement learning (KGRL) to harness the advantages of both reinforcement learning and knowledge graphs for interactive recommendation. This model is implemented upon the actor-critic network framework. It maintains a local knowledge network to guide decision-making and employs the attention mechanism to capture long-term semantics between items. We have conducted comprehensive experiments in a simulated online environment with six public real-world datasets and demonstrated the superiority of our model over several state-of-the-art methods.
引用
收藏
页数:8
相关论文
共 34 条
[11]  
Li Z., 2018, ADV NEURAL INFORM PR
[12]  
Lillicrap Timothy P, 2016, P 4 INT C LEARNING R
[13]  
Liu Y, 2019, ARXIV190307826
[14]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[15]   Interactive Recommendation via Deep Neural Memory Augmented Contextual Bandits [J].
Shen, Yilin ;
Deng, Yue ;
Ray, Avik ;
Jin, Hongxia .
12TH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS), 2018, :122-130
[16]  
Vaswani A, 2017, ADV NEUR IN, V30
[17]   Knowledge-aware Graph Neural Networks with Label Smoothness Regularization for Recommender Systems [J].
Wang, Hongwei ;
Zhang, Fuzheng ;
Zhang, Mengdi ;
Leskovec, Jure ;
Zhao, Miao ;
Li, Wenjie ;
Wang, Zhongyuan .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :968-977
[18]   Knowledge Graph Convolutional Networks for Recommender Systems [J].
Wang, Hongwei ;
Zhao, Miao ;
Xie, Xing ;
Li, Wenjie ;
Guo, Minyi .
WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, :3307-3313
[19]  
Wang HZ, 2017, AAAI CONF ARTIF INTE, P2695
[20]   Learning Hidden Features for Contextual Bandits [J].
Wang, Huazheng ;
Wu, Qingyun ;
Wang, Hongning .
CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, :1633-1642