Reinforcement Learning-Based Recommendation with User Reviews on Knowledge Graphs

被引:0
作者
Zhang, Siyuan [1 ]
Ouyang, Yuanxin [1 ]
Liu, Zhuang [2 ]
He, Weijie [2 ]
Rong, Wenge [2 ]
Xiong, Zhang [2 ]
机构
[1] Beihang Univ, State Key Lab Software Dev Environm, Beijing, Peoples R China
[2] Beihang Univ, Minist Educ, Engn Res Ctr Adv Comp Applicat Technol, Beijing, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2023 | 2023年 / 14119卷
基金
中国国家自然科学基金;
关键词
Recommendation system; Knowledge graph; Reinforcement learning; User reviews;
D O I
10.1007/978-3-031-40289-0_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Introducing knowledge graphs (KGs) into recommendation systems can improve their performance, while reinforcement learning (RL) methods can help utilize graph data for recommendation. We investigate existing RL-based methods for recommendation on KGs, and find that such approaches do not make full use of information from user reviews. Introducing user reviews into a recommendation system can reveal user preferences more deeply and equip a RL agent with a stronger ability to distinguish users' preferences for an item or not, which in turn improves the accuracy of recommendation results. We propose Reinforced Knowledge Graph Reasoning with User Reviews (RKGR-UR) by introducing user reviews into a RL-based recommendation model, which combines a rating prediction task to transform predicted ratings into rewards feedback for the RL agent. Experiments on three real datasets demonstrate the effectiveness of our method.
引用
收藏
页码:148 / 159
页数:12
相关论文
共 18 条
[1]  
[Anonymous], 2016, P 25 INT JOINT C ART
[2]  
[Anonymous], 2016, IJCAI
[3]   Knowledge-guided Deep Reinforcement Learning for Interactive Recommendation [J].
Chen, Xiaocong ;
Huang, Chaoran ;
Yao, Lina ;
Wang, Xianzhi ;
Liu, Wei ;
Zhang, Wenjie .
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
[4]   Reinforced KGs reasoning for explainable sequential recommendation [J].
Cui, Zhihong ;
Chen, Hongxu ;
Cui, Lizhen ;
Liu, Shijun ;
Liu, Xueyan ;
Xu, Guandong ;
Yin, Hongzhi .
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2022, 25 (02) :631-654
[5]   Learning to Collaborate in Multi-Module Recommendation via Multi-Agent Reinforcement Learning without Communication [J].
He, Xu ;
An, Bo ;
Li, Yanghua ;
Chen, Haikai ;
Wang, Rundong ;
Wang, Xinrun ;
Yu, Runsheng ;
Li, Xin ;
Wang, Zhirong .
RECSYS 2020: 14TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, 2020, :210-219
[6]  
Konda VR, 2000, ADV NEUR IN, V12, P1008
[7]   MATRIX FACTORIZATION TECHNIQUES FOR RECOMMENDER SYSTEMS [J].
Koren, Yehuda ;
Bell, Robert ;
Volinsky, Chris .
COMPUTER, 2009, 42 (08) :30-37
[8]   Reinforcement Learning over Sentiment-Augmented Knowledge Graphs towards Accurate and Explainable Recommendation [J].
Park, Sung-Jun ;
Chae, Dong-Kyu ;
Bae, Hong-Kyun ;
Park, Sumin ;
Kim, Sang-Wook .
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, :784-793
[9]  
Rendle S, 2012, Arxiv, DOI arXiv:1205.2618
[10]  
Shani G, 2005, J MACH LEARN RES, V6, P1265