Reinforcement Learning-Based Recommendation with User Reviews on Knowledge Graphs

被引:0
作者
Zhang, Siyuan [1 ]
Ouyang, Yuanxin [1 ]
Liu, Zhuang [2 ]
He, Weijie [2 ]
Rong, Wenge [2 ]
Xiong, Zhang [2 ]
机构
[1] Beihang Univ, State Key Lab Software Dev Environm, Beijing, Peoples R China
[2] Beihang Univ, Minist Educ, Engn Res Ctr Adv Comp Applicat Technol, Beijing, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2023 | 2023年 / 14119卷
基金
中国国家自然科学基金;
关键词
Recommendation system; Knowledge graph; Reinforcement learning; User reviews;
D O I
10.1007/978-3-031-40289-0_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Introducing knowledge graphs (KGs) into recommendation systems can improve their performance, while reinforcement learning (RL) methods can help utilize graph data for recommendation. We investigate existing RL-based methods for recommendation on KGs, and find that such approaches do not make full use of information from user reviews. Introducing user reviews into a recommendation system can reveal user preferences more deeply and equip a RL agent with a stronger ability to distinguish users' preferences for an item or not, which in turn improves the accuracy of recommendation results. We propose Reinforced Knowledge Graph Reasoning with User Reviews (RKGR-UR) by introducing user reviews into a RL-based recommendation model, which combines a rating prediction task to transform predicted ratings into rewards feedback for the RL agent. Experiments on three real datasets demonstrate the effectiveness of our method.
引用
收藏
页码:148 / 159
页数:12
相关论文
共 18 条
[11]  
Song WP, 2022, Arxiv, DOI arXiv:1906.09506
[12]   Recommender Systems Based on Collaborative Filtering Using Review Texts-A Survey [J].
Srifi, Mehdi ;
Oussous, Ahmed ;
Ait Lahcen, Ayoub ;
Mouline, Salma .
INFORMATION, 2020, 11 (06)
[13]  
Sutton RS, 2000, ADV NEUR IN, V12, P1057
[14]   KGAT: Knowledge Graph Attention Network for Recommendation [J].
Wang, Xiang ;
He, Xiangnan ;
Cao, Yixin ;
Liu, Meng ;
Chua, Tat-Seng .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :950-958
[15]   Multi-level Recommendation Reasoning over Knowledge Graphs with Reinforcement Learning [J].
Wang, Xiting ;
Liu, Kunpeng ;
Wang, Dongjie ;
Wu, Le ;
Fu, Yanjie ;
Xie, Xing .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :2098-2108
[16]   Reinforcement Knowledge Graph Reasoning for Explainable Recommendation [J].
Xian, Yikun ;
Fu, Zuohui ;
Muthukrishnan, S. ;
de Melo, Gerard ;
Zhang, Yongfeng .
PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, :285-294
[17]   Explicit Factor Models for Explainable Recommendation based on Phrase-level Sentiment Analysis [J].
Zhang, Yongfeng ;
Lai, Guokun ;
Zhang, Min ;
Zhang, Yi ;
Liu, Yiqun ;
Ma, Shaoping .
SIGIR'14: PROCEEDINGS OF THE 37TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2014, :83-92
[18]   Joint Deep Modeling of Users and Items Using Reviews for Recommendation [J].
Zheng, Lei ;
Noroozi, Vahid ;
Yu, Philip S. .
WSDM'17: PROCEEDINGS OF THE TENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2017, :425-433