Session-based Interactive Recommendation via Deep Reinforcement Learning

被引:1
作者
Shi, Longxiang [1 ]
Zhang, Zilin [2 ]
Wang, Shoujin [3 ]
Zhang, Qi [4 ]
Wu, Minghui [1 ]
Yang, Cheng [1 ]
Li, Shijian [2 ,5 ]
机构
[1] Hangzhou City Univ, Hangzhou, Peoples R China
[2] Zhejiang Univ, Hangzhou, Peoples R China
[3] Univ Technol Sydney, Sydney, Australia
[4] Tongji Univ, Shanghai, Peoples R China
[5] Qiantang Sci & Technol Innovat Ctr, Hangzhou, Peoples R China
来源
23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023 | 2023年
关键词
Interactive Recommendation; Reinforcement Learning; Deep Learning;
D O I
10.1109/ICDM58522.2023.00168
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep reinforcement learning (DRL), has shown promise in solving intractable challenges in interactive recommendation systems. In DRL-based interactive recommendation, state modeling is crucial for well-capturing users' continuous interaction behaviors with shopping systems. A user's multiple continuous interactions in a given time period (e.g., the time from login to log out) naturally constitute a session. However, existing studies often overlook such valuable session structure and characteristics and instead simply treat them as sequences. As a result, they are not able to capture the complex transitions over users' interactions within or between sessions, leading ho significant information loss. To bridge this significant gap, in this paper, we propose Session -based Interactive Recommendation with Graph Neural Networks (SIR-GNN). SIR-GNN models interaction data as sessions and employs novel graph neural networks to capture rich transition patterns among interactions. Specifically, a novel 3 -level transition module is well designed to effectively capture common patterns from all sessions, intrasession transitions, and adjacent -item transitions respectively, followed by an attention -based gated graph neural network to model the state representation for SIR well. Extensive experiments on 3 real -world benchmark datasels demonstrate the superiority of SIR-GNN over state-of-the-art baselines and the rationality of our design in SIR-GNN.
引用
收藏
页码:1319 / 1324
页数:6
相关论文
共 37 条
[1]  
Afsar M Mehdi, 2021, ACM Computing Surveys (CSUR)
[2]   Dual Attention Transfer in Session-based Recommendation with Multi-dimensional Integration [J].
Chen, Chen ;
Guo, Jie ;
Song, Bin .
SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, :869-878
[3]  
Chen HK, 2019, AAAI CONF ARTIF INTE, P3312
[4]   Handling Information Loss of Graph Neural Networks for Session-based Recommendation [J].
Chen, Tianwen ;
Wong, Raymond Chi-Wing .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :1172-1180
[5]  
Chen XY, 2019, PR MACH LEARN RES, V97
[6]   DRCGR: Deep reinforcement learning framework incorporating CNN and GAN-based for interactive recommendation [J].
Gao, Rong ;
Xia, Haifeng ;
Li, Jing ;
Liu, Donghua ;
Chen, Shuai ;
Chun, Gang .
2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, :1048-1053
[7]   Evaluating collaborative filtering recommender systems [J].
Herlocker, JL ;
Konstan, JA ;
Terveen, K ;
Riedl, JT .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2004, 22 (01) :5-53
[8]   State Encoders in Reinforcement Learning for Recommendation: A Reproducibility Study [J].
Huang, Jin ;
Oosterhuis, Harrie ;
Cetinkaya, Bunyamin ;
Rood, Thijs ;
de Rijke, Maarten .
PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, :2738-2748
[9]   State representation modeling for deep reinforcement learning based recommendation [J].
Liu, Feng ;
Tang, Ruiming ;
Li, Xutao ;
Zhang, Weinan ;
Ye, Yunming ;
Chen, Haokun ;
Guo, Huifeng ;
Zhang, Yuzhou ;
He, Xiuqiang .
KNOWLEDGE-BASED SYSTEMS, 2020, 205
[10]  
Lu W., 2019, CMC, V61