DCFGAN: An adversarial deep reinforcement learning framework with improved negative sampling for session-based recommender systems

被引:33
作者
Zhao, Jianli [1 ]
Li, Hao [1 ]
Qu, Lijun [1 ]
Zhang, Qinzhi [1 ]
Sun, Qiuxia [2 ]
Huo, Huan [3 ]
Gong, Maoguo [1 ,4 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao, Peoples R China
[3] Univ Technol Sydney, Fac Engn & Informat Technol, Sydney, NSW, Australia
[4] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
关键词
Session-based recommender systems; Reinforcement learning; Generative adversarial networks; Recurrent neural network; Negative sampling; NETWORKS;
D O I
10.1016/j.ins.2022.02.045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, with the development of Internet technology, recommender systems have been widely used by virtue of their ability to meet the personalized needs of users. In order to make full use of users' interactive behaviors, session-based recommender systems have attracted growing research interest. In previous session-based recommender systems, users' historical interactive behavior is utilized to train and update users' preferences, but users' responses to the current recommendation results (immediate feedback) are not effectively exploited to optimize the recommendation strategy. This leads to the decrease of subsequent recommendation accuracy. Aiming at this problem, based on the Recurrent Neural Network (RNN), this paper combines Reinforcement Learning (RL) and Generative Adversarial Networks (GANs). We fully exploit the users' immediate feedback with RL, and simultaneously take advantage of GAN to satisfy the requirement of training data brought by RL. Furthermore, we optimize the negative sampling method and propose Deep Generative Adversarial Networks-based Collaborative Filtering (DCFGAN). The experimental results show that this algorithm can effectively improve the recommendation accuracy in session-based recommender systems. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:222 / 235
页数:14
相关论文
共 43 条
[1]  
[Anonymous], 2013, Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues
[2]  
Antoniou A., 2017, CoRR abs/1711.04340
[3]   CFGAN: A Generic Collaborative Filtering Framework based on Generative Adversarial Networks [J].
Chae, Dong-Kyu ;
Kang, Jin-Soo ;
Kim, Sang-Wook ;
Lee, Jung-Tae .
CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, :137-146
[4]  
Cho K., 2014, C EMP METH NAT LANG
[5]  
Dang T. K., 2020, SOCIAL NETW COMPUT S, V1, P216
[6]   Recommender systems based on generative adversarial networks: A problem-driven perspective [J].
Gao, Min ;
Zhang, Junwei ;
Yu, Junliang ;
Li, Jundong ;
Wen, Junhao ;
Xiong, Qingyu .
INFORMATION SCIENCES, 2021, 546 :1166-1185
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[8]   Recurrent Neural Networks with Top-k Gains for Session-based Recommendations [J].
Hidasi, Balazs ;
Karatzoglou, Alexandros .
CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, :843-852
[9]  
Hidasi Balazs, 2015, P 4 INT C LEARN REPR
[10]   Reinforcement learning: A survey [J].
Kaelbling, LP ;
Littman, ML ;
Moore, AW .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 1996, 4 :237-285