DCFGAN: An adversarial deep reinforcement learning framework with improved negative sampling for session-based recommender systems

被引:27
|
作者
Zhao, Jianli [1 ]
Li, Hao [1 ]
Qu, Lijun [1 ]
Zhang, Qinzhi [1 ]
Sun, Qiuxia [2 ]
Huo, Huan [3 ]
Gong, Maoguo [1 ,4 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Math & Syst Sci, Qingdao, Peoples R China
[3] Univ Technol Sydney, Fac Engn & Informat Technol, Sydney, NSW, Australia
[4] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
关键词
Session-based recommender systems; Reinforcement learning; Generative adversarial networks; Recurrent neural network; Negative sampling; NETWORKS;
D O I
10.1016/j.ins.2022.02.045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, with the development of Internet technology, recommender systems have been widely used by virtue of their ability to meet the personalized needs of users. In order to make full use of users' interactive behaviors, session-based recommender systems have attracted growing research interest. In previous session-based recommender systems, users' historical interactive behavior is utilized to train and update users' preferences, but users' responses to the current recommendation results (immediate feedback) are not effectively exploited to optimize the recommendation strategy. This leads to the decrease of subsequent recommendation accuracy. Aiming at this problem, based on the Recurrent Neural Network (RNN), this paper combines Reinforcement Learning (RL) and Generative Adversarial Networks (GANs). We fully exploit the users' immediate feedback with RL, and simultaneously take advantage of GAN to satisfy the requirement of training data brought by RL. Furthermore, we optimize the negative sampling method and propose Deep Generative Adversarial Networks-based Collaborative Filtering (DCFGAN). The experimental results show that this algorithm can effectively improve the recommendation accuracy in session-based recommender systems. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:222 / 235
页数:14
相关论文
共 50 条
  • [31] A Hierarchical SLAM Framework Based on Deep Reinforcement Learning for Active Exploration
    Xue, Yuntao
    Chen, Weisheng
    Zhang, Liangbin
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 957 - 966
  • [32] Deep Reinforcement Learning Framework for Category-Based Item Recommendation
    Fu, Mingsheng
    Agrawal, Anubha
    Irissappane, Athirai A.
    Zhang, Jie
    Huang, Liwei
    Qu, Hong
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) : 12028 - 12041
  • [33] A Deep Reinforcement Learning-Based Framework for PolSAR Imagery Classification
    Nie, Wen
    Huang, Kui
    Yang, Jie
    Li, Pingxiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [34] Keeping Dataset Biases out of the Simulation A Debiased Simulator for Reinforcement Learning based Recommender Systems
    Huang, Jin
    Oosterhuis, Harrie
    de Rijke, Maarten
    van Hoof, Herke
    RECSYS 2020: 14TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, 2020, : 190 - 199
  • [35] A Reinforcement Learning Method Based on an Improved Sampling Mechanism for Unmanned Aerial Vehicle Penetration
    Wang, Yue
    Li, Kexv
    Zhuang, Xing
    Liu, Xinyu
    Li, Hanyu
    AEROSPACE, 2023, 10 (07)
  • [36] A Deep Reinforcement Learning Framework for Data Compression in Uplink NOMA-SWIPT Systems
    Elsayed, Mohamed
    Badawy, Ahmed
    El Shafie, Ahmed
    Mohamed, Amr
    Khattab, Tamer
    IEEE INTERNET OF THINGS JOURNAL, 2021, 9 (14) : 11656 - 11674
  • [37] Intelligent Decision Framework of Shield Attitude Correction Based on Deep Reinforcement Learning
    Xu, J.
    Bu, J. F.
    Zhang, L. G.
    Zhang, J.
    Li, K. F.
    Liu, S. M.
    PROCEEDINGS OF THE 17TH EAST ASIAN-PACIFIC CONFERENCE ON STRUCTURAL ENGINEERING AND CONSTRUCTION, EASEC-17 2022, 2023, 302 : 1273 - 1287
  • [38] iEnsemble: A Framework for Committee Machine Based on Multiagent Systems with Reinforcement Learning
    Uber Junior, Arnoldo
    de Freitas Filho, Paulo Jose
    Silveira, Ricardo Azambuja
    Costa e Lima, Mariana Dehon
    Reitz, Rodolfo Wilvert
    ADVANCES IN SOFT COMPUTING, MICAI 2016, PT II, 2017, 10062 : 65 - 80
  • [39] Learning to Delay in Ride-Sourcing Systems: A Multi-Agent Deep Reinforcement Learning Framework
    Ke, Jintao
    Xiao, Feng
    Yang, Hai
    Ye, Jieping
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (05) : 2280 - 2292
  • [40] An Improved Deep Reinforcement Learning Method for Dispatch Optimization Strategy of Modern Power Systems
    Zhai, Suwei
    Li, Wenyun
    Qiu, Zhenyu
    Zhang, Xinyi
    Hou, Shixi
    ENTROPY, 2023, 25 (03)