ENHANCING SEQUENTIAL RECOMMENDATION MODELING VIA ADVERSARIAL TRAINING

被引:0
作者
Zhang, Yabin [1 ]
Chen, Xu [1 ]
机构
[1] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024 | 2024年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Sequential recommendation; Adversarial training; Robustness;
D O I
10.1109/ICME57554.2024.10687997
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, substantial progress has been made in the field of modeling sequential recommendation tasks through the application of deep neural networks. However, practical implementations of sequential deep learning models have been shown to be prone to representation degradation problems, which may leading to high semantic similarities among embeddings, and severely impact the recommendation performance and robustness. For alleviating this problem, in this paper, we propose a simple yet highly effective Adversarial Training mechanism for regularizing Sequential Recommendation models, namely ATSRec. In specific, we first conduct an empirical and theoretical study of this representation degradation problem. Then, we introduce adversarial perturbations to the item embedding layer, aiming to maximize the adversarial loss during model training. At last, theoretically, we show that our adversarial mechanism effectively encourages the diversity of the embedding vectors, helping to increase the robustness of models. Through extensive experiments on four public datasets and seven state-of-the-art models, we observed substantial improvements in both model overall performance and robustness with the help of ATSRec.
引用
收藏
页数:6
相关论文
共 28 条
[1]  
Chung J., 2014, ARXIV PREPRINT ARXIV
[2]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[3]  
Gao HJ, 2015, AAAI CONF ARTIF INTE, P1721
[4]  
Gao Jing, 2019, arXiv
[5]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[6]  
He RN, 2016, IEEE DATA MINING, P191, DOI [10.1109/ICDM.2016.0030, 10.1109/ICDM.2016.88]
[7]   Adversarial Personalized Ranking for Recommendation [J].
He, Xiangnan ;
He, Zhankui ;
Du, Xiaoyu ;
Chua, Tat-Seng .
ACM/SIGIR PROCEEDINGS 2018, 2018, :355-364
[8]   Recurrent Neural Networks with Top-k Gains for Session-based Recommendations [J].
Hidasi, Balazs ;
Karatzoglou, Alexandros .
CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, :843-852
[9]   Decorrelated Batch Normalization [J].
Huang, Lei ;
Yang, Dawei ;
Lang, Bo ;
Deng, Jia .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :791-800
[10]   Self-Attentive Sequential Recommendation [J].
Kang, Wang-Cheng ;
McAuley, Julian .
2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, :197-206