ENHANCING SEQUENTIAL RECOMMENDATION MODELING VIA ADVERSARIAL TRAINING

被引:0
作者
Zhang, Yabin [1 ]
Chen, Xu [1 ]
机构
[1] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024 | 2024年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Sequential recommendation; Adversarial training; Robustness;
D O I
10.1109/ICME57554.2024.10687997
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, substantial progress has been made in the field of modeling sequential recommendation tasks through the application of deep neural networks. However, practical implementations of sequential deep learning models have been shown to be prone to representation degradation problems, which may leading to high semantic similarities among embeddings, and severely impact the recommendation performance and robustness. For alleviating this problem, in this paper, we propose a simple yet highly effective Adversarial Training mechanism for regularizing Sequential Recommendation models, namely ATSRec. In specific, we first conduct an empirical and theoretical study of this representation degradation problem. Then, we introduce adversarial perturbations to the item embedding layer, aiming to maximize the adversarial loss during model training. At last, theoretically, we show that our adversarial mechanism effectively encourages the diversity of the embedding vectors, helping to increase the robustness of models. Through extensive experiments on four public datasets and seven state-of-the-art models, we observed substantial improvements in both model overall performance and robustness with the help of ATSRec.
引用
收藏
页数:6
相关论文
共 28 条
[21]  
VASWANI A, 2017, ADV NIPS, V30
[22]  
Wang D, 2019, PR MACH LEARN RES, V97
[23]   Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba [J].
Wang, Jizhe ;
Huang, Pipei ;
Zhao, Huan ;
Zhang, Zhibo ;
Zhao, Binqiang ;
Lee, Dik Lun .
KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, :839-848
[24]   Recurrent Recommender Networks [J].
Wu, Chao-Yuan ;
Ahmed, Amr ;
Beutel, Alex ;
Smola, Alexander J. ;
Jing, How .
WSDM'17: PROCEEDINGS OF THE TENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2017, :495-503
[25]   SSE-PT: Sequential Recommendation Via Personalized Transformer [J].
Wu, Liwei ;
Li, Shuqing ;
Hsieh, Cho-Jui ;
Sharpnack, James .
RECSYS 2020: 14TH ACM CONFERENCE ON RECOMMENDER SYSTEMS, 2020, :328-337
[26]   Contrastive Learning for Sequential Recommendation [J].
Xie, Xu ;
Sun, Fei ;
Liu, Zhaoyang ;
Wu, Shiwen ;
Gao, Jinyang ;
Zhang, Jiandong ;
Ding, Bolin ;
Cui, Bin .
2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, :1259-1273
[27]  
Zhao Wayne Xin, 2022, ArXiv
[28]   Filter-enhanced MLP is All You Need for Sequential Recommendation [J].
Zhou, Kun ;
Yu, Hui ;
Zhao, Wayne Xin ;
Wen, Ji-Rong .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :2388-2399