Contrastive learning with adversarial masking for sequential recommendation

被引:0
作者
Xiang, Rongzheng [1 ]
Huang, Jiajin [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Beijing Univ Technol, Sch Informat Sci & Technol, Beijing 100124, Peoples R China
[2] Beijing Int Collaborat Base Brain Informat & Wisdo, Beijing 100124, Peoples R China
关键词
Sequential recommendation; Contrastive learning; Adversarial learning; Data augmentation; Masking; NEURAL-NETWORKS;
D O I
10.1016/j.elerap.2025.101493
中图分类号
F [经济];
学科分类号
02 ;
摘要
Sequential recommendation is of paramount importance for predicting user preferences based on their historical interactions. Recent studies have leveraged contrastive learning as an auxiliary task to enhance sequence representations, with the goal of improving recommendation accuracy. However, an important challenge arises: random item masking, a key component of contrastive learning, while promoting robust representations through intricate semantic inference, may inadvertently distort the original sequence semantics to some extent. In contrast, methods that prioritize the preservation of sequence semantics tend to neglect the essential masking mechanism for robust representation learning. To address this issue, we propose a model called Contrastive Learning with Adversarial Masking (CLAM) for sequential recommendation. CLAM consists of three core components: an inference module, an occlusion module, and a multi-task learning paradigm. During training, the occlusion module is optimized to perturb the inference module in both recommendation generation and contrastive learning tasks by adaptively generating item embedding masks. This adversarial training framework enables CLAM to balance sequential pattern preservation with the acquisition of robust representations in the inference module for recommendation tasks. Our extensive experiments on four benchmark datasets demonstrate the effectiveness of CLAM. It achieves significant improvements in sequential recommendation accuracy and robustness against noisy interactions.
引用
收藏
页数:12
相关论文
共 54 条
[1]   Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions [J].
Adomavicius, G ;
Tuzhilin, A .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (06) :734-749
[2]   Sequential Recommendation with Graph Neural Networks [J].
Chang, Jianxin ;
Gao, Chen ;
Zheng, Yu ;
Hui, Yiqun ;
Niu, Yanan ;
Song, Yang ;
Jin, Depeng ;
Li, Yong .
SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, :378-387
[3]  
Chen JY, 2024, AAAI CONF ARTIF INTE, P8283
[4]   Behavior Sequence Transformer for E-commerce Recommendation in Alibaba [J].
Chen, Qiwei ;
Zhao, Huan ;
Li, Wei ;
Huang, Pipei ;
Ou, Wenwu .
1ST INTERNATIONAL WORKSHOP ON DEEP LEARNING PRACTICE FOR HIGH-DIMENSIONAL SPARSE DATA WITH KDD (DLP-KDD 2019), 2019,
[5]  
Chen T, 2020, PR MACH LEARN RES, V119
[6]   Intent Contrastive Learning for Sequential Recommendation [J].
Chen, Yongjun ;
Liu, Zhiwei ;
Li, Jia ;
McAuley, Julian ;
Xiong, Caiming .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :2172-2182
[7]  
Cho K., P 2014 C EMP METH NA
[8]  
Dai HJ, 2017, ADV NEUR IN, V30
[9]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[10]   Sirius: Sequential Recommendation with Feature Augmented Graph Neural Networks [J].
Dong, Xinzhou ;
Jin, Beihong ;
Zhuo, Wei ;
Li, Beibei ;
Xue, Taofeng .
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT III, 2021, 12683 :315-320