Reliable Data Augmented Contrastive Learning for Sequential Recommendation

被引:0
作者
Zhao, Mankun [1 ,2 ,3 ]
Sun, Aitong [1 ,2 ,3 ]
Yu, Jian [1 ,2 ,3 ]
Li, Xuewei [1 ,2 ,3 ]
He, Dongxiao [1 ,2 ,3 ]
Yu, Ruiguo [1 ,2 ,3 ]
Yu, Mei [1 ,2 ,3 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Tianjin Key Lab Adv Networking TANKLab, Tianjin 300350, Peoples R China
[3] Tianjin Key Lab Cognit Comp & Applicat, Tianjin 300350, Peoples R China
关键词
Reliability; Data augmentation; Contrastive learning; Generators; Training; Transformers; Correlation; Sequential recommendation; contrastive learning; attention mechanism; data augmentation; MATRIX FACTORIZATION;
D O I
10.1109/TBDATA.2024.3453752
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sequential recommendation aims to capture users' dynamic preferences. Due to the limited information in the sequence and the uncertain user behavior, data sparsity has always been a key problem. Although data augmentation methods can alleviate this issue, unreliable data can affect the performance of such models. To solve the above problems, we propose a new framework, namely Reliable Data Augmented Contrastive Learning Recommender (RDCRec). Specifically, in order to generate more high-quality reliable items for data augmentation, we design a multi-attributes oriented sequence generator. It moves auxiliary information from the input layer to the attention layer for learning a better attention distribution. Then, we replace a percentage of items in the original sequence with reliable items generated by the generator as the augmented sequence, for creating a high-quality view for contrastive learning. In this way, RDCRec can extract more meaningful user patterns by using the self-supervised signals of the reliable items, thereby improving recommendation performance. Finally, we train a discriminator to identify unreplaced items in the augmented sequence thus we can update item embeddings selectively in order to increase the exposure of more reliable items and improve the accuracy of recommendation results. The discriminator, as an auxiliary model, is jointly trained with the generative task and the contrastive learning task. Large experiments on four popular datasets that are commonly used demonstrate the effectiveness of our new method for sequential recommendation.
引用
收藏
页码:694 / 705
页数:12
相关论文
共 40 条
[1]  
Chen T, 2020, PR MACH LEARN RES, V119
[2]   ELECRec: Training Sequential Recommenders as Discriminators [J].
Chen, Yongjun ;
Li, Jia ;
Xiong, Caiming .
PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, :2550-2554
[3]   Intent Contrastive Learning for Sequential Recommendation [J].
Chen, Yongjun ;
Liu, Zhiwei ;
Li, Jia ;
McAuley, Julian ;
Xiong, Caiming .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :2172-2182
[4]   Long short-term enhanced memory for sequential recommendation [J].
Duan, Jiasheng ;
Zhang, Peng-Fei ;
Qiu, Ruihong ;
Huang, Zi .
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (02) :561-583
[5]  
Hidasi B, 2016, Arxiv, DOI [arXiv:1511.06939, DOI 10.48550/ARXIV.1511.06939]
[6]   Self-Attentive Sequential Recommendation [J].
Kang, Wang-Cheng ;
McAuley, Julian .
2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, :197-206
[7]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[8]  
King I., 2013, P 23 INT JOINT C ART, P2605
[9]   MATRIX FACTORIZATION TECHNIQUES FOR RECOMMENDER SYSTEMS [J].
Koren, Yehuda ;
Bell, Robert ;
Volinsky, Chris .
COMPUTER, 2009, 42 (08) :30-37
[10]  
Lan ZZ, 2020, Arxiv, DOI [arXiv:1909.11942, DOI 10.48550/ARXIV.1909.11942]