Sequential recommendation based on multipair contrastive learning with informative augmentation

被引:0
|
作者
Yin, Pei [1 ,2 ]
Zhao, Jun [1 ]
Ma, Zi-jie [1 ]
Tan, Xiao [1 ]
机构
[1] Univ Shanghai Sci & Technol, Business Sch, Shanghai 200093, Peoples R China
[2] Univ Shanghai Sci & Technol, Sch Intelligent Emergency Management, Shanghai 200093, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 36卷 / 17期
关键词
Sequential recommendation; Data sparsity; Self-attention network; Contrastive learning; Representation learning;
D O I
10.1007/s00521-023-09044-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To solve the recommendation accuracy degradation problem encountered in sequential recommendation cases caused by data sparsity-such as short historical user behaviour sequences and limited information-this paper proposes a sequential recommendation model based on multipair contrastive learning with informative augmentation (IA-MPCL). The model aims to better learn user preference representations. Initially, a self-attention network is utilized to maintain the intrinsic relevance of the original sequences and introduce virtual interaction items for short sequences to achieve informative enhancement. Subsequently, multiple positive samples are generated by data augmentation methods to form multiple pairs of positive and negative samples. A multipair contrastive loss is constructed to eliminate the negative impact of fake positive and negative samples on the training process of the self-attention network. Finally, an adaptive loss weighting mechanism is proposed to dynamically regulate the role of the contrastive loss during multitask training. Through comparison experiments involving baseline methods and experiments conducted on datasets with different sparsity levels, the results show that IA-MPCL achieves significant improvements in terms of both recommendation accuracy and data sparsity resistance.
引用
收藏
页码:9707 / 9721
页数:15
相关论文
共 50 条
  • [41] Feature-Level Deeper Self-Attention Network With Contrastive Learning for Sequential Recommendation
    Hao, Yongjing
    Zhang, Tingting
    Zhao, Pengpeng
    Liu, Yanchi
    Sheng, Victor S.
    Xu, Jiajie
    Liu, Guanfeng
    Zhou, Xiaofang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (10) : 10112 - 10124
  • [42] Sequential recommendation algorithm for long-tail users based on knowledge-enhanced contrastive learning
    Ren Y.
    Zhou P.
    Zhang Z.
    Tongxin Xuebao/Journal on Communications, 2024, 45 (06): : 210 - 222
  • [43] Enhancing Sequential Music Recommendation with Negative Feedback-informed Contrastive Learning
    Seshadri, Pavan
    Shashaani, Shahrzad
    Knees, Peter
    PROCEEDINGS OF THE EIGHTEENTH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2024, 2024, : 1028 - 1032
  • [44] MoCo4SRec: A momentum contrastive learning framework for sequential recommendation
    Wei, Zihan
    Wu, Ning
    Li, Fengxia
    Wang, Ke
    Zhang, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 223
  • [45] Graphormer based contrastive learning for recommendation
    Wang, Jing
    Ren, Jiangtao
    APPLIED SOFT COMPUTING, 2024, 159
  • [46] Graphical contrastive learning for multi-interest sequential recommendation
    Liang, Shunpan
    Kong, Qianjin
    Lei, Yu
    Li, Chen
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 259
  • [47] Node representation learning with graph augmentation for sequential recommendation
    Zhu, Yingzheng
    Liang, Xiufang
    Duan, Huajuan
    Xu, Fuyong
    Wang, Yuanying
    Liu, Peiyu
    Lu, Ran
    INFORMATION SCIENCES, 2023, 646
  • [48] Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation
    Xie, Zhe
    Liu, Chengxuan
    Zhang, Yichi
    Lu, Hongtao
    Wang, Dong
    Ding, Yue
    PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 449 - 459
  • [49] ContrastVAE: Contrastive Variational AutoEncoder for Sequential Recommendation
    Wang, Yu
    Zhang, Hengrui
    Liu, Zhiwei
    Yang, Liangwei
    Yu, Philip S.
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 2057 - 2067
  • [50] Adaptive Augmentation and Neighbor Contrastive Learning for Multi-Behavior Recommendation
    Wu, Xia
    Wang, Shaoqing
    Zhang, Yao
    WEB AND BIG DATA, APWEB-WAIM 2024, PT II, 2024, 14962 : 18 - 32