Improving Sequential Recommendations via Bidirectional Temporal Data Augmentation With Pre-Training

被引:0
作者
Jiang, Juyong [1 ]
Zhang, Peiyan [2 ]
Luo, Yingtao [3 ]
Li, Chaozhuo [4 ]
Kim, Jae Boum [2 ]
Zhang, Kai [5 ]
Wang, Senzhang [6 ]
Kim, Sunghun [1 ]
Yu, Philip S. [7 ]
机构
[1] Hong Kong Univ Sci & Technol Guangzhou, Guangzhou 511458, Peoples R China
[2] Hong Kong Univ Sci & Technol, Hong Kong, Peoples R China
[3] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
[4] Microsoft Res Asia, Beijing 100080, Peoples R China
[5] East China Normal Univ, Shanghai 200050, Peoples R China
[6] Cent South Univ, Changsha 410017, Hunan, Peoples R China
[7] Univ Illinois, Dept Comp Sci, Chicago, IL 60607 USA
基金
中国国家自然科学基金;
关键词
Data augmentation; Correlation; Benchmark testing; User preference; Training; Electronic mail; Context modeling; Transformers; Recommender systems; Metadata; Sequential recommendation; data augmentation; model pre-training;
D O I
10.1109/TKDE.2025.3546035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sequential recommendation systems are integral to discerning temporal user preferences. Yet, the task of learning from abbreviated user interaction sequences poses a notable challenge. Data augmentation has been identified as a potent strategy to enhance the informational richness of these sequences. Traditional augmentation techniques, such as item randomization, may disrupt the inherent temporal dynamics. Although recent advancements in reverse chronological pseudo-item generation have shown promise, they can introduce temporal discrepancies when assessed in a natural chronological context. In response, we introduce a sophisticated approach, Bidirectional temporal data Augmentation with pre-training (BARec). Our approach leverages bidirectional temporal augmentation and knowledge-enhanced fine-tuning to synthesize authentic pseudo-prior items that retain user preferences and capture deeper item semantic correlations, thus boosting the model's expressive power. Our comprehensive experimental analysis on five benchmark datasets confirms the superiority of BARec across both short and elongated sequence contexts. Moreover, theoretical examination and case study offer further insight into the model's logical processes and interpretability.
引用
收藏
页码:2652 / 2664
页数:13
相关论文
共 68 条
[1]   User Cold-Start Recommendation via Inductive Heterogeneous Graph Neural Network [J].
Cai, Desheng ;
Qian, Shengsheng ;
Fang, Quan ;
Hu, Jun ;
Xu, Changsheng .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2023, 41 (03)
[2]   Sequential Recommendation with Graph Neural Networks [J].
Chang, Jianxin ;
Gao, Chen ;
Zheng, Yu ;
Hui, Yiqun ;
Niu, Yanan ;
Song, Yang ;
Jin, Depeng ;
Li, Yong .
SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, :378-387
[3]   A Collective Variational Autoencoder for Top-N Recommendation with Side Information [J].
Chen, Yifan ;
de Rijke, Maarten .
PROCEEDINGS OF THE 3RD WORKSHOP ON DEEP LEARNING FOR RECOMMENDER SYSTEMS (DLRS), 2018, :3-9
[4]   Intent Contrastive Learning for Sequential Recommendation [J].
Chen, Yongjun ;
Liu, Zhiwei ;
Li, Jia ;
McAuley, Julian ;
Xiong, Caiming .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :2172-2182
[5]   Recommender Systems Leveraging Multimedia Content [J].
Deldjoo, Yashar ;
Schedl, Markus ;
Cremonesi, Paolo ;
Pasi, Gabriella .
ACM COMPUTING SURVEYS, 2020, 53 (05)
[6]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[7]   Socially-aware Dual Contrastive Learning for Cold-Start Recommendation [J].
Du, Jing ;
Ye, Zesheng ;
Yao, Lina ;
Guo, Bin ;
Yu, Zhiwen .
PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, :1927-1932
[8]   Sequential Recommendation via Stochastic Self-Attention [J].
Fan, Ziwei ;
Liu, Zhiwei ;
Wang, Yu ;
Wang, Alice ;
Nazari, Zahra ;
Zheng, Lei ;
Peng, Hao ;
Yu, Philip S. .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :2036-2047
[9]   KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systems [J].
Gao, Chongming ;
Li, Shijun ;
Lei, Wenqiang ;
Chen, Jiawei ;
Li, Biao ;
Jiang, Peng ;
He, Xiangnan ;
Mao, Jiaxin ;
Chua, Tat-Seng .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, :540-550
[10]  
Gray RM, 2011, ENTROPY AND INFORMATION THEORY , SECOND EDITION, P395, DOI 10.1007/978-1-4419-7970-4