Neighborhood-based Hard Negative Mining for Sequential Recommendation

被引:6
作者
Fan, Lu [1 ]
Pu, Jiashu [2 ]
Zhang, Rongsheng [2 ]
Wu, Xiao-Ming [1 ]
机构
[1] Hong Kong Polytech Univ, Hong Kong, Peoples R China
[2] NetEase Inc, Fuxi AI Lab, Hangzhou, Peoples R China
来源
PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023 | 2023年
关键词
sequential recommendation; hard negative mining; graph mining;
D O I
10.1145/3539618.3591995
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Negative sampling plays a crucial role in training successful sequential recommendation models. Instead of merely employing random negative sample selection, numerous strategies have been proposed to mine informative negative samples to enhance training and performance. However, few of these approaches utilize structural information. In this work, we observe that as training progresses, the distributions of node-pair similarities in different groups with varying degrees of neighborhood overlap change significantly, suggesting that item pairs in distinct groups may possess different negative relationships. Motivated by this observation, we propose a graph-based negative sampling approach based on neighborhood overlap (GNNO) to exploit structural information hidden in user behaviors for negative mining. GNNO first constructs a global weighted item transition graph using training sequences. Subsequently, it mines hard negative samples based on the degree of overlap with the target item on the graph. Furthermore, GNNO employs curriculum learning to control the hardness of negative samples, progressing from easy to difficult. Extensive experiments on three Amazon benchmarks demonstrate GNNO's effectiveness in consistently enhancing the performance of various state-of-the-art models and surpassing existing negative sampling strategies. The code will be released at https://github.com/floatSDSDS/GNNO.
引用
收藏
页码:2042 / 2046
页数:5
相关论文
共 29 条
[1]  
Castells T., 2020, ADV NEUR IN, P4308, DOI 10.5555/3495724.3496086
[2]  
Cho K., 2014, Learning phrase representations using RNN encoderdecoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
[3]  
2014, DOI DOI 10.3115/V1/D14-1179
[4]  
Ding Jingtao, 2020, ADV NEUR IN, V33
[5]  
Gillick D., 2019, P 23 C COMPUTATIONAL, P528
[6]   MixGCF: An Improved Training Method for Graph Neural Network-based Recommender Systems [J].
Huang, Tinglin ;
Dong, Yuxiao ;
Ding, Ming ;
Yang, Zhen ;
Feng, Wenzheng ;
Wang, Xinyu ;
Tang, Jie .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :665-674
[7]   Self-Attentive Sequential Recommendation [J].
Kang, Wang-Cheng ;
McAuley, Julian .
2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, :197-206
[8]  
Karpukhin V, 2020, PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), P6769
[9]  
LANGVILLE A. N., 2006, GOOGLES PAGERANK SCI
[10]  
Ni JM, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P188