Unifying Graph Convolution and Contrastive Learning in Collaborative Filtering

被引:8
作者
Wu, Yihong [1 ]
Zhang, Le [2 ]
Mo, Fengran [1 ]
Zhu, Tianyu [3 ]
Ma, Weizhi [4 ]
Nie, Jian-Yun [1 ]
机构
[1] Univ Montreal, Montreal, PQ, Canada
[2] Mila Quebec AI Inst, Montreal, PQ, Canada
[3] Beihang Univ, MIIT Key Lab Data Intelligence & Management, Beijing, Peoples R China
[4] Tsinghua Univ, Inst AI Ind Res AIR, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2024 | 2024年
基金
加拿大自然科学与工程研究理事会;
关键词
Collaborative Filtering; Contrastive Learning; Graph Neural Networks;
D O I
10.1145/3637528.3671840
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph-based models and contrastive learning have emerged as prominent methods in Collaborative Filtering (CF). While many existing models in CF incorporate these methods in their design, there seems to be a limited depth of analysis regarding the foundational principles behind them. This paper bridges graph convolution, a pivotal element of graph-based models, with contrastive learning through a theoretical framework. By examining the learning dynamics and equilibrium of the contrastive loss, we offer a fresh lens to understand contrastive learning via graph theory, emphasizing its capability to capture high-order connectivity. Building on this analysis, we further show that the graph convolutional layers often used in graph-based models are not essential for high-order connectivity modeling and might contribute to the risk of oversmoothing. Stemming from our findings, we introduce Simple Contrastive Collaborative Filtering (SCCF), a simple and effective algorithm based on a naive embedding model and a modified contrastive loss. The efficacy of the algorithm is demonstrated through extensive experiments across four public datasets. The experiment code is available at https://github.com/wu1hong/SCCF.
引用
收藏
页码:3425 / 3436
页数:12
相关论文
共 50 条
[1]  
ACKLEY DH, 1985, COGNITIVE SCI, V9, P147
[2]  
Cai X., 2023, ARXIV
[3]  
Chen Junsong, 2023, arXiv
[4]  
Chen T., 2020, INT C MACH LEARN PML, P1597
[5]   Double peaks of gravitational wave spectrum induced from inflection point inflation [J].
Gao, Tie-Jun ;
Yang, Xiu-Yi .
EUROPEAN PHYSICAL JOURNAL C, 2021, 81 (06)
[6]   Learning Image and User Features for Recommendation in Social Networks [J].
Geng, Xue ;
Zhang, Hanwang ;
Bian, Jingwen ;
Chua, Tat-Seng .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4274-4282
[7]  
Gilmer J., 2017, P 34 ICML SYDN NSW A, V70, P1263, DOI [DOI 10.5555/3305381.3305512, 10.48550/arXiv.1704.01212, DOI 10.48550/ARXIV.1704.01212]
[8]  
Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
[9]  
Grill Jean-Bastien., 2020, Proc. Adv. Neural Inf. Process. Syst, P21271, DOI DOI 10.48550/ARXIV.2006.07733
[10]  
HaoChen Jeff Z., 2021, Advances in Neural Information Processing Systems, V34, P5000