HomoGCL: Rethinking Homophily in Graph Contrastive Learning

被引:11
作者
Li, Wen-Zhi [1 ,2 ]
Wang, Chang-Dong [1 ]
Xiong, Hui [2 ,3 ]
Lai, Jian-Huang [1 ]
机构
[1] Sun Yat Sen Univ, CSE, Guangzhou, Peoples R China
[2] HKUST GZ, AI Thrust, Guangzhou, Peoples R China
[3] HKUST, CSE, Hong Kong, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023 | 2023年
关键词
self-supervised learning; contrastive learning; graph homophily; graph representation learning;
D O I
10.1145/3580305.3599380
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Contrastive learning (CL) has become the de-facto learning paradigm in self-supervised learning on graphs, which generally follows the "augmenting-contrasting" learning scheme. However, we observe that unlike CL in computer vision domain, CL in graph domain performs decently even without augmentation. We conduct a systematic analysis of this phenomenon and argue that homophily, i.e., the principle that "like attracts like", plays a key role in the success of graph CL. Inspired to leverage this property explicitly, we propose HomoGCL, a model-agnostic framework to expand the positive set using neighbor nodes with neighbor-specific significances. Theoretically, HomoGCL introduces a stricter lower bound of the mutual information between raw node features and node embeddings in augmented views. Furthermore, HomoGCL can be combined with existing graph CL models in a plug-and-play way with light extra computational overhead. Extensive experiments demonstrate that HomoGCL yields multiple state-of-the-art results across six public datasets and consistently brings notable performance improvements when applied to various graph CL methods. Code is avilable at https://github.com/wenzhilics/HomoGCL.
引用
收藏
页码:1341 / 1352
页数:12
相关论文
共 53 条
  • [41] Xia J., 2022, PR MACH LEARN RES, p24 332
  • [42] SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentation
    Xia, Jun
    Wu, Lirong
    Chen, Jintao
    Hu, Bozhen
    Li, Stan Z.
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1070 - 1079
  • [43] Xu DK, 2021, ADV NEUR IN, V34
  • [44] Refactoring and Optimizing WRF Model on Sunway TaihuLight
    Xu, Kai
    Song, Zhenya
    Chan, Yuandong
    Wang, Shida
    Meng, Xiangxu
    Liu, Weiguo
    Xue, Wei
    [J]. PROCEEDINGS OF THE 48TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP 2019), 2019,
  • [45] On approximating the modified Bessel function of the first kind and Toader-Qi mean
    Yang, Zhen-Hang
    Chu, Yu-Ming
    [J]. JOURNAL OF INEQUALITIES AND APPLICATIONS, 2016, : 1 - 21
  • [46] Yin YH, 2022, AAAI CONF ARTIF INTE, P8892
  • [47] Yonglong Tian, 2020, Computer Vision - ECCV 2020 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12356), P776, DOI 10.1007/978-3-030-58621-8_45
  • [48] You YN, 2021, PR MACH LEARN RES, V139
  • [49] You Y, 2020, ADV NEUR IN, V33
  • [50] COSTA: Covariance-Preserving Feature Augmentation for Graph Contrastive Learning
    Zhang, Yifei
    Zhu, Hao
    Song, Zixing
    Koniusz, Piotr
    King, Irwin
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2524 - 2534