HomoGCL: Rethinking Homophily in Graph Contrastive Learning

被引:11
作者
Li, Wen-Zhi [1 ,2 ]
Wang, Chang-Dong [1 ]
Xiong, Hui [2 ,3 ]
Lai, Jian-Huang [1 ]
机构
[1] Sun Yat Sen Univ, CSE, Guangzhou, Peoples R China
[2] HKUST GZ, AI Thrust, Guangzhou, Peoples R China
[3] HKUST, CSE, Hong Kong, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023 | 2023年
关键词
self-supervised learning; contrastive learning; graph homophily; graph representation learning;
D O I
10.1145/3580305.3599380
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Contrastive learning (CL) has become the de-facto learning paradigm in self-supervised learning on graphs, which generally follows the "augmenting-contrasting" learning scheme. However, we observe that unlike CL in computer vision domain, CL in graph domain performs decently even without augmentation. We conduct a systematic analysis of this phenomenon and argue that homophily, i.e., the principle that "like attracts like", plays a key role in the success of graph CL. Inspired to leverage this property explicitly, we propose HomoGCL, a model-agnostic framework to expand the positive set using neighbor nodes with neighbor-specific significances. Theoretically, HomoGCL introduces a stricter lower bound of the mutual information between raw node features and node embeddings in augmented views. Furthermore, HomoGCL can be combined with existing graph CL models in a plug-and-play way with light extra computational overhead. Extensive experiments demonstrate that HomoGCL yields multiple state-of-the-art results across six public datasets and consistently brings notable performance improvements when applied to various graph CL methods. Code is avilable at https://github.com/wenzhilics/HomoGCL.
引用
收藏
页码:1341 / 1352
页数:12
相关论文
共 53 条
  • [1] Bachman P, 2019, ADV NEUR IN, V32
  • [2] Graph Barlow Twins: A self-supervised representation learning framework for graphs
    Bielak, Piotr
    Kajdanowicz, Tomasz
    Chawla, Nitesh V.
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [3] Bishop C M., 2006, Pattern recognition and machine learning, Vvol 4
  • [4] Chen Ting, 2019, 25 AMERICAS C INFORM
  • [5] Cover T. M., 1999, Elements of Information Theory
  • [6] Adversarial Graph Contrastive Learning with Information Regularization
    Feng, Shengyu
    Jing, Baoyu
    Zhu, Yada
    Tong, Hanghang
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1362 - 1371
  • [7] GENG JL, 2021, NEURIPS
  • [8] Grill J.-B., 2020, Advances in Neural Information Processing Systems, V33, P21271
  • [9] node2vec: Scalable Feature Learning for Networks
    Grover, Aditya
    Leskovec, Jure
    [J]. KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, : 855 - 864
  • [10] Hamilton WL, 2017, ADV NEUR IN, V30