HomoGCL: Rethinking Homophily in Graph Contrastive Learning

被引:11
作者
Li, Wen-Zhi [1 ,2 ]
Wang, Chang-Dong [1 ]
Xiong, Hui [2 ,3 ]
Lai, Jian-Huang [1 ]
机构
[1] Sun Yat Sen Univ, CSE, Guangzhou, Peoples R China
[2] HKUST GZ, AI Thrust, Guangzhou, Peoples R China
[3] HKUST, CSE, Hong Kong, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023 | 2023年
关键词
self-supervised learning; contrastive learning; graph homophily; graph representation learning;
D O I
10.1145/3580305.3599380
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Contrastive learning (CL) has become the de-facto learning paradigm in self-supervised learning on graphs, which generally follows the "augmenting-contrasting" learning scheme. However, we observe that unlike CL in computer vision domain, CL in graph domain performs decently even without augmentation. We conduct a systematic analysis of this phenomenon and argue that homophily, i.e., the principle that "like attracts like", plays a key role in the success of graph CL. Inspired to leverage this property explicitly, we propose HomoGCL, a model-agnostic framework to expand the positive set using neighbor nodes with neighbor-specific significances. Theoretically, HomoGCL introduces a stricter lower bound of the mutual information between raw node features and node embeddings in augmented views. Furthermore, HomoGCL can be combined with existing graph CL models in a plug-and-play way with light extra computational overhead. Extensive experiments demonstrate that HomoGCL yields multiple state-of-the-art results across six public datasets and consistently brings notable performance improvements when applied to various graph CL methods. Code is avilable at https://github.com/wenzhilics/HomoGCL.
引用
收藏
页码:1341 / 1352
页数:12
相关论文
共 53 条
  • [51] Zhu Jiong, 2020, NEURIPS
  • [52] Graph Contrastive Learning with Adaptive Augmentation
    Zhu, Yanqiao
    Xu, Yichen
    Yu, Feng
    Liu, Qiang
    Wu, Shu
    Wang, Liang
    [J]. PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 2069 - 2080
  • [53] Zhu Yanqiao, 2020, ICML WORKSH GRAPH RE