Contrastive learning (CL) has become the de-facto learning paradigm in self-supervised learning on graphs, which generally follows the "augmenting-contrasting" learning scheme. However, we observe that unlike CL in computer vision domain, CL in graph domain performs decently even without augmentation. We conduct a systematic analysis of this phenomenon and argue that homophily, i.e., the principle that "like attracts like", plays a key role in the success of graph CL. Inspired to leverage this property explicitly, we propose HomoGCL, a model-agnostic framework to expand the positive set using neighbor nodes with neighbor-specific significances. Theoretically, HomoGCL introduces a stricter lower bound of the mutual information between raw node features and node embeddings in augmented views. Furthermore, HomoGCL can be combined with existing graph CL models in a plug-and-play way with light extra computational overhead. Extensive experiments demonstrate that HomoGCL yields multiple state-of-the-art results across six public datasets and consistently brings notable performance improvements when applied to various graph CL methods. Code is avilable at https://github.com/wenzhilics/HomoGCL.
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Zhu, Yanqiao
Xu, Yichen
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Xu, Yichen
Yu, Feng
论文数: 0引用数: 0
h-index: 0
机构:
Alibaba Grp, Hangzhou, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Yu, Feng
Liu, Qiang
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Liu, Qiang
Wu, Shu
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Wu, Shu
Wang, Liang
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Wang, Liang
[J].
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021),
2021,
: 2069
-
2080
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Zhu, Yanqiao
Xu, Yichen
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Univ Posts & Telecommun, Sch Comp Sci, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Xu, Yichen
Yu, Feng
论文数: 0引用数: 0
h-index: 0
机构:
Alibaba Grp, Hangzhou, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Yu, Feng
Liu, Qiang
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Liu, Qiang
Wu, Shu
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Wu, Shu
Wang, Liang
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R ChinaChinese Acad Sci, Ctr Res Intelligent Percept & Comp, Inst Automat, Beijing, Peoples R China
Wang, Liang
[J].
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021),
2021,
: 2069
-
2080