Cross-perspective Graph Contrastive Learning

被引:2
作者
Lin, Shiyang [1 ]
Dong, Chenhe [1 ]
Shen, Ying [1 ]
机构
[1] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I | 2022年 / 13368卷
基金
中国国家自然科学基金;
关键词
Graph representation; Graph convolution networks; Contrastive learning; Self-attention mechanism; Semi-supervised learning;
D O I
10.1007/978-3-031-10983-6_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Attributed graph representation has attracted increasing attention recently due to its broad applications such as node classification, link prediction and recommendation. Most existing methods adopt Graph Neural Network (GNN) or its variants to propagate the attributes over the structure network. However, the attribute information will be overshadowed by the structure perspective. To address the limitation and build a link between nodes features and network structure, we aim to learn a holistic representation from two perspectives: topology perspective and feature perspective. To be specific, we separately construct the feature graph and topology graph. Inspired by the network homophily, we argue that there is a deep correlation information between the network structure perspective and the node attributes perspective. Attempting to exploit the potential information between them, we extend our approaches by maximizing the consistency between structural perspective and attribute perspective. In addition, an information fusion module is presented to allow flexible information exchange and integration between the two perspectives. Experimental results on four benchmark datasets demonstrate the effectiveness of our proposed method on graph representation learning, compared with several representative baselines.
引用
收藏
页码:58 / 70
页数:13
相关论文
共 27 条
[1]  
Abu-El-Haifa S, 2019, PR MACH LEARN RES, V97
[2]  
[Anonymous], 2017, P INT C LEARN REPR T
[3]  
Bo DY, 2021, AAAI CONF ARTIF INTE, V35, P3950
[4]  
Defferrard M, 2016, ADV NEUR IN, V29
[5]  
Hamilton WL, 2017, ADV NEUR IN, V30
[6]  
Hassani Kaveh, 2020, ICML, P4116, DOI DOI 10.48550/ARXIV.2006.05582
[7]   Graph Recurrent Networks with Attributed Random Walks [J].
Huang, Xiao ;
Song, Qingquan ;
Li, Yuening ;
Hu, Xia .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :732-740
[8]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735
[9]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[10]  
Kipf T.N., 2017, INT C LEARN REPR ICL