Robust Hypergraph-Augmented Graph Contrastive Learning for Graph Self-Supervised Learning

被引:0
作者
Wang, Zeming [1 ]
Li, Xiaoyang [2 ]
Wang, Rui [3 ]
Zheng, Changwen [4 ]
机构
[1] Chinese Acad Sci, Univ Chinese Acad Sci, Inst Software, Beijing, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Chinese Acad Sci, Inst Software, Sci & Technol Integrated Informat Syst Lab, Beijing, Peoples R China
[4] Chinese Acad Sci, Inst Software, Beijing, Peoples R China
来源
2023 2ND ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING, CACML 2023 | 2023年
关键词
graph contrastive learning; self-supervised; hypergraph; multi-view;
D O I
10.1145/3590003.3590053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning has emerged as a promising method for self-supervised graph representation learning. The traditional framework conventionally imposes two graph views generated by leveraging graph data augmentations. Such an approach focuses on leading the model to learn discriminative information from graph local structures, which brings up an intrinsic issue that the model partially fails to obtain sufficient discriminative information contained by the graph global information. To this end, we propose a hypergraph-augmented view to empower the self-supervised graph representation learning model to better capture the global information from nodes and corresponding edges. In the further exploration of the graph contrastive learning, we discover a principal challenge undermining conventional contrastive methods: the false negative sample problem, i.e., specific negative samples actually belong to the same category of the anchor sample. To address this issue, we take the neighbors of nodes into consideration and propose the robust graph contrastive learning. In practice, we empirically observe that the proposed hypergraph-augmented view can further enhance the robustness of graph contrastive learning by adopting our framework. Based on these improvements, we propose a novel method called Robust Hypergraph-Augmented Graph Contrastive Learning (RH-GCL). We conduct various experiments in the settings of both transductive and inductive node classification. The results demonstrate that our method achieves the state-of-the-art (SOTA) performance on different datasets. Specifically, the accuracy of node classification on Cora dataset is 84.4%, which is 1.1% higher than that of GRACE. We also perform the ablation study to verify the effectiveness of each part of our proposed method.
引用
收藏
页码:287 / 293
页数:7
相关论文
共 43 条
[1]  
Baevski A, 2022, PR MACH LEARN RES
[2]  
Bojchevski A, 2018, Arxiv, DOI arXiv:1707.03815
[3]  
Chen T, 2020, PR MACH LEARN RES, V119
[4]  
Fang HC, 2020, Arxiv, DOI arXiv:2005.12766
[5]  
Feng YF, 2019, AAAI CONF ARTIF INTE, P3558
[6]  
Gao H, 2022, PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, P3001
[7]  
Gao H, 2022, Arxiv, DOI arXiv:2208.08584
[8]   Weight-Aware Graph Contrastive Learning [J].
Gao, Hang ;
Li, Jiangmeng ;
Qiao, Peng ;
Zheng, Changwen .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 :719-730
[9]   node2vec: Scalable Feature Learning for Networks [J].
Grover, Aditya ;
Leskovec, Jure .
KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, :855-864
[10]  
Hamilton WL, 2017, ADV NEUR IN, V30