Robust graph contrastive learning with multi-hop views for node classification

被引:0
作者
Wang, Yutong [1 ]
Zhang, Junheng [1 ]
Cao, Ren [1 ]
Zou, Minhao [1 ]
Guan, Chun [1 ]
Leng, Siyang [1 ,2 ]
机构
[1] Fudan Univ, Inst AI & Robot, Acad Engn & Technol, Shanghai 200433, Peoples R China
[2] Fudan Univ, Res Inst Intelligent Complex Syst, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Graph contrastive learning; Multi-hop; Node classification;
D O I
10.1016/j.asoc.2025.112783
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Contrastive learning has been proven successful in graph self-supervised learning by addressing label scarcity in real-world applications. Most existing methods fail to effectively incorporate multi-hop information into the augmented views but only focus on augmenting the raw input data, which incurs massive computational and memory costs. To address such limitations, we propose a novel approach, Multi-hop Views Graph Contrastive Learning (MHVGCL), that enhances the node classification performance for graphs. Specifically, in contrast to existing methods that generate multiple augmented heads via neural networks, our approach generates these heads by exploiting multi-hop information, which is obtained iteratively from a single output head. This technique can extract more comprehensive structural information without destroying the graph topology. We further devise a multi-hop contrastive loss function to maximize agreements among the multi-hop views of the same node, while minimizing them among different nodes. This design contributes to more robust representation learning that keeps structural attributes invariant under different augmented views. Numerical experimental results on a variety of benchmarks demonstrate the significant superiority of our approach over other advanced methods, by learning more discriminative node representations even with extremely limited labels.
引用
收藏
页数:12
相关论文
共 39 条
[1]   Exploring Simple Siamese Representation Learning [J].
Chen, Xinlei ;
He, Kaiming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15745-15753
[2]   Evolving, dynamic clustering of spatio/spectro-temporal data in 3D spiking neural network models and a case study on EEG data [J].
Doborjeh, Maryam Gholami ;
Kasabov, Nikola ;
Doborjeh, Zohreh Gholami .
EVOLVING SYSTEMS, 2018, 9 (03) :195-211
[3]  
Hamilton WL, 2017, ADV NEUR IN, V30
[4]  
Hassani K, 2020, PR MACH LEARN RES, V119
[5]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735
[6]   Machine-Learning Methods for Estimating Performance of Structural Concrete Members Reinforced with Fiber-Reinforced Polymers [J].
Kazemi, Farzin ;
Asgarkhani, Neda ;
Shafighfard, Torkan ;
Jankowski, Robert ;
Yoo, Doo-Yeol .
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2025, 32 (01) :571-603
[7]   Data-Driven Modeling of Mechanical Properties of Fiber-Reinforced Concrete: A Critical Review [J].
Kazemi, Farzin ;
Shafighfard, Torkan ;
Yoo, Doo-Yeol .
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2024, 31 (04) :2049-2078
[8]  
Kipf T. N., 2017, INT C LEARN REPR, P1, DOI DOI 10.48550/ARXIV.1609.02907
[9]  
Lee D, 2023, AAAI CONF ARTIF INTE, P8456
[10]  
Lee N, 2022, AAAI CONF ARTIF INTE, P7372