Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labels

被引:62
作者
Dai, Enyan [1 ]
Jin, Wei [2 ]
Liu, Hui [2 ]
Wang, Suhang [1 ]
机构
[1] Penn State Univ, University Pk, PA 16802 USA
[2] Michigan State Univ, E Lansing, MI 48824 USA
来源
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING | 2022年
基金
美国国家科学基金会;
关键词
Noisy Edges; Robustness; Graph Neural Networks;
D O I
10.1145/3488560.3498408
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have shown their great ability in modeling graph structured data. However, real-world graphs usually contain structure noises and have limited labeled nodes. The performance of GNNs would drop significantly when trained on such graphs, which hinders the adoption of GNNs on many applications. Thus, it is important to develop noise-resistant GNNs with limited labeled nodes. However, the work on this is rather limited. Therefore, we study a novel problem of developing robust GNNs on noisy graphs with limited labeled nodes. Our analysis shows that both the noisy edges and limited labeled nodes could harm the message-passing mechanism of GNNs. To mitigate these issues, we propose a novel framework which adopts the noisy edges as supervision to learn a denoised and dense graph, which can down-weight or eliminate noisy edges and facilitate message passing of GNNs to alleviate the issue of limited labeled nodes. The generated edges are further used to regularize the predictions of unlabeled nodes with label smoothness to better train GNNs. Experimental results on real-world datasets demonstrate the robustness of the proposed framework on noisy graphs with limited labeled nodes.
引用
收藏
页码:181 / 191
页数:11
相关论文
共 50 条
[1]   Self-supervised robust Graph Neural Networks against noisy graphs and noisy labels [J].
Jinliang Yuan ;
Hualei Yu ;
Meng Cao ;
Jianqing Song ;
Junyuan Xie ;
Chongjun Wang .
Applied Intelligence, 2023, 53 :25154-25170
[2]   Self-supervised robust Graph Neural Networks against noisy graphs and noisy labels [J].
Yuan, Jinliang ;
Yu, Hualei ;
Cao, Meng ;
Song, Jianqing ;
Xie, Junyuan ;
Wang, Chongjun .
APPLIED INTELLIGENCE, 2023, 53 (21) :25154-25170
[3]   Towards robust adversarial defense on perturbed graphs with noisy labels [J].
Li, Ding ;
Xia, Hui ;
Hu, Chunqiang ;
Zhang, Rui ;
Du, Yu ;
Feng, Xiaolong .
EXPERT SYSTEMS WITH APPLICATIONS, 2025, 269
[4]   Contrastive message passing for robust graph neural networks with sparse labels [J].
Yan, Hui ;
Gao, Yuan ;
Ai, Guoguo ;
Wang, Huan ;
Li, Xin .
NEURAL NETWORKS, 2025, 182
[5]   Convergence of Graph Neural Networks on Relatively Sparse Graphs [J].
Wang, Zhiyang ;
Ruiz, Luana ;
Ribeiro, Alejandro .
FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF, 2023, :566-572
[6]   A SPECTRAL ANALYSIS OF GRAPH NEURAL NETWORKS ON DENSE AND SPARSE GRAPHS [J].
Ruiz, Luana ;
Ningyuan Huang ;
Villar, Soledad .
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2024), 2024, :9936-9940
[7]   TOWARDS AN EFFICIENT AND GENERAL FRAMEWORK OF ROBUST TRAINING FOR GRAPH NEURAL NETWORKS [J].
Xu, Kaidi ;
Liu, Sijia ;
Chen, Pin-Yu ;
Sun, Mengshu ;
Ding, Caiwen ;
Kailkhura, Bhavya ;
Lin, Xue .
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, :8479-8483
[8]   Towards Robust Representations of Spatial Networks Using Graph Neural Networks [J].
Iddianozie, Chidubem ;
McArdle, Gavin .
APPLIED SCIENCES-BASEL, 2021, 11 (15)
[9]   Distribution Consistency based Self-Training for Graph Neural Networks with Sparse Labels [J].
Wang, Fali ;
Zhao, Tianxiang ;
Wang, Suhang .
PROCEEDINGS OF THE 17TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2024, 2024, :712-720
[10]   ALEX: Towards Effective Graph Transfer Learning with Noisy Labels [J].
Yuan, Jingyang ;
Luo, Xiao ;
Qin, Yifang ;
Mao, Zhengyang ;
Ju, Wei ;
Zhang, Ming .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, :3647-3656