Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labels

被引:62
作者
Dai, Enyan [1 ]
Jin, Wei [2 ]
Liu, Hui [2 ]
Wang, Suhang [1 ]
机构
[1] Penn State Univ, University Pk, PA 16802 USA
[2] Michigan State Univ, E Lansing, MI 48824 USA
来源
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING | 2022年
基金
美国国家科学基金会;
关键词
Noisy Edges; Robustness; Graph Neural Networks;
D O I
10.1145/3488560.3498408
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have shown their great ability in modeling graph structured data. However, real-world graphs usually contain structure noises and have limited labeled nodes. The performance of GNNs would drop significantly when trained on such graphs, which hinders the adoption of GNNs on many applications. Thus, it is important to develop noise-resistant GNNs with limited labeled nodes. However, the work on this is rather limited. Therefore, we study a novel problem of developing robust GNNs on noisy graphs with limited labeled nodes. Our analysis shows that both the noisy edges and limited labeled nodes could harm the message-passing mechanism of GNNs. To mitigate these issues, we propose a novel framework which adopts the noisy edges as supervision to learn a denoised and dense graph, which can down-weight or eliminate noisy edges and facilitate message passing of GNNs to alleviate the issue of limited labeled nodes. The generated edges are further used to regularize the predictions of unlabeled nodes with label smoothness to better train GNNs. Experimental results on real-world datasets demonstrate the robustness of the proposed framework on noisy graphs with limited labeled nodes.
引用
收藏
页码:181 / 191
页数:11
相关论文
共 50 条
[11]   Robust Denoising in Graph Neural Networks [J].
Zhang, Siying ;
Han, Andi ;
Gao, Junbin .
2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, :1088-1095
[12]   Instant Graph Neural Networks for Dynamic Graphs [J].
Zheng, Yanping ;
Wang, Hanzhi ;
Wei, Zhewei ;
Liu, Jiajun ;
Wang, Sibo .
PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, :2605-2615
[13]   Watermarking Graph Neural Networks by Random Graphs [J].
Zhao, Xiangyu ;
Wu, Hanzhou ;
Zhang, Xinpeng .
9TH INTERNATIONAL SYMPOSIUM ON DIGITAL FORENSICS AND SECURITY (ISDFS'21), 2021,
[14]   Towards Deeper Graph Neural Networks [J].
Liu, Meng ;
Gao, Hongyang ;
Ji, Shuiwang .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :338-348
[15]   Graph Neural Network Meets Sparse Representation: Graph Sparse Neural Networks via Exclusive Group Lasso [J].
Jiang, Bo ;
Wang, Beibei ;
Chen, Si ;
Tang, Jin ;
Luo, Bin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) :12692-12698
[16]   NED-GNN: Detecting and Dropping Noisy Edges in Graph Neural Networks [J].
Xu, Ming ;
Zhang, Baoming ;
Yuan, Jinliang ;
Cao, Meng ;
Wang, Chongjun .
WEB AND BIG DATA, PT I, APWEB-WAIM 2022, 2023, 13421 :91-105
[17]   Graph neural networks on factor graphs for robust, fast, and scalable linear state estimation with PMUs [J].
Kundacina, Ognjen ;
Cosovic, Mirsad ;
Miskovic, Dragisa ;
Vukobratovic, Dejan .
SUSTAINABLE ENERGY GRIDS & NETWORKS, 2023, 34
[18]   Finding core labels for maximizing generalization of graph neural networks [J].
Fu, Sichao ;
Ma, Xueqi ;
Zhan, Yibing ;
You, Fanyu ;
Peng, Qinmu ;
Liu, Tongliang ;
Bailey, James ;
Mandic, Danilo .
NEURAL NETWORKS, 2024, 180
[19]   Soft-GNN: towards robust graph neural networks via self-adaptive data utilization [J].
Wu, Yao ;
Huang, Hong ;
Song, Yu ;
Jin, Hai .
FRONTIERS OF COMPUTER SCIENCE, 2025, 19 (04)
[20]   Sparse Graph Neural Networks with Scikit-Network [J].
Delarue, Simon ;
Bonald, Thomas .
COMPLEX NETWORKS & THEIR APPLICATIONS XII, VOL 1, COMPLEX NETWORKS 2023, 2024, 1141 :16-24