Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labels

被引:60
作者
Dai, Enyan [1 ]
Jin, Wei [2 ]
Liu, Hui [2 ]
Wang, Suhang [1 ]
机构
[1] Penn State Univ, University Pk, PA 16802 USA
[2] Michigan State Univ, E Lansing, MI 48824 USA
来源
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING | 2022年
基金
美国国家科学基金会;
关键词
Noisy Edges; Robustness; Graph Neural Networks;
D O I
10.1145/3488560.3498408
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have shown their great ability in modeling graph structured data. However, real-world graphs usually contain structure noises and have limited labeled nodes. The performance of GNNs would drop significantly when trained on such graphs, which hinders the adoption of GNNs on many applications. Thus, it is important to develop noise-resistant GNNs with limited labeled nodes. However, the work on this is rather limited. Therefore, we study a novel problem of developing robust GNNs on noisy graphs with limited labeled nodes. Our analysis shows that both the noisy edges and limited labeled nodes could harm the message-passing mechanism of GNNs. To mitigate these issues, we propose a novel framework which adopts the noisy edges as supervision to learn a denoised and dense graph, which can down-weight or eliminate noisy edges and facilitate message passing of GNNs to alleviate the issue of limited labeled nodes. The generated edges are further used to regularize the predictions of unlabeled nodes with label smoothness to better train GNNs. Experimental results on real-world datasets demonstrate the robustness of the proposed framework on noisy graphs with limited labeled nodes.
引用
收藏
页码:181 / 191
页数:11
相关论文
共 50 条
[21]   A Comprehensive Survey of Graph Neural Networks for Knowledge Graphs [J].
Ye, Zi ;
Kumar, Yogan Jaya ;
Sing, Goh Ong ;
Song, Fengyan ;
Wang, Junsong .
IEEE ACCESS, 2022, 10 :75729-75741
[22]   Towards Fair Graph Neural Networks via Graph Counterfactual [J].
Guo, Zhimeng ;
Li, Jialiang ;
Xiao, Teng ;
Ma, Yao ;
Wang, Suhang .
PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, :669-678
[23]   Informative pseudo-labeling for graph neural networks with few labels [J].
Yayong Li ;
Jie Yin ;
Ling Chen .
Data Mining and Knowledge Discovery, 2023, 37 :228-254
[24]   Informative pseudo-labeling for graph neural networks with few labels [J].
Li, Yayong ;
Yin, Jie ;
Chen, Ling .
DATA MINING AND KNOWLEDGE DISCOVERY, 2023, 37 (01) :228-254
[25]   Zorro: Valid, Sparse, and Stable Explanations in Graph Neural Networks [J].
Funke, Thorben ;
Khosla, Megha ;
Rathee, Mandeep ;
Anand, Avishek .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (08) :8687-8698
[26]   A Sparse Matrix Optimization Method for Graph Neural Networks Training [J].
Yao, Tiechui ;
Wang, Jue ;
Gu, Junyu ;
Shi, Yumeng ;
Liu, Fang ;
Wang, Xiaoguang ;
Wang, Yangang ;
Chi, Xuebin .
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, KSEM 2023, 2023, 14117 :114-123
[27]   Symbolic Hyperdimensional Vectors with Sparse Graph Convolutional Neural Networks [J].
Cornell, Filip ;
Karlgren, Jussi ;
Animesh ;
Girdzijauskas, Sarunas .
2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
[28]   Sparse norm regularized attribute selection for graph neural networks [J].
Jiang, Bo ;
Wang, Beibei ;
Luo, Bin .
PATTERN RECOGNITION, 2023, 137
[29]   Training Sparse Graph Neural Networks via Pruning and Sprouting [J].
Ma, Xueqi ;
Ma, Xingjun ;
Erfani, Sarah ;
Bailey, James .
PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, :136-144
[30]   Towards Robust Compressed Convolutional Neural Networks [J].
Wijayanto, Arie Wahyu ;
Choong, Jun Jin ;
Madhawa, Kaushalya ;
Murata, Tsuyoshi .
2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2019, :168-175