Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labels

被引:62
作者
Dai, Enyan [1 ]
Jin, Wei [2 ]
Liu, Hui [2 ]
Wang, Suhang [1 ]
机构
[1] Penn State Univ, University Pk, PA 16802 USA
[2] Michigan State Univ, E Lansing, MI 48824 USA
来源
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING | 2022年
基金
美国国家科学基金会;
关键词
Noisy Edges; Robustness; Graph Neural Networks;
D O I
10.1145/3488560.3498408
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have shown their great ability in modeling graph structured data. However, real-world graphs usually contain structure noises and have limited labeled nodes. The performance of GNNs would drop significantly when trained on such graphs, which hinders the adoption of GNNs on many applications. Thus, it is important to develop noise-resistant GNNs with limited labeled nodes. However, the work on this is rather limited. Therefore, we study a novel problem of developing robust GNNs on noisy graphs with limited labeled nodes. Our analysis shows that both the noisy edges and limited labeled nodes could harm the message-passing mechanism of GNNs. To mitigate these issues, we propose a novel framework which adopts the noisy edges as supervision to learn a denoised and dense graph, which can down-weight or eliminate noisy edges and facilitate message passing of GNNs to alleviate the issue of limited labeled nodes. The generated edges are further used to regularize the predictions of unlabeled nodes with label smoothness to better train GNNs. Experimental results on real-world datasets demonstrate the robustness of the proposed framework on noisy graphs with limited labeled nodes.
引用
收藏
页码:181 / 191
页数:11
相关论文
共 50 条
[41]   Towards Faithful and Consistent Explanations for Graph Neural Networks [J].
Zhao, Tianxiang ;
Luo, Dongsheng ;
Zhang, Xiang ;
Wang, Suhang .
PROCEEDINGS OF THE SIXTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2023, VOL 1, 2023, :634-642
[42]   RobGC: Towards Robust Graph Condensation [J].
Gao, Xinyi ;
Yin, Hongzhi ;
Chen, Tong ;
Ye, Guanhua ;
Zhang, Wentao ;
Cui, Bin .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (08) :4791-4804
[43]   DIFFERENTIALLY PRIVATE GRAPH NEURAL NETWORKS FOR MEDICAL POPULATION GRAPHS AND THE IMPACT OF THE GRAPH STRUCTURE [J].
Mueller, Tamara T. ;
Chevli, Maulik ;
Daigavane, Ameya ;
Rueckert, Daniel ;
Kaissis, Georgios .
IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI 2024, 2024,
[44]   Are Graph Neural Network Explainers Robust to Graph Noises? [J].
Li, Yiqiao ;
Verma, Sunny ;
Yang, Shuiqiao ;
Zhou, Jianlong ;
Chen, Fang .
AI 2022: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13728 :161-174
[45]   A robust feature reinforcement framework for heterogeneous graphs neural networks [J].
Wang, Zehao ;
Wu, Huifeng ;
Fan, Jin ;
Sun, Danfeng ;
Wu, Jia .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 141 :143-153
[46]   Towards Anomaly-resistant Graph Neural Networks via Reinforcement Learning [J].
Ding, Kaize ;
Shan, Xuan ;
Liu, Huan .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, :2979-2983
[47]   CCT: A Cyclic Co-Teaching Approach to Train Deep Neural Networks With Noisy Labels [J].
Kamassury, Jorge K. S. ;
Pickler, Henrique ;
Cordeiro, Filipe R. ;
Silva, Danilo .
IEEE ACCESS, 2025, 13 :43843-43860
[48]   Robust Graph Neural Networks via Probabilistic Lipschitz Constraints [J].
Arghal, Raghu ;
Lei, Eric ;
Bidokhti, Shirin Saeedi .
LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 168, 2022, 168
[49]   DropAGG: Robust Graph Neural Networks via Drop Aggregation [J].
Jiang, Bo ;
Chen, Yong ;
Wang, Beibei ;
Xu, Haiyun ;
Luo, Bin .
NEURAL NETWORKS, 2023, 163 :65-74
[50]   Robust graph neural networks with Dirichlet regularization and residual connection [J].
Yao, Kaixuan ;
Du, Zijin ;
Li, Ming ;
Cao, Feilong ;
Liang, Jiye .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (09) :3733-3743