Graph Rewiring and Preprocessing for Graph Neural Networks Based on Effective Resistance

被引:0
|
作者
Shen, Xu [1 ]
Lio, Pietro [2 ]
Yang, Lintao [1 ]
Yuan, Ru [1 ]
Zhang, Yuyang [1 ]
Peng, Chengbin [1 ]
机构
[1] Ningbo Univ, Fac Elect Engn & Comp Sci, Ningbo 315211, Peoples R China
[2] Univ Cambridge, Fac Comp Sci & Technol, Dept Comp Sci & Technol, Cambridge CB2 1TN, England
基金
中国国家自然科学基金;
关键词
Resistance; Message passing; Task analysis; Training; Redundancy; Laplace equations; Graph neural networks; over-smoothing; over-squashing; effective resistance; graph preprocessing;
D O I
10.1109/TKDE.2024.3397692
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) are powerful models for processing graph data and have demonstrated state-of-the-art performance on many downstream tasks. However, existing GNNs can generally suffer from two limitations: over-smoothing and over-squashing, which can significantly undermine their learning ability for large graphs. To overcome these issues simultaneously, by utilizing the concept of effective resistances, we focus on minimizing total constrained resistance while identifying problematic edges using topological redundancy and bottleneck sparsity coefficients. We introduce a novel graph rewiring and preprocessing method guided by effective resistance (GPER), capable of edge addition or removal. Theoretical analysis validates our method's efficacy in mitigating over-smoothing and over-squashing. In the experiments, we conduct node and graph classifications on the benchmark datasets and can achieve an average improvement of 7.8% and 2.0%, respectively. We also conduct scalability analysis on large graphs with GCN and demonstrate that the proposed preprocess approach can reduce graph size by over 50% while improve the performance.
引用
收藏
页码:6330 / 6343
页数:14
相关论文
共 50 条
  • [1] ON THE STABILITY OF GRAPH CONVOLUTIONAL NEURAL NETWORKS UNDER EDGE REWIRING
    Kenlay, Henry
    Thanou, Dorina
    Dong, Xiaowen
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 8513 - 8517
  • [2] Rewiring Networks for Graph Neural Network Training Using Discrete Geometry
    Bober, Jakub
    Monod, Anthea
    Saucan, Emil
    Webster, Kevin N.
    COMPLEX NETWORKS & THEIR APPLICATIONS XII, VOL 1, COMPLEX NETWORKS 2023, 2024, 1141 : 225 - 236
  • [3] Explanation-based Graph Neural Networks for Graph Classification
    Seo, Sangwoo
    Jung, Seungjun
    Kim, Changick
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2836 - 2842
  • [4] Graph-based Recommendation using Graph Neural Networks
    Dossena, Marco
    Irwin, Christopher
    Portinale, Luigi
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 1769 - 1774
  • [5] Graph-based Dependency Parsing with Graph Neural Networks
    Ji, Tao
    Wu, Yuanbin
    Lan, Man
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 2475 - 2485
  • [6] Graph Neural Networks for Graph Drawing
    Tiezzi, Matteo
    Ciravegna, Gabriele
    Gori, Marco
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 4668 - 4681
  • [7] Graph Rewriting for Graph Neural Networks
    Machowczyk, Adam
    Heckel, Reiko
    GRAPH TRANSFORMATION, ICGT 2023, 2023, 13961 : 292 - 301
  • [8] Graph Mining with Graph Neural Networks
    Jin, Wei
    WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 1119 - 1120
  • [9] Graph Clustering with Graph Neural Networks
    Tsitsulin, Anton
    Palowitch, John
    Perozzi, Bryan
    Mueller, Emmanuel
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [10] Domination based graph neural networks
    Meybodi, Mohsen Alambardar
    Safari, Mahdi
    Davoodijam, Ensieh
    International Journal of Computers and Applications, 2024, 46 (11) : 998 - 1005