Adaptive propagation deep graph neural networks

被引:8
作者
Chen, Wei [1 ]
Yan, Wenxu [1 ]
Wang, Wenyuan [1 ]
机构
[1] Jiangnan Univ, Sch Internet Things Engn, Wuxi 214000, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Adaptive propagation combinations; Subjective and objective information; Aggregation weights; Computational costs;
D O I
10.1016/j.patcog.2024.110607
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) with adaptive propagation combinations represent a specialized deep learning paradigm, engineered to capture complex nodal interconnections within graph data. The primary challenge of this model lies in distilling and representing features extracted over varying nodal distances. This paper delves into an array of adaptive propagation strategies, with a focus on the influence of nodal distances and information aggregation on model efficacy. Our investigation identifies a critical performance drop in scenarios featuring overly brief propagation paths or an insufficient number of layers. Addressing this, we propose an innovative adaptive propagation technique in deep graph neural networks, named AP-DGNN, aimed at reconstructing high -order graph convolutional neural networks (GCNs). The AP-DGNN model assigns unique aggregation combination weights to each node and category, culminating in a final model representation through a process of weighted aggregation. Notably, these weights are capable of assimilating both subjective and objective information characteristics within the network. To substantiate our model's effectiveness and scalability, we employed often -used benchmark datasets for experimental validation. A notable aspect of our AP-DGNN model is its minimal training parameter requirement and reduced computational demand. Furthermore, we demonstrate the model's enhanced performance, which remains consistent across various hyperparameter configurations. This aspect was rigorously tested under diverse hyperparameter settings. Our findings contribute significantly to the evolution of graph neural networks, potentially revolutionizing their application across multiple domains. The research presented herein not only advances the understanding of GNNs but also paves the way for their robust application in varied scenarios. Codes are available at https://github.com/CW112/AP_DGNN.
引用
收藏
页数:10
相关论文
共 32 条
[1]   Graph Neural Networks With Convolutional ARMA Filters [J].
Bianchi, Filippo Maria ;
Grattarola, Daniele ;
Livi, Lorenzo ;
Alippi, Cesare .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) :3496-3507
[2]   A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications [J].
Cai, HongYun ;
Zheng, Vincent W. ;
Chang, Kevin Chen-Chuan .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (09) :1616-1637
[3]   Search for deep graph neural networks [J].
Feng, Guosheng ;
Wang, Hongzhi ;
Wang, Chunnan .
INFORMATION SCIENCES, 2023, 649
[4]   Graphs, Convolutions, and Neural Networks: From Graph Filters to Graph Neural Networks [J].
Gama, Fernando ;
Isufi, Elvin ;
Leus, Geert ;
Ribeiro, Alejandro .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (06) :128-138
[5]   EdgeNets: Edge Varying Graph Neural Networks [J].
Isufi, Elvin ;
Gama, Fernando ;
Ribeiro, Alejandro .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) :7457-7473
[6]   Autoregressive Moving Average Graph Filtering [J].
Isufi, Elvin ;
Loukas, Andreas ;
Simonetto, Andrea ;
Leus, Geert .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (02) :274-288
[7]   GPENs: Graph Data Learning With Graph Propagation-Embedding Networks [J].
Jiang, Bo ;
Wang, Leiling ;
Cheng, Jian ;
Tang, Jin ;
Luo, Bin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (08) :3925-3938
[8]  
Klicpera Johannes, 2018, ICLR POSTER
[9]   CayleyNets: Graph Convolutional Neural Networks With Complex Rational Spectral Filters [J].
Levie, Ron ;
Monti, Federico ;
Bresson, Xavier ;
Bronstein, Michael M. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (01) :97-109
[10]   DeeperGCN: Training Deeper GCNs With Generalized Aggregation Functions [J].
Li, Guohao ;
Xiong, Chenxin ;
Qian, Guocheng ;
Thabet, Ali ;
Ghanem, Bernard .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) :13024-13034