Adaptive propagation deep graph neural networks

被引:8
作者
Chen, Wei [1 ]
Yan, Wenxu [1 ]
Wang, Wenyuan [1 ]
机构
[1] Jiangnan Univ, Sch Internet Things Engn, Wuxi 214000, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Adaptive propagation combinations; Subjective and objective information; Aggregation weights; Computational costs;
D O I
10.1016/j.patcog.2024.110607
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) with adaptive propagation combinations represent a specialized deep learning paradigm, engineered to capture complex nodal interconnections within graph data. The primary challenge of this model lies in distilling and representing features extracted over varying nodal distances. This paper delves into an array of adaptive propagation strategies, with a focus on the influence of nodal distances and information aggregation on model efficacy. Our investigation identifies a critical performance drop in scenarios featuring overly brief propagation paths or an insufficient number of layers. Addressing this, we propose an innovative adaptive propagation technique in deep graph neural networks, named AP-DGNN, aimed at reconstructing high -order graph convolutional neural networks (GCNs). The AP-DGNN model assigns unique aggregation combination weights to each node and category, culminating in a final model representation through a process of weighted aggregation. Notably, these weights are capable of assimilating both subjective and objective information characteristics within the network. To substantiate our model's effectiveness and scalability, we employed often -used benchmark datasets for experimental validation. A notable aspect of our AP-DGNN model is its minimal training parameter requirement and reduced computational demand. Furthermore, we demonstrate the model's enhanced performance, which remains consistent across various hyperparameter configurations. This aspect was rigorously tested under diverse hyperparameter settings. Our findings contribute significantly to the evolution of graph neural networks, potentially revolutionizing their application across multiple domains. The research presented herein not only advances the understanding of GNNs but also paves the way for their robust application in varied scenarios. Codes are available at https://github.com/CW112/AP_DGNN.
引用
收藏
页数:10
相关论文
共 50 条
[31]   Accelerate microstructure evolution simulation using graph neural networks with adaptive spatiotemporal resolution [J].
Fan, Shaoxun ;
Hitt, Andrew L. ;
Tang, Ming ;
Sadigh, Babak ;
Zhou, Fei .
MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2024, 5 (02)
[32]   Adaptive Transfer of Graph Neural Networks for Few-Shot Molecular Property Prediction [J].
Zhang, Baoquan ;
Luo, Chuyao ;
Jiang, Hao ;
Feng, Shanshan ;
Li, Xutao ;
Zhang, Bowen ;
Ye, Yunming .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2023, 20 (06) :3863-3875
[33]   Combining Graph Neural Networks and Deep Reinforcement Learning for Aircraft Maintenance Stand Scheduling [J].
Zheng, Yi ;
Guo, Runxia ;
Liu, Guihang .
PROCEEDINGS OF 2024 8TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE, CSAI 2024, 2024, :333-339
[34]   Deep Graph Neural Networks for Malware Detection Using Ghidra P-Code [J].
Iorizzo, Rinaldo ;
Yuan, Bo .
PROCEEDINGS OF THE 23RD EUROPEAN CONFERENCE ON CYBER WARFARE AND SECURITY, ECCWS 2024, 2024, 23 :800-806
[35]   DeGNN: Improving Graph Neural Networks with Graph Decomposition [J].
Miao, Xupeng ;
Gurel, Nezihe Merve ;
Zhang, Wentao ;
Han, Zhichao ;
Li, Bo ;
Min, Wei ;
Rao, Susie Xi ;
Ren, Hansheng ;
Shan, Yinan ;
Shao, Yingxia ;
Wang, Yujie ;
Wu, Fan ;
Xue, Hui ;
Yang, Yaming ;
Zhang, Zitao ;
Zhao, Yang ;
Zhang, Shuai ;
Wang, Yujing ;
Cui, Bin ;
Zhang, Ce .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :1223-1233
[36]   Imbalanced Graph Classification via Graph-of-Graph Neural Networks [J].
Wang, Yu ;
Zhao, Yuying ;
Shah, Neil ;
Derr, Tyler .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, :2068-2077
[37]   On Glocal Explainability of Graph Neural Networks [J].
Lv, Ge ;
Chen, Lei ;
Cao, Caleb Chen .
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I, 2022, :648-664
[38]   Sentence Extraction by Graph Neural Networks [J].
Muratore, Donatella ;
Hagenbuchner, Markus ;
Scarselli, Franco ;
Tsoi, Ah Chung .
ARTIFICIAL NEURAL NETWORKS (ICANN 2010), PT III, 2010, 6354 :237-+
[39]   Graph Neural Networks for Metasurface Modeling [J].
Khoram, Erfan ;
Wu, Zhicheng ;
Qu, Yurui ;
Zhou, Ming ;
Yu, Zongfu .
ACS PHOTONICS, 2023, 10 (04) :892-899
[40]   Understanding Dropout for Graph Neural Networks [J].
Shu, Juan ;
Xi, Bowei ;
Li, Yu ;
Wu, Fan ;
Kamhoua, Charles ;
Ma, Jianzhu .
COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2022, WWW 2022 COMPANION, 2022, :1128-1138