Adaptive propagation deep graph neural networks

被引:8
作者
Chen, Wei [1 ]
Yan, Wenxu [1 ]
Wang, Wenyuan [1 ]
机构
[1] Jiangnan Univ, Sch Internet Things Engn, Wuxi 214000, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Adaptive propagation combinations; Subjective and objective information; Aggregation weights; Computational costs;
D O I
10.1016/j.patcog.2024.110607
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) with adaptive propagation combinations represent a specialized deep learning paradigm, engineered to capture complex nodal interconnections within graph data. The primary challenge of this model lies in distilling and representing features extracted over varying nodal distances. This paper delves into an array of adaptive propagation strategies, with a focus on the influence of nodal distances and information aggregation on model efficacy. Our investigation identifies a critical performance drop in scenarios featuring overly brief propagation paths or an insufficient number of layers. Addressing this, we propose an innovative adaptive propagation technique in deep graph neural networks, named AP-DGNN, aimed at reconstructing high -order graph convolutional neural networks (GCNs). The AP-DGNN model assigns unique aggregation combination weights to each node and category, culminating in a final model representation through a process of weighted aggregation. Notably, these weights are capable of assimilating both subjective and objective information characteristics within the network. To substantiate our model's effectiveness and scalability, we employed often -used benchmark datasets for experimental validation. A notable aspect of our AP-DGNN model is its minimal training parameter requirement and reduced computational demand. Furthermore, we demonstrate the model's enhanced performance, which remains consistent across various hyperparameter configurations. This aspect was rigorously tested under diverse hyperparameter settings. Our findings contribute significantly to the evolution of graph neural networks, potentially revolutionizing their application across multiple domains. The research presented herein not only advances the understanding of GNNs but also paves the way for their robust application in varied scenarios. Codes are available at https://github.com/CW112/AP_DGNN.
引用
收藏
页数:10
相关论文
共 50 条
[41]   Implementation aspects of Graph Neural Networks [J].
Barcz, A. ;
Szymanski, Z. ;
Jankowski, S. .
PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2013, 2013, 8903
[42]   Graph Neural Networks for Recommender System [J].
Gao, Chen ;
Wang, Xiang ;
He, Xiangnan ;
Li, Yong .
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, :1623-1625
[43]   Graph Neural Networks in IoT: A Survey [J].
Dong, Guimin ;
Tang, Mingyue ;
Wang, Zhiyuan ;
Gao, Jiechao ;
Guo, Sikun ;
Cai, Lihua ;
Gutierrez, Robert ;
Campbel, Bradford ;
Barnes, Laura E. ;
Boukhechba, Mehdi .
ACM TRANSACTIONS ON SENSOR NETWORKS, 2023, 19 (02)
[44]   A Practical Tutorial on Graph Neural Networks [J].
Ward, Isaac Ronald ;
Joyner, Jack ;
Lickfold, Casey ;
Guo, Yulan ;
Bennamoun, Mohammed .
ACM COMPUTING SURVEYS, 2022, 54 (10S)
[45]   Graph Neural Networks in Network Neuroscience [J].
Bessadok, Alaa ;
Mahjoub, Mohamed Ali ;
Rekik, Islem .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) :5833-5848
[46]   AdaBoosting Clusters on Graph Neural Networks [J].
Zheng, Li ;
Gao, Jun ;
Li, Zhao ;
Zhang, Ji .
2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, :1523-1528
[47]   Graph Neural Networks: A bibliometrics overview [J].
Keramatfar, Abdalsamad ;
Rafiee, Mohadeseh ;
Amirkhani, Hossein .
MACHINE LEARNING WITH APPLICATIONS, 2022, 10
[48]   Multiscale graph neural networks with adaptive mesh refinement for accelerating mesh-based simulations [J].
Perera, Roberto ;
Agrawal, Vinamra .
COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2024, 429
[49]   Detecting anomalous traffic behaviors with seasonal deep Kalman filter graph convolutional neural networks [J].
Sun, Yanshen ;
Lu, Yen-Cheng ;
Fu, Kaiqun ;
Chen, Fanglan ;
Lu, Chang -Tien .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (08) :4729-4742
[50]   Combining graph neural network with deep reinforcement learning for resource allocation in computing force networks [J].
Han, Xueying ;
Xie, Mingxi ;
Yu, Ke ;
Huang, Xiaohong ;
Du, Zongpeng ;
Yao, Huijuan .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2024, 25 (05) :701-712