Graph neural architecture prediction

被引:1
作者
Gao, Jianliang [1 ]
Oloulade, Babatounde Moctard [1 ]
Al-Sabri, Raeed [1 ]
Chen, Jiamin [1 ]
Lyu, Tengfei [1 ]
Wu, Zhenpeng [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Yuelu St, Changsha 410083, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Neural architecture search; Automated machine learning; SEARCH; NETWORKS;
D O I
10.1007/s10115-023-01968-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) have shown their superiority in the modeling of graph data. Recently, increasing attention has been paid to automatic graph neural architecture search, aiming to overcome the shortcomings of manually constructing GNN architectures that requires a lot of expert experience. However, existing graph neural architecture search (GraphNAS) methods can only select architecture from the partial evaluated GNN architectures. To solve the challenges, we propose a GraphNeural Architecture Prediction (GraphNAP) framework, which can select the optimal GNN architecture from the search space efficiently. To achieve this goal, a neural predictor is designed in GraphNAP. Firstly, the neural predictor is trained by a small number of sampled GNN architectures. Then, the trained neural predictor is used to predict all GNN architectures in the search space. In this way, GraphNAP can efficiently explore the performance of all GNN architectures in the search space and then select the optimal GNN architecture. The experimental results show that GraphNAP outperforms state-of-the-art both handcrafted and GraphNAS-based methods for both graph and node classification tasks. The python implementation of GraphNAP can be found at https://github.com/BeObm/GraphNAP.
引用
收藏
页码:29 / 58
页数:30
相关论文
共 36 条
[1]   Learning Backtrackless Aligned-Spatial Graph Convolutional Networks for Graph Classification [J].
Bai, Lu ;
Cui, Lixin ;
Jiao, Yuhang ;
Rossi, Luca ;
Hancock, Edwin R. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) :783-798
[2]   Auto-GNAS: A Parallel Graph Neural Architecture Search Framework [J].
Chen, Jiamin ;
Gao, Jianliang ;
Chen, Yibo ;
Oloulade, Babatounde Moctard ;
Lyu, Tengfei ;
Li, Zhao .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (11) :3117-3128
[3]  
Chen Ming, 2020, P MACHINE LEARNING R, V119
[4]  
Fey M., 2019, P ICLR WORKSHOP REPR
[5]  
Gao Y, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1403
[6]  
Gilmer J, 2017, PR MACH LEARN RES, V70
[7]  
Guan Chaoyu, 2021, PR MACH LEARN RES, V139
[8]   Single Path One-Shot Neural Architecture Search with Uniform Sampling [J].
Guo, Zichao ;
Zhang, Xiangyu ;
Mu, Haoyuan ;
Heng, Wen ;
Liu, Zechun ;
Wei, Yichen ;
Sun, Jian .
COMPUTER VISION - ECCV 2020, PT XVI, 2020, 12361 :544-560
[9]  
Hu W., 2020, P ADV NEUR INF PROC, P1
[10]  
Huang Wenbing, 2018, ADV NEURAL INFORM PR, V31