Parallel graph neural architecture search optimization with incomplete features

被引:0
|
作者
Yang, Haitao [1 ]
Liu, Zhaowei [1 ]
Yang, Dong [2 ]
Wang, Lihong [1 ]
机构
[1] Yantai Univ, Sch Comp & Control Engn, Yantai 264005, Peoples R China
[2] Georgia State Univ, Sch Dept Comp Sci, Atlanta, GA 30303 USA
关键词
Neural architecture search; Graph neural networks; Incomplete features; MISSING DATA; IMPUTATION;
D O I
10.1016/j.asoc.2025.113068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph neural networks (GNNs) have shown remarkable success in many fields. However, the results of different model architectures for different scenarios can be very different. Designing effective neural architectures requires a great deal of specialized knowledge, which limits the application of GNNs models. In recent years, graph neural architecture search (GNAS) has attracted widespread attention. GNAS selects the GNNs structure in predefined search space using a suitable search algorithm. The search direction is constrained based on the evaluation made by the estimation strategy. Traditional GNAS methods suffer from long search times, difficulty in parameter selection, and high sensitivity to data quality. When feature information is missing, the candidate architectures explored during the search process cannot obtain complete feature information, which significantly reduces the accuracy of GNAS. To tackle these challenges, we propose a novel optimization framework for parallel graph neural architecture search, named AutoPGO. In AutoPGO, we complement the features based on a feature propagation algorithm generated by minimizing the Dirichlet energy function, improve the search algorithm using the mutation decay strategy and complete the optimization of the parameters using the Bayesian optimization method. Experimental results show that AutoPGO has good performance and some degree of robustness.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Smooth Variational Graph Embeddings for Efficient Neural Architecture Search
    Lukasik, Jovita
    Friede, David
    Zela, Arber
    Hutter, Frank
    Keuper, Margret
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [22] CommGNAS: Unsupervised Graph Neural Architecture Search for Community Detection
    Gao, Jianliang
    Chen, Jiamin
    Oloulade, Babatounde Moctard
    Al-Sabri, Raeed
    Lyu, Tengfei
    Zhang, Ji
    Li, Zhao
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2024, 12 (02) : 444 - 454
  • [23] Pooling Architecture Search for Graph Classification
    Wei, Lanning
    Zhao, Huan
    Yao, Quanming
    He, Zhiqiang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2091 - 2100
  • [24] Optimization-inspired manual architecture design and neural architecture search
    Yibo Yang
    Zhengyang Shen
    Huan Li
    Zhouchen Lin
    Science China Information Sciences, 2023, 66
  • [25] Particle Swarm Optimization and Random Search for Convolutional Neural Architecture Search
    Deligkaris, Kosmas
    IEEE ACCESS, 2024, 12 : 91229 - 91241
  • [26] FLASH: Fast Neural Architecture Search with Hardware Optimization
    Li, Guihong
    Mandal, Sumit K.
    Ogras, Umit Y.
    Marculescu, Radu
    ACM TRANSACTIONS ON EMBEDDED COMPUTING SYSTEMS, 2021, 20 (05)
  • [27] Neural Architecture Search Based on Particle Swarm Optimization
    Niu, Ruicheng
    Li, Hao
    Zhang, Yachuan
    Kang, Yan
    2019 3RD INTERNATIONAL CONFERENCE ON DATA SCIENCE AND BUSINESS ANALYTICS (ICDSBA 2019), 2019, : 319 - 324
  • [28] Optimization-inspired manual architecture design and neural architecture search
    Yang, Yibo
    Shen, Zhengyang
    Li, Huan
    Lin, Zhouchen
    SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (11)
  • [29] PSP: Progressive Space Pruning for Efficient Graph Neural Architecture Search
    Zhu, Guanghui
    Wang, Wenjie
    Xu, Zhuoer
    Cheng, Feng
    Qiu, Mengchuan
    Yuan, Chunfeng
    Huang, Yihua
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 2168 - 2181
  • [30] AutoSTG: Neural Architecture Search for Predictions of Spatio-Temporal Graph
    Pan, Zheyi
    Ke, Songyu
    Yang, Xiaodu
    Liang, Yuxuan
    Yu, Yong
    Zhang, Junbo
    Zheng, Yu
    PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 1846 - 1855