EGNN: Graph structure learning based on evolutionary computation helps more in graph neural networks

被引:74
|
作者
Liu, Zhaowei [1 ]
Yang, Dong [1 ]
Wang, Yingjie [1 ]
Lu, Mingjie [1 ]
Li, Ranran [1 ]
机构
[1] Yantai Univ, Yantai 264005, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural networks; Evolutionary computation; Graph representation learning; Graph structure learning;
D O I
10.1016/j.asoc.2023.110040
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, graph neural networks (GNNs) have been successfully applied in many fields due to their characteristics of neighborhood aggregation and have achieved state-of-the-art performance. While most GNNs process graph data, the original graph data is frequently noisy or incomplete, resulting in suboptimal GNN performance. In order to solve this problem, a Graph Structure Learning (GSL) method has recently emerged to improve the performance of graph neural networks by learning a graph structure that conforms to the ground truth. However, the current strategy of GSL is to iteratively optimize the optimal graph structure and a single GNN, which will encounter several problems in training, namely vulnerability and overfitting. A novel GSL approach called evolutionary graph neural network (EGNN) has been introduced in this work in order to improve defense against adversarial attacks and enhance GNN performance. Unlike the existing GSL method, which optimizes the graph structure and enhances the parameters of a single GNN model through alternating training methods, evolutionary theory has been applied to graph structure learning for the first time in this work. Specifically, different graph structures generated by mutation operations are used to evolve a set of model parameters in order to adapt to the environment (i.e., to improve the classification performance of unlabeled nodes). An evaluation mechanism is then used to measure the quality of the generated samples in order to retain only the model parameters (progeny) with good performance. Finally, the progeny that adapt to the environment are retained and used for further optimization. Through this process, EGNN overcomes the instability of graph structure learning and always evolves the best progeny, providing new solutions for the advancement and development of GSL. Extensive experiments on various benchmark datasets demonstrate the effectiveness of EGNN and the benefits of evolutionary computation-based graph structure learning.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Learning Kernel-Based Embeddings in Graph Neural Networks
    Navarin, Nicole
    Dinh Van Tran
    Sperduti, Alessandro
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1387 - 1394
  • [32] Towards more realistic network models based on Graph Neural Networks
    Badia-Sampera, Arnau
    Suarez-Varela, Jose
    Almasan, Paul
    Rusek, Krzysztof
    Barlet-Ros, Pere
    Cabellos-Aparicio, Albert
    CONEXT'19 COMPANION: PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON EMERGING NETWORKING EXPERIMENTS AND TECHNOLOGIES, 2019, : 14 - 16
  • [33] Non-Parametric Graph Learning for Bayesian Graph Neural Networks
    Pal, Soumyasundar
    Malekmohammadi, Saber
    Regol, Florence
    Zhang, Yingxue
    Xu, Yishi
    Coates, Mark
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI 2020), 2020, 124 : 1318 - 1327
  • [34] A Generation Method of Attack Graph Based on Evolutionary Computation
    Wang, Jiajia
    PROCEEDINGS OF THE 2016 2ND INTERNATIONAL CONFERENCE ON ADVANCES IN ENERGY, ENVIRONMENT AND CHEMICAL ENGINEERING (AEECE 2016), 2016, 89 : 28 - 31
  • [35] Decision-focused Graph Neural Networks for Graph Learning and Optimization
    Liu, Yang
    Zhou, Chuan
    Zhang, Peng
    Zhang, Shuai
    Zhang, Xiaoou
    Li, Zhao
    Chen, Hongyang
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1151 - 1156
  • [36] Learning graph in graph convolutional neural networks for robust seizure prediction
    Lian, Qi
    Qi, Yu
    Pan, Gang
    Wang, Yueming
    JOURNAL OF NEURAL ENGINEERING, 2020, 17 (03)
  • [37] Graph-to-Sequence Learning using Gated Graph Neural Networks
    Beck, Daniel
    Haffari, Gholamreza
    Cohn, Trevor
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 273 - 283
  • [38] Towards Bayesian Learning of the Architecture, Graph and Parameters for Graph Neural Networks
    Valkanas, Antonios
    Panzini, Andre-Walter
    Coates, Mark
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 852 - 856
  • [39] Graph alternate learning for robust graph neural networks in node classification
    Baoliang Zhang
    Xiaoxin Guo
    Zhenchuan Tu
    Jia Zhang
    Neural Computing and Applications, 2022, 34 : 8723 - 8735
  • [40] Graph alternate learning for robust graph neural networks in node classification
    Zhang, Baoliang
    Guo, Xiaoxin
    Tu, Zhenchuan
    Zhang, Jia
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (11): : 8723 - 8735