EGNN: Graph structure learning based on evolutionary computation helps more in graph neural networks

被引:74
|
作者
Liu, Zhaowei [1 ]
Yang, Dong [1 ]
Wang, Yingjie [1 ]
Lu, Mingjie [1 ]
Li, Ranran [1 ]
机构
[1] Yantai Univ, Yantai 264005, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural networks; Evolutionary computation; Graph representation learning; Graph structure learning;
D O I
10.1016/j.asoc.2023.110040
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, graph neural networks (GNNs) have been successfully applied in many fields due to their characteristics of neighborhood aggregation and have achieved state-of-the-art performance. While most GNNs process graph data, the original graph data is frequently noisy or incomplete, resulting in suboptimal GNN performance. In order to solve this problem, a Graph Structure Learning (GSL) method has recently emerged to improve the performance of graph neural networks by learning a graph structure that conforms to the ground truth. However, the current strategy of GSL is to iteratively optimize the optimal graph structure and a single GNN, which will encounter several problems in training, namely vulnerability and overfitting. A novel GSL approach called evolutionary graph neural network (EGNN) has been introduced in this work in order to improve defense against adversarial attacks and enhance GNN performance. Unlike the existing GSL method, which optimizes the graph structure and enhances the parameters of a single GNN model through alternating training methods, evolutionary theory has been applied to graph structure learning for the first time in this work. Specifically, different graph structures generated by mutation operations are used to evolve a set of model parameters in order to adapt to the environment (i.e., to improve the classification performance of unlabeled nodes). An evaluation mechanism is then used to measure the quality of the generated samples in order to retain only the model parameters (progeny) with good performance. Finally, the progeny that adapt to the environment are retained and used for further optimization. Through this process, EGNN overcomes the instability of graph structure learning and always evolves the best progeny, providing new solutions for the advancement and development of GSL. Extensive experiments on various benchmark datasets demonstrate the effectiveness of EGNN and the benefits of evolutionary computation-based graph structure learning.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] A Lightweight Method for Graph Neural Networks Based on Knowledge Distillation and Graph Contrastive Learning
    Wang, Yong
    Yang, Shuqun
    APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [22] Long-tailed graph neural networks via graph structure learning for node classification
    Junchao Lin
    Yuan Wan
    Jingwen Xu
    Xingchen Qi
    Applied Intelligence, 2023, 53 : 20206 - 20222
  • [23] Long-tailed graph neural networks via graph structure learning for node classification
    Lin, Junchao
    Wan, Yuan
    Xu, Jingwen
    Qi, Xingchen
    APPLIED INTELLIGENCE, 2023, 53 (17) : 20206 - 20222
  • [24] Graph structure and homophily for label propagation in Graph Neural Networks
    Vandromme, Maxence
    Petiton, Serge G.
    2023 IEEE 16TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP, MCSOC, 2023, : 194 - 201
  • [25] Multivariate time series prediction of complex systems based on graph neural networks with location embedding graph structure learning
    Shi, Xun
    Hao, Kuangrong
    Chen, Lei
    Wei, Bing
    Liu, Xiaoyan
    ADVANCED ENGINEERING INFORMATICS, 2022, 54
  • [26] A Multi-Objective Evolutionary Approach Based on Graph-in-Graph for Neural Architecture Search of Convolutional Neural Networks
    Xue, Yu
    Jiang, Pengcheng
    Neri, Ferrante
    Liang, Jiayu
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2021, 31 (09)
  • [27] Graph Structure Estimation Neural Networks
    Wang, Ruijia
    Mou, Shuai
    Wang, Xiao
    Xiao, Wanpeng
    Ju, Qi
    Shi, Chuan
    Xie, Xing
    PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 342 - 353
  • [28] Redundancy-Free Computation for Graph Neural Networks
    Jia, Zhihao
    Lin, Sina
    Ying, Rex
    You, Jiaxuan
    Leskovec, Jure
    Aiken, Alex
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 997 - 1005
  • [29] A Hybrid Secure Computation Framework for Graph Neural Networks
    Ren, Yixuan
    Jie, Yixin
    Wang, Qingtao
    Zhang, Bingbing
    Zhang, Chi
    Wei, Lingbo
    2021 18TH INTERNATIONAL CONFERENCE ON PRIVACY, SECURITY AND TRUST (PST), 2021,
  • [30] Neutral graph of regulatory Boolean networks using evolutionary computation
    Ruz, Gonzalo A.
    Goles, Eric
    2014 IEEE CONFERENCE ON COMPUTATIONAL INTELLIGENCE IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, 2014,