EGNN: Graph structure learning based on evolutionary computation helps more in graph neural networks

被引:77
作者
Liu, Zhaowei [1 ]
Yang, Dong [1 ]
Wang, Yingjie [1 ]
Lu, Mingjie [1 ]
Li, Ranran [1 ]
机构
[1] Yantai Univ, Yantai 264005, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural networks; Evolutionary computation; Graph representation learning; Graph structure learning;
D O I
10.1016/j.asoc.2023.110040
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, graph neural networks (GNNs) have been successfully applied in many fields due to their characteristics of neighborhood aggregation and have achieved state-of-the-art performance. While most GNNs process graph data, the original graph data is frequently noisy or incomplete, resulting in suboptimal GNN performance. In order to solve this problem, a Graph Structure Learning (GSL) method has recently emerged to improve the performance of graph neural networks by learning a graph structure that conforms to the ground truth. However, the current strategy of GSL is to iteratively optimize the optimal graph structure and a single GNN, which will encounter several problems in training, namely vulnerability and overfitting. A novel GSL approach called evolutionary graph neural network (EGNN) has been introduced in this work in order to improve defense against adversarial attacks and enhance GNN performance. Unlike the existing GSL method, which optimizes the graph structure and enhances the parameters of a single GNN model through alternating training methods, evolutionary theory has been applied to graph structure learning for the first time in this work. Specifically, different graph structures generated by mutation operations are used to evolve a set of model parameters in order to adapt to the environment (i.e., to improve the classification performance of unlabeled nodes). An evaluation mechanism is then used to measure the quality of the generated samples in order to retain only the model parameters (progeny) with good performance. Finally, the progeny that adapt to the environment are retained and used for further optimization. Through this process, EGNN overcomes the instability of graph structure learning and always evolves the best progeny, providing new solutions for the advancement and development of GSL. Extensive experiments on various benchmark datasets demonstrate the effectiveness of EGNN and the benefits of evolutionary computation-based graph structure learning.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Attention-based graph neural networks: a survey
    Sun, Chengcheng
    Li, Chenhao
    Lin, Xiang
    Zheng, Tianji
    Meng, Fanrong
    Rui, Xiaobin
    Wang, Zhixiao
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (SUPPL 2) : 2263 - 2310
  • [32] A comparison of statistical relational learning and graph neural networks for aggregate graph queries
    Embar, Varun
    Srinivasan, Sriram
    Getoor, Lise
    MACHINE LEARNING, 2021, 110 (07) : 1847 - 1866
  • [33] A comparison of statistical relational learning and graph neural networks for aggregate graph queries
    Varun Embar
    Sriram Srinivasan
    Lise Getoor
    Machine Learning, 2021, 110 : 1847 - 1866
  • [34] Perturb more, trap more: Understanding behaviors of graph neural networks
    Ji, Chaojie
    Wang, Ruxin
    Wu, Hongyan
    NEUROCOMPUTING, 2022, 493 : 59 - 75
  • [35] Multitask Learning on Graph Neural Networks: Learning Multiple Graph Centrality Measures with a Unified Network
    Avelar, Pedro
    Lemos, Henrique
    Prates, Marcelo
    Lamb, Luis
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 : 701 - 715
  • [36] Graph Neural Networks With Lifting-Based Adaptive Graph Wavelets
    Xu, Mingxing
    Dai, Wenrui
    Li, Chenglin
    Zou, Junni
    Xiong, Hongkai
    Frossard, Pascal
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2022, 8 : 63 - 77
  • [37] Graph Rewiring and Preprocessing for Graph Neural Networks Based on Effective Resistance
    Shen, Xu
    Lio, Pietro
    Yang, Lintao
    Yuan, Ru
    Zhang, Yuyang
    Peng, Chengbin
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6330 - 6343
  • [38] An Intelligent Ride-Sharing Recommendation Method Based on Graph Neural Network and Evolutionary Computation
    Zhou, Qian
    Wu, Jiayang
    Dai, Hua
    Yang, Geng
    Zhang, Yanchun
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (01) : 569 - 578
  • [39] Learning Transferable Policies with Improved Graph Neural Networks on Serial Robotic Structure
    Zhang, Fengyi
    Xiong, Fangzhou
    Yang, Xu
    Liu, Zhiyong
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 115 - 126
  • [40] Structack: Structure-based Adversarial Attacks on Graph Neural Networks
    Hussain, Hussain
    Duricic, Tomislav
    Lex, Elisabeth
    Helic, Denis
    Strohmaier, Markus
    Kern, Roman
    PROCEEDINGS OF THE 32ND ACM CONFERENCE ON HYPERTEXT AND SOCIAL MEDIA (HT '21), 2021, : 111 - 120