EGNN: Graph structure learning based on evolutionary computation helps more in graph neural networks

被引:77
作者
Liu, Zhaowei [1 ]
Yang, Dong [1 ]
Wang, Yingjie [1 ]
Lu, Mingjie [1 ]
Li, Ranran [1 ]
机构
[1] Yantai Univ, Yantai 264005, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural networks; Evolutionary computation; Graph representation learning; Graph structure learning;
D O I
10.1016/j.asoc.2023.110040
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, graph neural networks (GNNs) have been successfully applied in many fields due to their characteristics of neighborhood aggregation and have achieved state-of-the-art performance. While most GNNs process graph data, the original graph data is frequently noisy or incomplete, resulting in suboptimal GNN performance. In order to solve this problem, a Graph Structure Learning (GSL) method has recently emerged to improve the performance of graph neural networks by learning a graph structure that conforms to the ground truth. However, the current strategy of GSL is to iteratively optimize the optimal graph structure and a single GNN, which will encounter several problems in training, namely vulnerability and overfitting. A novel GSL approach called evolutionary graph neural network (EGNN) has been introduced in this work in order to improve defense against adversarial attacks and enhance GNN performance. Unlike the existing GSL method, which optimizes the graph structure and enhances the parameters of a single GNN model through alternating training methods, evolutionary theory has been applied to graph structure learning for the first time in this work. Specifically, different graph structures generated by mutation operations are used to evolve a set of model parameters in order to adapt to the environment (i.e., to improve the classification performance of unlabeled nodes). An evaluation mechanism is then used to measure the quality of the generated samples in order to retain only the model parameters (progeny) with good performance. Finally, the progeny that adapt to the environment are retained and used for further optimization. Through this process, EGNN overcomes the instability of graph structure learning and always evolves the best progeny, providing new solutions for the advancement and development of GSL. Extensive experiments on various benchmark datasets demonstrate the effectiveness of EGNN and the benefits of evolutionary computation-based graph structure learning.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Semisupervised Graph Neural Networks for Graph Classification
    Xie, Yu
    Liang, Yanfeng
    Gong, Maoguo
    Qin, A. K.
    Ong, Yew-Soon
    He, Tiantian
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (10) : 6222 - 6235
  • [42] Multilayer biological network alignment based on similarity computation via Graph Neural Networks
    Cinaglia, Pietro
    JOURNAL OF COMPUTATIONAL SCIENCE, 2024, 78
  • [43] uGrapher: High-Performance Graph Operator Computation via Unified Abstraction for Graph Neural Networks
    Zhou, Yangjie
    Leng, Jingwen
    Song, Yaoxu
    Lu, Shuwen
    Wang, Mian
    Li, Chao
    Guo, Minyi
    Shen, Wenting
    Li, Yong
    Lin, Wei
    Liu, Xiangwen
    Wu, Hanqing
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS, VOL 2, ASPLOS 2023, 2023, : 878 - 891
  • [44] Graph Partitioning and Sparse Matrix Ordering using Reinforcement Learning and Graph Neural Networks
    Gatti, Alice
    Hu, Zhixiong
    Smidt, Tess
    Ng, Esmond G.
    Ghysels, Pieter
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [45] DGSLN: Differentiable graph structure learning neural network for robust graph representations
    Zou, Xiaofeng
    Li, Kenli
    Chen, Cen
    Yang, Xulei
    Wei, Wei
    Li, Keqin
    INFORMATION SCIENCES, 2023, 626 : 94 - 113
  • [46] Learning Stochastic Graph Neural Networks With Constrained Variance
    Gao, Zhan
    Isufi, Elvin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 358 - 371
  • [47] Learning Graph Neural Networks for Image Style Transfer
    Jing, Yongcheng
    Mao, Yining
    Yang, Yiding
    Zhan, Yibing
    Song, Mingli
    Wang, Xinchao
    Tao, Dacheng
    COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 : 111 - 128
  • [48] Streaming Graph Neural Networks via Continual Learning
    Wang, Junshan
    Song, Guojie
    Wu, Yi
    Wang, Liang
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 1515 - 1524
  • [49] Inductive Lottery Ticket Learning for Graph Neural Networks
    Sui, Yong-Duo
    Wang, Xiang
    Chen, Tianlong
    Wang, Meng
    He, Xiang-Nan
    Chua, Tat-Seng
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2024, 39 (06) : 1223 - 1237
  • [50] On Inductive-Transductive Learning With Graph Neural Networks
    Ciano, Giorgio
    Rossi, Alberto
    Bianchini, Monica
    Scarselli, Franco
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) : 758 - 769