DGSLN: Differentiable graph structure learning neural network for robust graph representations

被引:9
|
作者
Zou, Xiaofeng [1 ]
Li, Kenli [1 ]
Chen, Cen [1 ,2 ]
Yang, Xulei [2 ]
Wei, Wei [3 ]
Li, Keqin [1 ,4 ]
机构
[1] Hunan Univ, Coll Informat Sci & Engn, Changsha, Peoples R China
[2] Inst Infocomm Res, Singapore, Singapore
[3] Xian Univ Technol, Sch Comp Sci & Engn, Xian, Peoples R China
[4] SUNY Coll New Paltz, Dept Comp Sci, New Paltz, NY USA
基金
中国国家自然科学基金;
关键词
Adaptive structure learning; Graph neural networks; Graph regularization; Graph sparsification;
D O I
10.1016/j.ins.2023.01.059
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, graph neural networks (GNNs) have been widely used for graph representation learning, where the central idea is to recursively aggregate neighborhood information to update the node feature based on the graph topology. Therefore, an appropriate graph topology is crucial for effective graph representation learning in GNNs. However, most existing GNNs assume that the initial graph is complete and accurate, and utilize the fixed initial graph structure in the entire network, which may limit the learning representation capability of the model. In this work, we propose a novel differentiable graph structure learning neural network (DGSLN), which learns suitable graph structures for GNNs. Specifically, our DGSLN presents a general graph generation scheme that integrates various useful graph prior messages to generate normal structures. We describe the generation process with homophily, node degree, and sparsity as examples. Moreover, we develop a hybrid loss function to ensure the quality of learned graphs, which combines task -specific loss and graph regularization loss to optimize graph structures from both struc-tural adaptive and task-driven aspects. Extensive experiments on graph classification and node classification have shown that our approach significantly improves performance on different benchmark datasets compared to state-of-the-art GNNs methods.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页码:94 / 113
页数:20
相关论文
共 50 条
  • [1] Graph Structure Learning for Robust Graph Neural Networks
    Jin, Wei
    Ma, Yao
    Liu, Xiaorui
    Tang, Xianfeng
    Wang, Suhang
    Tang, Jiliang
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 66 - 74
  • [2] Learning Robust Representations with Graph Denoising Policy Network
    Wang, Lu
    Yu, Wenchao
    Wang, Wei
    Cheng, Wei
    Zhang, Wei
    Zha, Hongyuan
    He, Xiaofeng
    Chen, Haifeng
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1378 - 1383
  • [3] Robust graph learning with graph convolutional network
    Wan, Yingying
    Yuan, Changan
    Zhan, Mengmeng
    Chen, Long
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (03)
  • [4] Are Graph Neural Network Explainers Robust to Graph Noises?
    Li, Yiqiao
    Verma, Sunny
    Yang, Shuiqiao
    Zhou, Jianlong
    Chen, Fang
    AI 2022: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13728 : 161 - 174
  • [5] Robust Graph Neural Network based on Graph Denoising
    Tenorio, Victor M.
    Rey, Samuel
    Marques, Antonio G.
    FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF, 2023, : 578 - 582
  • [6] Reverse Graph Learning for Graph Neural Network
    Peng, Liang
    Hu, Rongyao
    Kong, Fei
    Gan, Jiangzhang
    Mo, Yujie
    Shi, Xiaoshuang
    Zhu, Xiaofeng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 4530 - 4541
  • [7] Graph Neural Network based Multi-instance Learning with Graph Structure Learning
    Liu, Fan
    Liu, Weidong
    2024 7TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA, ICAIBD 2024, 2024, : 505 - 510
  • [8] Graph Transformer: Learning Better Representations for Graph Neural Networks
    Wang, Boyuan
    Cui, Lixin
    Bai, Lu
    Hancock, Edwin R.
    STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, S+SSPR 2020, 2021, 12644 : 139 - 149
  • [9] Graph Differentiable Architecture Search with Structure Learning
    Qin, Yijian
    Wang, Xin
    Zhang, Zeyang
    Zhu, Wenwu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [10] Deep Neural Networks for Learning Graph Representations
    Cao, Shaosheng
    Lu, Wei
    Xu, Qiongkai
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 1145 - 1152