STOCHASTIC GRAPH NEURAL NETWORKS

被引:0
作者
Gao, Zhan [1 ]
Isufi, Elvin [2 ]
Ribeiro, Alejandro [1 ]
机构
[1] Univ Penn, Dept Elect & Syst Engn, Philadelphia, PA 19104 USA
[2] Delft Univ Technol, Dept Intelligent Syst, Delft, Netherlands
来源
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING | 2020年
关键词
Graph neural networks; graph filters; random link losses; convergence analysis; distributed learning; DESIGN;
D O I
10.1109/icassp40776.2020.9054424
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. However, current GNN implementations assume ideal distributed scenarios and ignore link fluctuations that occur due to environment or human factors. In these situations, the GNN fails to address its distributed task if the topological randomness is not considered accordingly. To overcome this issue, we put forth the stochastic graph neural network (SGNN) model: a GNN where the distributed graph convolutional operator is modified to account for the network changes. Since stochasticity brings in a new paradigm, we develop a novel learning process for the SGNN and introduce the stochastic gradient descent (SGD) algorithm to estimate the parameters. We prove through the SGD that the SGNN learning process converges to a stationary point under mild Lipschitz assumptions. Numerical simulations corroborate the proposed theory and show an improved performance of the SGNN compared with the conventional GNN when operating over random time varying graphs.
引用
收藏
页码:9080 / 9084
页数:5
相关论文
共 22 条
  • [1] [Anonymous], 2013, INT C LEARNING REPRE
  • [2] Advances in Distributed Graph Filtering
    Coutino, Mario
    Isufi, Elvin
    Leus, Geert
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (09) : 2320 - 2333
  • [3] Defferrard M, 2016, ADV NEUR IN, V29
  • [4] Du J., 2018, ARXIV171010370
  • [5] Fout A., 2017, INT C NEUR INF PROC
  • [6] Convolutional Neural Network Architectures for Signals Supported on Graphs
    Gama, Fernando
    Marques, Antonio G.
    Leus, Geert
    Ribeiro, Alejandro
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (04) : 1034 - 1049
  • [7] STOCHASTIC FIRST- AND ZEROTH-ORDER METHODS FOR NONCONVEX STOCHASTIC PROGRAMMING
    Ghadimi, Saeed
    Lan, Guanghui
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2013, 23 (04) : 2341 - 2368
  • [8] OPTIMIZATION OF LIPSCHITZ CONTINUOUS-FUNCTIONS
    GOLDSTEIN, AA
    [J]. MATHEMATICAL PROGRAMMING, 1977, 13 (01) : 14 - 22
  • [9] Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
    Gomez-Bombarelli, Rafael
    Wei, Jennifer N.
    Duvenaud, David
    Hernandez-Lobato, Jose Miguel
    Sanchez-Lengeling, Benjamin
    Sheberla, Dennis
    Aguilera-Iparraguirre, Jorge
    Hirzel, Timothy D.
    Adams, Ryan P.
    Aspuru-Guzik, Alan
    [J]. ACS CENTRAL SCIENCE, 2018, 4 (02) : 268 - 276
  • [10] Filtering Random Graph Processes Over Random Time-Varying Graphs
    Isufi, Elvin
    Loukas, Andreas
    Simonetto, Andrea
    Leus, Geert
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (16) : 4406 - 4421