Graph Neural Networks With Convolutional ARMA Filters

被引:205
作者
Bianchi, Filippo Maria [1 ,2 ]
Grattarola, Daniele [3 ]
Livi, Lorenzo [4 ,5 ]
Alippi, Cesare [3 ,6 ]
机构
[1] UiT Arctic Univ Norway, Dept Math & Stat, N-9019 Tromso, Norway
[2] NORCE Norwegian Res Ctr, N-5008 Bergen, Norway
[3] Univ Svizzera Italiana, Fac Informat, CH-6900 Lugano, Switzerland
[4] Univ Manitoba, Dept Comp Sci & Math, Winnipeg, MB R3T 2N2, Canada
[5] Univ Exeter, Dept Comp Sci, Exeter EX4 4PY, Devon, England
[6] Politecn Milan, Dept Elect Informat & Bioengn, I-20133 Milan, Italy
基金
瑞士国家科学基金会;
关键词
Convolution; Laplace equations; Task analysis; Graph neural networks; Chebyshev approximation; Frequency response; Eigenvalues and eigenfunctions; Geometric deep learning; graph filters; graph neural networks; graph theory; graph signal processing;
D O I
10.1109/TPAMI.2021.3054830
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Popular graph neural networks implement convolution operations on graphs based on polynomial spectral filters. In this paper, we propose a novel graph convolutional layer inspired by the auto-regressive moving average (ARMA) filter that, compared to polynomial ones, provides a more flexible frequency response, is more robust to noise, and better captures the global graph structure. We propose a graph neural network implementation of the ARMA filter with a recursive and distributed formulation, obtaining a convolutional layer that is efficient to train, localized in the node space, and can be transferred to new graphs at test time. We perform a spectral analysis to study the filtering effect of the proposed ARMA layer and report experiments on four downstream tasks: semi-supervised node classification, graph signal classification, graph classification, and graph regression. Results show that the proposed ARMA layer brings significant improvements over graph neural networks based on polynomial filters.
引用
收藏
页码:3496 / 3507
页数:12
相关论文
共 55 条
  • [1] [Anonymous], 2015, ARXIV150904537
  • [2] Bacciu D., 2018, INT C MACHINE LEARNI, P294
  • [3] Battaglia P.W., 2018, Relational inductive biases, deep learning, and graph networks
  • [4] Bianchi F.M., 2017, RECURRENT NEURAL NET, P58, DOI DOI 10.1007/978-3-319-70338-1
  • [5] Geometric Deep Learning Going beyond Euclidean data
    Bronstein, Michael M.
    Bruna, Joan
    LeCun, Yann
    Szlam, Arthur
    Vandergheynst, Pierre
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) : 18 - 42
  • [6] Bruna J., 2014, 2 INT C LEARN REPR I, P1
  • [7] Defferrard M, 2016, ADV NEUR IN, V29
  • [8] Dhillon IS, 2007, IEEE T PATTERN ANAL, V29, P1944, DOI [10.1109/TPAMI.2007.1115, 10.1109/TP'AMI.2007.1115]
  • [9] Duvenaudt D, 2015, ADV NEUR IN, V28
  • [10] Fey Matthias, 2019, ICLR WORKSHOP REPRES