Graph Neural Networks With Convolutional ARMA Filters

被引:204
|
作者
Bianchi, Filippo Maria [1 ,2 ]
Grattarola, Daniele [3 ]
Livi, Lorenzo [4 ,5 ]
Alippi, Cesare [3 ,6 ]
机构
[1] UiT Arctic Univ Norway, Dept Math & Stat, N-9019 Tromso, Norway
[2] NORCE Norwegian Res Ctr, N-5008 Bergen, Norway
[3] Univ Svizzera Italiana, Fac Informat, CH-6900 Lugano, Switzerland
[4] Univ Manitoba, Dept Comp Sci & Math, Winnipeg, MB R3T 2N2, Canada
[5] Univ Exeter, Dept Comp Sci, Exeter EX4 4PY, Devon, England
[6] Politecn Milan, Dept Elect Informat & Bioengn, I-20133 Milan, Italy
基金
瑞士国家科学基金会;
关键词
Convolution; Laplace equations; Task analysis; Graph neural networks; Chebyshev approximation; Frequency response; Eigenvalues and eigenfunctions; Geometric deep learning; graph filters; graph neural networks; graph theory; graph signal processing;
D O I
10.1109/TPAMI.2021.3054830
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Popular graph neural networks implement convolution operations on graphs based on polynomial spectral filters. In this paper, we propose a novel graph convolutional layer inspired by the auto-regressive moving average (ARMA) filter that, compared to polynomial ones, provides a more flexible frequency response, is more robust to noise, and better captures the global graph structure. We propose a graph neural network implementation of the ARMA filter with a recursive and distributed formulation, obtaining a convolutional layer that is efficient to train, localized in the node space, and can be transferred to new graphs at test time. We perform a spectral analysis to study the filtering effect of the proposed ARMA layer and report experiments on four downstream tasks: semi-supervised node classification, graph signal classification, graph classification, and graph regression. Results show that the proposed ARMA layer brings significant improvements over graph neural networks based on polynomial filters.
引用
收藏
页码:3496 / 3507
页数:12
相关论文
共 50 条
  • [1] Adaptive filters in Graph Convolutional Neural Networks
    Apicella, Andrea
    Isgro, Francesco
    Pollastro, Andrea
    Prevete, Roberto
    PATTERN RECOGNITION, 2023, 144
  • [2] MIMO Graph Filters for Convolutional Neural Networks
    Gama, Fernando
    Marques, Antonio G.
    Ribeiro, Alejandro
    Leus, Geert
    2018 IEEE 19TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2018, : 651 - 655
  • [3] Dynamic Local Filters in Graph Convolutional Neural Networks
    Apicella, Andrea
    Isgro, Francesco
    Pollastro, Andrea
    Prevete, Roberto
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT II, 2023, 14234 : 406 - 417
  • [4] Augmenting Graph Convolutional Neural Networks with Highpass Filters
    Ansarizadeh, Fatemeh
    Tay, David B.
    Thiruvady, Dhananjay
    Robles-Kelly, Antonio
    STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, S+SSPR 2020, 2021, 12644 : 77 - 86
  • [5] CONVOLUTIONAL NEURAL NETWORKS VIA NODE-VARYING GRAPH FILTERS
    Gaina, Fernando
    Leust, Geert
    Marques, Antonio G.
    Ribeiro, Alejandro
    2018 IEEE DATA SCIENCE WORKSHOP (DSW), 2018, : 220 - 224
  • [6] CayleyNets: Graph Convolutional Neural Networks With Complex Rational Spectral Filters
    Levie, Ron
    Monti, Federico
    Bresson, Xavier
    Bronstein, Michael M.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (01) : 97 - 109
  • [7] GACP: graph neural networks with ARMA filters and a parallel CNN for hyperspectral image classification
    Yang, Jing
    Sun, Jie
    Ren, Yaping
    Li, Shaobo
    Ding, Shujie
    Hu, Jianjun
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2023, 16 (01) : 1770 - 1800
  • [8] Convolutional Graph Neural Networks
    Gama, Fernando
    Marques, Antonio G.
    Leus, Geert
    Ribeiro, Alejandro
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 452 - 456
  • [9] Convolutional Neural Networks with Recurrent Neural Filters
    Yang, Yi
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 912 - 917
  • [10] Symmetrical filters in convolutional neural networks
    Dzhezyan, Gregory
    Cecotti, Hubert
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (07) : 2027 - 2039