FAST GRAPH CONVOLUTIONAL RECURRENT NEURAL NETWORKS

被引:0
作者
Kadambari, Sai Kiran [1 ]
Chepuri, Sundeep Prabhakar [1 ]
机构
[1] Indian Inst Sci, Bangalore, Karnataka, India
来源
CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS | 2019年
关键词
Deep learning; Graph neural networks; graph signal processing; recurrent neural networks;
D O I
10.1109/ieeeconf44664.2019.9048829
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a Fast Graph Convolutional Neural Network (FGRNN) architecture to predict sequences with an underlying graph structure. The proposed architecture addresses the limitations of the standard recurrent neural network (RNN), namely, vanishing and exploding gradients, causing numerical instabilities during training. State-of-the-art architectures that combine gated RNN architectures, such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) with graph convolutions are known to improve the numerical stability during the training phase, but at the expense of the model size involving a large number of training parameters. FGRNN addresses this problem by adding a weighted residual connection with only two extra training parameters as compared to the standard RNN. Numerical experiments on the real 3D point cloud dataset corroborates the proposed architecture.
引用
收藏
页码:467 / 471
页数:5
相关论文
共 16 条
[1]   Geometric Deep Learning Going beyond Euclidean data [J].
Bronstein, Michael M. ;
Bruna, Joan ;
LeCun, Yann ;
Szlam, Arthur ;
Vandergheynst, Pierre .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) :18-42
[2]  
Bruna J., 2014, 2 INT C LEARN REPR, P1
[3]  
Chepuri SP, 2017, INT CONF ACOUST SPEE, P6508, DOI 10.1109/ICASSP.2017.7953410
[4]  
Defferrard M., 2016, Advances in Neural Information Processing Systems, DOI DOI 10.5555/3157382.3157527
[5]   Long-Term Recurrent Convolutional Networks for Visual Recognition and Description [J].
Donahue, Jeff ;
Hendricks, Lisa Anne ;
Rohrbach, Marcus ;
Venugopalan, Subhashini ;
Guadarrama, Sergio ;
Saenko, Kate ;
Darrell, Trevor .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (04) :677-691
[6]   Learning Graphs From Data [J].
Dong, Xiaowen ;
Thanou, Dorina ;
Rabbat, Michael ;
Frossard, Pascal .
IEEE SIGNAL PROCESSING MAGAZINE, 2019, 36 (03) :44-63
[7]  
Graves A, 2012, STUD COMPUT INTELL, V385, P1, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[8]  
Karpathy A, 2015, PROC CVPR IEEE, P3128, DOI 10.1109/CVPR.2015.7298932
[9]  
Kipf T N, 2016, ICLR
[10]  
Kusupati A., 2018, ADV NEUR IN, P9031, DOI 10.5555/3327546.3327577