IMPROVING DYNAMIC GRAPH CONVOLUTIONAL NETWORK WITH FINE-GRAINED ATTENTION MECHANISM

被引:5
作者
Wu, Bo [1 ]
Liang, Xun [1 ]
Zheng, Xiangping [1 ]
Guo, Yuhui [1 ]
Tang, Hui [1 ]
机构
[1] Renmin Univ China, Sch Informat, Zhongguancun St, Beijing, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2022年
基金
中国国家自然科学基金;
关键词
Graph convolutional network; Dynamic Graph; Fine-grained Attention;
D O I
10.1109/ICASSP43922.2022.9746009
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Graph convolutional network (GCN) is a novel framework that utilizes a pre-defined Laplacian matrix to learn graph data effectively. With its powerful nonlinear fitting ability, GCN can produce high-quality node embedding. However, generalized GCN can only handle static graphs, whereas a large number of graphs are dynamic and evolve over time, which limits the application field of GCN. Facing the challenge, GCN with recurrent neural network (e.g., RNN) is naturally combined to acquire dynamic graph changes through joint training. However, these methods must use the node information during the entire timeline and ignore two subtle factors: the influence of nodes change with time and are related to the frequency of events. Therefore, we propose a stable and scalable dynamic GCN method using a fine-grained attention mechanism named FADGC. We use GCN to obtain static node vectors at each timestep and integrate node influence factors with multi-head attention for graph time-series learning. Experiments on multiple datasets show that our approach can better capture the inherent special characteristics of different dynamic graphs and achieve higher performance compared with related approaches.
引用
收藏
页码:3938 / 3942
页数:5
相关论文
共 17 条
[1]  
Bruna J., 2013, SPECTRAL NETWORKS LO, DOI DOI 10.48550/ARXIV.1312.6203
[2]  
Defferrard M, 2016, ADV NEUR IN, V29
[3]  
Du L, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P2086
[4]  
Goyal P., 2018, DynGEM: Deep Embedding Method for Dynamic Graphs
[5]   dyngraph2vec: Capturing network dynamics using dynamic graph representation learning [J].
Goyal, Palash ;
Chhetri, Sujit Rokka ;
Canedo, Arquimedes .
KNOWLEDGE-BASED SYSTEMS, 2020, 187
[6]  
Kipf T.N., 2016, VARIATIONAL GRAPH AU
[7]  
Kipf ThomasN., 2017, Semi-supervised classification with graph convolutional networks
[8]   CayleyNets: Graph Convolutional Neural Networks With Complex Rational Spectral Filters [J].
Levie, Ron ;
Monti, Federico ;
Bresson, Xavier ;
Bronstein, Michael M. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (01) :97-109
[9]   Dynamic graph convolutional networks [J].
Manessi, Franco ;
Rozza, Alessandro ;
Manzo, Mario .
PATTERN RECOGNITION, 2020, 97
[10]  
Pareja A, 2020, AAAI CONF ARTIF INTE, V34, P5363