T-GAN: A deep learning framework for prediction of temporal complex networks with adaptive graph convolution and attention mechanism

被引:13
作者
Huang, Ru [1 ]
Ma, Lei [1 ]
He, Jianhua [2 ]
Chu, Xiaoli [3 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Meilong Rd 130, Shanghai 200237, Peoples R China
[2] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
[3] Univ Sheffield, Dept Elect & Elect Engn, Sheffield S1 3JD, S Yorkshire, England
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Complex networks; Temporal graph embedding; Graph data mining; Graph neural network; LINK PREDICTION; NODES;
D O I
10.1016/j.displa.2021.102023
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Complex network is graph network with non-trivial topological features often occurring in real systems, such as video monitoring networks, social networks and sensor networks. While there is growing research study on complex networks, the main focus has been on the analysis and modeling of large networks with static topology. Predicting and control of temporal complex networks with evolving patterns are urgently needed but have been rarely studied. In view of the research gaps we are motivated to propose a novel end-to-end deep learning based network model, which is called temporal graph convolution and attention (T-GAN) for prediction of temporal complex networks. To joint extract both spatial and temporal features of complex networks, we design new adaptive graph convolution and integrate it with Long Short-Term Memory (LSTM) cells. An encoder-decoder framework is applied to achieve the objectives of predicting properties and trends of complex networks. And we proposed a dual attention block to improve the sensitivity of the model to different time slices. Our proposed T-GAN architecture is general and scalable, which can be used for a wide range of real applications. We demonstrate the applications of T-GAN to three prediction tasks for evolving complex networks, namely, node classification, feature forecasting and topology prediction over 6 open datasets. Our T-GAN based approach significantly outperforms the existing models, achieving improvement of more than 4.7% in recall and 25.1% in precision. Additional experiments are also conducted to show the generalization of the proposed model on learning the characteristic of time-series images. Extensive experiments demonstrate the effectiveness of T-GAN in learning spatial and temporal feature and predicting properties for complex networks.
引用
收藏
页数:20
相关论文
共 54 条
  • [1] Simplicial closure and higher-order link prediction
    Benson, Austin R.
    Abebe, Rediet
    Schaub, Michael T.
    Jadbabaie, Ali
    Kleinberg, Jon
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2018, 115 (48) : E11221 - E11230
  • [2] Bruna J., 2014, P INT C LEARN REPR I
  • [3] E-LSTM-D: A Deep Learning Framework for Dynamic Network Link Prediction
    Chen, Jinyin
    Zhang, Jian
    Xu, Xuanheng
    Fu, Chenbo
    Zhang, Dan
    Zhang, Qingpeng
    Xuan, Qi
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (06): : 3699 - 3712
  • [4] Sensor Network Security: A Survey
    Chen, Xiangqian
    Makki, Kia
    Yen, Kang
    Pissinou, Niki
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2009, 11 (02): : 52 - 73
  • [5] Emerging Trends Word2Vec
    Church, Kenneth Ward
    [J]. NATURAL LANGUAGE ENGINEERING, 2017, 23 (01) : 155 - 162
  • [6] Davis J., 2006, P 23 INT C MACH LEAR, P233, DOI DOI 10.1145/1143844.1143874
  • [7] Temporal Link Prediction Using Matrix and Tensor Factorizations
    Dunlavy, Daniel M.
    Kolda, Tamara G.
    Acar, Evrim
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2011, 5 (02)
  • [8] Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation
    Fouss, Francois
    Pirotte, Alain
    Renders, Jean-Michel
    Saerens, Marco
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2007, 19 (03) : 355 - 369
  • [9] Complex propagation on directed small world networks
    Gandica, Yerali
    Bonalde, Ismardo
    Luis Cabrera, Juan
    [J]. PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2010, 389 (19) : 4172 - 4176
  • [10] Projection-based link prediction in a bipartite network
    Gao, Man
    Chen, Ling
    Bin Li
    Li, Yun
    Liu, Wei
    Xu, Yong-Cheng
    [J]. INFORMATION SCIENCES, 2017, 376 : 158 - 171