DyVGRNN: DYnamic mixture Variational Graph Recurrent Neural Networks

被引:2
|
作者
Niknam, Ghazaleh [1 ]
Molaei, Soheila [2 ]
Zare, Hadi [1 ]
Pan, Shirui [3 ]
Jalili, Mahdi [4 ]
Zhu, Tingting [2 ]
Clifton, David [2 ,5 ]
机构
[1] Univ Tehran, Dept Data Sci & Technol, Tehran, Iran
[2] Univ Oxford, Dept Engn Sci, Oxford, England
[3] Griffith Univ, Sch Informat & Commun Technol, Nathan, Qld, Australia
[4] RMIT Univ, Sch Engn, Bundoora, Vic, Australia
[5] Oxford Suzhou Ctr Adv Res OSCAR, Suzhou, Peoples R China
关键词
Dynamic graph representation learning; Dynamic node embedding; Variational graph auto-encoder; Graph recurrent neural network; Attention mechanism;
D O I
10.1016/j.neunet.2023.05.048
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although graph representation learning has been studied extensively in static graph settings, dynamic graphs are less investigated in this context. This paper proposes a novel integrated variational framework called DYnamic mixture Variational Graph Recurrent Neural Networks (DyVGRNN), which consists of extra latent random variables in structural and temporal modelling. Our proposed framework comprises an integration of Variational Graph Auto-Encoder (VGAE) and Graph Recurrent Neural Network (GRNN) by exploiting a novel attention mechanism. The Gaussian Mixture Model (GMM) and the VGAE framework are combined in DyVGRNN to model the multimodal nature of data, which enhances performance. To consider the significance of time steps, our proposed method incorporates an attention-based module. The experimental results demonstrate that our method greatly outperforms state-of-the-art dynamic graph representation learning methods in terms of link prediction and clustering.1 & COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:596 / 610
页数:15
相关论文
共 50 条
  • [1] Variational Graph Recurrent Neural Networks
    Hajiramezanali, Ehsan
    Hasanzadeh, Arman
    Duffield, Nick
    Narayanan, Krishna
    Zhou, Mingyuan
    Qian, Xiaoning
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [2] Interpretable Clustering on Dynamic Graphs with Recurrent Graph Neural Networks
    Yao, Yuhang
    Joe-Wong, Carlee
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4608 - 4616
  • [3] Dynamic Representation Learning via Recurrent Graph Neural Networks
    Zhang, Chun-Yang
    Yao, Zhi-Liang
    Yao, Hong-Yu
    Huang, Feng
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (02): : 1284 - 1297
  • [4] Gated Graph Recurrent Neural Networks
    Ruiz, Luana
    Gama, Fernando
    Ribeiro, Alejandro
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 6303 - 6318
  • [5] VGGM: Variational Graph Gaussian Mixture Model for Unsupervised Change Point Detection in Dynamic Networks
    Zhang, Xinxun
    Jiao, Pengfei
    Gao, Mengzhou
    Li, Tianpeng
    Wu, Yiming
    Wu, Huaming
    Zhao, Zhidong
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 4272 - 4284
  • [6] Variational Graph Convolutional Networks for Dynamic Graph Representation Learning
    Mir, Aabid A.
    Zuhairi, Megat F.
    Musa, Shahrulniza
    Alanazi, Meshari H.
    Namoun, Abdallah
    IEEE ACCESS, 2024, 12 : 161697 - 161717
  • [7] Variational Recurrent Neural Networks for Speech Separation
    Chien, Jen-Tzung
    Kuo, Kuan-Ting
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 1193 - 1197
  • [8] A mixture of recurrent neural networks for speaker normalisation
    Trentin, E
    Giuliani, D
    NEURAL COMPUTING & APPLICATIONS, 2001, 10 (02): : 120 - 135
  • [9] A Mixture of Recurrent Neural Networks for Speaker Normalisation
    Edmondo Trentin
    Diego Giuliani
    Neural Computing & Applications, 2001, 10 : 120 - 135
  • [10] Augmenting Recurrent Graph Neural Networks with a Cache
    Ma, Guixiang
    Vo, Vy A.
    Willke, Theodore L.
    Ahmed, Nesreen K.
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 1608 - 1619