Dynamic heterogeneous graph representation learning with neighborhood type modeling

被引:9
作者
Zhang, Lin [1 ]
Guo, Jiawen [1 ]
Bai, Qijie [1 ]
Song, Chunyao [1 ]
机构
[1] Nankai Univ, Coll Comp Sci, Tianjin Key Lab Network & Data Secur Technol, Tianjin 300350, Peoples R China
基金
美国国家科学基金会;
关键词
Dynamic heterogeneous network; Representation learning; Graph attention network; Heterogeneity encoding;
D O I
10.1016/j.neucom.2023.02.060
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph representation learning aims to learn the representations of graph structured data in low-dimensional space, and has a wide range of applications in graph analysis tasks. Real-world networks are generally heterogeneous and dynamic, which contain multiple types of nodes and edges, and the graph may evolve at a high speed over time. The complex heterogeneous properties and rapidly evolving graph structures make it difficult to learn high-quality graph representations for dynamic heterogeneous graphs. Currently, studies concentrated on representation learning of temporal heterogeneous networks are insufficient. Existing methods either rely on meta-paths where the embedding quality heavily depending on experts' selection, or use network snapshots where the fine-grained temporal information cannot be captured. In this paper, we propose a novel graph neural network model-node signature based Temporal Heterogeneous Graph Attention Network, termed as THGAT, for learning the representations of dynamic heterogeneous networks. THGAT improves the aggregation way of neighborhood information, and pays attention to the enlightenment of the importance of neighbor nodes by heterogeneous informa-tion and temporal information that cannot be ignored in the network. We also innovatively propose three node signature methods for encoding the heterogeneous information of the nodes and use the time encoding technique suitable for real-time networks to directly represent the temporal information, so as to overcome the limitations of existing methods. We conduct experiments on four real-world datasets, and the results demonstrate that THGAT improves the representation learning quality significantly, in aspects of link prediction, node classification, and node clustering, compared to the state-of-the-art methods. To make the work more complete, we also analyze the applicable scenarios of the three node signature methods through experiments, respectively. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页码:46 / 60
页数:15
相关论文
共 44 条
  • [1] [Anonymous], 2013, P WORKSHOP ICLR 2013
  • [2] Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473]
  • [3] Network Embedding and Change Modeling in Dynamic Heterogeneous Networks
    Bian, Ranran
    Koh, Yun Sing
    Dobbie, Gillian
    Divoli, Anna
    [J]. PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, : 861 - 864
  • [4] A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications
    Cai, HongYun
    Zheng, Vincent W.
    Chang, Kevin Chen-Chuan
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (09) : 1616 - 1637
  • [5] Learning Community Embedding with Community Detection and Node Embedding on Graphs
    Cavallari, Sandro
    Zheng, Vincent W.
    Cai, Hongyun
    Chang, Kevin Chen-Chuan
    Cambria, Erik
    [J]. CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 377 - 386
  • [6] A Survey on Network Embedding
    Cui, Peng
    Wang, Xiao
    Pei, Jian
    Zhu, Wenwu
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (05) : 833 - 852
  • [7] metapath2vec: Scalable Representation Learning for Heterogeneous Networks
    Dong, Yuxiao
    Chawla, Nitesh V.
    Swami, Ananthram
    [J]. KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 135 - 144
  • [8] Scalable Representation Learning for Dynamic Heterogeneous Information Networks via Metagraphs
    Fang, Yang
    Zhao, Xiang
    Huang, Peixin
    Xiao, Weidong
    de Rijke, Maarten
    [J]. ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2022, 40 (04)
  • [9] HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning
    Fu, Tao-yang
    Lee, Wang-Chien
    Lei, Zhen
    [J]. CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 1797 - 1806
  • [10] A Convolutional Encoder Model for Neural Machine Translation
    Gehring, Jonas
    Auli, Michael
    Grangier, David
    Dauphin, Yann N.
    [J]. PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 123 - 135