Temporality- and Frequency-aware Graph Contrastive Learning for Temporal Networks

被引:5
作者
Tan, Shiyin [1 ]
You, Jingyi [2 ]
Li, Dongyuan [2 ]
机构
[1] Kuaishou Technol, Beijing, Peoples R China
[2] Tokyo Inst Technol, Tokyo, Japan
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022 | 2022年
关键词
Graph contrastive learning; Graph representation learning; Temporal network embedding; POWER-LAW DISTRIBUTIONS;
D O I
10.1145/3511808.3557469
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph contrastive learning (GCL) methods aim to learn more distinguishable representations by contrasting positive and negative samples. They have received increasing attention in recent years due to their wide application in recommender systems and knowledge graphs. However, almost all GCL methods are applied to static networks and can not be extended to temporal networks directly. Furthermore, recent GCL models treat low- and high-frequency nodes equally in overall training objectives, which hinders the prediction precision. To solve the aforementioned problems, in this paper, we propose a Temporality- and Frequency-aware Graph Contrastive Learning for temporal networks (TF-GCL). Specifically, to learn more diverse representations for infrequent nodes and fully explore temporal information, we first generate two augmented views from the input graph based on topological and temporal perspectives. We then design a temporality- and frequency-aware objective function to maximize the agreement between node representations of the two views. Experimental results demonstrate that TF-GCL remarkably achieves more robust node representations and significantly outperforms the state-of-the-art methods on six temporal link prediction benchmark datasets. Considering the reproducibility, we release our code on Github.
引用
收藏
页码:1878 / 1888
页数:11
相关论文
共 67 条
  • [1] Bachman P, 2019, ADV NEUR IN, V32
  • [2] Bipartite Graph Embedding via Mutual Information Maximization
    Cao, Jiangxia
    Lin, Xixun
    Guo, Shu
    Liu, Luchen
    Liu, Tingwen
    Wang, Bin
    [J]. WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 635 - 643
  • [3] Power-Law Distributions in Empirical Data
    Clauset, Aaron
    Shalizi, Cosma Rohilla
    Newman, M. E. J.
    [J]. SIAM REVIEW, 2009, 51 (04) : 661 - 703
  • [4] Collobert R, 2008, P 25 ICML, P160, DOI [10.1145/1390156.1390177, DOI 10.1145/1390156.1390177]
  • [5] Temporal Link Prediction: A Survey
    Divakaran, Aswathy
    Mohan, Anuraj
    [J]. NEW GENERATION COMPUTING, 2020, 38 (01) : 213 - 258
  • [6] Fana Shaohua, 2020, P WEB C 2020 WWW 20
  • [7] An introduction to ROC analysis
    Fawcett, Tom
    [J]. PATTERN RECOGNITION LETTERS, 2006, 27 (08) : 861 - 874
  • [8] Gao TY, 2021, 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), P6894
  • [9] dyngraph2vec: Capturing network dynamics using dynamic graph representation learning
    Goyal, Palash
    Chhetri, Sujit Rokka
    Canedo, Arquimedes
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 187
  • [10] Gracious Tony, 2021, P AAAI