Event Sparse Net: Sparse Dynamic Graph Multi-representation Learning with Temporal Attention for Event-Based Data

被引:0
|
作者
Li, Dan [1 ]
Huang, Teng [1 ]
Hong, Jie [1 ]
Hong, Yile [1 ]
Wang, Jiaqi [1 ]
Wang, Zhen [2 ]
Zhang, Xi [3 ,4 ]
机构
[1] Guangzhou Univ, Inst Artificial Intelligence & Blockchain, Guangzhou, Peoples R China
[2] Zhejiang Lab, Kechuang Ave, Hangzhou, Zhejiang, Peoples R China
[3] Sun Yat Sen Univ, Sch Arts, Guangzhou, Peoples R China
[4] Univ Colorado Boulder, Coll Mus, Boulder, CO 80309 USA
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX | 2024年 / 14433卷
基金
中国国家自然科学基金;
关键词
dynamic graph representations; self-attention mechanism; light sparse temporal model; link prediction;
D O I
10.1007/978-981-99-8546-3_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph structure data has seen widespread utilization in modeling and learning representations, with dynamic graph neural networks being a popular choice. However, existing approaches to dynamic representation learning suffer from either discrete learning, leading to the loss of temporal information, or continuous learning, which entails significant computational burdens. Regarding these issues, we propose an innovative dynamic graph neural network called Event Sparse Net (ESN). By encoding time information adaptively as snapshots and there is an identical amount of temporal structure in each snapshot, our approach achieves continuous and precise time encoding while avoiding potential information loss in snapshot-based methods. Additionally, we introduce a lightweight module, namely Global Temporal Attention, for computing node representations based on temporal dynamics and structural neighborhoods. By simplifying the fully-connected attention fusion, our approach significantly reduces computational costs compared to the currently best-performing methods. We assess our methodology on four continuous/discrete graph datasets for link prediction to assess its effectiveness. In comparison experiments with top-notch baseline models, ESN achieves competitive performance with faster inference speed.
引用
收藏
页码:208 / 219
页数:12
相关论文
共 50 条
  • [21] TREND: TempoRal Event and Node Dynamics for Graph Representation Learning
    Wen, Zhihao
    Fang, Yuan
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1159 - 1169
  • [22] Integrated Sparse Coding With Graph Learning for Robust Data Representation
    Zhang, Yupei
    Liu, Shuhui
    IEEE ACCESS, 2020, 8 : 161245 - 161260
  • [23] EventDrop: Data Augmentation for Event-based Learning
    Gu, Fuqiang
    Sng, Weicong
    Hu, Xuke
    Yu, Fangwen
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 700 - 707
  • [24] An approach to model and query event-based temporal data
    Bertino, E
    Ferrari, E
    Guerrini, G
    FIFTH INTERNATIONAL WORKSHOP ON TEMPORAL REPRESENTATION AND REASONING - PROCEEDINGS: TIME-98, 1998, : 122 - 131
  • [25] Event-based Dynamic Graph Drawing without the Agonizing Pain
    Arleo, A.
    Miksch, S.
    Archambault, D.
    COMPUTER GRAPHICS FORUM, 2022, 41 (06) : 226 - 244
  • [26] SE-GCL: an event-based simple and effective graph contrastive learning for text representation
    Tao Meng
    Wei Ai
    Jianbin Li
    Ze Wang
    Keqin Li
    Neural Computing and Applications, 2025, 37 (8) : 5913 - 5926
  • [27] FARSE-CNN: Fully Asynchronous, Recurrent and Sparse Event-Based CNN
    Santambrogio, Riccardo
    Cannici, Marco
    Matteucci, Matteo
    COMPUTER VISION - ECCV 2024, PT LIV, 2025, 15112 : 1 - 18
  • [28] SNE: an Energy-Proportional Digital Accelerator for Sparse Event-Based Convolutions
    Di Mauro, Alfio
    Prasad, Arpan Suravi
    Huang, Zhikai
    Spallanzanit, Matteo
    Conti, Francesco
    Benini, Luca
    PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 825 - 830
  • [29] Event-based Navigation for Autonomous Drone Racing with Sparse Gated Recurrent Network
    Andersen, Kristoffer Fogh
    Huy Xuan Pham
    Ugurlu, Halil Ibrahim
    Kayacan, Erdal
    2022 EUROPEAN CONTROL CONFERENCE (ECC), 2022, : 1342 - 1348
  • [30] Semi-Supervised Graph Attention Networks for Event Representation Learning
    Rodrigues Mattos, Joao Pedro
    Marcacini, Ricardo M.
    2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, : 1234 - 1239