Event Sparse Net: Sparse Dynamic Graph Multi-representation Learning with Temporal Attention for Event-Based Data

被引:0
|
作者
Li, Dan [1 ]
Huang, Teng [1 ]
Hong, Jie [1 ]
Hong, Yile [1 ]
Wang, Jiaqi [1 ]
Wang, Zhen [2 ]
Zhang, Xi [3 ,4 ]
机构
[1] Guangzhou Univ, Inst Artificial Intelligence & Blockchain, Guangzhou, Peoples R China
[2] Zhejiang Lab, Kechuang Ave, Hangzhou, Zhejiang, Peoples R China
[3] Sun Yat Sen Univ, Sch Arts, Guangzhou, Peoples R China
[4] Univ Colorado Boulder, Coll Mus, Boulder, CO 80309 USA
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX | 2024年 / 14433卷
基金
中国国家自然科学基金;
关键词
dynamic graph representations; self-attention mechanism; light sparse temporal model; link prediction;
D O I
10.1007/978-981-99-8546-3_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph structure data has seen widespread utilization in modeling and learning representations, with dynamic graph neural networks being a popular choice. However, existing approaches to dynamic representation learning suffer from either discrete learning, leading to the loss of temporal information, or continuous learning, which entails significant computational burdens. Regarding these issues, we propose an innovative dynamic graph neural network called Event Sparse Net (ESN). By encoding time information adaptively as snapshots and there is an identical amount of temporal structure in each snapshot, our approach achieves continuous and precise time encoding while avoiding potential information loss in snapshot-based methods. Additionally, we introduce a lightweight module, namely Global Temporal Attention, for computing node representations based on temporal dynamics and structural neighborhoods. By simplifying the fully-connected attention fusion, our approach significantly reduces computational costs compared to the currently best-performing methods. We assess our methodology on four continuous/discrete graph datasets for link prediction to assess its effectiveness. In comparison experiments with top-notch baseline models, ESN achieves competitive performance with faster inference speed.
引用
收藏
页码:208 / 219
页数:12
相关论文
共 50 条
  • [1] Sparse-Dyn: Sparse dynamic graph multirepresentation learning via event-based sparse temporal attention network
    Pang, Yan
    Shan, Ai
    Wang, Zhen
    Wang, Mengyu
    Li, Jianwei
    Zhang, Ji
    Huang, Teng
    Liu, Chao
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (11) : 8770 - 8789
  • [2] Event-Based Dynamic Graph Representation Learning for Patent Application Trend Prediction
    Zou, Tao
    Yu, Le
    Sun, Leilei
    Du, Bowen
    Wang, Deqing
    Zhuang, Fuzhen
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (05) : 1951 - 1963
  • [3] Event-Based Dynamic Graph Visualisation
    Simonetto, Paolo
    Archambault, Daniel
    Kobourov, Stephen
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (07) : 2373 - 2386
  • [4] A Theory for Sparse Event-Based Closed Loop Control
    Daye, Pierre
    Ieng, Sio-Hoi
    Benosman, Ryad
    FRONTIERS IN NEUROSCIENCE, 2019, 13
  • [5] EvAn: Neuromorphic Event-Based Sparse Anomaly Detection
    Annamalai, Lakshmi
    Chakraborty, Anirban
    Thakur, Chetan Singh
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [6] SpikeMOT: Event-Based Multi-Object Tracking With Sparse Motion Features
    Wang, Song
    Wang, Zhu
    Li, Can
    Qi, Xiaojuan
    So, Hayden Kwok-Hay
    IEEE ACCESS, 2025, 13 : 214 - 230
  • [7] ACOUSTIC SCENE CLASSIFICATION USING SPARSE FEATURE LEARNING AND EVENT-BASED POOLING
    Lee, Kyogu
    Hyung, Ziwon
    Nam, Juhan
    2013 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2013,
  • [8] Event-LSTM: An Unsupervised and Asynchronous Learning-Based Representation for Event-Based Data
    Annamalai, Lakshmi
    Ramanathan, Vignesh
    Thakur, Chetan Singh
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 4678 - 4685
  • [9] A Dynamic GCN with Cross-Representation Distillation for Event-Based Learning
    Deng, Yongjian
    Chen, Hao
    Li, Youfu
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 1492 - 1500
  • [10] Document-Level Event Argument Extraction with Sparse Representation Attention
    Zhang, Mengxi
    Chen, Honghui
    MATHEMATICS, 2024, 12 (17)