Degree-Aware Graph Neural Network Quantization

被引:1
|
作者
Fan, Ziqin [1 ]
Jin, Xi [1 ]
Gencaga, Deniz
机构
[1] Univ Sci & Technol China, Inst Microelect, Dept Phys, 96 Jinzhai Rd, Hefei 230026, Peoples R China
关键词
network quantization; graph neural network; graph data;
D O I
10.3390/e25111510
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In this paper, we investigate the problem of graph neural network quantization. Despite the great success on convolutional neural networks, directly applying current network quantization approaches to graph neural networks faces two challenges. First, the fixed-scale parameter in the current methods cannot flexibly fit diverse tasks and network architectures. Second, the variations of node degree in a graph leads to uneven responses, limiting the accuracy of the quantizer. To address these two challenges, we introduce learnable scale parameters that can be optimized jointly with the graph networks. In addition, we propose degree-aware normalization to process nodes with different degrees. Experiments on different tasks, baselines, and datasets demonstrate the superiority of our method against previous state-of-the-art ones.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Hardware-Aware Quantization for Multiplierless Neural Network Controllers
    Habermann, Tobias
    Kuehle, Jonas
    Kumm, Martin
    Volkova, Anastasia
    2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, APCCAS, 2022, : 541 - 545
  • [22] Hierarchy-Aware Adaptive Graph Neural Network
    Wu, Dengsheng
    Wu, Huidong
    Li, Jianping
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (01) : 365 - 378
  • [23] Attention-Aware Heterogeneous Graph Neural Network
    Zhang, Jintao
    Xu, Quan
    BIG DATA MINING AND ANALYTICS, 2021, 4 (04) : 233 - 241
  • [24] Attention-Aware Heterogeneous Graph Neural Network
    Jintao Zhang
    Quan Xu
    Big Data Mining and Analytics, 2021, 4 (04) : 233 - 241
  • [25] Saliency-aware regularized graph neural network
    Pei, Wenjie
    Xu, Weina
    Wu, Zongze
    Li, Weichao
    Wang, Jinfan
    Lu, Guangming
    Wang, Xiangrong
    ARTIFICIAL INTELLIGENCE, 2024, 328
  • [26] Graph Neural Network for Context-Aware Recommendation
    Sattar, Asma
    Bacciu, Davide
    NEURAL PROCESSING LETTERS, 2023, 55 (05) : 5357 - 5376
  • [27] Graph Neural Network for Context-Aware Recommendation
    Asma Sattar
    Davide Bacciu
    Neural Processing Letters, 2023, 55 : 5357 - 5376
  • [28] Automorphic Equivalence-aware Graph Neural Network
    Xu, Fengli
    Yao, Quanming
    Hui, Pan
    Li, Yong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [29] Algorithms and architecture support of degree-based quantization for graph neural networks
    Guo, Yilong
    Chen, Yuxuan
    Zou, Xiaofeng
    Yang, Xulei
    Gu, Yuandong
    JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 129
  • [30] PHGNN: Position-aware Graph Neural Network for Heterogeneous Graph Embedding
    Yang, Hangjun
    Li, Linsen
    Zhang, Lingxuan
    Tang, Junhua
    Chen, Zhongwei
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,