Degree-Aware Graph Neural Network Quantization

被引:1
|
作者
Fan, Ziqin [1 ]
Jin, Xi [1 ]
Gencaga, Deniz
机构
[1] Univ Sci & Technol China, Inst Microelect, Dept Phys, 96 Jinzhai Rd, Hefei 230026, Peoples R China
关键词
network quantization; graph neural network; graph data;
D O I
10.3390/e25111510
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In this paper, we investigate the problem of graph neural network quantization. Despite the great success on convolutional neural networks, directly applying current network quantization approaches to graph neural networks faces two challenges. First, the fixed-scale parameter in the current methods cannot flexibly fit diverse tasks and network architectures. Second, the variations of node degree in a graph leads to uneven responses, limiting the accuracy of the quantizer. To address these two challenges, we introduce learnable scale parameters that can be optimized jointly with the graph networks. In addition, we propose degree-aware normalization to process nodes with different degrees. Experiments on different tasks, baselines, and datasets demonstrate the superiority of our method against previous state-of-the-art ones.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] DAHGN: Degree-Aware Heterogeneous Graph Neural Network
    Zhao, Mingxia
    Jia, Adele Lu
    KNOWLEDGE-BASED SYSTEMS, 2024, 285
  • [2] Degree-Aware Kernel Mapping for Graph Processing on GPUs
    Srivastava, Sanya
    Sorensen, Tyler
    2023 IEEE INTERNATIONAL SYMPOSIUM ON PERFORMANCE ANALYSIS OF SYSTEMS AND SOFTWARE, ISPASS, 2023, : 319 - 321
  • [3] DegUIL: Degree-Aware Graph Neural Networks for Long-Tailed User Identity Linkage
    Long, Meixiu
    Chen, Siyuan
    Du, Xin
    Wang, Jiahai
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: APPLIED DATA SCIENCE AND DEMO TRACK, ECML PKDD 2023, PT VI, 2023, 14174 : 122 - 138
  • [4] Degree-aware Hybrid Graph Traversal on FPGA-HMC Platform
    Zhang, Jialiang
    Li, Jing
    PROCEEDINGS OF THE 2018 ACM/SIGDA INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE GATE ARRAYS (FPGA'18), 2018, : 229 - 238
  • [5] MEGA: A Memory-Efficient GNN Accelerator Exploiting Degree-Aware Mixed-Precision Quantization
    Zhu, Zeyu
    Li, Fanrong
    Li, Gang
    Liu, Zejian
    Mo, Zitao
    Hu, Qinghao
    Liang, Xiaoyao
    Cheng, Jian
    2024 IEEE INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE COMPUTER ARCHITECTURE, HPCA 2024, 2024, : 124 - 138
  • [6] User Familiar Degree-Aware Recommender System
    Li Yusheng
    Haihong, E.
    Song Meina
    Song Junde
    2015 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS), 2015, : 385 - 391
  • [7] MEGA: A Memory-Efficient GNN Accelerator Exploiting Degree-Aware Mixed-Precision Quantization
    Institute of Automation, Chinese Academy of Sciences, China
    不详
    不详
    不详
    不详
    Proc. Int. Symp. High Perform. Comput. Archit., 1600, (124-138): : 124 - 138
  • [8] DADA: Degree-Aware Algorithms for Network-Based Disease Gene Prioritization
    Erten, Sinan
    Bebek, Gurkan
    Ewing, Rob M.
    Koyutuerk, Mehmet
    BIODATA MINING, 2011, 4
  • [9] Degree-aware embedding-based multi-correlated graph convolutional collaborative filtering
    Ma, Chao
    Qin, Jiwei
    Wang, Tao
    Gao, Aohua
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (18): : 25911 - 25932
  • [10] Degree-Aware Embedding and Interactive Feature Fusion-Based Graph Convolution Collaborative Filtering
    Ma, Chao
    Qin, Jiwei
    Gao, Aohua
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2023, 2023, 14119 : 120 - 135