DRGN: a dynamically reconfigurable accelerator for graph neural networks

被引:1
|
作者
Yang C. [1 ]
Huo K.-B. [1 ]
Geng L.-F. [1 ]
Mei K.-Z. [1 ]
机构
[1] School of Microelectronics, Xi’an Jiaotong University, No. 28 Xianning Road, Beilin District, Xi’an
基金
中国国家自然科学基金;
关键词
Data storage; Dynamic reconfigurable computing; Graph neural network; Prefetcher; Vertex reordering;
D O I
10.1007/s12652-022-04402-x
中图分类号
学科分类号
摘要
Graph neural networks (GNNs) have achieved great success in processing non-Euclidean geometric spatial data structures. However, the irregular memory access of aggregation and the power-law distribution of the real-world graph challenge the existing memory hierarchy and caching policy of CPUs and GPUs. Meanwhile, after the emergence of an increasing number of GNN algorithms, higher requirements have been established for the flexibility of the hardware architecture. In this work, we design a dynamically reconfigurable GNN accelerator (named DRGN) supporting multiple GNN algorithms. Specifically, we first propose a vertex reordering algorithm and an adjacency matrix compressing algorithm to improve the graph data locality. Furthermore, to improve bandwidth utilization and the reuse rate of node features, we proposed a dedicatedly designed prefetcher to significantly improve hit rate. Finally, we proposed a scheduling mechanism to assign tasks to PE units to address the issue of workload imbalance. The effectiveness of proposed DRGN accelerator was evaluated using three GNN algorithms, including PageRank, GCN, and GraphSage. Compared to the execution time of these three GNN algorithms on CPU, performing PageRank algorithm on DRGN can achieve speedup by 231×, the GCN algorithm can achieve speedup by 150× on DRGN, and the GraphSage algorithm can achieve speedup by 39× when executed on DRGN. Compared with state-of-the-art GNN accelerators, DRGN can achieve higher energy-efficiency under the condition of relative lower-end process. © 2022, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.
引用
收藏
页码:8985 / 9000
页数:15
相关论文
共 50 条
  • [21] Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks
    Chen, Yu-Hsin
    Krishna, Tushar
    Emer, Joel
    Sze, Vivienne
    2016 IEEE INTERNATIONAL SOLID-STATE CIRCUITS CONFERENCE (ISSCC), 2016, 59 : 262 - U363
  • [22] FP-GNN: Adaptive FPGA accelerator for Graph Neural Networks
    Tian, Teng
    Zhao, Letian
    Wang, Xiaotian
    Wu, Qizhe
    Yuan, Wei
    Jin, Xi
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 136 : 294 - 310
  • [23] An Efficient Optical Sparse Matrix Multiplication Accelerator for Graph Neural Networks
    Jia, Ying
    Guo, Hongxiang
    Guo, Yi
    Wu, Jian
    2022 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE, ACP, 2022, : 1868 - 1872
  • [24] Customizable FPGA-based Accelerator for Binarized Graph Neural Networks
    Wang, Ziwei
    Que, Zhiqiang
    Luk, Wayne
    Fan, Hongxiang
    Proceedings - IEEE International Symposium on Circuits and Systems, 2022, 2022-May : 1968 - 1972
  • [25] NEM-GNN: DAC/ADC-less, Scalable, Reconfigurable, Graph and Sparsity-Aware Near-Memory Accelerator for Graph Neural Networks
    Raman, Siddhartha Raman Sundara
    John, Lizy
    Kulkarni, Jaydeep P.
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2024, 21 (02)
  • [26] Dimension fusion: Dimension-level dynamically composable accelerator for convolutional neural networks
    Deng, Huipeng
    Wang, Jian
    Ye, Huafeng
    Xiao, Shanlin
    Meng, Xiangyu
    Yu, Zhiyi
    IEICE ELECTRONICS EXPRESS, 2021, 18 (24):
  • [27] Dimension Fusion: Dimension-Level Dynamically Composable Accelerator for Convolutional Neural Networks
    Deng, Huipeng
    Wang, Jian
    Ye, Huafeng
    Xiao, Shanlin
    Meng, Xiangyu
    Yu, Zhiyi
    IEICE ELECTRONICS EXPRESS, 2021,
  • [28] Reconfigurable Acceleration of Graph Neural Networks for Jet Identification in Particle Physics
    Que, Zhiqiang
    Loo, Marcus
    Luk, Wayne
    Proceeding - IEEE International Conference on Artificial Intelligence Circuits and Systems, AICAS 2022, 2022, : 202 - 205
  • [29] Reconfigurable Acceleration of Graph Neural Networks for Jet Identification in Particle Physics
    Que, Zhiqiang
    Loo, Marcus
    Luk, Wayne
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 202 - 205
  • [30] An Adaptive Cryptographic Accelerator for Network Storage Security on Dynamically Reconfigurable Platform
    Tang, Li
    Liu, Jing-Ning
    Feng, Dan
    Tong, Wei
    EIGHTH INTERNATIONAL SYMPOSIUM ON OPTICAL STORAGE AND 2008 INTERNATIONAL WORKSHOP ON INFORMATION DATA STORAGE, 2009, 7125