DRGN: a dynamically reconfigurable accelerator for graph neural networks

被引:1
|
作者
Yang C. [1 ]
Huo K.-B. [1 ]
Geng L.-F. [1 ]
Mei K.-Z. [1 ]
机构
[1] School of Microelectronics, Xi’an Jiaotong University, No. 28 Xianning Road, Beilin District, Xi’an
基金
中国国家自然科学基金;
关键词
Data storage; Dynamic reconfigurable computing; Graph neural network; Prefetcher; Vertex reordering;
D O I
10.1007/s12652-022-04402-x
中图分类号
学科分类号
摘要
Graph neural networks (GNNs) have achieved great success in processing non-Euclidean geometric spatial data structures. However, the irregular memory access of aggregation and the power-law distribution of the real-world graph challenge the existing memory hierarchy and caching policy of CPUs and GPUs. Meanwhile, after the emergence of an increasing number of GNN algorithms, higher requirements have been established for the flexibility of the hardware architecture. In this work, we design a dynamically reconfigurable GNN accelerator (named DRGN) supporting multiple GNN algorithms. Specifically, we first propose a vertex reordering algorithm and an adjacency matrix compressing algorithm to improve the graph data locality. Furthermore, to improve bandwidth utilization and the reuse rate of node features, we proposed a dedicatedly designed prefetcher to significantly improve hit rate. Finally, we proposed a scheduling mechanism to assign tasks to PE units to address the issue of workload imbalance. The effectiveness of proposed DRGN accelerator was evaluated using three GNN algorithms, including PageRank, GCN, and GraphSage. Compared to the execution time of these three GNN algorithms on CPU, performing PageRank algorithm on DRGN can achieve speedup by 231×, the GCN algorithm can achieve speedup by 150× on DRGN, and the GraphSage algorithm can achieve speedup by 39× when executed on DRGN. Compared with state-of-the-art GNN accelerators, DRGN can achieve higher energy-efficiency under the condition of relative lower-end process. © 2022, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.
引用
收藏
页码:8985 / 9000
页数:15
相关论文
共 50 条
  • [41] Adaptive water distribution networks with dynamically reconfigurable topology
    Wright, Robert
    Stoianov, Ivan
    Parpas, Panos
    Henderson, Kevin
    King, John
    JOURNAL OF HYDROINFORMATICS, 2014, 16 (06) : 1280 - 1301
  • [42] Grapher: A Reconfigurable Graph Computing Accelerator with Optimized Processing Elements
    Deng, Junyong
    Lu, Songtao
    Zhang, Baoxiang
    Jia, Yanting
    ELECTRONICS, 2024, 13 (17)
  • [43] Design of graph computing accelerator based on reconfigurable PE array
    Junyong, Deng
    Yanting, Jia
    Baoxiang, Zhang
    Yuchun, Kang
    Songtao, Lu
    Journal of China Universities of Posts and Telecommunications, 2024, 31 (05): : 49 - 63
  • [44] Feeld upgradeable, dynamically reconfigurable accelerated firewall for networks
    Ashfaq, O
    Mairaj, J
    Raza, A
    Anis, H
    SCONEST 2004: Student Conference on Engineering Sciences and Technology, 2002, : 144 - 151
  • [45] Cellular Network of Networks on Dynamically Partial Reconfigurable FPGA
    Abtioglu, Emrah
    Yeniceri, Ramazan
    Yalcin, Mustak E.
    2015 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN (ECCTD), 2015, : 276 - 279
  • [46] A dynamically reconfigurable logic cell: from artificial neural networks to quantum-dot cellular automata
    Syed Rameez Naqvi
    Tallha Akram
    Saba Iqbal
    Sajjad Ali Haider
    Muhammad Kamran
    Nazeer Muhammad
    Applied Nanoscience, 2018, 8 : 89 - 103
  • [47] A dynamically reconfigurable logic cell: from artificial neural networks to quantum-dot cellular automata
    Naqvi, Syed Rameez
    Akram, Tallha
    Iqbal, Saba
    Haider, Sajjad Ali
    Kamran, Muhammad
    Muhammad, Nazeer
    APPLIED NANOSCIENCE, 2018, 8 (1-2) : 89 - 103
  • [48] A task graph approach for efficient exploitation of reconfiguration in dynamically reconfigurable systems
    Papademetriou, Kyprianos
    Dollas, Apostolos
    FCCM 2006: 14TH ANNUAL IEEE SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, PROCEEDINGS, 2006, : 307 - +
  • [49] VSA: Reconfigurable Vectorwise Spiking Neural Network Accelerator
    Lien, Hong-Han
    Hsu, Chung-Wei
    Chang, Tian-Sheuan
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [50] A Retargetable Compiler Based on Graph Representation for Dynamically Reconfigurable Processor Arrays
    Tunbunheng, Vasutan
    Amano, Hideharu
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2008, E91D (11) : 2655 - 2665