HyperGRAF: Hyperdimensional Graph-based Reasoning Acceleration on FPGA

被引:8
作者
Chen, Hanning [1 ]
Zakeri, Ali [1 ]
Wen, Fei [2 ]
Barkam, Hamza Errahmouni [1 ]
Imani, Mohsen [1 ]
机构
[1] Univ Calif Irvine, Irvine, CA 92697 USA
[2] Texas A&M Univ, College Stn, TX 77843 USA
来源
2023 33RD INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE LOGIC AND APPLICATIONS, FPL | 2023年
基金
美国国家科学基金会;
关键词
ALGORITHM;
D O I
10.1109/FPL60245.2023.00013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The latest hardware accelerators proposed for graph applications primarily focus on graph neural networks (GNNs) and graph mining. High-level graph reasoning tasks, such as graph memorization and neighborhood reconstruction, have barely been addressed. Compared to low-level learning applications like node classification and clustering, high-level reasoning typically requires a more complex model to mimic human brain functionalities. Brain-inspired Hyper-Dimensional Computing (HDC) has recently introduced a promising lightweight and efficient machine learning solution, particularly for symbolic representation. General-purpose computing platforms (CPU/GPU) have been revealed to be inefficient for HDC applications. Therefore, it becomes essential to design a domain-specific accelerator targeting HDC-based graph reasoning algorithms. In this work, we propose the first domain-specific accelerator for HDC-based graph reasoning, HyperGRAF. We first develop a scheduler to balance the sparse matrix computation workloads, before parallelizing the hypervector calculations on two levels for the graph memorization task. Finally, we design a pipeline-style matrix multiplication accelerator for the neighborhood reconstruction task. We evaluate our design under a wide range of generated graphs with different sizes and sparsity. The results show that HyperGRAF achieves over 100x improvement in both speedup and energy efficiency of graph reasoning compared to NVIDIA Jetson Orin.
引用
收藏
页码:34 / 41
页数:8
相关论文
共 55 条
  • [1] HDGIM: Hyperdimensional Genome Sequence Matching on Unreliable highly scaled FeFET
    Barkam, Hamza Errahmouni
    Yun, Sanggeon
    Genssler, Paul R.
    Zou, Zhuowen
    Liu, Che-Kai
    Amrouch, Hussam
    Imani, Mohsen
    [J]. 2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
  • [2] Chen H., 2022, 2022 IEEE 30 ANN INT, P1
  • [3] DARL: Distributed Reconfigurable Accelerator for Hyperdimensional Reinforcement Learning
    Chen, Hanning
    Issa, Mariam
    Ni, Yang
    Imani, Mohsen
    [J]. 2022 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2022,
  • [4] Full Stack Parallel Online Hyperdimensional Regression on FPGA
    Chen, Hanning
    Najafi, M. Hassan
    Sadredini, Elaheh
    Imani, Mohsen
    [J]. 2022 IEEE 40TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2022), 2022, : 517 - 524
  • [5] FlexMiner: A Pattern-Aware Accelerator for Graph Pattern Mining
    Chen, Xuhao
    Huang, Tianhao
    Xu, Shuotao
    Bourgeat, Thomas
    Chung, Chanwoo
    Arvind
    [J]. 2021 ACM/IEEE 48TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA 2021), 2021, : 581 - 594
  • [6] Duan S., 2022, arXiv
  • [7] LeHDC: Learning-Based Hyperdimensional Computing Classifier
    Duan, Shijin
    Liu, Yejia
    Ren, Shaolei
    Xu, Xiaolin
    [J]. PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 1111 - 1116
  • [8] Classification Using Hyperdimensional Computing: A Review
    Ge, Lulu
    Parhi, Keshab K.
    [J]. IEEE CIRCUITS AND SYSTEMS MAGAZINE, 2020, 20 (02) : 30 - 47
  • [9] I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandization
    Geng, Tong
    Wu, Chunshu
    Zhang, Yongan
    Tan, Cheng
    Xie, Chenhao
    You, Haoran
    Herbordt, Martin C.
    Lin, Yingyan
    Li, Ang
    [J]. PROCEEDINGS OF 54TH ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE, MICRO 2021, 2021, : 1051 - 1063
  • [10] AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing
    Geng, Tong
    Li, Ang
    Shi, Runbin
    Wu, Chunshu
    Wang, Tianqi
    Li, Yanfei
    Haghi, Pouya
    Tumeo, Antonino
    Che, Shuai
    Reinhardt, Steve
    Herbordt, Martin C.
    [J]. 2020 53RD ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE (MICRO 2020), 2020, : 922 - 936