HyperGRAF: Hyperdimensional Graph-based Reasoning Acceleration on FPGA

被引:8
作者
Chen, Hanning [1 ]
Zakeri, Ali [1 ]
Wen, Fei [2 ]
Barkam, Hamza Errahmouni [1 ]
Imani, Mohsen [1 ]
机构
[1] Univ Calif Irvine, Irvine, CA 92697 USA
[2] Texas A&M Univ, College Stn, TX 77843 USA
来源
2023 33RD INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE LOGIC AND APPLICATIONS, FPL | 2023年
基金
美国国家科学基金会;
关键词
ALGORITHM;
D O I
10.1109/FPL60245.2023.00013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The latest hardware accelerators proposed for graph applications primarily focus on graph neural networks (GNNs) and graph mining. High-level graph reasoning tasks, such as graph memorization and neighborhood reconstruction, have barely been addressed. Compared to low-level learning applications like node classification and clustering, high-level reasoning typically requires a more complex model to mimic human brain functionalities. Brain-inspired Hyper-Dimensional Computing (HDC) has recently introduced a promising lightweight and efficient machine learning solution, particularly for symbolic representation. General-purpose computing platforms (CPU/GPU) have been revealed to be inefficient for HDC applications. Therefore, it becomes essential to design a domain-specific accelerator targeting HDC-based graph reasoning algorithms. In this work, we propose the first domain-specific accelerator for HDC-based graph reasoning, HyperGRAF. We first develop a scheduler to balance the sparse matrix computation workloads, before parallelizing the hypervector calculations on two levels for the graph memorization task. Finally, we design a pipeline-style matrix multiplication accelerator for the neighborhood reconstruction task. We evaluate our design under a wide range of generated graphs with different sizes and sparsity. The results show that HyperGRAF achieves over 100x improvement in both speedup and energy efficiency of graph reasoning compared to NVIDIA Jetson Orin.
引用
收藏
页码:34 / 41
页数:8
相关论文
共 55 条
  • [21] Kipf T. N., 2017, ICLR, P1
  • [22] Lin Y.H., 2022, P 2022 IEEE 5 EUR C, P123, DOI 10.1145/3490422.3502359
  • [23] Linghao Song, 2022, FPGA '22: Proceedings of the 2022 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, P65, DOI 10.1145/3490422.3502357
  • [24] COSIME: FeFET based Associative Memory for In-Memory Cosine Similarity Search
    Liu, Che-Kai
    Chen, Haobang
    Imani, Mohsen
    Ni, Kai
    Kazemi, Arman
    Laguna, Ann Franchesca
    Niemier, Michael
    Hu, Xiaobo Sharon
    Zhao, Liang
    Zhuo, Cheng
    Yin, Xunzhao
    [J]. 2022 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2022,
  • [25] L3E-HD: A Framework Enabling Efficient Ensemble in High-Dimensional Space for Language Tasks
    Liu, Fangxin
    Li, Haomin
    Yang, Xiaokang
    Jiang, Li
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1844 - 1848
  • [26] McDonald N., arXiv
  • [27] GNNIE: GNN Inference Engine with Load-balancing and Graph-specific Caching
    Mondal, Sudipta
    Manasi, Susmita Dey
    Kunal, Kishor
    Ramprasath, S.
    Sapatnekar, Sachin S.
    [J]. PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 565 - 570
  • [28] Neurally-Inspired Hyperdimensional Classification for Efficient and Robust Biosignal Processing
    Ni, Yang
    Lesica, Nicholas
    Zeng, Fan-Gang
    Imani, Mohsen
    [J]. 2022 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2022,
  • [29] HDPG: Hyperdimensional Policy-based Reinforcement Learning for Continuous Control
    Ni, Yang
    Issa, Mariam
    Abraham, Danny
    Imani, Mandi
    Yin, Xunzhao
    Imani, Mohsen
    [J]. PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, : 1141 - 1146
  • [30] Ni Y, 2022, DES AUT TEST EUROPE, P292, DOI 10.23919/DATE54114.2022.9774524