HyperGRAF: Hyperdimensional Graph-based Reasoning Acceleration on FPGA

被引:14
作者
Chen, Hanning [1 ]
Zakeri, Ali [1 ]
Wen, Fei [2 ]
Barkam, Hamza Errahmouni [1 ]
Imani, Mohsen [1 ]
机构
[1] Univ Calif Irvine, Irvine, CA 92697 USA
[2] Texas A&M Univ, College Stn, TX 77843 USA
来源
2023 33RD INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE LOGIC AND APPLICATIONS, FPL | 2023年
基金
美国国家科学基金会;
关键词
ALGORITHM;
D O I
10.1109/FPL60245.2023.00013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The latest hardware accelerators proposed for graph applications primarily focus on graph neural networks (GNNs) and graph mining. High-level graph reasoning tasks, such as graph memorization and neighborhood reconstruction, have barely been addressed. Compared to low-level learning applications like node classification and clustering, high-level reasoning typically requires a more complex model to mimic human brain functionalities. Brain-inspired Hyper-Dimensional Computing (HDC) has recently introduced a promising lightweight and efficient machine learning solution, particularly for symbolic representation. General-purpose computing platforms (CPU/GPU) have been revealed to be inefficient for HDC applications. Therefore, it becomes essential to design a domain-specific accelerator targeting HDC-based graph reasoning algorithms. In this work, we propose the first domain-specific accelerator for HDC-based graph reasoning, HyperGRAF. We first develop a scheduler to balance the sparse matrix computation workloads, before parallelizing the hypervector calculations on two levels for the graph memorization task. Finally, we design a pipeline-style matrix multiplication accelerator for the neighborhood reconstruction task. We evaluate our design under a wide range of generated graphs with different sizes and sparsity. The results show that HyperGRAF achieves over 100x improvement in both speedup and energy efficiency of graph reasoning compared to NVIDIA Jetson Orin.
引用
收藏
页码:34 / 41
页数:8
相关论文
共 55 条
[1]   HDGIM: Hyperdimensional Genome Sequence Matching on Unreliable highly scaled FeFET [J].
Barkam, Hamza Errahmouni ;
Yun, Sanggeon ;
Genssler, Paul R. ;
Zou, Zhuowen ;
Liu, Che-Kai ;
Amrouch, Hussam ;
Imani, Mohsen .
2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
[2]   DARL: Distributed Reconfigurable Accelerator for Hyperdimensional Reinforcement Learning [J].
Chen, Hanning ;
Issa, Mariam ;
Ni, Yang ;
Imani, Mohsen .
2022 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2022,
[3]   Full Stack Parallel Online Hyperdimensional Regression on FPGA [J].
Chen, Hanning ;
Najafi, M. Hassan ;
Sadredini, Elaheh ;
Imani, Mohsen .
2022 IEEE 40TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2022), 2022, :517-524
[4]  
Chen HN, 2022, ANN IEEE SYM FIELD P, P236
[5]   FlexMiner: A Pattern-Aware Accelerator for Graph Pattern Mining [J].
Chen, Xuhao ;
Huang, Tianhao ;
Xu, Shuotao ;
Bourgeat, Thomas ;
Chung, Chanwoo ;
Arvind .
2021 ACM/IEEE 48TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA 2021), 2021, :581-594
[6]  
Duan S., 2022, arXiv
[7]   LeHDC: Learning-Based Hyperdimensional Computing Classifier [J].
Duan, Shijin ;
Liu, Yejia ;
Ren, Shaolei ;
Xu, Xiaolin .
PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022, 2022, :1111-1116
[8]   Classification Using Hyperdimensional Computing: A Review [J].
Ge, Lulu ;
Parhi, Keshab K. .
IEEE CIRCUITS AND SYSTEMS MAGAZINE, 2020, 20 (02) :30-47
[9]   I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandization [J].
Geng, Tong ;
Wu, Chunshu ;
Zhang, Yongan ;
Tan, Cheng ;
Xie, Chenhao ;
You, Haoran ;
Herbordt, Martin C. ;
Lin, Yingyan ;
Li, Ang .
PROCEEDINGS OF 54TH ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE, MICRO 2021, 2021, :1051-1063
[10]   AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing [J].
Geng, Tong ;
Li, Ang ;
Shi, Runbin ;
Wu, Chunshu ;
Wang, Tianqi ;
Li, Yanfei ;
Haghi, Pouya ;
Tumeo, Antonino ;
Che, Shuai ;
Reinhardt, Steve ;
Herbordt, Martin C. .
2020 53RD ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE (MICRO 2020), 2020, :922-936