ReGNN: A ReRAM-based Heterogeneous Architecture for General Graph Neural Networks

被引:14
作者
Liu, Cong [1 ]
Liu, Haikun [1 ]
Jin, Hai [1 ]
Liao, Xiaofei [1 ]
Zhang, Yu [1 ]
Duan, Zhuohui [1 ]
Xu, Jiahong [1 ]
Li, Huize [1 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Engn Res Ctr Big Data Technol & Syst, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab,Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
来源
PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022 | 2022年
基金
中国国家自然科学基金;
关键词
Digital-Analog Heterogeneous Architecture; Graph Neural Network; PIM; ReRAM;
D O I
10.1145/3489517.3530479
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have both graph processing and neural network computational features. Traditional graph accelerators and NN accelerators cannot meet these dual characteristics of GNN applications simultaneously. In this work, we propose a ReRAMbased processing-in-memory (PIM) architecture called ReGNN for GNN acceleration. ReGNN is composed of analog PIM (APIM) modules for accelerating matrix vector multiplication (MVM) operations, and digital PIM (DPIM) modules for accelerating non-MVM aggregation operations. To improve data parallelism, ReGNN maps data to aggregation sub-engines based on the degree of vertices and the dimension of feature vectors. Experimental results show that ReGNN speeds up GNN inference by 228x and 8.4x, and reduces energy consumption by 305.2x and 10.5x, compared with GPU and the ReRAM-based GNN accelerator ReGraphX, respectively.
引用
收藏
页码:469 / 474
页数:6
相关论文
共 50 条
[41]   End-to-end heterogeneous graph neural networks for traffic assignment [J].
Liu, Tong ;
Meidani, Hadi .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 165
[42]   Graph Transformer-based Heterogeneous Graph Neural Networks enhanced by multiple meta-path adjacency matrices decomposition [J].
Li, Shibin ;
Gong, Jun ;
Ke, Shengnan ;
Tang, Shengjun .
NEUROCOMPUTING, 2025, 629
[43]   A general framework for quantifying aleatoric and epistemic uncertainty in graph neural networks [J].
Munikoti, Sai ;
Agarwal, Deepesh ;
Das, Laya ;
Natarajan, Balasubramaniam .
NEUROCOMPUTING, 2023, 521 :1-10
[44]   Polynomial-based graph convolutional neural networks for graph classification [J].
Luca Pasa ;
Nicolò Navarin ;
Alessandro Sperduti .
Machine Learning, 2022, 111 :1205-1237
[45]   Research on Recommendation Algorithm Based on Heterogeneous Graph neural Network [J].
Chen Z. ;
Li H. ;
Du J. .
Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2021, 48 (10) :137-144
[46]   A Session Recommendation Model Based on Heterogeneous Graph Neural Network [J].
An, Zhiwei ;
Tan, Yirui ;
Zhang, Jinli ;
Jiang, Zongli ;
Li, Chen .
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2023, 2023, 14119 :160-171
[47]   Polynomial-based graph convolutional neural networks for graph classification [J].
Pasa, Luca ;
Navarin, Nicolo ;
Sperduti, Alessandro .
MACHINE LEARNING, 2022, 111 (04) :1205-1237
[48]   Revisiting Attention-Based Graph Neural Networks for Graph Classification [J].
Tao, Ye ;
Li, Ying ;
Wu, Zhonghai .
PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVII, PPSN 2022, PT I, 2022, 13398 :442-458
[49]   Link Inference via Heterogeneous Multi-view Graph Neural Networks [J].
Xing, Yuying ;
Li, Zhao ;
Hui, Pengrui ;
Huang, Jiaming ;
Chen, Xia ;
Zhang, Long ;
Yu, Guoxian .
DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT I, 2020, 12112 :698-+
[50]   Heterogeneous graph neural networks for fraud detection and explanation in supply chain finance [J].
Wu, Bin ;
Chao, Kuo-Ming ;
Li, Yinsheng .
INFORMATION SYSTEMS, 2024, 121