ReGNN: A ReRAM-based Heterogeneous Architecture for General Graph Neural Networks

被引:14
作者
Liu, Cong [1 ]
Liu, Haikun [1 ]
Jin, Hai [1 ]
Liao, Xiaofei [1 ]
Zhang, Yu [1 ]
Duan, Zhuohui [1 ]
Xu, Jiahong [1 ]
Li, Huize [1 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Engn Res Ctr Big Data Technol & Syst, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab,Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
来源
PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022 | 2022年
基金
中国国家自然科学基金;
关键词
Digital-Analog Heterogeneous Architecture; Graph Neural Network; PIM; ReRAM;
D O I
10.1145/3489517.3530479
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have both graph processing and neural network computational features. Traditional graph accelerators and NN accelerators cannot meet these dual characteristics of GNN applications simultaneously. In this work, we propose a ReRAMbased processing-in-memory (PIM) architecture called ReGNN for GNN acceleration. ReGNN is composed of analog PIM (APIM) modules for accelerating matrix vector multiplication (MVM) operations, and digital PIM (DPIM) modules for accelerating non-MVM aggregation operations. To improve data parallelism, ReGNN maps data to aggregation sub-engines based on the degree of vertices and the dimension of feature vectors. Experimental results show that ReGNN speeds up GNN inference by 228x and 8.4x, and reduces energy consumption by 305.2x and 10.5x, compared with GPU and the ReRAM-based GNN accelerator ReGraphX, respectively.
引用
收藏
页码:469 / 474
页数:6
相关论文
共 50 条
[21]   ADC-Free ReRAM-Based In-Situ Accelerator for Energy-Efficient Binary Neural Networks [J].
Kim, Hyeonuk ;
Jung, Youngbeom ;
Kim, Lee-Sup .
IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (02) :353-365
[22]   Spara: An Energy-Efficient ReRAM-Based Accelerator for Sparse Graph Analytics Applications [J].
Zheng, Long ;
Zhao, Jieshan ;
Huang, Yu ;
Wang, Qinggang ;
Zeng, Zhen ;
Xue, Jingling ;
Liao, Xiaofei ;
Jin, Hai .
2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM IPDPS 2020, 2020, :696-707
[23]   FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture [J].
Ji, Yu ;
Zhang, Youyang ;
Xie, Xinfeng ;
Li, Shuangchen ;
Wang, Peiqi ;
Hu, Xing ;
Zhang, Youhui ;
Xie, Yuan .
TWENTY-FOURTH INTERNATIONAL CONFERENCE ON ARCHITECTURAL SUPPORT FOR PROGRAMMING LANGUAGES AND OPERATING SYSTEMS (ASPLOS XXIV), 2019, :733-747
[24]   ReRAM-based graph attention network with node-centric edge searching and hamming similarity [J].
Mao, Ruibin ;
Sheng, Xia ;
Graves, Catherine ;
Xu, Cong ;
Li, Can .
2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
[25]   A Unified Framework for Training, Mapping and Simulation of ReRAM-Based Convolutional Neural Network Acceleration [J].
Liu, He ;
Han, Jianhui ;
Zhang, Youhui .
IEEE COMPUTER ARCHITECTURE LETTERS, 2019, 18 (01) :63-66
[26]   Energy-Efficient DNN Inferencing on ReRAM-Based PIM Accelerators Using Heterogeneous Operation Units [J].
Narang, Gaurav ;
Doppa, Janardhan Rao ;
Pande, Partha Pratim .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2025, 44 (06) :2130-2143
[27]   Architecture-Compiler Co-design for ReRAM-Based Multi-core CIM Architectures [J].
Pelke, Rebecca ;
Bosbach, Nils ;
Degener, Niklas ;
Cubero-Cascante, Jose ;
Staudigl, Felix ;
Leupers, Rainer ;
Joseph, Jan Moritz .
VLSI-SOC 2023: INNOVATIONS FOR TRUSTWORTHY ARTIFICIAL INTELLIGENCE, 2024, 680 :21-44
[28]   PRESTO: A Recommender of Musical Collaborations Based on Heterogeneous Graph Neural Networks [J].
Terroso-Saenz, Fernando ;
Soto, Jesus ;
Munoz, Andres ;
Roose, Philippe .
INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2025,
[29]   MAX2: An ReRAM-Based Neural Network Accelerator That Maximizes Data Reuse and Area Utilization [J].
Mao, Manqing ;
Peng, Xiaochen ;
Liu, Rui ;
Li, Jingtao ;
Yu, Shimeng ;
Chakrabarti, Chaitali .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (02) :398-410
[30]   Heterogeneous Global Graph Neural Networks for Personalized Session-based Recommendation [J].
Pang, Yitong ;
Wu, Lingfei ;
Shen, Qi ;
Zhang, Yiming ;
Wei, Zhihua ;
Xu, Fangli ;
Chang, Ethan ;
Long, Bo ;
Pei, Jian .
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, :775-783