Reliable Hyperdimensional Reasoning on Unreliable Emerging Technologies

被引:7
作者
Barkam, Hamza Errahmouni [1 ]
Yun, Sanggeon [1 ]
Chen, Hanning [1 ]
Gensler, Paul [2 ]
Mema, Albi [2 ]
Ding, Andrew [1 ]
Michelogiannakis, George [3 ]
Amrouch, Hussam [2 ,4 ,5 ]
Imani, Mohsen [1 ]
机构
[1] Univ Calif Irvine, Irvine, CA 92697 USA
[2] Univ Stuttgart, Stuttgart, Germany
[3] Lawrence Berkeley Natl Lab, Berkeley, CA USA
[4] Tech Univ Munich, Munich Inst Robot & Machine Intelligence, Munich, Germany
[5] Tech Univ Munich, Chair AI Processor Design, Munich, Germany
来源
2023 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD | 2023年
基金
美国国家科学基金会;
关键词
D O I
10.1109/ICCAD57390.2023.10323935
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
While Graph Neural Networks (GNNs) have demonstrated remarkable achievements in knowledge graph reasoning, their computational efficiency on conventional computing platforms is impeded by the memory wall problem. To overcome these challenges, we introduce an innovative algorithm-hardware solution that harnesses the potential of hyperdimensional computing (HDC) for robust and memory-centric computation on computing in-memory (CiM) platforms. Departing from traditional graph neural networks, the proposed HDC reasoning model employs a symbolic approach to effectively encode graph entities and their relationships as high-dimensional neural activity. Complementing this approach is a customized Computing-in-Memory (CiM) architecture based on advanced Ferroelectric Field-Effect Transistor (FeFET) technology, which incorporates a precise characterization of non-idealities. This modeling enables the generation of an HDC-tailored model that faithfully represents the hardware architecture. Despite the non-idealities inherent in emerging CiM technologies, our platform demonstrates performance on par with traditional von Neumann architectures for substantial combinations of FeFET device parameters. Our solution overcomes FeFET CiM the increased non-idealities from down-scaled 3nm, operating effectively under all possible configurations when 50 graph edges are considered. Scenarios with less than 4-bit precision per FeFET device cannot handle graphs with more than 200 edges, whereas the 4-bit case can achieve a 90.3% graph reconstruction rate on the worst-case scenario of 80% of noise.
引用
收藏
页数:9
相关论文
共 52 条
[1]   Brain-Inspired Hyperdimensional Computing for Ultra-Efficient Edge AI [J].
Amrouch, Hussam ;
Imani, Mohsen ;
Jiao, Xun ;
Aloimonos, Yiannis ;
Fermuller, Cornelia ;
Yuan, Dehao ;
Ma, Dongning ;
Barkam, Hamza E. ;
Genssler, Paul R. ;
Sutor, Peter .
2022 INTERNATIONAL CONFERENCE ON HARDWARE/SOFTWARE CODESIGN AND SYSTEM SYNTHESIS (CODES+ISSS), 2022, :25-34
[2]   Accelerating Deep Neural Networks in Processing-in-Memory Platforms: Analog or Digital Approach? [J].
Angizi, Shaahin ;
He, Zhezhi ;
Reis, Dayane ;
Hu, Xiaobo Sharon ;
Tsai, Wilman ;
Lin, Shy Jay ;
Fan, Deliang .
2019 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2019), 2019, :198-203
[3]  
[Anonymous], 2011, P 2011 C EMP METH NA
[4]   HDGIM: Hyperdimensional Genome Sequence Matching on Unreliable highly scaled FeFET [J].
Barkam, Hamza Errahmouni ;
Yun, Sanggeon ;
Genssler, Paul R. ;
Zou, Zhuowen ;
Liu, Che-Kai ;
Amrouch, Hussam ;
Imani, Mohsen .
2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
[5]  
Chatterjee S., 2022, IEEE TED
[6]   DARL: Distributed Reconfigurable Accelerator for Hyperdimensional Reinforcement Learning [J].
Chen, Hanning ;
Issa, Mariam ;
Ni, Yang ;
Imani, Mohsen .
2022 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN, ICCAD, 2022,
[7]   Full Stack Parallel Online Hyperdimensional Regression on FPGA [J].
Chen, Hanning ;
Najafi, M. Hassan ;
Sadredini, Elaheh ;
Imani, Mohsen .
2022 IEEE 40TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2022), 2022, :517-524
[8]  
Dünkel S, 2017, INT EL DEVICES MEET
[9]   A Theory of Sequence Indexing and Working Memory in Recurrent Neural Networks [J].
Frady, E. Paxon ;
Kleyko, Denis ;
Sommer, Friedrich T. .
NEURAL COMPUTATION, 2018, 30 (06) :1449-1513
[10]   I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandization [J].
Geng, Tong ;
Wu, Chunshu ;
Zhang, Yongan ;
Tan, Cheng ;
Xie, Chenhao ;
You, Haoran ;
Herbordt, Martin C. ;
Lin, Yingyan ;
Li, Ang .
PROCEEDINGS OF 54TH ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE, MICRO 2021, 2021, :1051-1063