Mitigating methodology of hardware non-ideal characteristics for non-volatile memory based neural networks

被引:0
作者
Lixia HAN [1 ,2 ]
Peng HUANG [1 ,2 ]
Yijiao WANG [3 ]
Zheng ZHOU [1 ,2 ]
Haozhang YANG [1 ,2 ]
Yiyang CHEN [1 ,2 ]
Xiaoyan LIU [1 ,2 ]
Jinfeng KANG [1 ,2 ]
机构
[1] School of Integrated Circuits,Peking University
[2] Beijing Advanced Innovation Center for Integrated Circuits
[3] School of Integrated Circuit Science and Engineering,Beihang University
关键词
D O I
暂无
中图分类号
TP333 [存贮器]; TP183 [人工神经网络与计算];
学科分类号
081201 ; 081104 ; 0812 ; 0835 ; 1405 ;
摘要
Non-volatile memory-based computing-in-memory(nvCIM) paradigm has been extensively studied to boost the energy efficiency of neural network accelerators in edge applications. However, the degradation of inference accuracy induced by the non-ideal characteristics across circuits, arrays, and devices is becoming a crucial issue. In this work, we establish a hardware characteristic behavior model to analyze the impact of nvCIM non-ideal characteristics on neural network accuracy.Then we propose a hardware aware training and weight mapping correction methods to mitigate inference accuracy degradation.Through simulation verification, about 95% inference accuracy degradation is recovered by adopting the proposed mitigation method for various non-ideal characteristics and various neural network models. The feasibility of the proposed method is further proved in an experimental example with a flash-based LeNet recognition system.
引用
收藏
页码:307 / 321
页数:15
相关论文
共 50 条
[41]   Chalcogenide-based non-volatile memory technology [J].
Maimon, J ;
Spall, E ;
Quinn, R ;
Schnur, S .
2001 IEEE AEROSPACE CONFERENCE PROCEEDINGS, VOLS 1-7, 2001, :2289-2294
[42]   Non-volatile memory based on the ferroelectric photovoltaic effect [J].
Rui Guo ;
Lu You ;
Yang Zhou ;
Zhi Shiuh Lim ;
Xi Zou ;
Lang Chen ;
R. Ramesh ;
Junling Wang .
Nature Communications, 4
[43]   Non-volatile Memory Devices Based on Diphenyl Bithiophenes [J].
Canesi, E. V. ;
Bertarelli, C. ;
Bianco, A. ;
Caironi, M. ;
Dassa, G. ;
Natali, D. ;
Rottigni, A. ;
Sampietro, M. ;
Zerbi, G. .
SMART MATERIALS & MICRO/NANOSYSTEMS, 2009, 54 :458-463
[44]   Memristive Non-Volatile Memory Based on Graphene Materials [J].
Shen, Zongjie ;
Zhao, Chun ;
Qi, Yanfei ;
Mitrovic, Ivona Z. ;
Yang, Li ;
Wen, Jiacheng ;
Huang, Yanbo ;
Li, Puzhuo ;
Zhao, Cezhou .
MICROMACHINES, 2020, 11 (04)
[45]   Non-Volatile Photonic Memory Based on a SAHAS Configuration [J].
Olivares, Irene ;
Parra, Jorge ;
Sanchis, Pablo .
IEEE PHOTONICS JOURNAL, 2021, 13 (02)
[46]   Optimal Scheduling to Minimize Non-Volatile Memory Access Time with Hardware Cache [J].
Tseng, Wei-Che ;
Xue, Chun Jason ;
Zhuge, Qingfeng ;
Hu, Jingtong ;
Sha, Edwin H. -M. .
PROCEEDINGS OF THE 2010 18TH IEEE/IFIP INTERNATIONAL CONFERENCE ON VLSI AND SYSTEM-ON-CHIP, 2010, :131-136
[47]   Hardware Security of Emerging Non-Volatile Memory Devices under Imaging Attacks [J].
Huynh, Nhu ;
Cherian, Hebin ;
Ahn, Ethan C. .
2021 INTERNATIONAL CONFERENCE ON APPLIED ELECTRONICS, AE, 2021, :55-58
[48]   MorLog: Morphable Hardware Logging for Atomic Persistence in Non-Volatile Main Memory [J].
Wei, Xueliang ;
Feng, Dan ;
Tong, Wei ;
Liu, Jingning ;
Ye, Liuqing .
2020 ACM/IEEE 47TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA 2020), 2020, :610-623
[49]   Neural network learning using non-ideal resistive memory devices [J].
Kim, Youngseok ;
Gokmen, Tayfun ;
Miyazoe, Hiroyuki ;
Solomon, Paul ;
Kim, Seyoung ;
Ray, Asit ;
Doevenspeck, Jonas ;
Khan, Raihan S. ;
Narayanan, Vijay ;
Ando, Takashi .
FRONTIERS IN NANOTECHNOLOGY, 2022, 4
[50]   Non-Volatile memory (NVM) technologies [J].
Shao, Zili ;
Chang, Yuan-Hao .
JOURNAL OF SYSTEMS ARCHITECTURE, 2016, 71 :1-1