Impact of Single-Event Upsets on Convolutional Neural Networks in Xilinx Zynq FPGAs

被引:32
作者
Wang, H. -B. [1 ,2 ]
Wang, Y. -S. [3 ]
Xiao, J. -H. [3 ]
Wang, S. -L. [4 ]
Liang, T. -J. [4 ]
机构
[1] Hohai Univ, Coll IoT Engn, Changzhou 213022, Jiangsu, Peoples R China
[2] Chinese Res Inst Atom Energy Sci, Innovat Fdn Radiat Applicat, Beijing 102413, Peoples R China
[3] Hohai Univ, Coll Internet Things Engn, Changzhou 213022, Jiangsu, Peoples R China
[4] Chinese Acad Sci, Inst High Energy Phys, Dongguan 523000, Peoples R China
关键词
Field programmable gate arrays; Quantization (signal); Standards; Reliability; Single event upsets; Neurons; Topology; Convolutional neural network (CNN); field-programmable gate array (FPGA); neutron exposure; processing system (PS); quantization; single-event upset (SEU); soft error rate (SER); triple modular redundancy (TMR); ZynqNet; CNN; RELIABILITY; DESIGN;
D O I
10.1109/TNS.2021.3062014
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Convolutional neural networks (CNNs) are quickly becoming an attractive solution for autonomous vehicles, military weapons, and space exploration. Thanks to their reconfiguration ability, design flexibility, and low power consumption, field-programmable gate arrays (FPGAs) have become a promising candidate for CNN accelerators. However, FPGAs have been proven to be susceptible to radiation-induced single-event upsets (SEUs). One goal of this article is to analyze the impact of quantization on the reliability of CNNs in FPGAs. Therefore, we performed quantization on ZynqNet without affecting its classification accuracy. Meanwhile, we implemented the triple modular redundancy (TMR) version of ZynqNet and we also evaluated the effects of SEUs on these CNNs through both fault injections and neutron exposures. Fault injection results show that TMRed ZynqNet reduces the soft error rate (SER) by 33.59% with a circuit area increase of 111.92% when compared with the standard ZynqNet. The experimental results demonstrate that the quantized ZynqNet reduces the SER by 71.36% with a circuit area reduction of 44.76% when compared with the standard ZynqNet. These results confirm that quantization does contribute to SER reduction of the neural networks. In addition, the operating system on the processing system (PS) side was also found to be highly sensitive to SEUs, and, thus, mitigation techniques should be applied.
引用
收藏
页码:394 / 401
页数:8
相关论文
共 28 条
[21]   Challenges in Testing Complex Systems [J].
Quinn, Heather .
IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2014, 61 (02) :766-786
[22]   High Performance Low Power Pulse-Clocked TMR Circuits for Soft-Error Hardness [J].
Ramamurthy, Chandarasekaran ;
Chellappa, Srivatsan ;
Vashishtha, Vinay ;
Gogulamudi, Anudeep ;
Clark, Lawrence T. .
IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2015, 62 (06) :3040-3048
[23]   Layout-Aware Multi-Cell Upsets Effects Analysis on TMR Circuits Implemented on SRAM-Based FPGAs [J].
Sterpone, Luca ;
Violante, Massimo ;
Panariti, Alessandro ;
Bocquillon, A. ;
Miller, Florent ;
Buard, Nadine ;
Manuzzato, Andrea ;
Gerardin, Simone ;
Paccagnella, Alessandro .
IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2011, 58 (05) :2325-2332
[24]   A Low-Overhead FFT Design With Higher SEU Resilience Implemented in FPGA [J].
Wang, H. -B. ;
Wang, Y. -S. ;
Cui, J. -L. ;
Wang, S. -L. ;
Liang, T. -J. ;
Mei, B. ;
Liu, X. -F. ;
Qian, R. .
IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2020, 67 (05) :805-810
[25]   Scene Understanding in Deep Learning-Based End-to-End Controllers for Autonomous Vehicles [J].
Yang, Shun ;
Wang, Wenshuo ;
Liu, Chang ;
Deng, Weiwen .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (01) :53-63
[26]   Atmospheric neutron single event effect test on Xilinx 28 nm system on chip at CSNS-BL09 [J].
Yang, Weitao ;
Li, Yonghong ;
Li, Yang ;
Hu, Zhiliang ;
Xie, Fei ;
He, Chaohui ;
Wang, Songlin ;
Zhou, Bin ;
He, Huan ;
Khan, Waseem ;
Liang, Tianjiao .
MICROELECTRONICS RELIABILITY, 2019, 99 :119-124
[27]   ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices [J].
Zhang, Xiangyu ;
Zhou, Xinyu ;
Lin, Mengxiao ;
Sun, Ran .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6848-6856
[28]   Quaternion-Based Adaptive Output Feedback Attitude Control of Spacecraft Using Chebyshev Neural Networks [J].
Zou, An-Min ;
Kumar, Krishna Dev ;
Hou, Zeng-Guang .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (09) :1457-1471