Special Session: On the Reliability of Conventional and Quantum Neural Network Hardware

被引:10
|
作者
Sadi, Mehdi [1 ]
He, Yi [2 ]
Li, Yanjing [2 ]
Alam, Mahabubul [3 ]
Kundu, Satwik [3 ]
Ghosh, Swaroop [3 ]
Bahrami, Javad [4 ]
Karimi, Naghmeh [4 ]
机构
[1] Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA
[2] Univ Chicago, Dept Comp Sci, Chicago, IL 60637 USA
[3] Penn State Univ, Dept Elect & Amp Comp Engn, University Pk, PA 16802 USA
[4] Univ Maryland Baltimore Cty UMBC, Dept Elect & Amp Comp Engn, Baltimore, MD USA
关键词
POWER;
D O I
10.1109/VTS52500.2021.9794194
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural Networks (NNs) are being extensively used in critical applications such as aerospace, healthcare, autonomous driving, and military, to name a few. Limited precision of the underlying hardware platforms, permanent and transient faults injected unintentionally as well as maliciously, and voltage/temperature fluctuations can potentially result in malfunctions in NNs with consequences ranging from substantial reduction in the network accuracy to jeopardizing the correct prediction of the network in worst cases. To alleviate such reliability concerns, this paper discusses the state-of-the-art reliability enhancement schemes that can be tailored for deep learning accelerators. We will discuss the errors associated with the hardware implementation of Deep-Learning (DL) algorithms along with their corresponding countermeasures. An in-field self-test methodology with a high test coverage is introduced, and an accurate high-level framework, so-called FIdelity, is proposed that enables the designers to evaluate DL accelerators in presence of such errors. Then, a state-of-the-art robustness-preserving training algorithm based on the Hessian Regularization is introduced. This algorithm alleviates the perturbations during inference time with negligible degradation in the accuracy of the network. Finally, Quantum Neural Networks (QNNs) and the methods to make them resilient against a variety of vulnerabilities such as fault injection, spatial and temporal variations in Qubits, and noise in QNNs are discussed.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Special Session: Hardware Approximate Computing: How, Why, When and Where?
    Saadat, Hassaan
    Parameswaran, Sri
    2017 INTERNATIONAL CONFERENCE ON COMPILERS, ARCHITECTURES AND SYNTHESIS FOR EMBEDDED SYSTEMS (CASES), 2017,
  • [32] Special Session: CAD for Hardware Security - Automation is Key to Adoption of Solutions
    Aftabjahani, Sohrab
    Kastner, Ryan
    Tehranipoor, Mark
    Farahmandi, Farimah
    Oberg, Jason
    Nordstrom, Anders
    Fern, Nicole
    Althoff, Alric
    2021 IEEE 39TH VLSI TEST SYMPOSIUM (VTS), 2021,
  • [33] Conversion of Artificial Neural Network to Spiking Neural Network for Hardware Implementation
    Chen, Yi-Lun
    Lu, Chih-Cheng
    Juang, Kai-Cheung
    Tang, Kea-Tiong
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [34] Survey on Accelerating Neural Network with Hardware
    Chen G.
    Ma S.
    Guo Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2019, 56 (02): : 240 - 253
  • [35] Hardware design and the fairness of a neural network
    Guo, Yuanbo
    Yan, Zheyu
    Yu, Xiaoting
    Kong, Qingpeng
    Xie, Joy
    Luo, Kevin
    Zeng, Dewen
    Wu, Yawen
    Jia, Zhenge
    Shi, Yiyu
    NATURE ELECTRONICS, 2024, 7 (08): : 714 - 723
  • [36] Neural network pruning and hardware acceleration
    Jeong, Taehee
    Ghasemi, Ehsam
    Tuyls, Jorn
    Delaye, Elliott
    Sirasao, Ashish
    2020 IEEE/ACM 13TH INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING (UCC 2020), 2020, : 440 - 445
  • [37] On neural network hardware and programming paradigms
    Mathia, K
    Clark, J
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 2692 - 2697
  • [38] CONSIDERATIONS FOR NEURAL NETWORK HARDWARE IMPLEMENTATIONS
    COLLINS, DR
    PENZ, PA
    1989 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-3, 1989, : 834 - 836
  • [39] Quantum Neural Network for Quantum Neural Computing
    Zhou, Min-Gang
    Liu, Zhi-Ping
    Yin, Hua-Lei
    Li, Chen-Long
    Xu, Tong-Kai
    Chen, Zeng-Bing
    RESEARCH, 2023, 6
  • [40] The effectiveness of analogue 'neural network' hardware
    Hopfield, J. J.
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1990, 1 (01) : 27 - 40