Special Session: On the Reliability of Conventional and Quantum Neural Network Hardware

被引:10
|
作者
Sadi, Mehdi [1 ]
He, Yi [2 ]
Li, Yanjing [2 ]
Alam, Mahabubul [3 ]
Kundu, Satwik [3 ]
Ghosh, Swaroop [3 ]
Bahrami, Javad [4 ]
Karimi, Naghmeh [4 ]
机构
[1] Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA
[2] Univ Chicago, Dept Comp Sci, Chicago, IL 60637 USA
[3] Penn State Univ, Dept Elect & Amp Comp Engn, University Pk, PA 16802 USA
[4] Univ Maryland Baltimore Cty UMBC, Dept Elect & Amp Comp Engn, Baltimore, MD USA
关键词
POWER;
D O I
10.1109/VTS52500.2021.9794194
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural Networks (NNs) are being extensively used in critical applications such as aerospace, healthcare, autonomous driving, and military, to name a few. Limited precision of the underlying hardware platforms, permanent and transient faults injected unintentionally as well as maliciously, and voltage/temperature fluctuations can potentially result in malfunctions in NNs with consequences ranging from substantial reduction in the network accuracy to jeopardizing the correct prediction of the network in worst cases. To alleviate such reliability concerns, this paper discusses the state-of-the-art reliability enhancement schemes that can be tailored for deep learning accelerators. We will discuss the errors associated with the hardware implementation of Deep-Learning (DL) algorithms along with their corresponding countermeasures. An in-field self-test methodology with a high test coverage is introduced, and an accurate high-level framework, so-called FIdelity, is proposed that enables the designers to evaluate DL accelerators in presence of such errors. Then, a state-of-the-art robustness-preserving training algorithm based on the Hessian Regularization is introduced. This algorithm alleviates the perturbations during inference time with negligible degradation in the accuracy of the network. Finally, Quantum Neural Networks (QNNs) and the methods to make them resilient against a variety of vulnerabilities such as fault injection, spatial and temporal variations in Qubits, and noise in QNNs are discussed.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Special Session: Reliability of Hardware-Implemented Spiking Neural Networks (SNN)
    Vatajelu, Elena-Ioana
    Di Natale, Giorgio
    Anghel, Lorena
    2019 IEEE 37TH VLSI TEST SYMPOSIUM (VTS), 2019,
  • [2] Special Session: Reliability Analysis for AI/ML Hardware
    Kundu, Shamik
    Basu, Kanad
    Sadi, Mehdi
    Titirsha, Twisha
    Song, Shihao
    Das, Anup
    Guin, Ujjwal
    2021 IEEE 39TH VLSI TEST SYMPOSIUM (VTS), 2021,
  • [3] Special Session: Effective In-field Testing of Deep Neural Network Hardware Accelerators
    Kundu, Shamik
    Banerjee, Suvadeep
    Raha, Arnab
    Basu, Kanad
    2022 IEEE 40TH VLSI TEST SYMPOSIUM (VTS), 2022,
  • [4] SPECIAL ISSUE ON NEURAL NETWORK HARDWARE
    SANCHEZSINENCIO, E
    NEWCOMB, RW
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (03): : 345 - 346
  • [5] Reliability Analysis of a Spiking Neural Network Hardware Accelerator
    Spyrou, Theofilos
    El-Sayed, Sarah A.
    Afacan, Engin
    Camunas-Mesa, Luis A.
    Linares-Barranco, Bernabe
    Stratigopoulos, Haralampos-G
    PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 370 - 375
  • [6] Special Session: The Recent Advance in Hardware Implementation of Post-Quantum Cryptography
    Xie, Jiafeng
    Basu, Kanad
    Gaj, Kris
    Guin, Ujjwal
    2020 IEEE 38TH VLSI TEST SYMPOSIUM (VTS 2020), 2020,
  • [7] Special Session: Neuromorphic hardware design and reliability from traditional CMOS to emerging technologies
    Pavanello, Fabio
    Vatajelu, Elena Ioana
    Bosio, Alberto
    Van Vaerenbergh, Thomas
    Bienstman, Peter
    Charbonnier, Benoit
    Carpegna, Alessio
    Di Carlo, Stefano
    Savino, Alessandro
    2023 IEEE 41ST VLSI TEST SYMPOSIUM, VTS, 2023,
  • [8] Special Session: Recent Developments in Hardware Security
    Commarota, Ro
    Karimi, Naghmeh
    Garg, Siddharth
    Rajendran, Jeyavijayan
    2018 IEEE 36TH VLSI TEST SYMPOSIUM (VTS 2018), 2018,
  • [9] Special Session: New Directions in Hardware Security
    Tehranipoor, Mark
    2016 29TH INTERNATIONAL CONFERENCE ON VLSI DESIGN AND 2016 15TH INTERNATIONAL CONFERENCE ON EMBEDDED SYSTEMS (VLSID), 2016, : 50 - 52
  • [10] Special session "software reliability engineering"
    Grosspietsch, KE
    PROCEEDINGS OF THE 26TH EUROMICRO CONFERENCE, VOLS I AND II, 2000, : A192 - A192