Resilience-Aware Frequency Tuning for Neural-Network-Based Approximate Computing Chips

被引:17
|
作者
Wang, Ying [1 ]
Deng, Jiachao [1 ]
Fang, Yuntan [1 ]
Li, Huawei [1 ]
Li, Xiaowei [1 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; error tolerance; neural network (NN); timing variation;
D O I
10.1109/TVLSI.2017.2682885
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Unlike conventional ICs, approximate computing chips are less sensitive to hardware errors. This fascinating feature can be utilized to improve the performance of chip design and even change the timing closure procedure of digital circuit design flow. In this paper, we study the potential of resilience-aware circuit clocking scheme, and demonstrate the methodology with advanced neural network (NN)-based accelerator. We propose a novel timing analysis and frequency setting method for NN-based approximate computing circuits based on in-field NN retraining. With the proposed iterative retiming-and-retraining framework, NN-based accelerator can be retrained to operate safely at aggressive operating frequencies compared with the frequency decided purely by statistical timing analysis or Monto Carlo analysis. For nanometer process technology with increasing threats of timing errors induced by process variation, noises, and so on, our retiming-and-retraining method enables higher circuit operating frequency and enables dynamic precision/frequency adjustment for approximate computing circuits. We evaluate the methodology with both the neural and deep learning accelerators in experiments. The experimental results show that timing errors in neural circuits can be effectively tamed for different applications, so that the circuits can operate at higher clocking rates under the specified quality constraint or be dynamically scaled to work at a wide range of frequency states with only minor accuracy losses.
引用
收藏
页码:2736 / 2748
页数:13
相关论文
共 50 条
  • [21] Towards Artificial Neural Network Based Intrusion Detection with Enhanced Hyperparameter Tuning
    Calugar, Andrei Nicolae
    Meng, Weizhi
    Zhang, Haijun
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2627 - 2632
  • [22] Dynamic batch size tuning based on stopping criterion for neural network training
    Takase, Tomoumi
    Neurocomputing, 2021, 429 : 1 - 11
  • [23] Fine-Tuning Convolutional Neural Network Based Railway Damage Detection
    Aydin, Ahmet
    Salur, Mehmet Umut
    Aydin, Ilhan
    IEEE EUROCON 2021 - 19TH INTERNATIONAL CONFERENCE ON SMART TECHNOLOGIES, 2021, : 216 - 221
  • [24] Dynamic batch size tuning based on stopping criterion for neural network training
    Takase, Tomoumi
    NEUROCOMPUTING, 2021, 429 : 1 - 11
  • [25] Boundary-Aware Point Based Deep Neural Network for Shape Segmentation
    Guan B.
    Zhou F.
    Lin S.
    Luo X.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (01): : 147 - 155
  • [26] A survey and benchmark evaluation for neural-network-based lossless universal compressors toward multi-source data
    Hui Sun
    Huidong Ma
    Feng Ling
    Haonan Xie
    Yongxia Sun
    Liping Yi
    Meng Yan
    Cheng Zhong
    Xiaoguang Liu
    Gang Wang
    Frontiers of Computer Science, 2025, 19 (7)
  • [27] Hyperspectral and Lidar Data Applied to the Urban Land Cover Machine Learning and Neural-Network-Based Classification: A Review
    Kuras, Agnieszka
    Brell, Maximilian
    Rizzi, Jonathan
    Burud, Ingunn
    REMOTE SENSING, 2021, 13 (17)
  • [28] Neural-Network-Based Direction-of-Arrival Estimation for Reverberant Speech - The Importance of Energetic, Temporal, and Spatial Information
    Ben Zaken, Orel
    Kumar, Anurag
    Tourbabin, Vladimir
    Rafaely, Boaz
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 1298 - 1309
  • [29] NEURAL-NETWORK-BASED DETECTION METHODS FOR COLOR, SHARPNESS, AND GEOMETRY ARTIFACTS IN STEREOSCOPIC AND VR180 VIDEOS
    Lavrushkin, Sergey
    Kozhemyakov, Konstantin
    Vatolin, Dmitriy
    2020 INTERNATIONAL CONFERENCE ON 3D IMMERSION (IC3D), 2020,
  • [30] A Graph Neural Network and Pointer Network-Based Approach for QoS-Aware Service Composition
    Wang, Xiao
    Xu, Hanchuan
    Wang, Xianzhi
    Xu, Xiaofei
    Wang, Zhongjie
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (03) : 1589 - 1603