A Feature Map Lossless Compression Framework for Convolutional Neural Network Accelerators

被引:0
|
作者
Zhang, Zekun [1 ,2 ]
Jiao, Xin [2 ]
Xu, Chengyu [2 ]
机构
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] SenseTime Res, Shanghai, Peoples R China
来源
2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024 | 2024年
关键词
Feature map compression; deep learning; convolutional neural networks; hardware acceleration;
D O I
10.1109/AICAS59952.2024.10595980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a predictor-based lossless compression algorithm for the feature maps present within convolutional neural networks (CNNs), which provides the possibility to solve the system bandwidth bottleneck and excessive power consumption problem of hardware acceleration. It is also an algorithm-hardware co-design methodology, yielding a hardware-friendly compression approach with low power consumption. The performance of the algorithm is evaluated in the detection, recognition, and segment CNN tasks respectively. Results show that an average compression ratio of 3.03x and a gain of nearly 50% over existing methods can be achieved for VGG-16; 2.78x and a gain of around 51% for ResNet-18; 2.45 and a gain of nearly 38% for SegNet.
引用
收藏
页码:422 / 426
页数:5
相关论文
共 50 条
  • [41] Automatic Classification Framework of Tongue Feature Based on Convolutional Neural Networks
    Li, Jiawei
    Zhang, Zhidong
    Zhu, Xiaolong
    Zhao, Yunlong
    Ma, Yuhang
    Zang, Junbin
    Li, Bo
    Cao, Xiyuan
    Xue, Chenyang
    MICROMACHINES, 2022, 13 (04)
  • [42] Bin-Specific Quantization in Spectral-Domain Convolutional Neural Network Accelerators
    Park, Jinho
    Lee, Jaewon
    Kim, Gain
    Bae, Hyeon-Min
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 407 - 410
  • [43] Understanding of a Convolutional Neural Network
    Albawi, Saad
    Mohammed, Tareq Abed
    Al-Zawi, Saad
    2017 INTERNATIONAL CONFERENCE ON ENGINEERING AND TECHNOLOGY (ICET), 2017,
  • [44] PRUNIX: Non-Ideality Aware Convolutional Neural Network Pruning for Memristive Accelerators
    Al-Shaarawy, Ali
    Amirsoleimani, Amirali
    Genov, Roman
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 1299 - 1303
  • [45] Differential convolutional neural network
    Sarigul, M.
    Ozyildirim, B. M.
    Avci, M.
    NEURAL NETWORKS, 2019, 116 : 279 - 287
  • [46] LIGHTWEIGHT COMPRESSION OF NEURAL NETWORK FEATURE TENSORS FOR COLLABORATIVE INTELLIGENCE
    Cohen, Robert A.
    Choi, Hyomin
    Bajic, Ivan, V
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [47] Segmentation of linear map objects using sequential convolutional neural network
    Yang M.
    Chen G.
    Li L.
    Huang H.
    Miao J.
    Yan X.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (01): : 108 - 116
  • [48] Convolutional Neural Networks for Enhanced Compression Techniques
    Gnacek, Matthew
    Heatwole, Cory
    Fan, David
    Hoffman, Marc
    PROCEEDINGS OF THE 2021 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2021, : 392 - 399
  • [49] NLCMAP: A FRAMEWORK FOR THE EFFICIENT MAPPING OF NON-LINEAR CONVOLUTIONAL NEURAL NETWORKS ON FPGA ACCELERATORS
    Aiello, Giuseppe
    Bussolino, Beatrice
    Valpreda, Emanuele
    Roch, Massimo Ruo
    Masera, Guido
    Martina, Maurizio
    Marsi, Stefano
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 926 - 930
  • [50] A Convolutional Neural Network Framework for Accurate Skin Cancer Detection
    Thurnhofer-Hemsi, Karl
    Dominguez, Enrique
    NEURAL PROCESSING LETTERS, 2021, 53 (05) : 3073 - 3093