A Feature Map Lossless Compression Framework for Convolutional Neural Network Accelerators

被引:0
|
作者
Zhang, Zekun [1 ,2 ]
Jiao, Xin [2 ]
Xu, Chengyu [2 ]
机构
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] SenseTime Res, Shanghai, Peoples R China
来源
2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024 | 2024年
关键词
Feature map compression; deep learning; convolutional neural networks; hardware acceleration;
D O I
10.1109/AICAS59952.2024.10595980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a predictor-based lossless compression algorithm for the feature maps present within convolutional neural networks (CNNs), which provides the possibility to solve the system bandwidth bottleneck and excessive power consumption problem of hardware acceleration. It is also an algorithm-hardware co-design methodology, yielding a hardware-friendly compression approach with low power consumption. The performance of the algorithm is evaluated in the detection, recognition, and segment CNN tasks respectively. Results show that an average compression ratio of 3.03x and a gain of nearly 50% over existing methods can be achieved for VGG-16; 2.78x and a gain of around 51% for ResNet-18; 2.45 and a gain of nearly 38% for SegNet.
引用
收藏
页码:422 / 426
页数:5
相关论文
共 50 条
  • [21] DeepRibSt: a multi-feature convolutional neural network for predicting ribosome stalling
    Zhang, Yuan
    Zhang, Sai
    He, Xizhi
    Lu, Jing
    Gao, Xieping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (11) : 17239 - 17255
  • [22] Memory Bandwidth and Energy Efficiency Optimization of Deep Convolutional Neural Network Accelerators
    Nie, Zikai
    Li, Zhisheng
    Wang, Lei
    Guo, Shasha
    Dou, Qiang
    ADVANCED COMPUTER ARCHITECTURE, 2018, 908 : 15 - 29
  • [23] Improving Performance Estimation for Design Space Exploration for Convolutional Neural Network Accelerators
    Ferianc, Martin
    Fan, Hongxiang
    Manocha, Divyansh
    Zhou, Hongyu
    Liu, Shuanglong
    Niu, Xinyu
    Luk, Wayne
    ELECTRONICS, 2021, 10 (04) : 1 - 14
  • [24] EcoFlow: Efficient Convolutional Dataflows on Low-Power Neural Network Accelerators
    Orosa, Lois
    Koppula, Skanda
    Umuroglu, Yaman
    Kanellopoulos, Konstantinos
    Gomez-Luna, Juan
    Blott, Michaela
    Vissers, Kees
    Mutlu, Onur
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (09) : 2275 - 2289
  • [25] Lossless Compression of Deep Neural Networks
    Serra, Thiago
    Kumar, Abhinav
    Ramalingam, Srikumar
    INTEGRATION OF CONSTRAINT PROGRAMMING, ARTIFICIAL INTELLIGENCE, AND OPERATIONS RESEARCH, CPAIOR 2020, 2020, 12296 : 417 - 430
  • [26] Intelligent Framework for Malware Detection with Convolutional Neural Network
    Mourtaji, Youness
    Bouhorma, Mohammed
    Alghazzawi, Daniyal
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON NETWORKING, INFORMATION SYSTEMS & SECURITY (NISS19), 2019,
  • [27] An Embedded Inference Framework for Convolutional Neural Network Applications
    Bi, Sheng
    Zhang, Yingjie
    Dong, Min
    Min, Huaqing
    IEEE ACCESS, 2019, 7 : 171084 - 171094
  • [28] Deep Convolutional Neural Network Framework for Subpixel Mapping
    He, Da
    Zhong, Yanfei
    Wang, Xinyu
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (11): : 9518 - 9539
  • [29] Compression Priors Assisted Convolutional Neural Network for Fractional Interpolation
    Zhang, Han
    Song, Li
    Li, Li
    Li, Zhu
    Yang, Xiaokang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1953 - 1967
  • [30] CONVOLUTIONAL NEURAL NETWORK AS A FEATURE EXTRACTOR FOR AUTOMATIC POLYP DETECTION
    Taha, Bilal
    Dias, Jorge
    Werghi, Naoufel
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2060 - 2064