Method of Convolutional Neural Network Model Pruning Based on Gray Correlation Analysis

被引:0
|
作者
Huang Shiqing [1 ]
Bai Ruilin [1 ]
Qin Gaoe [2 ]
机构
[1] Jiangnan Univ, Minist Educ, Key Lab Adv Proc Control Light Ind, Wuxi 214122, Jiangsu, Peoples R China
[2] Xinje Elect Co Ltd, Wuxi 214122, Jiangsu, Peoples R China
关键词
image processing; model pruning; deep learning; convolutional neural network; gray correlation analysis; model acceleration;
D O I
10.3788/LOP57.041011
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A model pruning method based on gray correlation analysis is proposed to solve the problem that the convolutional neural network cannot be deployed on embedded devices due to the huge computation and memory space. For the weight model file after data training, the importance of each convolution kernel is quantized by using the pruning method based on gray correlation analysis. In each pruning, the convolution kernel with the minimum quantization result is deleted from the model so as to reduce the computation and accelerate the inferential speed. Iteration training is used to compensate for the performance loss of the new model. The experimental results show that compared with APoZ method and L1 method, the accuracy of the proposed method increases by 5. 3% and 10.4% at the same inferential speed, the acceleration effect of VGG-16 model is 2. 7 times that of the original model, and the memory space is reduced to 1/13.5.
引用
收藏
页数:7
相关论文
共 19 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] [Anonymous], LASER OPTOELECTRONIC
  • [3] [Anonymous], POWER CAPACITOR REAC
  • [4] [Anonymous], 2015, ICLR
  • [5] [Anonymous], LASER OPTOELECTRONIC
  • [6] [Anonymous], PROC CVPR IEEE
  • [7] [Anonymous], 2015, PROC CVPR IEEE
  • [8] [Anonymous], 2017, P ICLR
  • [9] [Anonymous], 2016, LASER OPTOELECTRONIC
  • [10] A Multi-Focus Image Fusion Algorithm Based on Depth Learning
    Chen Qingjiang
    Li Yi
    Chai Yuzhou
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (07)