SSFP: A Structured Stripe-Filter Pruning Method for Deep Neural Networks

被引:0
作者
Liu, Jingjing [1 ]
Huang, Lingjin [1 ]
Feng, Manlong [1 ]
Guo, Aiying [1 ]
机构
[1] Shanghai Univ, Sch Microelect, Shanghai, Peoples R China
来源
2024 13TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS, ICCCAS 2024 | 2024年
基金
中国国家自然科学基金;
关键词
Network pruning; Filter pruning; Stripe pruning; Model compression;
D O I
10.1109/ICCCAS62034.2024.10652748
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Network pruning has gained popularity for reducing storage and computational requirements in deep neural network models. However, common pruning techniques focus on the single granularity without sufficiently exploring collaborative research on different granularity levels. In order to explore the combination of different pruning granularities while effectively compressing the network in a structured manner, this paper proposes a structured stripe-filter pruning method (SSFP) that combines filter and stripe pruning. The fine-grained is embedded within the architecture of coarse-grained pruning, employing a mixed compression strategy with two pruning modules to accomplish pruning tasks. Experiments demonstrate better model compression results than the comparison techniques in the VGG-16 and RESNET-56 convolutional neural networks. When applying SSFP to VGG-16, FLOPs is reduced by 70.1%, the total number of parameters is reduced by 93.5%, and the accuracy of CIFAR-10 is improved from 93.40% to 93.63%.
引用
收藏
页码:80 / 84
页数:5
相关论文
共 22 条
[1]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[2]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[3]   Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration [J].
He, Yang ;
Liu, Ping ;
Wang, Ziwei ;
Hu, Zhilan ;
Yang, Yi .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4335-4344
[4]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[5]  
Krizhevsky Alex., 2009, Technical Report
[6]  
Li H, 2017, Arxiv, DOI [arXiv:1608.08710, DOI 10.48550/ARXIV.1608.08710]
[7]   Pruning and quantization for deep neural network acceleration: A survey [J].
Liang, Tailin ;
Glossner, John ;
Wang, Lei ;
Shi, Shaobo ;
Zhang, Xiaotong .
NEUROCOMPUTING, 2021, 461 :370-403
[8]   HRank: Filter Pruning using High-Rank Feature Map [J].
Lin, Mingbao ;
Ji, Rongrong ;
Wang, Yan ;
Zhang, Yichen ;
Zhang, Baochang ;
Tian, Yonghong ;
Shao, Ling .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1526-1535
[9]   Toward Compact ConvNets via Structure-Sparsity Regularized Filter Pruning [J].
Lin, Shaohui ;
Ji, Rongrong ;
Li, Yuchao ;
Deng, Cheng ;
Li, Xuelong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (02) :574-588
[10]   Towards Optimal Structured CNN Pruning via Generative Adversarial Learning [J].
Lin, Shaohui ;
Ji, Rongrong ;
Yan, Chenqian ;
Zhang, Baochang ;
Cao, Liujuan ;
Ye, Qixiang ;
Huang, Feiyue ;
Doermann, David .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2785-2794