A CNN pruning approach using constrained binary particle swarm optimization with a reduced search space for image classification

被引:12
作者
Tmamna, Jihene [1 ]
Ben Ayed, Emna [2 ]
Fourati, Rahma [1 ,3 ]
Hussain, Amir [4 ]
Ben Ayed, Mounir [5 ]
机构
[1] Univ Sfax, Natl Engn Sch Sfax ENIS, Res Grp Intelligent Machines, BP 1173, Sfax 3038, Tunisia
[2] Polytech Sfax IPSAS, Ind 4 0 Res Lab, Ave 5 August,3002 Sfax Rue Said Aboubaker, Sfax, Tunisia
[3] Univ Jendouba, Fac Sci Jurid, Econ & Gest Jendouba, Jendouba 8189, Tunisia
[4] Edinburgh Napier Univ, Sch Comp, Edinburgh, Scotland
[5] Univ Sfax, Fac Sci Sfax, Comp Sci & Commun Dept, Sfax, Tunisia
基金
英国工程与自然科学研究理事会;
关键词
Energy-efficient models; Green deep learning; Filter pruning; Binary particle swarm optimization; Filter weighting initialization; Search space reduction strategy; CONVOLUTIONAL NEURAL-NETWORKS;
D O I
10.1016/j.asoc.2024.111978
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep convolutional neural networks (CNNs) have exhibited exceptional performance in a range of computer vision tasks. However, these deep CNNs typically demand significant computational resources, which not only hinders their practical deployment but also contributes to a considerable carbon footprint. To tackle this issue, several filter pruning methods based on evolutionary algorithms have been proposed to provide significant memory and energy savings during CNN inference. However, due to the curse of high dimensionality in the structure of deep CNNs, the search space expands dramatically, presenting significant challenges for these methods. This paper proposes a novel algorithm called BPSO-FPruner for CNN filter pruning. BPSO-FPruner utilizes a constrained binary particle swarm optimization algorithm for filter pruning, incorporating a new initialization strategy based on filter weighting information and a reduced search space strategy. Extensive validation using VGG, ResNet, DenseNet, and MobileNetv2 architectures on the CIFAR-10, CIFAR-100, and Tiny ImageNet datasets demonstrates the effectiveness of BPSO-FPruner in reducing model computational costs and carbon footprint emissions while maintaining or improving performance.
引用
收藏
页数:21
相关论文
共 80 条
[1]   Development of a compressed FCN architecture for semantic segmentation using Particle Swarm Optimization [J].
Agarwal, Mohit ;
Gupta, Suneet K. ;
Biswas, K. K. .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (16) :11833-11846
[2]   Updating the neural network sediment load models using different sensitivity analysis methods: a regional application [J].
Asheghi, Reza ;
Hosseini, Seyed Abbas ;
Saneie, Mojtaba ;
Shahri, Abbas Abbaszadeh .
JOURNAL OF HYDROINFORMATICS, 2020, 22 (03) :562-577
[3]   Redundant feature pruning for accelerated inference in deep neural networks [J].
Ayinde, Babajide O. ;
Inanc, Tamer ;
Zurada, Jacek M. .
NEURAL NETWORKS, 2019, 118 :148-158
[4]   Deep Model Compression based on the Training History [J].
Basha, S. H. Shabbeer ;
Farazuddin, Mohammad ;
Pulabaigari, Viswanath ;
Dubey, Shiv Ram ;
Mukherjee, Snehasis .
NEUROCOMPUTING, 2024, 573
[5]   ZeroQ: A Novel Zero Shot Quantization Framework [J].
Cai, Yaohui ;
Yao, Zhewei ;
Dong, Zhen ;
Gholami, Amir ;
Mahoney, Michael W. ;
Keutzer, Kurt .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :13166-13175
[6]   Recent trends in the use of statistical tests for comparing swarm and evolutionary computing algorithms: Practical guidelines and a critical review [J].
Carrasco, J. ;
Garcia, S. ;
Rueda, M. M. ;
Das, S. ;
Herrera, F. .
SWARM AND EVOLUTIONARY COMPUTATION, 2020, 54 (54)
[7]   Automatic channel pruning via clustering and swarm intelligence optimization for CNN [J].
Chang, Jingfei ;
Lu, Yang ;
Xue, Ping ;
Xu, Yiqun ;
Wei, Zhen .
APPLIED INTELLIGENCE, 2022, 52 (15) :17751-17771
[8]   FPC: Filter pruning via the contribution of output feature map for deep convolutional neural networks acceleration [J].
Chen, Yanming ;
Wen, Xiang ;
Zhang, Yiwen ;
He, Qiang .
KNOWLEDGE-BASED SYSTEMS, 2022, 238
[9]   CCPrune: Collaborative channel pruning for learning compact convolutional networks [J].
Chen, Yanming ;
Wen, Xiang ;
Zhang, Yiwen ;
Shi, Weisong .
NEUROCOMPUTING, 2021, 451 :35-45
[10]   Inference-aware convolutional neural network pruning [J].
Choudhary, Tejalal ;
Mishra, Vipul ;
Goswami, Anurag ;
Sarangapani, Jagannathan .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 135 :44-56