MDPruner: Meta-Learning Driven Dynamic Filter Pruning for Efficient Object Detection

被引:0
|
作者
Zhou, Lingyun [1 ]
Liu, Xiaoyong [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Automat Sci & Engn, Xian 710049, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Object detection; Computational modeling; Image coding; Complexity theory; Image edge detection; Training; Information filters; Convolutional neural networks; filter pruning; meta-learning; convolutional neural network compression and acceleration;
D O I
10.1109/ACCESS.2024.3464576
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Filter pruning is a potent technique for diminishing the computational demands of Convolutional Neural Networks (CNNs), while effectively retaining model performance in image categorization tasks. However, research on its application to object detection models is scant and often incurs substantial performance degradation. In this paper, we present a novel Meta-network-based Dynamic Pruner method (MDPruner) designed to attenuate the computational burden of object detection models, concurrently preserving their efficacy. The rationale behind our approach is straightforward: for intricate images, we designate a lesser pruning rate to uphold detection accuracy, while for less complicated images, we apply a higher pruning rate to compress the model effectually and economize computational assets - thus, striking an ideal equilibrium between compression proficiency and performance sustenance. To accomplish this, we exploit a supernet framework to concurrently train pruned networks of diverse sizes, thereby obviating the necessity for supplementary parameter overhead. Furthermore, to deftly and accurately evaluate the detection complexity of input images and to choose the optimal pruning network, we propose a lightweight meta-network module, which is engineered to identify the most suitable subnetwork for processing, dependent on the image's detection complexity. Comprehensive evaluations effectuated on the COCO and PASCAL VOC datasets have substantiated the effectiveness of our proposed MDPruner in compressing object detection models.
引用
收藏
页码:136925 / 136935
页数:11
相关论文
共 50 条
  • [21] Meta-learning for efficient unsupervised domain adaptation
    Vettoruzzo, Anna
    Bouguelia, Mohamed-Rafik
    Roegnvaldsson, Thorsteinn
    NEUROCOMPUTING, 2024, 574
  • [22] Memory Efficient Meta-Learning with Large Images
    Bronskill, John
    Massiceti, Daniela
    Patacchiola, Massimiliano
    Hofmann, Katja
    Nowozin, Sebastian
    Turner, Richard E.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [23] Knowledge-Driven Meta-Learning for CSI Feedback
    Xiao, Han
    Tian, Wenqiang
    Liu, Wendong
    Guo, Jiajia
    Zhang, Zhi
    Jin, Shi
    Shi, Zhihua
    Guo, Li
    Shen, Jia
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 5694 - 5709
  • [24] Tracking by Instance Detection: A Meta-Learning Approach
    Wang, Guangting
    Luo, Chong
    Sun, Xiaoyan
    Xiong, Zhiwei
    Zeng, Wenjun
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6287 - 6296
  • [25] Efficient Meta-Learning for Continual Learning with Taylor Expansion Approximation
    Zou, Xiaohan
    Lin, Tong
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [26] Pruning Quantized Unsupervised Meta-Learning DegradingNet Solution for Industrial Equipment and Semiconductor Process Anomaly Detection and Prediction
    Yu, Yi-Cheng
    Yang, Shiau-Ru
    Chuang, Shang-Wen
    Chien, Jen-Tzung
    Lee, Chen-Yi
    APPLIED SCIENCES-BASEL, 2024, 14 (05):
  • [27] Lightweight Meta-Learning BotNet Attack Detection
    Fadhilla, Cut Alna
    Alfikri, Muhammad Dany
    Kaliski, Rafael
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (10) : 8455 - 8466
  • [28] Swin Transformer-Based Object Detection Model Using Explainable Meta-Learning Mining
    Baek, Ji-Won
    Chung, Kyungyong
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [29] Meta-learning few shot object detection algorithm based on channel and spatial attention mechanisms
    Jiang, Lianyuan
    Chen, Jinlong
    Yang, Minghao
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 897 - 903
  • [30] Meta-learning for dynamic tuning of active learning on stream classification
    Martins, Vinicius Eiji
    Cano, Alberto
    Barbon, Sylvio, Jr.
    PATTERN RECOGNITION, 2023, 138