The Mode-Fisher pooling for time complexity optimization in deep convolutional neural networks

被引:0
|
作者
Mansouri, Dou El Kefel [1 ,2 ]
Kaddar, Bachir [1 ]
Benkabou, Seif-Eddine [2 ]
Benabdeslem, Khalid [2 ]
机构
[1] Univ Ibn Khaldoun, BP P 78 Zaaroura, Tiaret 14000, Algeria
[2] Univ Poitiers, ENSMA, ISAE, LIAS, 1 Ave Clement Ader, F-86960 Lyon, France
来源
NEURAL COMPUTING & APPLICATIONS | 2021年 / 33卷 / 12期
关键词
Convolutional neural networks CNNs; Mode-Fisher pooling; Energy; ILLUMINANT ESTIMATION; IMAGE FEATURES; COLOR;
D O I
10.1007/s00521-020-05406-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we aim to improve the performance, time complexity and energy efficiency of deep convolutional neural networks (CNNs) by combining hardware and specialization techniques. Since the pooling step represents a process that contributes significantly to CNNs performance improvement, we propose theMode-Fisher poolingmethod. This form of pooling can potentially offer a very promising results in terms of improving feature extraction performance. The proposed method reduces significantly the data movement in the CNN and save up to 10% of total energy, without any performance penalty.
引用
收藏
页码:6443 / 6465
页数:23
相关论文
共 50 条
  • [1] The Mode-Fisher pooling for time complexity optimization in deep convolutional neural networks
    Dou El Kefel Mansouri
    Bachir Kaddar
    Seif-Eddine Benkabou
    Khalid Benabdeslem
    Neural Computing and Applications, 2021, 33 : 6443 - 6465
  • [2] REGP: A NEW POOLING ALGORITHM FOR DEEP CONVOLUTIONAL NEURAL NETWORKS
    Yildirim, O.
    Baloglu, U. B.
    NEURAL NETWORK WORLD, 2019, 29 (01) : 45 - 60
  • [3] Weighted pooling for image recognition of deep convolutional neural networks
    Zhu, Xiaoning
    Meng, Qingyue
    Ding, Bojian
    Gu, Lize
    Yang, Yixian
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 4): : S9371 - S9383
  • [4] Rank-based pooling for deep convolutional neural networks
    Shi, Zenglin
    Ye, Yangdong
    Wu, Yunpeng
    NEURAL NETWORKS, 2016, 83 : 21 - 31
  • [5] Implications of Pooling Strategies in Convolutional Neural Networks: A Deep Insight
    Sharma, Shallu
    Mehra, Rajesh
    FOUNDATIONS OF COMPUTING AND DECISION SCIENCES, 2019, 44 (03) : 303 - 330
  • [6] Deep Convolutional Neural Networks for Pedestrian Detection with Skip Pooling
    Liu, Jie
    Gao, Xingkun
    Bao, Nianyuan
    Tang, Jie
    Wu, Gangshan
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 2056 - 2063
  • [7] Weighted pooling for image recognition of deep convolutional neural networks
    Xiaoning Zhu
    Qingyue Meng
    Bojian Ding
    Lize Gu
    Yixian Yang
    Cluster Computing, 2019, 22 : 9371 - 9383
  • [8] ADAPTIVE SALIENCE PRESERVING POOLING FOR DEEP CONVOLUTIONAL NEURAL NETWORKS
    Yu Zhenyu
    Dai Shiyu
    Xing Yuxiang
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 513 - 518
  • [9] Complexity of Deep Convolutional Neural Networks in Mobile Computing
    Naeem, Saad
    Jamil, Noreen
    Khan, Habib Ullah
    Nazir, Shah
    COMPLEXITY, 2020, 2020
  • [10] On the Reduction of Computational Complexity of Deep Convolutional Neural Networks
    Maji, Partha
    Mullins, Robert
    ENTROPY, 2018, 20 (04)