Fractional-order convolutional neural networks with population extremal optimization

被引:18
|
作者
Chen, Bi-Peng [1 ]
Chen, Yun [1 ]
Zeng, Guo-Qiang [2 ]
She, Qingshan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Wenzhou Univ, Natl Local Joint Engn Lab Digitalize Elect Design, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Caputo fractional-order gradient method; Population extremal optimization; Initial bias and weight; MNIST dataset; Fractional-order convolutional neural networks; PARTICLE SWARM OPTIMIZATION; QUANTITATIVE-ANALYSIS; STABILITY;
D O I
10.1016/j.neucom.2022.01.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article is devoted to the intelligent optimization issue by means of PEO-FOCNN, i.e., the fractional order convolutional neural networks (FOCNNs) with population extremal optimization (PEO). The Caputo fractional-order gradient method (CFOGM) is adopted to improve the dynamic updating effectiveness of the biases and weights for convolutional neural networks (CNN). Moreover, considering the significance of the initial biases and weights and their updating mechanisms to the optimization performance of FOCNN, the PEO algorithm is used to seek an optimal selection from lots of the initial biases and weights. The optimization effect of PEO method for FOCNN is demonstrated by the training and testing accuracies of PEO-FOCNN compared with standard FOCNN. And, the superiority of the proposed PEO-FOCNN to FOCNN based on some other popular optimization algorithms, such as the genetic algorithm-based FOCNN (GA-FOCNN), differential evolution-based FOCNN (DE-FOCNN) and particle swarm optimization-based FOCNN (PSO-FOCNN), is verified by the experiments on the MNIST dataset in terms of three types of statistical tests. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:36 / 45
页数:10
相关论文
共 50 条
  • [1] Convolutional neural networks based on fractional-order momentum for parameter training
    Kan, Tao
    Gao, Zhe
    Yang, Chuang
    Jian, Jing
    NEUROCOMPUTING, 2021, 449 : 85 - 99
  • [2] Optimization of fractional-order chaotic cellular neural networks by metaheuristics
    Esteban Tlelo-Cuautle
    Astrid Maritza González-Zapata
    Jonathan Daniel Díaz-Muñoz
    Luis Gerardo de la Fraga
    Israel Cruz-Vega
    The European Physical Journal Special Topics, 2022, 231 : 2037 - 2043
  • [3] Optimization of fractional-order chaotic cellular neural networks by metaheuristics
    Tlelo-Cuautle, Esteban
    Maritza Gonzalez-Zapata, Astrid
    Daniel Diaz-Munoz, Jonathan
    Gerardo de la Fraga, Luis
    Cruz-Vega, Israel
    EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2022, 231 (10): : 2037 - 2043
  • [4] A fractional-order momentum optimization approach of deep neural networks
    Yu, ZhongLiang
    Sun, Guanghui
    Lv, Jianfeng
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (09): : 7091 - 7111
  • [5] A fractional-order momentum optimization approach of deep neural networks
    ZhongLiang Yu
    Guanghui Sun
    Jianfeng Lv
    Neural Computing and Applications, 2022, 34 : 7091 - 7111
  • [6] A fractional-order momentum optimization approach of deep neural networks
    Yu, ZhongLiang
    Sun, Guanghui
    Lv, Jianfeng
    Neural Computing and Applications, 2022, 34 (09) : 7091 - 7111
  • [7] Fractional-Order Hopfield Neural Networks
    Boroomand, Arefeh
    Menhaj, Mohammad B.
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT I, 2009, 5506 : 883 - 890
  • [8] Dynamics of fractional-order neural networks
    Kaslik, Eva
    Sivasundaram, Seenith
    2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 611 - 618
  • [9] A SURVEY OF FRACTIONAL-ORDER NEURAL NETWORKS
    Zhang, Shuo
    Chen, YangQuan
    Yu, Yongguang
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2017, VOL 9, 2017,
  • [10] Dynamics in fractional-order neural networks
    Song, Chao
    Cao, Jinde
    NEUROCOMPUTING, 2014, 142 : 494 - 498