Fractional-order convolutional neural networks with population extremal optimization

被引:17
|
作者
Chen, Bi-Peng [1 ]
Chen, Yun [1 ]
Zeng, Guo-Qiang [2 ]
She, Qingshan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Wenzhou Univ, Natl Local Joint Engn Lab Digitalize Elect Design, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Caputo fractional-order gradient method; Population extremal optimization; Initial bias and weight; MNIST dataset; Fractional-order convolutional neural networks; PARTICLE SWARM OPTIMIZATION; QUANTITATIVE-ANALYSIS; STABILITY;
D O I
10.1016/j.neucom.2022.01.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article is devoted to the intelligent optimization issue by means of PEO-FOCNN, i.e., the fractional order convolutional neural networks (FOCNNs) with population extremal optimization (PEO). The Caputo fractional-order gradient method (CFOGM) is adopted to improve the dynamic updating effectiveness of the biases and weights for convolutional neural networks (CNN). Moreover, considering the significance of the initial biases and weights and their updating mechanisms to the optimization performance of FOCNN, the PEO algorithm is used to seek an optimal selection from lots of the initial biases and weights. The optimization effect of PEO method for FOCNN is demonstrated by the training and testing accuracies of PEO-FOCNN compared with standard FOCNN. And, the superiority of the proposed PEO-FOCNN to FOCNN based on some other popular optimization algorithms, such as the genetic algorithm-based FOCNN (GA-FOCNN), differential evolution-based FOCNN (DE-FOCNN) and particle swarm optimization-based FOCNN (PSO-FOCNN), is verified by the experiments on the MNIST dataset in terms of three types of statistical tests. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:36 / 45
页数:10
相关论文
共 50 条
  • [21] Stability analysis of fractional-order neural networks: An LMI approach
    Yang, Ying
    He, Yong
    Wang, Yong
    Wu, Min
    NEUROCOMPUTING, 2018, 285 : 82 - 93
  • [22] Stability Analysis of Fractional-Order Neural Networks with Time Delay
    Hu Wang
    Yongguang Yu
    Guoguang Wen
    Shuo Zhang
    Neural Processing Letters, 2015, 42 : 479 - 500
  • [23] Synchronization of fractional-order memristive neural networks with time delays
    Chen, Chong
    Ding, Zhixia
    Li, Sai
    Wang, Liheng
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2754 - 2759
  • [24] Fractional-Order Traveling Wave Approximations for a Fractional-Order Neural Field Model
    Gonzalez-Ramirez, Laura R.
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16
  • [25] Quantized Control for Synchronization of Delayed Fractional-Order Memristive Neural Networks
    Fan, Yingjie
    Huang, Xia
    Wang, Zhen
    Xia, Jianwei
    Shen, Hao
    NEURAL PROCESSING LETTERS, 2020, 52 (01) : 403 - 419
  • [26] Event-based delayed impulsive control for fractional-order dynamic systems with application to synchronization of fractional-order neural networks
    Zheng, Bibo
    Wang, Zhanshan
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (27) : 20241 - 20251
  • [27] Global attractivity of memristor-based fractional-order neural networks
    Zhang, Shuo
    Yu, Yongguang
    Gu, Yajuan
    NEUROCOMPUTING, 2017, 227 : 64 - 73
  • [28] Global projective synchronization in fractional-order quaternion valued neural networks
    Zhang, Weiwei
    Zhang, Hai
    Cao, Jinde
    Zhang, Hongmei
    Alsaadi, Fuad E.
    Alsaedi, Ahmed
    ASIAN JOURNAL OF CONTROL, 2022, 24 (01) : 227 - 236
  • [29] Stability and synchronization of fractional-order memristive neural networks with multiple delays
    Chen, Liping
    Cao, Jinde
    Wu, Ranchao
    Tenreiro Machado, J. A.
    Lopes, Antonio M.
    Yang, Hejun
    NEURAL NETWORKS, 2017, 94 : 76 - 85
  • [30] Influence of multiple time delays on bifurcation of fractional-order neural networks
    Xu, Changjin
    Liao, Maoxin
    Li, Peiluan
    Guo, Ying
    Xiao, Qimei
    Yuan, Shuai
    APPLIED MATHEMATICS AND COMPUTATION, 2019, 361 : 565 - 582