Fractional-order convolutional neural networks with population extremal optimization

被引:17
|
作者
Chen, Bi-Peng [1 ]
Chen, Yun [1 ]
Zeng, Guo-Qiang [2 ]
She, Qingshan [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Wenzhou Univ, Natl Local Joint Engn Lab Digitalize Elect Design, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Caputo fractional-order gradient method; Population extremal optimization; Initial bias and weight; MNIST dataset; Fractional-order convolutional neural networks; PARTICLE SWARM OPTIMIZATION; QUANTITATIVE-ANALYSIS; STABILITY;
D O I
10.1016/j.neucom.2022.01.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article is devoted to the intelligent optimization issue by means of PEO-FOCNN, i.e., the fractional order convolutional neural networks (FOCNNs) with population extremal optimization (PEO). The Caputo fractional-order gradient method (CFOGM) is adopted to improve the dynamic updating effectiveness of the biases and weights for convolutional neural networks (CNN). Moreover, considering the significance of the initial biases and weights and their updating mechanisms to the optimization performance of FOCNN, the PEO algorithm is used to seek an optimal selection from lots of the initial biases and weights. The optimization effect of PEO method for FOCNN is demonstrated by the training and testing accuracies of PEO-FOCNN compared with standard FOCNN. And, the superiority of the proposed PEO-FOCNN to FOCNN based on some other popular optimization algorithms, such as the genetic algorithm-based FOCNN (GA-FOCNN), differential evolution-based FOCNN (DE-FOCNN) and particle swarm optimization-based FOCNN (PSO-FOCNN), is verified by the experiments on the MNIST dataset in terms of three types of statistical tests. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:36 / 45
页数:10
相关论文
共 50 条
  • [31] Synchronization in Fractional-Order Delayed Non-Autonomous Neural Networks
    Wu, Dingping
    Wang, Changyou
    Jiang, Tao
    MATHEMATICS, 2025, 13 (07)
  • [32] Projective synchronization of fractional-order memristor-based neural networks
    Bao, Hai-Bo
    Cao, Jin-De
    NEURAL NETWORKS, 2015, 63 : 1 - 9
  • [33] PROJECTION SYNCHRONIZATION OF FUNCTIONAL FRACTIONAL-ORDER NEURAL NETWORKS WITH VARIABLE COEFFICIENTS
    Jia, Lili
    Lei, Zongxin
    Wang, Changyou
    Zhou, Yuqian
    Jiang, Tao
    Du, Yuanhua
    Zhang, Qiuyan
    JOURNAL OF APPLIED ANALYSIS AND COMPUTATION, 2023, 13 (02): : 1070 - 1087
  • [34] Stabilization of reaction-diffusion fractional-order memristive neural networks
    Li, Ruoxia
    Cao, Jinde
    Li, Ning
    NEURAL NETWORKS, 2023, 165 : 290 - 297
  • [35] Stability analysis of fractional-order Hopfield neural networks with time delays
    Wang, Hu
    Yu, Yongguang
    Wen, Guoguang
    NEURAL NETWORKS, 2014, 55 : 98 - 109
  • [36] Stability Analysis of Fractional-order Neural Networks with Delays Based on LMI
    Hu, Xiaofang
    Tang, Meilan
    Liu, Xinge
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 118 - 123
  • [37] Order-Dependent Sampling Control of Uncertain Fractional-Order Neural Networks System
    Ge, Chao
    Zhang, Qi
    Zhang, Ruonan
    Yang, Li
    NEURAL PROCESSING LETTERS, 2023, 55 (08) : 10773 - 10787
  • [38] Hybrid Projective Synchronization of Fractional-order Neural Networks with Different Dimensions
    Yang, Zhanying
    Li, Jingwen
    Tang, Xiaoyun
    Niu, Yanqing
    JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2019, 88 (08)
  • [39] Passivity and passification of fractional-order memristive neural networks with time delays
    Ding, Zhixia
    Yang, Le
    Ye, Yanyan
    Li, Sai
    Huang, Zixin
    ISA TRANSACTIONS, 2023, 137 : 314 - 322
  • [40] New stability results of fractional-order Hopfield neural networks with delays
    Song Chao
    Cao Jinde
    Fei Shumin
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 3561 - 3565