Improving Dendritic Neuron Model With Dynamic Scale-Free Network-Based Differential Evolution

被引:69
作者
Yu, Yang [1 ,2 ]
Lei, Zhenyu [3 ]
Wang, Yirui [4 ]
Zhang, Tengfei [1 ,2 ]
Peng, Chen [5 ]
Gao, Shangce [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing 210023, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Coll Artificial Intelligence, Nanjing 210023, Jiangsu, Peoples R China
[3] Univ Toyama, Fac Engn, Toyama 9308555, Japan
[4] Ningbo Univ, Fac Elect Engn & Comp Sci, Ningbo 315211, Zhejiang, Peoples R China
[5] Shanghai Univ, Sch Mechatron Engn & Automat, Dept Automat, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Artificial neuron networks (ANNs); dendrite neuron network; differential evolution (DE); scale-free network; OPTIMIZATION; INTELLIGENCE; NEIGHBORHOOD; COMPUTATION; ALGORITHMS; TESTS;
D O I
10.1109/JAS.2021.1004284
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Some recent research reports that a dendritic neuron model (DNM) can achieve better performance than traditional artificial neuron networks (ANNs) on classification, prediction, and other problems when its parameters are well-tuned by a learning algorithm. However, the back-propagation algorithm (BP), as a mostly used learning algorithm, intrinsically suffers from defects of slow convergence and easily dropping into local minima. Therefore, more and more research adopts non-BP learning algorithms to train ANNs. In this paper, a dynamic scale-free network-based differential evolution (DSNDE) is developed by considering the demands of convergent speed and the ability to jump out of local minima. The performance of a DSNDE trained DNM is tested on 14 benchmark datasets and a photovoltaic power forecasting problem. Nine meta-heuristic algorithms are applied into comparison, including the champion of the 2017 IEEE Congress on Evolutionary Computation (CEC2017) benchmark competition effective butterfly optimizer with covariance matrix adapted retreat phase (EBOwithCMAR). The experimental results reveal that DSNDE achieves better performance than its peers.
引用
收藏
页码:99 / 110
页数:12
相关论文
共 53 条
[1]   Emergence of scaling in random networks [J].
Barabási, AL ;
Albert, R .
SCIENCE, 1999, 286 (5439) :509-512
[2]   Deep learning and time series-to-image encoding for financial forecasting [J].
Barra, Silvio ;
Carta, Salvatore Mario ;
Corriga, Andrea ;
Podda, Alessandro Sebastian ;
Recupero, Diego Reforgiato .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (03) :683-692
[3]   Differential Evolution With Neighborhood and Direction Information for Numerical Optimization [J].
Cai, Yiqiao ;
Wang, Jiahai .
IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (06) :2202-2215
[4]   Neural-Network-Based Nonlinear Model Predictive Tracking Control of a Pneumatic Muscle Actuator-Driven Exoskeleton [J].
Cao, Yu ;
Huang, Jian .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (06) :1478-1488
[5]   Evaluating time series forecasting models: an empirical study on performance estimation methods [J].
Cerqueira, Vitor ;
Torgo, Luis ;
Mozetic, Igor .
MACHINE LEARNING, 2020, 109 (11) :1997-2028
[6]  
Chaudhuri A, 2017, STUD FUZZ SOFT COMP, V352, P9
[7]   Differential Evolution: A Survey of the State-of-the-Art [J].
Das, Swagatam ;
Suganthan, Ponnuthurai Nagaratnam .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2011, 15 (01) :4-31
[8]   A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms [J].
Derrac, Joaquin ;
Garcia, Salvador ;
Molina, Daniel ;
Herrera, Francisco .
SWARM AND EVOLUTIONARY COMPUTATION, 2011, 1 (01) :3-18
[9]  
Dua D, 2017, UCI MACHINE LEARNING
[10]   Multiplicative computation in a visual neuron sensitive to looming [J].
Gabbiani, F ;
Krapp, HG ;
Koch, C ;
Laurent, G .
NATURE, 2002, 420 (6913) :320-324