Artificial neural network regression as a local search heuristic for ensemble strategies in differential evolution

被引:59
作者
Fister, Iztok [1 ]
Suganthan, Ponnuthurai Nagaratnam [2 ]
Fister, Iztok, Jr. [1 ]
Kamal, Salahuddin M. [3 ]
Al-Marzouki, Fahad M. [3 ]
Perc, Matjaz [3 ,4 ]
Strnad, Damjan [1 ]
机构
[1] Univ Maribor, Fac Elect Engn & Comp Sci, Smetanova 17, SLO-2000 Maribor, Slovenia
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] King Abdulaziz Univ, Fac Sci, Dept Phys, Jeddah 21413, Saudi Arabia
[4] Univ Maribor, Fac Nat Sci & Math, Koroska Cesta 160, SLO-2000 Maribor, Slovenia
关键词
Nonlinear dynamics; Artificial neural network; Differential evolution; Regression; Local search; Ensemble strategies; NEIGHBORHOOD; OPTIMIZATION; ALGORITHM; PARAMETERS;
D O I
10.1007/s11071-015-2537-8
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Nature frequently serves as an inspiration for developing new algorithms to solve challenging real-world problems. Mathematical modeling has led to the development of artificial neural networks (ANNs), which have proven especially useful for solving problems such as classification and regression. Moreover, evolutionary algorithms (EAs), inspired by Darwin's natural evolution, have been successfully applied to solve optimization, modeling, and simulation problems. Differential evolution (DE) is a particularly well-known EA that possesses a multitude of strategies for generating an offspring solution, where the best strategy is not known in advance. In this paper, the ANN regression is applied as a local search heuristic within the DE algorithm that tries predicting the best strategy or attempting to generate a better offspring from an ensemble of DE strategies. This local search heuristic is applied to the population of solutions according to a control parameter that regulates between the time complexity of calculation and the quality of the solution. The experiments on a CEC 2014 test suite consisting of 30 benchmark functions reveal the full potential in developing this idea.
引用
收藏
页码:895 / 914
页数:20
相关论文
共 56 条
[1]   Differential evolution algorithm for solving multi-objective crop planning model [J].
Adeyemo, Josiah ;
Otieno, Fred .
AGRICULTURAL WATER MANAGEMENT, 2010, 97 (06) :848-856
[2]  
[Anonymous], 2013, 201311 ZHENGZH U
[3]  
[Anonymous], 2010, Articial intelligence: A modern approach
[4]  
[Anonymous], 2013, P 15 ANN C COMP GEN
[5]  
[Anonymous], 2003, ARXIVCS0308031
[6]   Solving economic emission load dispatch problems using hybrid differential evolution [J].
Bhattacharya, Aniruddha ;
Chattopadhyay, Pranab Kumar .
APPLIED SOFT COMPUTING, 2011, 11 (02) :2526-2537
[7]  
Bigus J. P., 1996, DATA MINING NEURAL N
[8]   Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems [J].
Brest, Janez ;
Greiner, Saso ;
Boskovic, Borko ;
Mernik, Marjan ;
Zumer, Vijern .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2006, 10 (06) :646-657
[9]   Differential Evolution With Neighborhood and Direction Information for Numerical Optimization [J].
Cai, Yiqiao ;
Wang, Jiahai .
IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (06) :2202-2215
[10]  
Chakraborty UK, 2006, P IEEE C EV COMP, P2042, DOI DOI 10.1109/CEC.2006.1688558