Training back-propagation neural network using hybrid fruit fly optimization algorithm

被引:1
作者
Cai F. [1 ,2 ]
Cui J. [2 ]
Dong B. [2 ]
Li J. [2 ]
Li X. [1 ,3 ]
机构
[1] School of Computer Science and Technology, Tianjin University, Tianjin
[2] School of Civil Engineering, Shandong Jianzhu University, Jinan
[3] Xinjiang Production and Construction Corps 12 Division Information Technology Service Center, Urumqi
基金
中国国家自然科学基金;
关键词
Ant colony optimization algorithm; Back-propagation neural network; Fruit fly optimization algorithm; Parameter optimization; UCI database;
D O I
10.1166/jctn.2016.4978
中图分类号
学科分类号
摘要
Back-propagation (BP) neural network is a multilayer feedforward neural network and has been widely used. However, back-propagation algorithm has some drawbacks, such as tendency to getting into partial minimal value and hidden layer nodes are determined by experience and slow convergence, in order to avoid this disadvantages, this work puts forward a hybrid of fruit fly optimization algorithm (FOA) and ant colony optimization algorithm (ACO) to resolve the aforementioned drawbacks. Firstly, the proposed hybrid method is applied to find best the initial pheromone distribution which includes heuristic factor, expectation factor and pheromone volatility. Secondly, ant colony algorithm is applied to optimize the network structure and parameters of back-propagation neural network to overcome drawbacks of BP. In this paper, the proposed algorithm is applied to Function optimization problems, UCI flowers classification and octane value prediction problem. The results are compared with ACO-based learning algorithm for back-propagation neural network and the resulting accuracy of BP trained with ACO, FOA and FOAACO. The experimental results show that FOAACO algorithm is much better than ACO and FOA for training BP neural network in terms of avoiding local optimum and converging speed. It is also proved that the proposed hybrid fruit fly optimization algorithm is better accuracy than ACO and FOA for training BP neural network. Copyright © 2016 American Scientific Publishers All rights reserved.
引用
收藏
页码:3212 / 3221
页数:9
相关论文
共 23 条
[1]  
Aiqin H., Yong W., Algorithms, 7, (2014)
[2]  
Ali M.M., Khompatraporn C., Zabinsky B.Z., Journal of Global Optimization, 31, (2005)
[3]  
Cheng M.Y., Tsai H.C., Sudjono E., Expert Systems with Applications, 37, (2010)
[4]  
Chiang W.K., Zhang D., Zhou L., Decision Support Systems, 41, (2006)
[5]  
Chung H., Lee H., Jun C.-H., Bullentin of the Korean Chemical Society, 22, (2001)
[6]  
Dorigo M., Optimization, Learning and Natural Algorithms, (1992)
[7]  
Dorigo M., Blum C., Theoretical Computer Science, 344, (2005)
[8]  
Duran O., Rodriguez N., Consalter L.A., Expert Systems with Applications, 36, (2009)
[9]  
Eberhart R.C., Shi Y., Particle swarm optimization: Developments, applications and resources, Proc. IEEE Int. Conf. Evolutionary Computation, 1, pp. 81-86, (2001)
[10]  
Han J., Wang P., Yang X., Tuning of PID controller based on fruit fly optimization algorithm, 2012 International Conference on Mechatronics and Automation (ICMA), (2012)