Research on Shallow Neural Network Evolution Method Based on Improved Coyote Optimization Algorithm

被引:0
作者
Liu W. [1 ,2 ]
Fu J. [1 ,2 ]
Zhou D.-N. [3 ]
Wang X.-Y. [1 ,2 ]
Cheng M. [1 ,2 ]
Huang M. [1 ,2 ]
Guo Z.-Q. [1 ,2 ]
Jin B. [1 ,2 ]
Niu Y.-J. [1 ,2 ]
机构
[1] College of Science, Liaoning Technical University, Fuxin
[2] Institute of Mathematics and Systems Science, Liaoning Technical University, Fuxin
[3] BusinessBigData Tech. Co., Ltd, Data Services Business Group, Chengdu
来源
Jisuanji Xuebao/Chinese Journal of Computers | 2021年 / 44卷 / 06期
基金
中国国家自然科学基金;
关键词
Adaptive influence weight; BP neural network; Chaos; Coyote optimization algorithm; Neuroevolution;
D O I
10.11897/SP.J.1016.2021.01200
中图分类号
学科分类号
摘要
As a kind of Neural network training method which is different from stochastic gradient descent, neuroevolution has become an important branch in the field of machine learning research. How to design a better evolutionary strategy and explore new type of neural network weights of the neuroevolutionary method is one of the hot issues of current research. In this paper, an evolutionary method of shallow layer neural network based on improved coyote optimization algorithm is proposed. By introducing the method of adaptive weighting factor and chaos perturbation, the traditional coyotes optimization algorithm is improved from two aspects of convergence speed and optimization ability. Secondly, the improved coyote optimization algorithm is adopted as the neural evolution strategy, which is integrated into the neural evolution process of the shallow neural network. Taking BP neural network as an example, a new updating method of BP neural network weight and threshold optimization is constructed. Finally, several representative data sets in UCI standard database are used to verify the effectiveness of the algorithm. Experimental results show that: The evolutionary strategy of improved coyote optimization algorithm gives full play to the global optimization ability of heuristic optimization algorithm in the parameter space of BP neural network, approximates the optimal solution quickly. The BP neural network that after neural evolution shows excellent performance in classification tasks, the feasibility and effectiveness of the improved coyote optimization algorithm as a new neural evolutionary strategy are fully verified. The research results in this paper enrich and expand the research content in the field of neuroevolution and provide an important reference for building a new machine learning toolbox with neuroevolution as the main body. © 2021, Science Press. All right reserved.
引用
收藏
页码:1200 / 1213
页数:13
相关论文
共 41 条
  • [1] Stanley K O, Clune J, Lehman J, Et al., Designing neural networks through neuroevolution, Nature Machine Intelligence, 1, 1, pp. 24-35, (2019)
  • [2] Miller G F, Todd P M, Hegde S U., Designing neural networks using genetic algorithms, Proceedings of the 3rd International Conference on Genetic Algorithms, pp. 379-384, (1989)
  • [3] Such F P, Madhavan V, Conti E, Et al., Deep neuroevolution: genetic algorithms are a competitive alternative for training deep neural networks for reinforcement learning, (2017)
  • [4] Lehman J, Chen J, Clune J, Et al., Safe mutations for deep and recurrent neural networks through output gradients, (2017)
  • [5] Zhang X, Clune J, Stanley K O, Et al., On the relationship between the open-AI evolution strategy and stochastic gradient descent, (2017)
  • [6] Lehman J, Chen J, Clune J, Et al., ES is more than just a traditional finite-difference approximator, (2017)
  • [7] Conti E, Madhavan V, Such F P, Et al., Improving exploration in evolution strategies for deep reinforcement learning via a population of novelty-seeking agents, (2017)
  • [8] Wei Y H, Xu C, Hu Q Y., Transformation of optimization problems in revenue management, queueing system, and supply chain management, International Journal of Production Economics, 146, 2, pp. 588-597, (2015)
  • [9] Yang X-S., Nature-Inspired Optimization Algorithms, (2014)
  • [10] Socha K, Dorigo M., Ant colony optimization for continuous domains, European Journal of Operational Research, 185, 3, pp. 1155-1173, (2008)