Transfer ants reinforcement learning algorithm and its application on rectangular packing problem

被引:0
|
作者
Xu X. [1 ]
Chen J. [2 ]
Rao Y. [1 ]
Meng R. [1 ,4 ]
Yuan B. [3 ]
Luo Q. [1 ]
机构
[1] School of Mechanical Science & Engineering of HUST, Huazhong University of Science and Technology, Wuhan
[2] Department of Automotive Engineering, Guizhou Communication Vocational College, Guiyang
[3] School of Mechanical and Electronic Engineering, Wuhan University of Technology, Wuhan
[4] College of Mechanical & Power Engineering, China Three Gorges University, Yichang
关键词
Ant colony algorithm; Knowledge transfer; Rectangular packing problem; Reinforcement learning;
D O I
10.13196/j.cims.2020.12.006
中图分类号
学科分类号
摘要
Rectangular packing problem is a typical NP-Hard problem, the solution time will increase exponentially with increasing of parts' number. To reduce the computing time of similar tasks and improve the optimization performance and material utilization, combined with the lowest skyline search algorithm based on fitness evaluation factor, a novel ants reinforcement learning algorithm based on knowledge transfer was proposed for rectangular packing problem. Aiming at the high-dimensional knowledge space, this algorithm constructed a high-dimensional space combination matrix based on knowledge extension. With the help of "trial-and-error" learning mode of reinforcement learning, the algorithm acquired and updated knowledge in the knowledge matrix by using ant colony with self-learning ability. The knowledge acquired by pre-learning was transferred to the target task by linear transfer strategy, which helped the new task make decisions quickly online. Simulation result showed that the proposed algorithm could obtain a higher quality solution at the speed of 2-6 times faster than other intelligent algorithm, which was very suitable in solving large and medium-scale rectangular packing problem. © 2020, Editorial Department of CIMS. All right reserved.
引用
收藏
页码:3236 / 3247
页数:11
相关论文
共 28 条
  • [1] WEI Lijun, HU Qian, LEUNG S C H, Et al., An improved skyline based heuristic for the 2D strip packing problem and its efficient implementation, Computers & Operations Research, 80, pp. 113-127, (2016)
  • [2] BAKER B S, COFFMAN E G J, RIVEST R L., Orthogonal packings in two dimensions, SIAM Journal on Computing, 9, 4, pp. 846-855, (1980)
  • [3] SHANG Zhengyang, GU Jinan, DING Wei, Et al., Heuristic algorithm for 2D rectangular packing problem, Computer Integrated Manufacturing Systems, 24, 3, pp. 583-590, (2018)
  • [4] GONCALVES J F., A parallel multi-population genetic algorithm for a constrained two-dimensional orthogonal packing problem[J], Journal of Combinatorial Optimization, 22, 2, pp. 180-201, (2011)
  • [5] LIN T D, HSU C C, LI F H., Optimization by ant colony hybrid local search for online class constrained bin packing problem[J], Applied Mechanics & Materials, 311, pp. 123-128, (2013)
  • [6] LIU D S, TAN K C, HUANG S Y, Et al., On solving multiobjective bin packing problems using evolutionary particle swarm optimization, European Journal of Operational Research, 190, 2, pp. 357-382, (2008)
  • [7] REED M, YIANNAKOU A, EVERING R., An ant colony algorithm for the multi-compartment vehicle routing problem, Applied Soft Computing, 15, pp. 169-176, (2014)
  • [8] KAELBLING L P, LITTMAN M L, MOORE A P., Reinforcement learning:A survey, Journal of Artificial Intelligence Research, 4, 1, pp. 237-285, (1996)
  • [9] ZHANG Xinhua, Grid cluster cooperative dependent multi task scheduling method based on reinforcement learning and ant colony algorithm[J], Journal of Changsha University, 30, 2, pp. 50-33, (2016)
  • [10] CHANG Feng, HE Yuanye, Fault diagnosis method for wsn sensor node based on reinforcement learning and ant colony algorithm[J], Computer Measurement & Control, 23, 3, pp. 755-785, (2015)