Unmanned ground weapon target assignment based on deep Q-learning network with an improved multi-objective artificial bee colony algorithm

被引:29
作者
Wang, Tong [1 ]
Fu, Liyue [1 ]
Wei, Zhengxian [2 ]
Zhou, Yuhu [1 ]
Gao, Shan [1 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Syst Engn Res Inst, Syst Engn Innovat Ctr, 1 Fengxian East Rd, Beijing 100094, Peoples R China
关键词
Multi-objective optimization; Deep reinforcement learning; Weapon target assignment; Adaptive operator selection mechanism; MANY-OBJECTIVE OPTIMIZATION; EVOLUTIONARY ALGORITHM; MODEL;
D O I
10.1016/j.engappai.2022.105612
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Various objective functions in the operation process of unmanned ground combat vehicles (UGVs) have an important impact on the equilibrium of the system. Unbalanced scheduling of unmanned ground combat vehicles and poor target strikes exist in complex urban battlefields. A new multi-weapon target assignment architecture and a multi-objective artificial bee colony (MOABC) algorithm with an elite strategy are proposed to solve these problems. Considering the influence of mutation operator on multi-objective assignment, by introducing the action mechanism of the self-adaptive variation operator and combining the state representation of the nectar source with the overall allocation scheme, the deep Q-learning network with improved multi-objective artificial bee colony (MOADQN) algorithm is proposed. Through comparative analysis with multi-objective artificial bee colony algorithm, non-dominated sorting genetic algorithm-II (NSGA-II), multi-objective particle swarm optimization (MOPSO), the multi-objective evolutionary algorithm based on decomposition with electronic countermeasure (ECM-MOEA/D) and the deep Q-learning network with multi -objective artificial bee colony (MOAIQL) algorithm, the proposed MOADQN algorithm can solve the problems such as poor allocation effectiveness and low gain of traditional algorithms. The proposed MOADQN algorithm has significant advantages in solving multi-objective optimization problems and strong expansion performance in the complex urban environment.
引用
收藏
页数:17
相关论文
共 63 条
[1]   A review of EVs charging: From the perspective of energy optimization, optimization approaches, and charging techniques [J].
Amjad, Muhammad ;
Ahmad, Ayaz ;
Rehmani, Mubashir Husain ;
Umer, Tariq .
TRANSPORTATION RESEARCH PART D-TRANSPORT AND ENVIRONMENT, 2018, 62 :386-417
[2]   Solving the dynamic weapon target assignment problem by an improved artificial bee colony algorithm with heuristic factor initialization [J].
Chang, Tianqing ;
Kong, Depeng ;
Hao, Na ;
Xu, Kehu ;
Yang, Guozhen .
APPLIED SOFT COMPUTING, 2018, 70 :845-863
[3]   Dynamic multiobjective evolutionary algorithm with adaptive response mechanism selection strategy [J].
Chen, Liang ;
Wang, Hanyang ;
Pan, Darong ;
Wang, Hao ;
Gan, Wenyan ;
Wang, Duodian ;
Zhu, Tao .
KNOWLEDGE-BASED SYSTEMS, 2022, 246
[4]   New Solution Creation Operator in MOEA/D for Faster Convergence [J].
Chen, Longcan ;
Pang, Lie Meng ;
Ishibuchi, Hisao .
PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVII, PPSN 2022, PT II, 2022, 13399 :234-246
[5]  
Cheng Q., 2021, P IEEE INT C UNM SYS, P908
[6]   A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization [J].
Cheng, Ran ;
Jin, Yaochu ;
Olhofer, Markus ;
Sendhoff, Bernhard .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2016, 20 (05) :773-791
[7]   A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization [J].
Chugh, Tinkle ;
Jin, Yaochu ;
Miettinen, Kaisa ;
Hakanen, Jussi ;
Sindhya, Karthik .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2018, 22 (01) :129-142
[8]  
Corne D., 2001, Proceedings of the Genetic and Evolutionary Computation Conference GECCO'2001, P283, DOI [DOI 10.5555/2955239.2955289, 10.5555/2955239.2955289]
[9]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197
[10]   An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints [J].
Deb, Kalyanmoy ;
Jain, Himanshu .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2014, 18 (04) :577-601