Pursuit-evasion game based on fuzzy reinforcement learning and model predictive control

被引:0
作者
Hu, Peng-Lin [1 ]
Pan, Quan [1 ]
Zhao, Chun-Hui [1 ]
机构
[1] School of Automation, Northwestern Polytechnical University, Xi’an
来源
Kongzhi yu Juece/Control and Decision | 2025年 / 40卷 / 06期
关键词
3D pursuit-evasion game; Apollonius circle; fuzzy reinforcement learning; model predictive control;
D O I
10.13195/j.kzyjc.2024.1039
中图分类号
学科分类号
摘要
Addressing the strategy formulation and robust control issues in the pursuit-evasion game of agents in 3D space, this paper proposes a hierarchical pursuit-evasion game framework based on fuzzy reinforcement learning and model predictive control(MPC). The proposed framework integrates the Apollonius circle in 3D space with the fuzzy actor-critic learning(FACL) algorithm to obtain the agents' motion information, which is then used as the reference input for the MPC algorithm to design the controller for quadrotor unmanned aerial vehicles. By decoupling the underactuated system model of the quadrotor, altitude, translation, and attitude controllers that consider the integral term of the error system are designed. The reference information provided by the FACL algorithm effectively enhances the control efficiency of the MPC algorithm. Simulation and experimental results demonstrate that the designed hierarchical framework can effectively solve the pursuit-evasion game problem in 3D space. © 2025 Northeast University. All rights reserved.
引用
收藏
页码:1855 / 1865
页数:10
相关论文
共 33 条
[1]  
Weintraub I E, Pachter M, Garcia E., An introduction to pursuit-evasion differential games, American Control Conference, pp. 1049-1066, (2020)
[2]  
perimeter from a ground intruder using an aerial defender: Theory and practice, IEEE International Symposium on Safety, Security, and Rescue Robotics, pp. 184-189, (2021)
[3]  
Biediger D, Popov L, Becker A T., The pursuit and evasion of drones attacking an automated turret, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 9677-9682, (2021)
[4]  
Zhang F, Zha W., Evasion strategies of a three-player lifeline game, Science China Information Sciences, 61, pp. 1-11, (2018)
[5]  
Yan R, Deng R L, Lai H W, Et al., Homicidal chauffeur reach-avoid games via guaranteed winning strategies, IEEE Transactions on Automatic Control
[6]  
Liang L, Deng F, Peng Z H, Et al., A differential game for cooperative target defense, Automatica, 102, pp. 58-71, (2019)
[7]  
Ibragimov G, Ferrara M, Ruziboev M, Et al., Linear evasion differential game of one evader and several pursuers with integral constraints, International Journal of Game Theory, 50, 3, pp. 729-750, (2021)
[8]  
Deng Z Q, Kong Z D., Multi-agent cooperative pursuit-defense strategy against one single attacker, IEEE Robotics and Automation Letters, 5, 4, pp. 5772-5778, (2020)
[9]  
Garcia E, Casbeer D W, Von Moll A, Et al., Multiple pursuer multiple evader differential games, IEEE Transactions on Automatic Control, 66, 5, pp. 2345-2350, (2021)
[10]  
Yan R, Shi Z Y, Zhong Y S., Cooperative strategies for two-evader-one-pursuer reach-avoid differential games, International Journal of Solids and Structures, 52, 9, pp. 1894-1912, (2021)