Intelligent guidance for no⁃fly zone avoidance based on reinforcement learning

The rapid development of Artificial Intelligence（AI）provides a new technical approach for the research of aircraft guidance. Aiming at the problem of reentry aircraft for avoiding uncertain no-fly zone，we propose the research frame of“predictor-corrector guidance-pre-training of bank angle guidance model based on supervised learning-further training of bank angle guidance model based on reinforcement learning”. On the one hand，lots of flying trajectory for avoiding no-fly zone are produced by predictor-corrector guidance. The bank angle guidance model is pre-trained with supervised learning algorithm. On the other hand，the bank angle guidance model is further trained by the use of Proximal Policy Optimization（PPO）algorithm. A large number of exploration interactions are taken between aircraft and environment with uncertain no-fly-zone. At the same time，the powerful lateral maneuverability of high lift-drag ratio reentry aircraft is exploited with effective reward. Such method will get rid of restriction of bank angle solution space produced by predictor-corrector guidance，which is expected to produce better strategy for avoiding no-fly zone. By comparing with traditional predictor-corrector guidance and intelligent guidance based on supervised learning，it is verified that the no-fly zone intelligent guidance technology based on reinforcement learning can fully exploit the wide area flight advantages of aircraft，so as to meet the adaptability requirements of future intelligent decision system under uncertain scenarios. © 2023 AAAS Press of Chinese Society of Aeronautics and Astronautics. All rights reserved.