Multiconstrained Gliding Guidance Based on Optimal and Reinforcement Learning Method

被引:5
|
作者
Zhe, Luo [1 ]
Xinsan, Li [1 ,2 ]
Lixin, Wang [1 ]
Qiang, Shen [1 ]
机构
[1] Xian High Tech Inst, Xian 710025, Peoples R China
[2] Northwest Univ, Sch Astronaut, Xian 710072, Peoples R China
关键词
ALGORITHM;
D O I
10.1155/2021/6652232
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In order to improve the autonomy of gliding guidance for complex flight missions, this paper proposes a multiconstrained intelligent gliding guidance strategy based on optimal guidance and reinforcement learning (RL). Three-dimensional optimal guidance is introduced to meet the terminal latitude, longitude, altitude, and flight-path-angle constraints. A velocity control strategy through lateral sinusoidal maneuver is proposed, and an analytical terminal velocity prediction method considering maneuvering flight is studied. Aiming at the problem that the maneuvering amplitude in velocity control cannot be determined offline, an intelligent parameter adjustment method based on RL is studied. This method considers parameter determination as a Markov Decision Process (MDP) and designs a state space via terminal speed and an action space with maneuvering amplitude. In addition, it constructs a reward function that integrates terminal velocity error and gliding guidance tasks and uses Q-Learning to achieve the online intelligent adjustment of maneuvering amplitude. The simulation results show that the intelligent gliding guidance method can meet various terminal constraints with high accuracy and can improve the autonomous decision-making ability under complex tasks effectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Multi constraint optimal intelligent gliding guidance via reinforcement learning
    Zhu J.
    Zhao C.
    Li X.
    Bao W.
    Guofang Keji Daxue Xuebao/Journal of National University of Defense Technology, 2022, 44 (04): : 116 - 124
  • [2] Energy Management Strategy for Optimal Charge Depletion of Plug-In FCHEV Based on Multiconstrained Deep Reinforcement Learning
    Wang, Haocong
    Wang, Xiaomin
    Fu, Zhumu
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2025, 11 (01): : 1077 - 1090
  • [3] A guidance method for coplanar orbital interception based on reinforcement learning
    ZENG Xin
    ZHU Yanwei
    YANG Leping
    ZHANG Chengming
    Journal of Systems Engineering and Electronics, 2021, 32 (04) : 927 - 938
  • [4] A guidance method for coplanar orbital interception based on reinforcement learning
    Zeng Xin
    Zhu Yanwei
    Yang Leping
    Zhang Chengming
    JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2021, 32 (04) : 927 - 938
  • [5] A Reinforcement Learning Method for Gliding Control of Underwater Gliding Snake-like Robot
    Zhang X.
    Li B.
    Chang J.
    Tang J.
    Jiqiren/Robot, 2019, 41 (03): : 334 - 342
  • [6] Highly constrained optimal gliding guidance
    Zhu, Jianwen
    Liu, Luhua
    Tang, Guojian
    Bao, Weimin
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2015, 229 (12) : 2321 - 2335
  • [7] A Sliding Mode Terminal Guidance Law Based on Reinforcement Learning Method
    Liu, Xinyu
    Hao, Mingrui
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 271 - 280
  • [8] Cooperative game guidance method for hypersonic vehicles based on reinforcement learning
    Ni W.
    Wang Y.
    Xu C.
    Chi F.
    Liang H.
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2023, 44
  • [9] Gliding Control of Underwater Gliding Snake-like Robot based on Reinforcement Learning
    Zhang, Xiao-lu
    Li, Bin
    Chang, Jian
    Tang, Jing-ge
    2018 IEEE 8TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER), 2018, : 323 - 328
  • [10] Near-optimal guidance method for maximizing the reachable domain of gliding aircraft
    Tsuchiya, Takeshi
    TRANSACTIONS OF THE JAPAN SOCIETY FOR AERONAUTICAL AND SPACE SCIENCES, 2006, 49 (165) : 137 - 145