Multiconstrained Gliding Guidance Based on Optimal and Reinforcement Learning Method

被引:5
|
作者
Zhe, Luo [1 ]
Xinsan, Li [1 ,2 ]
Lixin, Wang [1 ]
Qiang, Shen [1 ]
机构
[1] Xian High Tech Inst, Xian 710025, Peoples R China
[2] Northwest Univ, Sch Astronaut, Xian 710072, Peoples R China
关键词
ALGORITHM;
D O I
10.1155/2021/6652232
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In order to improve the autonomy of gliding guidance for complex flight missions, this paper proposes a multiconstrained intelligent gliding guidance strategy based on optimal guidance and reinforcement learning (RL). Three-dimensional optimal guidance is introduced to meet the terminal latitude, longitude, altitude, and flight-path-angle constraints. A velocity control strategy through lateral sinusoidal maneuver is proposed, and an analytical terminal velocity prediction method considering maneuvering flight is studied. Aiming at the problem that the maneuvering amplitude in velocity control cannot be determined offline, an intelligent parameter adjustment method based on RL is studied. This method considers parameter determination as a Markov Decision Process (MDP) and designs a state space via terminal speed and an action space with maneuvering amplitude. In addition, it constructs a reward function that integrates terminal velocity error and gliding guidance tasks and uses Q-Learning to achieve the online intelligent adjustment of maneuvering amplitude. The simulation results show that the intelligent gliding guidance method can meet various terminal constraints with high accuracy and can improve the autonomous decision-making ability under complex tasks effectively.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Reinforcement Learning-Based Guidance of Autonomous Vehicles
    Clemmons, Joseph
    Jin, Yu-Fang
    2023 24TH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN, ISQED, 2023, : 496 - 501
  • [22] A Multiconstrained Ascent Guidance Method for Solid Rocket-Powered Launch Vehicles
    Chen, Si-Yuan
    Xia, Qun-Li
    INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2016, 2016
  • [23] Optimal pivot path of the simplex method for linear programming based on reinforcement learning
    Anqi Li
    Tiande Guo
    Congying Han
    Bonan Li
    Haoran Li
    Science China(Mathematics), 2024, 67 (06) : 1263 - 1286
  • [24] Optimal pivot path of the simplex method for linear programming based on reinforcement learning
    Li, Anqi
    Guo, Tiande
    Han, Congying
    Li, Bonan
    Li, Haoran
    SCIENCE CHINA-MATHEMATICS, 2024, 67 (06) : 1263 - 1286
  • [25] Intelligent Online Multiconstrained Reentry Guidance Based on Hindsight Experience Replay
    Jiang, Qingji
    Wang, Xiaogang
    Bai, Yuliang
    Li, Yu
    INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2023, 2023
  • [26] Gliding trajectory tracking guidance law based on indirect radau pseudospectral method
    School of Astronautics, Beijing University of Aeronautics and Astronautics, Beijing
    100191, China
    不详
    100048, China
    Yuhang Xuebao, 12 (1398-1405):
  • [27] A search method for a hypersonic gliding vehicle based on early warning information guidance
    Zhang, Junbiao
    Xiong, Jiajun
    Li, Lingzhi
    Xi, Qiushi
    Chen, Xin
    Li, Fan
    IET RADAR SONAR AND NAVIGATION, 2022, 16 (07): : 1162 - 1175
  • [28] ON REINFORCEMENT LEARNING IN OPTIMIZATION HEURISTICS AND OPTIMAL METHOD SWITCHING
    Macek, Karel
    Kukal, Jaromir
    Bostik, Josef
    16TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING MENDEL 2010, 2010, : 22 - 28
  • [29] Reinforcement Learning Based on Active Learning Method
    Sagha, Hesam
    Shouraki, Saeed Bagheri
    Khasteh, Hosein
    Kiaei, Ali Akbar
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL II, PROCEEDINGS, 2008, : 598 - +
  • [30] Reinforcement-Learning-Based Robust Guidance for Asteroid Approaching
    Yang, Hongwei
    Hu, Jincheng
    Li, Shuang
    Bai, Xiaoli
    JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2024, 47 (10) : 2058 - 2072