Attitude Control of Hypersonic Vehicle based on Reinforcement Learning

被引:0
|
作者
Liu, Jingwen [1 ]
Fan, Hongdong [1 ]
Fan, Yonghua [2 ]
Cai, Guangbin [1 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Northwestern Polytech Univ, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
hypersonic vehicle; intelligent control; attitude control; DDQN;
D O I
10.1109/FASTA61401.2024.10595336
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, the attitude control problem of hypersonic vehicle is studied. The DDQN (double deep Q network) algorithm is used to realize the online adaptive adjustment of the control parameters of the PID (proportional-integral-derivative) controller. Firstly, the dynamic model of hypersonic vehicle is established. Then, the implementation process of parameter adjustment using DDQN algorithm is described. By building two neural networks, the main network is used to determine the action to be performed, and the target network is used to determine the action value, so as to realize the adaptive adjustment of the control parameters. Finally, the effectiveness of the proposed method is verified by simulation experiments.
引用
收藏
页码:1503 / 1507
页数:5
相关论文
共 50 条
  • [21] Hypersonic vehicle attitude control based on new fast terminal sliding mode
    Liu, Yuchao
    Guo, Jianguo
    Zhou, Jun
    Wang, Guoqing
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2015, 36 (07): : 2372 - 2380
  • [22] Robust adaptive dynamic programming based attitude tracking control for hypersonic vehicle
    Du, Xiangyu
    Qin, Tong
    Tang, Yunqing
    Liu, Lei
    Wang, Bo
    Fan, Huijin
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 5162 - 5167
  • [23] Attitude control for hypersonic vehicle with compound actuators based on adaptive dynamic inversion
    Di, X.-G. (dixiaoguang@hit.edu.cn), 1600, China Spaceflight Society (34):
  • [24] Active Defence Guidance for Hypersonic Vehicle with Incomplete Information Based on Reinforcement Learning
    Ni, Weilin
    Qiu, Peihuan
    Lu, Baogang
    Chen, Anhong
    Liang, Haizhao
    PROCEEDINGS OF THE 2024 3RD INTERNATIONAL SYMPOSIUM ON INTELLIGENT UNMANNED SYSTEMS AND ARTIFICIAL INTELLIGENCE, SIUSAI 2024, 2024, : 274 - 281
  • [25] Second-order sliding mode attitude control based on fuzzy control for hypersonic vehicle
    Guan P.
    He Z.-W.
    Ge X.-S.
    Kongzhi yu Juece/Control and Decision, 2019, 34 (09): : 1901 - 1908
  • [26] Attitude tracking control of hypersonic vehicle based on an improved prescribed performance dynamic surface control
    Yin, Z. Y.
    Wang, B.
    Xiong, R. T.
    Xiang, Z.
    Liu, L.
    Fan, H. J.
    Xue, C. L.
    AERONAUTICAL JOURNAL, 2024, 128 (1323): : 875 - 895
  • [27] Longitudinal Attitude Control of a Hypersonic Vehicle with Angle of Attack Constraints
    Zhang Zhikai
    Duan Guangren
    Hou Mingzhe
    2015 10TH ASIAN CONTROL CONFERENCE (ASCC), 2015,
  • [28] Statistical erformance Analysis of Hypersonic Vehicle Attitude Control System
    Jiang Ruimin
    Guo Jianguo
    2018 3RD INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTICS ENGINEERING (ICCRE), 2018, : 56 - 59
  • [29] Fuzzy dynamic characteristic model based attitude control of hypersonic vehicle in gliding phase
    Xiong Luo
    Jiang Li
    Science China Information Sciences, 2011, 54 : 448 - 459
  • [30] Attitude control synthesis of unstable hypersonic vehicle with aeroservoelastic effect
    Piao M.
    Yang Z.
    Sun M.
    Huang J.
    Chen Z.
    Zhongguo Kexue Jishu Kexue/Scientia Sinica Technologica, 2019, 49 (07): : 825 - 839