Attitude Control of Hypersonic Vehicle based on Reinforcement Learning

被引:0
|
作者
Liu, Jingwen [1 ]
Fan, Hongdong [1 ]
Fan, Yonghua [2 ]
Cai, Guangbin [1 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Northwestern Polytech Univ, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
hypersonic vehicle; intelligent control; attitude control; DDQN;
D O I
10.1109/FASTA61401.2024.10595336
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, the attitude control problem of hypersonic vehicle is studied. The DDQN (double deep Q network) algorithm is used to realize the online adaptive adjustment of the control parameters of the PID (proportional-integral-derivative) controller. Firstly, the dynamic model of hypersonic vehicle is established. Then, the implementation process of parameter adjustment using DDQN algorithm is described. By building two neural networks, the main network is used to determine the action to be performed, and the target network is used to determine the action value, so as to realize the adaptive adjustment of the control parameters. Finally, the effectiveness of the proposed method is verified by simulation experiments.
引用
收藏
页码:1503 / 1507
页数:5
相关论文
共 50 条
  • [31] Direct parametric attitude tracking control for generic hypersonic vehicle
    Liu, Wangkui
    Duan, Guangren
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2018, 49 (07) : 1507 - 1517
  • [32] Fuzzy dynamic characteristic model based attitude control of hypersonic vehicle in gliding phase
    LUO Xiong 1
    2 National Laboratory of Space Intelligent Control
    Science China(Information Sciences), 2011, 54 (03) : 448 - 459
  • [33] Fuzzy dynamic characteristic model based attitude control of hypersonic vehicle in gliding phase
    Luo Xiong
    Li Jiang
    SCIENCE CHINA-INFORMATION SCIENCES, 2011, 54 (03) : 448 - 459
  • [34] Attitude Coupling Control and Lateral Stability Analysis of Hypersonic Vehicle
    Li, Xu
    Yang, Ye
    He, Qianwei
    Cheng, Zhongtao
    Wang, Yongji
    Liu, Lei
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 3764 - 3769
  • [35] Backstepping attitude control for hypersonic gliding vehicle based on a robust dynamic inversion approach
    Liu, Xiaodong
    Zhang, Yu
    Wang, Sen
    Huang, Wanwei
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART I-JOURNAL OF SYSTEMS AND CONTROL ENGINEERING, 2014, 228 (08) : 543 - 552
  • [36] Reinforcement Learning for UAV Attitude Control
    Koch, William
    Mancuso, Renato
    West, Richard
    Bestavros, Azer
    ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS, 2019, 3 (02)
  • [37] Decoupling Attitude Control of a Hypersonic Glide Vehicle Based on a Nonlinear Extended State Observer
    Chen, Jian
    Du, Nannan
    Han, Yu
    INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2020, 2020
  • [38] Satellite attitude control method based on deep reinforcement learning
    Wang Yuejiao
    Ma Zhong
    Yang Yidai
    Wang Zhuping
    Tang Lei
    CHINESE SPACE SCIENCE AND TECHNOLOGY, 2019, 39 (04) : 36 - 42
  • [39] Barrier Lyapunov function based reinforcement learning control for air-breathing hypersonic vehicle with variable geometry inlet
    Liu, Chen
    Dong, Chaoyang
    Zhou, Zhijie
    Wang, Zhaolei
    AEROSPACE SCIENCE AND TECHNOLOGY, 2020, 96
  • [40] Fixed-time convergence attitude control for a tilt trirotor unmanned aerial vehicle based on reinforcement learning
    Xie, Tian
    Xian, Bin
    Gu, Xu
    ISA TRANSACTIONS, 2023, 132 : 477 - 489