A novel guidance law based on proximal policy optimization

被引:0
作者
Jiang, Yang [1 ]
Yu, Jianglong [1 ]
Li, Qingdong [1 ]
Ren, Zhang [1 ]
Done, Xiwang [1 ,2 ]
Hua, Yongzhao [1 ,2 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Sci & Technol Aircraft Control Lab, Beijing 100191, Peoples R China
[2] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
来源
2022 41ST CHINESE CONTROL CONFERENCE (CCC) | 2022年
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
reinforcement learning; proximal policy optimization; high-speed maneuvering target; SLIDING-MODE CONTROL;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a new guidance law based on deep reinforcement learning is proposed for the high-speed maneuvering target attack problem. Firstly, the missile-target kinematic model is established, and the action space and state space of reinforcement learning are designed. Then, according to the missile strike process, the reward function suitable for this scenario is proposed. The proximal policy optimization (PPO) based guidance law construction is completed. Finally, the strike effect in multiple sets of experiments verifies the effectiveness of the method proposed in this paper.
引用
收藏
页码:3364 / 3369
页数:6
相关论文
共 50 条
[41]   Entropy adjustment by interpolation for exploration in Proximal Policy Optimization (PPO) [J].
Boudlal, Ayoub ;
Khafaji, Abderahim ;
Elabbadi, Jamal .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
[42]   An Empirical Investigation of Early Stopping Optimizations in Proximal Policy Optimization [J].
Dossa, Rousslan Fernand Julien ;
Huang, Shengyi ;
Ontanon, Santiago ;
Matsubara, Takashi .
IEEE ACCESS, 2021, 9 :117981-117992
[43]   ROBOTIC ARM TRAJECTORY TRACKING METHOD BASED ON IMPROVED PROXIMAL POLICY OPTIMIZATION [J].
Zheng, Qingchun ;
Peng, Zhi ;
Zhu, Peihao ;
Zhao, Yangyang ;
Ma, Wenpeng .
PROCEEDINGS OF THE ROMANIAN ACADEMY SERIES A-MATHEMATICS PHYSICS TECHNICAL SCIENCES INFORMATION SCIENCE, 2023, 24 (03) :235-244
[44]   Optimal Control Algorithm for Subway Train Operation by Proximal Policy Optimization [J].
Chen, Bin ;
Gao, Chunhai ;
Zhang, Lei ;
Chen, Junjie ;
Chen, Jun ;
Li, Yuyi .
APPLIED SCIENCES-BASEL, 2023, 13 (13)
[45]   Intelligent anti-jamming decision algorithm based on proximal policy optimization [J].
Ma, Song ;
Li, Li ;
Li, Wei ;
Huang, Wei ;
Wang, Jun .
Tongxin Xuebao/Journal on Communications, 2024, 45 (08) :249-257
[46]   Dynamic Deployment of DNN Inference Tasks Based on Distributed Proximal Policy Optimization [J].
He, Wenchen ;
Li, Yitao ;
Wang, Liqiang .
COMPUTER NETWORKS AND IOT, PT 3, IAIC 2023, 2024, 2060 :133-143
[47]   Autonomous Driving Decision Control Based on Improved Proximal Policy Optimization Algorithm [J].
Song, Qingpeng ;
Liu, Yuansheng ;
Lu, Ming ;
Zhang, Jun ;
Qi, Han ;
Wang, Ziyu ;
Liu, Zijian .
APPLIED SCIENCES-BASEL, 2023, 13 (11)
[48]   Evaluation of Proximal Policy Optimization with Extensions in Virtual Environments of Various Complexity [J].
Rauch, Robert ;
Korecko, Stefan ;
Gazda, Juraj .
2022 32ND INTERNATIONAL CONFERENCE RADIOELEKTRONIKA (RADIOELEKTRONIKA), 2022, :251-255
[49]   Anti-Martingale Proximal Policy Optimization [J].
Gu, Yang ;
Cheng, Yuhu ;
Yu, Kun ;
Wang, Xuesong .
IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (10) :6421-6432
[50]   Proximal Policy Optimization with Mixed Distributed Training [J].
Zhang, Zhenyu ;
Luo, Xiangfeng ;
Liu, Tong ;
Xie, Shaorong ;
Wang, Jianshu ;
Wang, Wei ;
Li, Yang ;
Peng, Yan .
2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, :1452-1456