Trajectory tracking control of an unmanned aerial vehicle with deep reinforcement learning for tasks inside the EAST

被引:3
作者
Yu, Chao [1 ,2 ]
Yang, Yang [1 ]
Cheng, Yong [1 ]
Wang, Zheng [3 ]
Shi, Mingming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Plasma Phys, Hefei Inst Phys Sci, Hefei 230031, Peoples R China
[2] Univ Sci & Technol China, Hefei 230026, Peoples R China
[3] Hefei Univ Technol, Hefei, Peoples R China
关键词
EAST; UAV; Trajectory tracking; Remote handling; Deep reinforcement learning; CONCEPTUAL DESIGN; DEPLOYER;
D O I
10.1016/j.fusengdes.2023.113894
中图分类号
TL [原子能技术]; O571 [原子核物理学];
学科分类号
0827 ; 082701 ;
摘要
The robotic arms inside the EAST (Experimental Advanced Superconducting Tokamak) are bulky and slow, making them unable to efficiently complete remote handling tasks such as inspection and grasping. Miniature intelligent UAVs have the potential to assist in remote handling tasks. A key challenge is to achieve autonomous flight along a set trajectory within the EAST's vacuum vessel. This paper presents an autonomous UAV system with deep reinforcement learning for this purpose. The autonomous flight of a quadrotor UAV within the EAST was simulated using OpenAI Gym-style environment. To verify that the trained policy is transferable, we experimentally verified the trajectory tracking of UAVs along specific trajectories in real scenarios. The results show that our autonomous UAV system can complete trajectory-tracking flight tasks inside the EAST vacuum vessel.
引用
收藏
页数:10
相关论文
共 50 条
[21]   Deep Reinforcement Learning Based Dynamic Time Slot Allocation in Unmanned Aerial Vehicle [J].
Fan, Jiao ;
Xu, Dongyang ;
Zhang, Tiantian ;
Mumtaz, Rao ;
Yu, Keping .
ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, :1310-1315
[22]   Unmanned Aerial Vehicle Pitch Control Using Deep Reinforcement Learning with Discrete Actions in Wind Tunnel Test [J].
Wada, Daichi ;
Araujo-Estrada, Sergio A. ;
Windsor, Shane .
AEROSPACE, 2021, 8 (01) :1-16
[23]   Deep Reinforcement Learning for Autonomous Dynamic Skid Steer Vehicle Trajectory Tracking [J].
Srikonda, Sandeep ;
Norris, William Robert ;
Nottage, Dustin ;
Soylemezoglu, Ahmet .
ROBOTICS, 2022, 11 (05)
[24]   Sliding Mode Control for Fast & Accurate Trajectory Tracking in an Unconventional Micro Unmanned Aerial Vehicle [J].
Lim, Andre ;
Cheng, Xiang ;
Lin, Feng .
2020 IEEE 16TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION (ICCA), 2020, :47-52
[25]   Robust Constrained Trajectory Tracking Control for Quadrotor Unmanned Aerial Vehicle Based on Disturbance Observers [J].
Zhu, Bing ;
Chen, Mou ;
Li, Tao .
JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2020, 142 (11)
[26]   Trajectory Tracking of Quadrotor Unmanned Aerial Vehicle Based on Adaptive Backstepping Sliding Mode Control [J].
Li, Jihan ;
Zhang, Chunyu ;
Li, Boqun ;
Zhang, Jin .
PROCEEDINGS OF THE 36TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC 2024, 2024, :3619-3624
[27]   Interval Observer-based Robust Trajectory Tracking Control for Quadrotor Unmanned Aerial Vehicle [J].
Kun Yan ;
Jing-Rong Zhang ;
Hai-Peng Ren .
International Journal of Control, Automation and Systems, 2024, 22 :288-300
[28]   Monte Carlo-based reinforcement learning control for unmanned aerial vehicle systems [J].
Wei, Qinglai ;
Yang, Zesheng ;
Su, Huaizhong ;
Wang, Lijian .
NEUROCOMPUTING, 2022, 507 :282-291
[29]   A Quadrotor Trajectory Tracking Control Method Based on Deep Reinforcement Learning [J].
Wu, Guohua ;
Zeng, Jiaheng ;
Wang, Dezhi ;
Zheng, Long ;
Zou, Wei .
Xitong Fangzhen Xuebao / Journal of System Simulation, 2025, 37 (05) :1169-1187
[30]   Dual Deep Neural Networks for Improving Trajectory Tracking Control of Unmanned Surface Vehicle [J].
Sun, Wenli ;
Gao, Xu ;
Yu, Yanli .
2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, :3441-3446