Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation

被引:0
|
作者
Estevez, Julian [1 ]
Manuel Lopez-Guede, Jose [2 ]
del Valle-Echavarri, Javier [2 ]
Grana, Manuel [3 ]
机构
[1] Univ Basque Country UPV EHU, Fac Engn Gipuzkoa, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
[2] Univ Basque Country, Fac Engn Vitoria, Grp Computat Intelligence, Vitoria 01006, Spain
[3] Univ Basque Country, Fac Comp Sci, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Aerial robots; payload; reinforcement learning; UAVs; QUADROTOR;
D O I
10.1109/ACCESS.2024.3470509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study introduces a novel trajectory planning approach for the transportation of cable-suspended loads employing three quadrotors, relying on a reinforcement learning (RL) algorithm. The primary objective of this path planning method is to transport the cargo smoothly while avoiding its swing. Within this proposed solution, the value function of the RL is estimated through a feature vector and a parameter vector tailored to the specific problem. The parameter vector undergoes iterative updates via a batch method, subsequently guiding the generation of the desired trajectory through a greedy strategy. Ultimately, this desired trajectory is communicated to the quadrotor controller to ensure precise trajectory tracking. Simulation outcomes demonstrate the capability of the trained parameters to effectively fit the value function.
引用
收藏
页码:144009 / 144016
页数:8
相关论文
共 50 条
  • [11] Multi-UAV trajectory optimizer: A sustainable system for wireless data harvesting with deep reinforcement learning
    Seong, Mincheol
    Jo, Ohyun
    Shin, Kyungseop
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [12] Reinforcement Learning based Approach for Multi-UAV Cooperative Searching in Unknown Environments
    Yue, Wei
    Guan, Xianhe
    Xi, Yun
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2018 - 2023
  • [13] Transformer-Based Reinforcement Learning for Scalable Multi-UAV Area Coverage
    Chen, Dezhi
    Qi, Qi
    Fu, Qianlong
    Wang, Jingyu
    Liao, Jianxin
    Han, Zhu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 10062 - 10077
  • [14] Optimal formation tracking control based on reinforcement learning for multi-UAV systems
    Wang, Weizhen
    Chen, Xin
    Jia, Jiangbo
    Wu, Kaili
    Xie, Mingyang
    CONTROL ENGINEERING PRACTICE, 2023, 141
  • [15] Multi-UAV Dynamic Wireless Networking With Deep Reinforcement Learning
    Wang, Qiang
    Zhang, Wenqi
    Liu, Yuanwei
    Liu, Ying
    IEEE COMMUNICATIONS LETTERS, 2019, 23 (12) : 2243 - 2246
  • [16] Collaborative Decision-Making Method for Multi-UAV Based on Multiagent Reinforcement Learning
    Li, Shaowei
    Jia, Yuhong
    Yang, Fan
    Qin, Qingyang
    Gao, Hui
    Zhou, Yaoming
    IEEE ACCESS, 2022, 10 : 91385 - 91396
  • [17] Multi-UAV Autonomous Path Planning in Reconnaissance Missions Considering Incomplete Information: A Reinforcement Learning Method
    Chen, Yu
    Dong, Qi
    Shang, Xiaozhou
    Wu, Zhenyu
    Wang, Jinyu
    DRONES, 2023, 7 (01)
  • [18] Multi-UAV Formation Transformation Based on Improved Heuristically-Accelerated Reinforcement Learning
    Xiao, Yanbing
    Zhang, Yingzhou
    Sun, Yuxin
    Qian, Junyan
    2019 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC), 2019, : 341 - 347
  • [19] Multi-UAV Reinforcement Learning for Data Collection in Cellular MIMO Networks
    Diaz-Vilor, Carles
    Abdelhady, Amr M.
    Eltawil, Ahmed M.
    Jafarkhani, Hamid
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (10) : 15462 - 15476
  • [20] Toward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches
    Bai, Yu
    Zhao, Hui
    Zhang, Xin
    Chang, Zheng
    Jantti, Riku
    Yang, Kun
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2023, 25 (04): : 3038 - 3067