Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation

被引:0
|
作者
Estevez, Julian [1 ]
Manuel Lopez-Guede, Jose [2 ]
del Valle-Echavarri, Javier [2 ]
Grana, Manuel [3 ]
机构
[1] Univ Basque Country UPV EHU, Fac Engn Gipuzkoa, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
[2] Univ Basque Country, Fac Engn Vitoria, Grp Computat Intelligence, Vitoria 01006, Spain
[3] Univ Basque Country, Fac Comp Sci, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Aerial robots; payload; reinforcement learning; UAVs; QUADROTOR;
D O I
10.1109/ACCESS.2024.3470509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study introduces a novel trajectory planning approach for the transportation of cable-suspended loads employing three quadrotors, relying on a reinforcement learning (RL) algorithm. The primary objective of this path planning method is to transport the cargo smoothly while avoiding its swing. Within this proposed solution, the value function of the RL is estimated through a feature vector and a parameter vector tailored to the specific problem. The parameter vector undergoes iterative updates via a batch method, subsequently guiding the generation of the desired trajectory through a greedy strategy. Ultimately, this desired trajectory is communicated to the quadrotor controller to ensure precise trajectory tracking. Simulation outcomes demonstrate the capability of the trained parameters to effectively fit the value function.
引用
收藏
页码:144009 / 144016
页数:8
相关论文
共 50 条
  • [31] Multi-UAV Assisted Network Coverage Optimization for Rescue Operations using Reinforcement Learning
    Oubbati, Omar Sami
    Badis, Hakim
    Rachedi, Abderrezak
    Lakas, Abderrahmane
    Lorenz, Pascal
    2023 IEEE 20TH CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2023,
  • [32] Reinforcement-Learning-Based Multi-UAV Cooperative Search for Moving Targets in 3D Scenarios
    Liu, Yifei
    Li, Xiaoshuai
    Wang, Jian
    Wei, Feiyu
    Yang, Junan
    DRONES, 2024, 8 (08)
  • [33] QoE-Driven Adaptive Deployment Strategy of Multi-UAV Networks Based on Hybrid Deep Reinforcement Learning
    Zhou, Yi
    Ma, Xiaoyong
    Hu, Shuting
    Zhou, Danyang
    Cheng, Nan
    Lu, Ning
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (08) : 5868 - 5881
  • [34] Extrinsic-and-Intrinsic Reward-Based Multi-Agent Reinforcement Learning for Multi-UAV Cooperative Target Encirclement
    Chen, Jinchao
    Wang, Yang
    Zhang, Ying
    Lu, Yantao
    Shu, Qiuhao
    Hu, Yujiao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025,
  • [35] Multi-UAV Formation Maneuvering Control Based on Q-Learning Fuzzy Controller
    Rui, Pang
    2ND IEEE INTERNATIONAL CONFERENCE ON ADVANCED COMPUTER CONTROL (ICACC 2010), VOL. 4, 2010, : 252 - 257
  • [36] The Game of Drones: rapid agent-based machine-learning models for multi-UAV path planning
    Zohdi, T. I.
    COMPUTATIONAL MECHANICS, 2020, 65 (01) : 217 - 228
  • [37] UAV Trajectory Design Based on Reinforcement Learning for Wireless Power Transfer
    Ku, Sungmo
    Jung, Sangwon
    Lee, Chungyoung
    2019 34TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2019), 2019, : 553 - 555
  • [38] A hierarchical reinforcement learning framework for multi-UAV combat using leader-follower strategy
    Pang, Jinhui
    He, Jinglin
    Mohamed, Noureldin Mohamed Abdelaal Ahmed
    Lin, Changqing
    Zhang, Zhihui
    Hao, Xiaoshuai
    KNOWLEDGE-BASED SYSTEMS, 2025, 316
  • [39] A Deep Reinforcement Learning Method for Collision Avoidance with Dense Speed-Constrained Multi-UAV
    Han, Jiale
    Zhu, Yi
    Yang, Jian
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (03): : 2152 - 2159
  • [40] Deep Reinforcement Learning for Flocking Motion of Multi-UAV Systems: Learn From a Digital Twin
    Shen, Gaoqing
    Lei, Lei
    Li, Zhilin
    Cai, Shengsuo
    Zhang, Lijuan
    Cao, Pan
    Liu, Xiaojiao
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (13): : 11141 - 11153