Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation

被引:0
|
作者
Estevez, Julian [1 ]
Manuel Lopez-Guede, Jose [2 ]
del Valle-Echavarri, Javier [2 ]
Grana, Manuel [3 ]
机构
[1] Univ Basque Country UPV EHU, Fac Engn Gipuzkoa, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
[2] Univ Basque Country, Fac Engn Vitoria, Grp Computat Intelligence, Vitoria 01006, Spain
[3] Univ Basque Country, Fac Comp Sci, Grp Computat Intelligence, Donostia San Sebastian 20018, Spain
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Aerial robots; payload; reinforcement learning; UAVs; QUADROTOR;
D O I
10.1109/ACCESS.2024.3470509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This study introduces a novel trajectory planning approach for the transportation of cable-suspended loads employing three quadrotors, relying on a reinforcement learning (RL) algorithm. The primary objective of this path planning method is to transport the cargo smoothly while avoiding its swing. Within this proposed solution, the value function of the RL is estimated through a feature vector and a parameter vector tailored to the specific problem. The parameter vector undergoes iterative updates via a batch method, subsequently guiding the generation of the desired trajectory through a greedy strategy. Ultimately, this desired trajectory is communicated to the quadrotor controller to ensure precise trajectory tracking. Simulation outcomes demonstrate the capability of the trained parameters to effectively fit the value function.
引用
收藏
页码:144009 / 144016
页数:8
相关论文
共 50 条
  • [41] The Game of Drones: rapid agent-based machine-learning models for multi-UAV path planning
    T. I. Zohdi
    Computational Mechanics, 2020, 65 : 217 - 228
  • [42] Learning-Based Multi-UAV Flocking Control With Limited Visual Field and Instinctive Repulsion
    Bai, Chengchao
    Yan, Peng
    Piao, Haiyin
    Pan, Wei
    Guo, Jifeng
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (01) : 462 - 475
  • [43] Computation Offloading and Trajectory Planning of Multi-UAV-Enabled MEC: A Knowledge-Assisted Multiagent Reinforcement Learning Approach
    Li, Xulong
    Qin, Yunhui
    Huo, Jiahao
    Wei, Huangfu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 7077 - 7088
  • [44] Multi-UAV Path Planning in GPS and Communication Denial Environment
    Xu, Yahao
    Wei, Yiran
    Wang, Di
    Jiang, Keyang
    Deng, Hongbin
    SENSORS, 2023, 23 (06)
  • [45] Novel Reinforcement Learning Guided Enhanced Variable Weight Grey Wolf Optimization (RLV-GWO) Algorithm for Multi-UAV Path Planning
    Kumar, Rajeev
    Singh, Laxman
    Tiwari, Rajdev
    WIRELESS PERSONAL COMMUNICATIONS, 2023, 131 (03) : 2093 - 2123
  • [46] Novel Reinforcement Learning Guided Enhanced Variable Weight Grey Wolf Optimization (RLV-GWO) Algorithm for Multi-UAV Path Planning
    Rajeev Kumar
    Laxman Singh
    Rajdev Tiwari
    Wireless Personal Communications, 2023, 131 : 2093 - 2123
  • [47] Frequency-aware Trajectory and Power Control for Multi-UAV Systems
    Ma, Jason
    Ostertag, Michael H.
    Bharadia, Dinesh
    Rosing, Tajana S.
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [48] Reinforcement Learning Based Dual-UAV Trajectory Optimization for Secure Communication
    Qian, Zhouyi
    Deng, Zhixiang
    Cai, Changchun
    Li, Haochen
    ELECTRONICS, 2023, 12 (09)
  • [49] Research on Multi UAV Algorithm Based on Evolutionary Reinforcement Learning
    Huang, Jingyi
    Cui, Yujie
    Wu, Shuying
    Yang, Ziyi
    Li, Bo
    Wang, Geng
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT II, 2025, 15202 : 447 - 459
  • [50] The Algorithm for UAV Obstacle Avoidance and Route Planning Based on Reinforcement Learning
    Liu, Jiantong
    Wang, Zhengjie
    Zhang, Zhide
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC2019), 2020, 582 : 747 - 754