Cooperative Multi-Agent Planning Framework for Fuel Constrained UAV-UGV Routing Problem

被引:0
作者
Mondal, Md Safwan [1 ]
Ramasamy, Subramanian [1 ]
Humann, James D. [3 ]
Dotterweich, James M. [2 ]
Reddinger, Jean-Paul F. [2 ]
Childers, Marshal A. [2 ]
Bhounsule, Pranav A. [1 ]
机构
[1] Univ Illinois, Dept Mech & Ind Engn, Chicago, IL 60607 USA
[2] DEVCOM Army Res Lab, Aberdeen Proving Grounds, Aberdeen, MD 21005 USA
[3] DEVCOM Army Res Lab, Los Angeles, CA 90094 USA
关键词
Multi-agent planning; VRP; UAV; UGV; TRAVELING SALESMAN PROBLEM; UNMANNED-AERIAL-VEHICLE; PERSISTENT SURVEILLANCE; GROUND-VEHICLE; ALGORITHM;
D O I
10.1007/s10846-024-02209-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned Aerial Vehicles (UAVs), adept at aerial surveillance, are often constrained by their limited battery capacity. Refueling on slow-moving Unmanned Ground Vehicles (UGVs) can significantly enhance UAVs' operational endurance. This paper explores the computationally complex problem of cooperative UAV-UGV routing for vast area surveillance, considering speed and fuel constraints. It presents a sequential multi-agent planning framework aimed at achieving feasible and optimally satisfactory solutions. By considering the UAV fuel limit and utilizing a minimum set cover algorithm, we determine UGV refueling stops. This, in turn, facilitates UGV route planning as the first step. Through a task allocation technique and energy-constrained vehicle routing problem modeling with time windows (E-VRPTW), we then achieve the UAV route in the second step of the framework. The effectiveness of our multi-agent strategy is demonstrated through the implementation on 30 different task scenarios across three different scales. This work provides significant insight into the collaborative advantages of UAV-UGV systems and introduces heuristic approaches to bypass computational challenges and swiftly reach high-quality solutions.
引用
收藏
页数:17
相关论文
共 48 条
[41]   A Framework for Multi-Agent UAV Exploration and Target-Finding in GPS-Denied and Partially Observable Environments [J].
Walker, Ory ;
Vanegas, Fernando ;
Gonzalez, Felipe .
SENSORS, 2020, 20 (17) :1-23
[42]   Sequence-to-Sequence Multi-Agent Reinforcement Learning for Multi-UAV Task Planning in 3D Dynamic Environment [J].
Liu, Ziwei ;
Qiu, Changzhen ;
Zhang, Zhiyong .
APPLIED SCIENCES-BASEL, 2022, 12 (23)
[43]   Multi-Agent Deep Reinforcement Learning-Based Multi-UAV Path Planning for Wireless Data Collection and Energy Transfer [J].
Lee, Chungnyeong ;
Lee, Sangcheol ;
Kim, Taehoon ;
Bang, Inkyu ;
Lee, Jung Hoon ;
Chae, Seong Ho .
2024 FIFTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS, ICUFN 2024, 2024, :500-504
[44]   Multi-UAV Cooperative Air Combat Decision-Making Based on Multi-Agent Double-Soft Actor-Critic [J].
Li, Shaowei ;
Wang, Yongchao ;
Zhou, Yaoming ;
Jia, Yuhong ;
Shi, Hanyue ;
Yang, Fan ;
Zhang, Chaoyue .
AEROSPACE, 2023, 10 (07)
[45]   STRATEGIC DOMINANCE AND DYNAMIC PROGRAMMING FOR MULTI-AGENT PLANNING Application to the Multi-Robot Box-pushing Problem [J].
Hamila, Mohamed Amine ;
Grislin-Le Strugeon, Emmanuelle ;
Mandiau, Rene ;
Mouaddib, Abdel-Illah .
ICAART: PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL. 2, 2012, :91-97
[46]   Research on AGV path planning in flexible job-shop scheduling problem based on multi-agent deep Q network [J].
Yuan, Minghai ;
Lu, Songwei ;
Zheng, Liang ;
Yu, Qi ;
Pei, Fengque ;
Gu, Wenbin .
INTELLIGENT SERVICE ROBOTICS, 2025, 18 (03) :709-722
[47]   Optimization of the distance-constrained multi-based multi-UAV routing problem with simulated annealing and local search-based matheuristic to detect forest fires: The case of Turkey [J].
Ozkan, Omer .
APPLIED SOFT COMPUTING, 2021, 113
[48]   A Multi-agent Cooperative Planning Method for the Distributed Hydrogen Supply Network and the Power Distribution Network Considering the Flexible Interconnections Between On-site and Off-site Hydrogen Refueling Stations [J].
Xia, Weiyi ;
Ren, Zhouyang ;
Pan, Zhen .
Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2024, 44 (23) :9187-9199