WPT-enabled UAV Trajectory Design for Healthcare Delivery Using Reinforcement Learning

被引:2
作者
Merabet, Adel [1 ]
Lakas, Abderrahmane [1 ]
Belkacem, Abdelkader Nasreddine [1 ]
机构
[1] UAE Univ, Coll IT, Dept Comp & Netw Engn, Al Ain, U Arab Emirates
来源
2022 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC | 2022年
关键词
unmanned aerial vehicle; drone; reinforcement learning; wireless power transfer; simulation; healthcare; delivery;
D O I
10.1109/IWCMC55113.2022.9824768
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Over the last few years, the use of unmanned aerial vehicles (UAVs) has grown, with the goal of being widely deployed in sectors such as deliveries, rescue operations, mining fields, patrolling, and monitoring. However, the limitations of the onboard battery capacity and the flying range pose a problem to most applications while performing daily tasks such as parcel delivery or aerial communications in large areas. This paper proposes a reinforcement learning method to compute optimal trajectories for a UAV, considering both visiting delivery locations and recharging stations. The use of wireless power transfer (WPT) technology allows UAVs to wirelessly recharge their batteries on the fly and therefore to extend their flying range further. In this scenario, we consider several WPT-enabled charging stations placed around the serviced area. The proposed approach leverages a reinforcement learning strategy, and the performance results obtained show its effectiveness in finding an optimal trajectory by minimizing the UAV's travel and service time.
引用
收藏
页码:271 / 277
页数:7
相关论文
共 10 条
[1]   Review of Communication Technologies for Electric Vehicle Charging Management and Coordination [J].
ElGhanam, Eiman ;
Hassan, Mohamed ;
Osman, Ahmed ;
Ahmed, Ibtihal .
WORLD ELECTRIC VEHICLE JOURNAL, 2021, 12 (03)
[2]   A reinforcement learning approach for optimizing multiple traveling salesman problems over graphs [J].
Hu, Yujiao ;
Yao, Yuan ;
Lee, Wee Sun .
KNOWLEDGE-BASED SYSTEMS, 2020, 204
[3]   UAV Trajectory Design Based on Reinforcement Learning for Wireless Power Transfer [J].
Ku, Sungmo ;
Jung, Sangwon ;
Lee, Chungyoung .
2019 34TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2019), 2019, :553-555
[4]  
Maei H, 2009, ADV NEURAL INFORM PR, V22
[5]  
Maei H. R., 2010, ICML 2010
[6]   The flying sidekick traveling salesman problem: Optimization of drone-assisted parcel delivery [J].
Murray, Chase C. ;
Chu, Amanda G. .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2015, 54 :86-109
[7]   Design and Implementation of Shaped Magnetic-Resonance-Based Wireless Power Transfer System for Roadway-Powered Moving Electric Vehicles [J].
Shin, Jaegue ;
Shin, Seungyong ;
Kim, Yangsu ;
Ahn, Seungyoung ;
Lee, Seokhwan ;
Jung, Guho ;
Jeon, Seong-Jeub ;
Cho, Dong-Ho .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2014, 61 (03) :1179-1192
[8]   Investigation in wireless power transmission for UAV charging [J].
Simic, Milan ;
Bil, Cees ;
Vojisavljevic, Vuk .
KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS 19TH ANNUAL CONFERENCE, KES-2015, 2015, 60 :1846-1855
[9]  
Vilathgamuwa D.M., 2015, Plug in electric vehicles in smart grids, P33, DOI DOI 10.1007/978-981-287-299-92
[10]   UAV-Enabled Wireless Power Transfer: Trajectory Design and Energy Optimization [J].
Xu, Jie ;
Zeng, Yong ;
Zhang, Rui .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (08) :5092-5106