Multi-Agent Deep Reinforcement Learning-Based Multi-UAV Path Planning for Wireless Data Collection and Energy Transfer

被引:1
作者
Lee, Chungnyeong [1 ]
Lee, Sangcheol [1 ]
Kim, Taehoon [2 ]
Bang, Inkyu [3 ]
Lee, Jung Hoon [4 ]
Chae, Seong Ho [5 ]
机构
[1] Tech Univ Korea, Dept IT Semicond Convergence Engn, Shihung, South Korea
[2] Hanbat Natl Univ, Dept Comp Engn, Daejeon, South Korea
[3] Hanbat Natl Univ, Dept Intelligence Media Engn, Daejeon, South Korea
[4] Hankuk Univ Foreign Studies, Dept Elect Engn & Appl Commun Res Ctr, Seoul, South Korea
[5] Tech Univ Korea, Dept Elect Engn, Shihung, South Korea
来源
2024 FIFTEENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS, ICUFN 2024 | 2024年
关键词
Age of information; data collection; multi-agent deep reinforcement learning; trajectory planning; unmanned aerial vehicle;
D O I
10.1109/ICUFN61752.2024.10625275
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose the wireless energy transfer and data collection system for multi-unmanned aerial vehicles (UAVs). This system enables multiple UAVs to transfer energy to and collect data from internet of things (IoT) devices, and to recharge their batteries at a central charging station when their batteries are low. In this paper, we propose a multi-UAV path algorithm based on distributed multi-agent deep Q-network (MADQN) to minimize the overall age-of-information (AoI) of IoT devices. The numerical results demonstrate that our proposed algorithm outperforms the benchmark scheme in terms of AoI enables to prolong data collection by continuously charging the battery of both IoT devices and UAVs.
引用
收藏
页码:500 / 504
页数:5
相关论文
共 10 条
[1]   A Comprehensive Survey on 5G-and-Beyond Networks With UAVs: Applications, Emerging Technologies, Regulatory Aspects, Research Trends and Challenges [J].
Banafaa, Mohammed Khaled ;
Pepeoglu, Oemer ;
Shayea, Ibraheem ;
Alhammadi, Abdulraqeb ;
Shamsan, Zaid Ahmed ;
Razaz, Muneef A. ;
Alsagabi, Majid ;
Al-Sowayan, Sulaiman .
IEEE ACCESS, 2024, 12 :7786-7826
[2]   Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement Learning [J].
Bayerlein, Harald ;
Theile, Mirco ;
Caccamo, Marco ;
Gesbert, David .
IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2021, 2 :1171-1187
[3]   AI for UAV-Assisted IoT Applications: A Comprehensive Review [J].
Cheng, Nan ;
Wu, Shen ;
Wang, Xiucheng ;
Yin, Zhisheng ;
Li, Changle ;
Chen, Wen ;
Chen, Fangjiong .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (16) :14438-14461
[4]   Optimal Frequency Reuse and Power Control in Multi-UAV Wireless Networks: Hierarchical Multi-Agent Reinforcement Learning Perspective [J].
Lee, Seungmin ;
Lim, Suhyeon ;
Chae, Seong Ho ;
Jung, Bang Chul ;
Park, Chan Yi ;
Lee, Howon .
IEEE ACCESS, 2022, 10 :39555-39565
[5]   RE-ORA: Residual Energy-Aware Online Random Access for Improving the Lifetime of Slotted ALOHA-Based Swarming Drone Networks [J].
Lim, Suhyeon ;
Chae, Seong Ho ;
Lee, Howon .
IEEE ACCESS, 2021, 9 :45504-45511
[6]   Synchronizing UAV Teams for Timely Data Collection and Energy Transfer by Deep Reinforcement Learning [J].
Oubbati, Omar Sami ;
Atiquzzaman, Mohammed ;
Lim, Hyotaek ;
Rachedi, Abderrezak ;
Lakas, Abderrahmane .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (06) :6682-6697
[7]   AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Reinforcement Learning Method [J].
Sun, Mengying ;
Xu, Xiaodong ;
Qin, Xiaoqi ;
Zhang, Ping .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (24) :17275-17289
[8]  
van Hasselt H, 2016, AAAI CONF ARTIF INTE, P2094
[9]   Energy Efficient UAV Communication With Energy Harvesting [J].
Yang, Zhaohui ;
Xu, Wei ;
Shikh-Bahaei, Mohammad .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (02) :1913-1927
[10]   Massive MIMO Downlink for Wireless Information and Energy Transfer With Energy Harvesting Receivers [J].
Zhao, Long ;
Wang, Xiaodong .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (05) :3309-3322