Multi-UAV Reinforcement Learning for Data Collection in Cellular MIMO Networks

被引:0
|
作者
Diaz-Vilor, Carles [1 ]
Abdelhady, Amr M. [2 ]
Eltawil, Ahmed M. [2 ]
Jafarkhani, Hamid [1 ]
机构
[1] Univ Calif Irvine, Ctr Pervas Commun & Comp, Irvine, CA 92697 USA
[2] King Abdullah Univ Sci & Technol, Comp Elect & Math Sci & Engn Div, Thuwal 23955, Saudi Arabia
关键词
Autonomous aerial vehicles; Data collection; Interference; Internet of Things; Optimization; Trajectory optimization; Data models; UAV; trajectory; optimization; data collection; cellular; MIMO; reinforcement learning; TD3; WIRELESS SENSOR NETWORKS; ENERGY-EFFICIENT; TRAJECTORY OPTIMIZATION; NODE DEPLOYMENT; COMMUNICATION; DESIGN; INFORMATION; INTERNET; ANTENNAS; AGE;
D O I
10.1109/TWC.2024.3430228
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Uncrewed Aerial Vehicles (UAVs) provide a compelling solution for data collection in Internet of Things (IoT) networks due to their mobility and adaptability. However, the line-of-sight dominance in their channels may result in severe interference to ground users during UAV operations. To address this, we present an optimization framework that concurrently optimizes UAV trajectories and transmit powers. Our approach efficiently results in the collection of data from a variety of IoT sensors while (a) minimizing the UAVs flying time and (b) mitigating interference with terrestrial networks. Given the complex nature of such an optimization problem, this paper leverages reinforcement learning, specifically the twin delayed deep deterministic policy gradient algorithm, where a distributed learning algorithm is presented. Experimental results validate the efficacy of our proposed approach, demonstrating its capability to significantly enhance data collection in IoT networks while minimizing UAV flight time and interference with ground user links.
引用
收藏
页码:15462 / 15476
页数:15
相关论文
共 50 条
  • [31] A Method of Multi-UAV Cooperative Task Assignment Based on Reinforcement Learning
    Zhao, Xiaohu
    Jiang, Hanli
    An, Chenyang
    Wu, Ruocheng
    Guo, Yijun
    Yang, Daquan
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [32] Dynamic deployment of multi-UAV base stations with deep reinforcement learning
    Wu, Guanhan
    Jia, Weimin
    Zhao, Jianwei
    ELECTRONICS LETTERS, 2021, 57 (15) : 600 - 602
  • [33] Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning
    Westheider, Jonas
    Rueckin, Julius
    Popovic, Marija
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS, 2023, : 649 - 656
  • [34] Optimization Design of Multi-UAV Communication Network Based on Reinforcement Learning
    Cao, Zhengyang
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [35] Collision Detection and Avoidance for Multi-UAV based on Deep Reinforcement Learning
    Wang, Guanzheng
    Liu, Zhihong
    Xiao, Kun
    Xu, Yinbo
    Yang, Lingjie
    Wang, Xiangke
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7783 - 7789
  • [36] Reinforcement Learning Based Trajectory Planning for Multi-UAV Load Transportation
    Estevez, Julian
    Manuel Lopez-Guede, Jose
    del Valle-Echavarri, Javier
    Grana, Manuel
    IEEE ACCESS, 2024, 12 : 144009 - 144016
  • [37] Multi-UAV Cooperative Target Assignment Method Based on Reinforcement Learning
    Ding, Yunlong
    Kuang, Minchi
    Shi, Heng
    Gao, Jiazhan
    DRONES, 2024, 8 (10)
  • [38] Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking
    Moon, Jiseon
    Papaioannou, Savvas
    Laoudias, Christos
    Kolios, Panayiotis
    Kim, Sunwoo
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (20) : 15441 - 15455
  • [39] Accelerating Multi-UAV Collaborative Sensing Data Collection: A Hybrid TDMA-NOMA-Cooperative Transmission in Cell-Free MIMO Networks
    Park, Eunhyuk
    Kim, Junbeom
    Park, Seok-Hwan
    Simeone, Osvaldo
    Shitz, Shlomo Shamai
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (06): : 7086 - 7099
  • [40] Deep Reinforcement Learning for Multi-UAV Exploration Under Energy Constraints
    Zhou, Yating
    Shi, Dianxi
    Yang, Huanhuan
    Hu, Haomeng
    Yang, Shaowu
    Zhang, Yongjun
    COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING, COLLABORATECOM 2022, PT II, 2022, 461 : 363 - 379