A novel energy-efficiency framework for UAV-assisted networks using adaptive deep reinforcement learning

被引:2
|
作者
Seerangan, Koteeswaran [1 ]
Nandagopal, Malarvizhi [2 ]
Govindaraju, Tamilmani [3 ]
Manogaran, Nalini [4 ]
Balusamy, Balamurugan [5 ]
Selvarajan, Shitharth [6 ,7 ]
机构
[1] SA Engn Coll Autonomous, Dept CSE AI&ML, Chennai 600077, Tamil Nadu, India
[2] Vel Tech Rangarajan Dr Sagunthala R&D Inst Sci & T, Sch Comp, Dept CSE, Chennai 600062, Tamil Nadu, India
[3] SRM Inst Sci & Technol, Dept Computat Intelligence, Chennai 603203, Tamil Nadu, India
[4] SA Engn Coll Autonomous, Dept CSE, Chennai 600077, Tamil Nadu, India
[5] Shiv Nadar Inst Eminence Univ, Greater Noida 201314, Uttar Pradesh, India
[6] Kebri Dehar Univ, Dept Comp Sci, Kebri Dehar 250, Ethiopia
[7] Leeds Beckett Univ, Sch Built Environm Engn & Comp, Leeds LS6 3QS, England
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Unmanned aerial vehicles; Energy efficiency; Deep reinforcement learning; Novel loss function; Hybrid energy valley and hermit crab; DESIGN; IOT;
D O I
10.1038/s41598-024-71621-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the air-to-ground transmissions, the lifespan of the network is based on the "unmanned aerial vehicle's (UAV)" life span because of the limited battery capacity. Thus, the enhancement of energy efficiency and the outage of the ground candidate's minimization are significant factors of the network functionality. UAV-aided transmission can highly enhance the spectrum efficacy and coverage. Because of their flexible deployment and the high maneuverability, the UAVs can be the best alternative for the situations where the "Internet of Things (IoT)" systems utilize more energy to attain the essential information rate, when they are far away from the terrestrial base station. Therefore, it is significant to win over the few troubles in the conventional UAV-aided efficiency approaches. Thus, this proposed work is aimed to design an innovative energy efficiency framework in the UAV-assisted network using a reinforcement learning mechanism. The energy efficiency optimization in the UAV offers better wireless coverage to the static and mobile ground user. Presently, reinforcement learning techniques effectively optimize the energy efficiency rate of the system by employing the 2D trajectory mechanism, which effectively removes the interference rate attained in the nearby UAV cells. The main objective of the recommended framework is to maximize the energy efficiency rate of the UAV network by performing the joint optimization using UAV 3D trajectory, with the energy utilized during interference accounting, and connected user counts. Hence, an efficient Adaptive Deep Reinforcement Learning with Novel Loss Function (ADRL-NLF) framework is designed to provide a better energy efficiency rate to the UAV network. Moreover, the parameter of ADRL is tuned using the Hybrid Energy Valley and Hermit Crab (HEVHC) algorithm. Various experimental observations are performed to observe the effectualness rate of the recommended energy efficiency model for UAV-based networks over the classical energy efficiency framework in UAV Networks.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Reinforcement Learning Method
    Sun, Mengying
    Xu, Xiaodong
    Qin, Xiaoqi
    Zhang, Ping
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (24) : 17275 - 17289
  • [22] Reinforcement Learning for Energy-Efficient User Association in UAV-Assisted Cellular Networks
    Kaleem, Zeeshan
    Khalid, Waqas
    Ahmad, Ayaz
    Yu, Heejung
    Almasoud, Abdullah M.
    Yuen, Chau
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (02) : 2474 - 2481
  • [23] Resource allocation for UAV-assisted 5G mMTC slicing networks using deep reinforcement learning
    Gupta, Rohit Kumar
    Kumar, Saubhik
    Misra, Rajiv
    TELECOMMUNICATION SYSTEMS, 2023, 82 (01) : 141 - 159
  • [24] Resource allocation for UAV-assisted 5G mMTC slicing networks using deep reinforcement learning
    Rohit Kumar Gupta
    Saubhik Kumar
    Rajiv Misra
    Telecommunication Systems, 2023, 82 : 141 - 159
  • [25] UAV-assisted Internet of vehicles: A framework empowered by reinforcement learning and Blockchain
    Alagha, Ahmed
    Kadadha, Maha
    Mizouni, Rabeb
    Singh, Shakti
    Bentahar, Jamal
    Otrok, Hadi
    VEHICULAR COMMUNICATIONS, 2025, 52
  • [26] Deep Reinforcement Learning-Based Resource Allocation in Cooperative UAV-Assisted Wireless Networks
    Luong, Phuong
    Gagnon, Francois
    Tran, Le-Nam
    Labeau, Fabrice
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) : 7610 - 7625
  • [27] UAV-Assisted NOMA for Enhancing ISAC: A Deep Reinforcement Learning Solution
    Amhaz, Ali
    Elhattab, Mohamed
    Sharafeddine, Sanaa
    Assi, Chadi
    IEEE COMMUNICATIONS LETTERS, 2025, 29 (02) : 249 - 253
  • [28] Energy Efficiency Maximization for UAV-Assisted Emergency Communication Networks
    Niu, Haibin
    Zhao, Xinyu
    Hou, Liming
    Ma, Dongjun
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [29] Throughput and energy efficiency maximization for UAV-assisted vehicular networks
    Bian, Hui
    Dai, Haibo
    Yang, Luxi
    PHYSICAL COMMUNICATION, 2020, 42
  • [30] Trajectory Planning in UAV-Assisted Wireless Networks via Reinforcement Learning
    He, Simeng
    Zhang, Shangwei
    2022 IEEE 23RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING (IEEE HPSR), 2022, : 232 - 237