A novel energy-efficiency framework for UAV-assisted networks using adaptive deep reinforcement learning

被引:2
|
作者
Seerangan, Koteeswaran [1 ]
Nandagopal, Malarvizhi [2 ]
Govindaraju, Tamilmani [3 ]
Manogaran, Nalini [4 ]
Balusamy, Balamurugan [5 ]
Selvarajan, Shitharth [6 ,7 ]
机构
[1] SA Engn Coll Autonomous, Dept CSE AI&ML, Chennai 600077, Tamil Nadu, India
[2] Vel Tech Rangarajan Dr Sagunthala R&D Inst Sci & T, Sch Comp, Dept CSE, Chennai 600062, Tamil Nadu, India
[3] SRM Inst Sci & Technol, Dept Computat Intelligence, Chennai 603203, Tamil Nadu, India
[4] SA Engn Coll Autonomous, Dept CSE, Chennai 600077, Tamil Nadu, India
[5] Shiv Nadar Inst Eminence Univ, Greater Noida 201314, Uttar Pradesh, India
[6] Kebri Dehar Univ, Dept Comp Sci, Kebri Dehar 250, Ethiopia
[7] Leeds Beckett Univ, Sch Built Environm Engn & Comp, Leeds LS6 3QS, England
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Unmanned aerial vehicles; Energy efficiency; Deep reinforcement learning; Novel loss function; Hybrid energy valley and hermit crab; DESIGN; IOT;
D O I
10.1038/s41598-024-71621-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the air-to-ground transmissions, the lifespan of the network is based on the "unmanned aerial vehicle's (UAV)" life span because of the limited battery capacity. Thus, the enhancement of energy efficiency and the outage of the ground candidate's minimization are significant factors of the network functionality. UAV-aided transmission can highly enhance the spectrum efficacy and coverage. Because of their flexible deployment and the high maneuverability, the UAVs can be the best alternative for the situations where the "Internet of Things (IoT)" systems utilize more energy to attain the essential information rate, when they are far away from the terrestrial base station. Therefore, it is significant to win over the few troubles in the conventional UAV-aided efficiency approaches. Thus, this proposed work is aimed to design an innovative energy efficiency framework in the UAV-assisted network using a reinforcement learning mechanism. The energy efficiency optimization in the UAV offers better wireless coverage to the static and mobile ground user. Presently, reinforcement learning techniques effectively optimize the energy efficiency rate of the system by employing the 2D trajectory mechanism, which effectively removes the interference rate attained in the nearby UAV cells. The main objective of the recommended framework is to maximize the energy efficiency rate of the UAV network by performing the joint optimization using UAV 3D trajectory, with the energy utilized during interference accounting, and connected user counts. Hence, an efficient Adaptive Deep Reinforcement Learning with Novel Loss Function (ADRL-NLF) framework is designed to provide a better energy efficiency rate to the UAV network. Moreover, the parameter of ADRL is tuned using the Hybrid Energy Valley and Hermit Crab (HEVHC) algorithm. Various experimental observations are performed to observe the effectualness rate of the recommended energy efficiency model for UAV-based networks over the classical energy efficiency framework in UAV Networks.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Deep Reinforcement Learning for UAV-Assisted Spectrum Sharing Under Partial Observability
    Zhang, Sigen
    Wang, Zhe
    Gao, Guanyu
    Li, Jun
    Zhang, Jie
    Yin, Ziyan
    2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
  • [42] Maximizing Energy Efficiency in UAV-Assisted NOMA-MEC Networks
    Liu, Zhixin
    Qi, Junxiao
    Shen, Yanyan
    Ma, Kai
    Guan, Xinping
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (24) : 22208 - 22222
  • [43] Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing
    Zhang, Peiying
    Su, Yu
    Li, Boxiao
    Liu, Lei
    Wang, Cong
    Zhang, Wei
    Tan, Lizhuang
    DRONES, 2023, 7 (03)
  • [44] UAV-assisted Aerial Survey of Railways using Deep Learning
    Kafetzis, Dimitrios
    Fourfouris, Ioannis
    Argyropoulos, Savvas
    Koutsopoulos, Iordanis
    2020 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'20), 2020, : 1491 - 1500
  • [45] Weighted Energy-Efficiency Maximization for a UAV-Assisted Multiplatoon Mobile-Edge Computing System
    Duan, Xuting
    Zhou, Yukang
    Tian, Daxin
    Zhou, Jianshan
    Sheng, Zhengguo
    Shen, Xuemin
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (19) : 18208 - 18220
  • [46] Trajectory optimization for UAV-assisted relay over 5G networks based on reinforcement learning framework
    Sara M. M. Abohashish
    Rawya Y. Rizk
    E. I. Elsedimy
    EURASIP Journal on Wireless Communications and Networking, 2023
  • [47] Trajectory optimization for UAV-assisted relay over 5G networks based on reinforcement learning framework
    Abohashish, Sara M. M.
    Rizk, Rawya Y.
    Elsedimy, E. I.
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2023, 2023 (01)
  • [48] Asynchronous Federated Deep-Reinforcement-Learning-Based Dependency Task Offloading for UAV-Assisted Vehicular Networks
    Shen, Si
    Shen, Guojiang
    Dai, Zhehao
    Zhang, Kaiyu
    Kong, Xiangjie
    Li, Jianxin
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (19): : 31561 - 31574
  • [49] Adaptive Reinforcement Learning Framework for NOMA-UAV Networks
    Mahmud, Syed Khurram
    Liu, Yuanwei
    Chen, Yue
    Chai, Kok Keong
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (09) : 2943 - 2947
  • [50] Energy-Efficiency Maximization of Multiple RISs-Enabled Communication Networks by Deep Reinforcement Learning
    Aung, Pyae Sone
    Tun, Yan Kyaw
    Han, Zhu
    Hong, Choong Seon
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 2181 - 2186