A novel energy-efficiency framework for UAV-assisted networks using adaptive deep reinforcement learning

被引:2
作者
Seerangan, Koteeswaran [1 ]
Nandagopal, Malarvizhi [2 ]
Govindaraju, Tamilmani [3 ]
Manogaran, Nalini [4 ]
Balusamy, Balamurugan [5 ]
Selvarajan, Shitharth [6 ,7 ]
机构
[1] SA Engn Coll Autonomous, Dept CSE AI&ML, Chennai 600077, Tamil Nadu, India
[2] Vel Tech Rangarajan Dr Sagunthala R&D Inst Sci & T, Sch Comp, Dept CSE, Chennai 600062, Tamil Nadu, India
[3] SRM Inst Sci & Technol, Dept Computat Intelligence, Chennai 603203, Tamil Nadu, India
[4] SA Engn Coll Autonomous, Dept CSE, Chennai 600077, Tamil Nadu, India
[5] Shiv Nadar Inst Eminence Univ, Greater Noida 201314, Uttar Pradesh, India
[6] Kebri Dehar Univ, Dept Comp Sci, Kebri Dehar 250, Ethiopia
[7] Leeds Beckett Univ, Sch Built Environm Engn & Comp, Leeds LS6 3QS, England
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Unmanned aerial vehicles; Energy efficiency; Deep reinforcement learning; Novel loss function; Hybrid energy valley and hermit crab; DESIGN; IOT;
D O I
10.1038/s41598-024-71621-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the air-to-ground transmissions, the lifespan of the network is based on the "unmanned aerial vehicle's (UAV)" life span because of the limited battery capacity. Thus, the enhancement of energy efficiency and the outage of the ground candidate's minimization are significant factors of the network functionality. UAV-aided transmission can highly enhance the spectrum efficacy and coverage. Because of their flexible deployment and the high maneuverability, the UAVs can be the best alternative for the situations where the "Internet of Things (IoT)" systems utilize more energy to attain the essential information rate, when they are far away from the terrestrial base station. Therefore, it is significant to win over the few troubles in the conventional UAV-aided efficiency approaches. Thus, this proposed work is aimed to design an innovative energy efficiency framework in the UAV-assisted network using a reinforcement learning mechanism. The energy efficiency optimization in the UAV offers better wireless coverage to the static and mobile ground user. Presently, reinforcement learning techniques effectively optimize the energy efficiency rate of the system by employing the 2D trajectory mechanism, which effectively removes the interference rate attained in the nearby UAV cells. The main objective of the recommended framework is to maximize the energy efficiency rate of the UAV network by performing the joint optimization using UAV 3D trajectory, with the energy utilized during interference accounting, and connected user counts. Hence, an efficient Adaptive Deep Reinforcement Learning with Novel Loss Function (ADRL-NLF) framework is designed to provide a better energy efficiency rate to the UAV network. Moreover, the parameter of ADRL is tuned using the Hybrid Energy Valley and Hermit Crab (HEVHC) algorithm. Various experimental observations are performed to observe the effectualness rate of the recommended energy efficiency model for UAV-based networks over the classical energy efficiency framework in UAV Networks.
引用
收藏
页数:23
相关论文
共 33 条
  • [1] Agarwal V., 2021, J. Sci. Res, V65, P209
  • [2] Energy-Efficient UAV-to-User Scheduling to Maximize Throughput in Wireless Networks
    Ahmed, Shakil
    Chowdhury, Mostafa Zaman
    Jang, Yeong Min
    [J]. IEEE ACCESS, 2020, 8 (08): : 21215 - 21225
  • [3] Energy valley optimizer: a novel metaheuristic algorithm for global and engineering optimization
    Azizi, Mahdi
    Aickelin, Uwe
    Khorshidi, Hadi A.
    Shishehgarkhaneh, Milad Baghalzadeh
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01):
  • [4] Mean Field Deep Reinforcement Learning for Fair and Efficient UAV Control
    Chen, Dezhi
    Qi, Qi
    Zhuang, Zirui
    Wang, Jingyu
    Liao, Jianxin
    Han, Zhu
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (02) : 813 - 828
  • [5] Deep Q-Network based resource allocation for UAV-assisted Ultra-Dense Networks
    Chen, Xin
    Liu, Xu
    Chen, Ying
    Jiao, Libo
    Min, Geyong
    [J]. COMPUTER NETWORKS, 2021, 196
  • [6] Egret Swarm Optimization Algorithm: An Evolutionary Computation Approach for Model Free Optimization
    Chen, Zuyan
    Francis, Adam
    Li, Shuai
    Liao, Bolin
    Xiao, Dunhui
    Ha, Tran Thu
    Li, Jianfeng
    Ding, Lei
    Cao, Xinwei
    [J]. BIOMIMETICS, 2022, 7 (04)
  • [7] A Deep Learning Approach for Task Offloading in Multi-UAV Aided Mobile Edge Computing
    Ebrahim, Moshira A.
    Ebrahim, Gamal A.
    Mohamed, Hoda K.
    Abdellatif, Sameh O.
    [J]. IEEE ACCESS, 2022, 10 : 101716 - 101731
  • [8] Performance analysis and optimization of UAV-assisted NOMA short packet communication systems
    Hoang, Tran Manh
    Dung, Le The
    Nguyen, Ba Cao
    Kim, Taejoon
    [J]. ICT EXPRESS, 2024, 10 (02): : 292 - 298
  • [9] Optimization of Energy Efficiency in UAV-Enabled Cognitive IoT With Short Packet Communication
    Hu, Hang
    Huang, Yangchao
    Cheng, Guobing
    Kang, Qiaoyan
    Zhang, Hang
    Pan, Yu
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (12) : 12357 - 12368
  • [10] Reinforcement Learning for a Cellular Internet of UAVs: Protocol Design, Trajectory Control, and Resource Management
    Hu, Jingzhi
    Zhang, Hongliang
    Song, Lingyang
    Han, Zhu
    Poor, H. Vincent
    [J]. IEEE WIRELESS COMMUNICATIONS, 2020, 27 (01) : 116 - 123