A novel energy-efficiency framework for UAV-assisted networks using adaptive deep reinforcement learning

被引:2
|
作者
Seerangan, Koteeswaran [1 ]
Nandagopal, Malarvizhi [2 ]
Govindaraju, Tamilmani [3 ]
Manogaran, Nalini [4 ]
Balusamy, Balamurugan [5 ]
Selvarajan, Shitharth [6 ,7 ]
机构
[1] SA Engn Coll Autonomous, Dept CSE AI&ML, Chennai 600077, Tamil Nadu, India
[2] Vel Tech Rangarajan Dr Sagunthala R&D Inst Sci & T, Sch Comp, Dept CSE, Chennai 600062, Tamil Nadu, India
[3] SRM Inst Sci & Technol, Dept Computat Intelligence, Chennai 603203, Tamil Nadu, India
[4] SA Engn Coll Autonomous, Dept CSE, Chennai 600077, Tamil Nadu, India
[5] Shiv Nadar Inst Eminence Univ, Greater Noida 201314, Uttar Pradesh, India
[6] Kebri Dehar Univ, Dept Comp Sci, Kebri Dehar 250, Ethiopia
[7] Leeds Beckett Univ, Sch Built Environm Engn & Comp, Leeds LS6 3QS, England
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Unmanned aerial vehicles; Energy efficiency; Deep reinforcement learning; Novel loss function; Hybrid energy valley and hermit crab; DESIGN; IOT;
D O I
10.1038/s41598-024-71621-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the air-to-ground transmissions, the lifespan of the network is based on the "unmanned aerial vehicle's (UAV)" life span because of the limited battery capacity. Thus, the enhancement of energy efficiency and the outage of the ground candidate's minimization are significant factors of the network functionality. UAV-aided transmission can highly enhance the spectrum efficacy and coverage. Because of their flexible deployment and the high maneuverability, the UAVs can be the best alternative for the situations where the "Internet of Things (IoT)" systems utilize more energy to attain the essential information rate, when they are far away from the terrestrial base station. Therefore, it is significant to win over the few troubles in the conventional UAV-aided efficiency approaches. Thus, this proposed work is aimed to design an innovative energy efficiency framework in the UAV-assisted network using a reinforcement learning mechanism. The energy efficiency optimization in the UAV offers better wireless coverage to the static and mobile ground user. Presently, reinforcement learning techniques effectively optimize the energy efficiency rate of the system by employing the 2D trajectory mechanism, which effectively removes the interference rate attained in the nearby UAV cells. The main objective of the recommended framework is to maximize the energy efficiency rate of the UAV network by performing the joint optimization using UAV 3D trajectory, with the energy utilized during interference accounting, and connected user counts. Hence, an efficient Adaptive Deep Reinforcement Learning with Novel Loss Function (ADRL-NLF) framework is designed to provide a better energy efficiency rate to the UAV network. Moreover, the parameter of ADRL is tuned using the Hybrid Energy Valley and Hermit Crab (HEVHC) algorithm. Various experimental observations are performed to observe the effectualness rate of the recommended energy efficiency model for UAV-based networks over the classical energy efficiency framework in UAV Networks.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Deep Learning for Secure UAV-Assisted RIS Communication Networks
    Mughal U.A.
    Alkhrijah Y.
    Almadhor A.
    Yuen C.
    IEEE Internet of Things Magazine, 2024, 7 (02): : 38 - 44
  • [32] End-to-End Energy-Efficiency and Reliability of UAV-Assisted Wireless Data Ferrying
    Shafique, Taniya
    Tabassum, Hina
    Hossain, Ekram
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (03) : 1822 - 1837
  • [33] Federated deep reinforcement learning based trajectory design for UAV-assisted networks with mobile ground devices
    Gao, Yunfei
    Liu, Mingliu
    Yuan, Xiaopeng
    Hu, Yulin
    Sun, Peng
    Schmeink, Anke
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [34] Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning
    Qi, Huamei
    Zhou, Zheng
    APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [35] UAV-Assisted Fair Communication for Mobile Networks: A Multi-Agent Deep Reinforcement Learning Approach
    Zhou, Yi
    Jin, Zhanqi
    Shi, Huaguang
    Wang, Zhangyun
    Lu, Ning
    Liu, Fuqiang
    REMOTE SENSING, 2022, 14 (22)
  • [36] Deep-Reinforcement-Learning-Based Computation Offloading in UAV-Assisted Vehicular Edge Computing Networks
    Yan, Junjie
    Zhao, Xiaohui
    Li, Zan
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 19882 - 19897
  • [37] Ellipsoidal Trajectory Optimization for Minimizing Latency and Data Transmission Energy in UAV-Assisted MEC Using Deep Reinforcement Learning
    Sadia, Rabeya
    Akter, Shathee
    Yoon, Seokhoon
    Forestiero, Agostino
    APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [38] Deep-Reinforcement-Learning-Based Placement for Integrated Access Backhauling in UAV-Assisted Wireless Networks
    Wang, Yuhui
    Farooq, Junaid
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (08): : 14727 - 14738
  • [39] Energy-Efficiency Optimization for D2D Communications Underlaying UAV-Assisted Industrial IoT Networks With SWIPT
    Su, Zhijie
    Feng, Wanmei
    Tang, Jie
    Chen, Zhen
    Fu, Yuli
    Zhao, Nan
    Wong, Kai-Kit
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (03) : 1990 - 2002
  • [40] Deep Reinforcement Learning for UAV-Assisted Spectrum Sharing: A Minority Game Approach
    Ding, Xinyu
    Zhang, Jie
    Wang, Zhe
    Wang, Xuehe
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 44 - 50