Reinforcement learning for intelligent online computation offloading in wireless powered edge networks

被引:33
作者
Mustafa, Ehzaz [1 ]
Shuja, Junaid [1 ]
Bilal, Kashif [1 ]
Mustafa, Saad [1 ]
Maqsood, Tahir [1 ]
Rehman, Faisal [1 ]
Khan, Atta ur Rehman [2 ]
机构
[1] COMSATS Univ Islamabad, Dept Comp Sci, Abbottabad Campus, Abbottabad, Pakistan
[2] Ajman Univ, Coll Engn & Informat Technol, Ajman, U Arab Emirates
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2023年 / 26卷 / 02期
关键词
Mobile edge computing; Wireless power transfer; Computation offloading; Reinforcement learning; RATE MAXIMIZATION; RESOURCE-ALLOCATION; CLOUD;
D O I
10.1007/s10586-022-03700-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The method of charging mobile devices with wireless power transfer (WPT) from the base station (BS) integrated with mobile edge computing (MEC) increases the potential of MEC. The increasing demand for intelligent computation offloading requires effective decisions among local or remote computation specifically in wireless fading channels of the dynamic environment. Our main aim is to generate an effective offloading decision between local and remote computation in a real-time environment for each wireless channel while preserving optimal computation rate. In this article, we consider a wireless powered MEC system that governs a binary offloading decision to execute the task locally at the edge devices or the remote server. We propose a reinforcement learning based intelligent online offloading (RLIO) framework that adopts an optimal offloading action based on reinforcement methods. This framework acquires a worthy decision among local or remote computation for the time varying wireless channel conditions in dense networks. Numerical results show that the proposed framework can achieve optimal performance while preserving the computation time compared with existing optimization methods. Second, the average execution cost of RLIO is less than 0.4 ms per channel, which enables real-time and optimal offloading in dynamic and large-scale networks.
引用
收藏
页码:1053 / 1062
页数:10
相关论文
共 44 条
  • [1] Federated Learning in Edge Computing: A Systematic Survey
    Abreha, Haftay Gebreslasie
    Hayajneh, Mohammad
    Serhani, Mohamed Adel
    [J]. SENSORS, 2022, 22 (02)
  • [2] Enabling Intelligent IoCV Services at the Edge for 5G Networks and Beyond
    Al Ridhawi, Ismaeel
    Aloqaily, Moayad
    Boukerche, Azzedine
    Jararweh, Yaser
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (08) : 5190 - 5200
  • [3] Atieh AT., 2021, RESEARCHBERG REV SCI, V1, P1
  • [4] A comprehensive survey on clustering in vehicular networks: Current solutions and future challenges
    Ayyub, Muddasar
    Oracevic, Alma
    Hussain, Rasheed
    Khan, Ammara Anjum
    Zhang, Zhongshan
    [J]. AD HOC NETWORKS, 2022, 124
  • [5] Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks
    Bi, Suzhi
    Huang, Liang
    Wang, Hui
    Zhang, Ying-Jun Angela
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) : 7519 - 7537
  • [6] Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading
    Bi, Suzhi
    Zhang, Ying Jun
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (06) : 4177 - 4190
  • [7] WIRELESS POWERED COMMUNICATION NETWORKS: AN OVERVIEW
    Bi, Suzhi
    Zeng, Yong
    Zhang, Rui
    [J]. IEEE WIRELESS COMMUNICATIONS, 2016, 23 (02) : 10 - 18
  • [8] An improved anonymous authentication scheme for distributed mobile cloud computing services
    Chaudhry, Shehzad Ashraf
    Kim, I. Luk
    Rho, Seungmin
    Farash, Mohammad Sabzinejad
    Shon, Taeshik
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 1): : 1595 - 1609
  • [9] DRL based offloading of industrial IoT applications in wireless powered mobile edge computing
    Chen, Wenchao
    Zhu, Bincheng
    Chi, Kaikai
    Zhang, Shubin
    [J]. IET COMMUNICATIONS, 2022, 16 (09) : 951 - 962
  • [10] Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
    Chen, Xianfu
    Zhang, Honggang
    Wu, Celimuge
    Mao, Shiwen
    Ji, Yusheng
    Bennis, Mehdi
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03): : 4005 - 4018