Advanced Energy-Efficient Computation Offloading Using Deep Reinforcement Learning in MTC Edge Computing

被引:21
作者
Khan, Israr [1 ]
Tao, Xiaofeng [1 ]
Rahman, G. M. Shafiqur [2 ]
Rehman, Waheed Ur [1 ,3 ]
Salam, Tabinda [1 ,4 ]
机构
[1] Beijing Univ Posts & Telecommun, Natl Engn Lab Mobile Network Technol, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Key Lab Universal Wireless Commun, Minist Educ, Beijing 100876, Peoples R China
[3] Univ Peshawar, Dept Comp Sci, Peshawar 25120, Pakistan
[4] Shaheed Benazir Bhutto Women Univ, Dept Comp Sci, Peshawar 25000, Pakistan
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Machine type communication; mobile edge computing; computation offloading; deep reinforcement learning; energy efficiency; RESOURCE-ALLOCATION; 5G; INTERNET; ARCHITECTURE; CHALLENGES; VEHICLES;
D O I
10.1109/ACCESS.2020.2991057
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile edge computing (MEC) supports the internet of things (IoT) by leveraging computation offloading. It minimizes the delay and consequently reduces the energy consumption of the IoT devices. However, the consideration of static communication mode in most of the recent work, despite varying network dynamics and resource diversity, is the main limitation. An energy-efficient computation offloading method using deep reinforcement learning (DRL) is proposed. Both delay-tolerant and non-delay tolerant scenarios are considered using capillary machine type communication (MTC). Depending upon the type of service, an intelligent MTC edge server using DRL decides either process the incoming request at the MTC edge server or sends it to the cloud server. To control communication, we draft a markov decision problem (MDP). This minimizes the long-term power consumption of the system. The formulation of the optimization problem is considered under the constraint of computing power resources and delays. Simulation results delineate the significant performance gain of 12 & x0025; in computation offloading through the proposed DRL approach. The effectiveness and superiority of the proposed model are compared with other baselines and are demonstrated numerically.
引用
收藏
页码:82867 / 82875
页数:9
相关论文
共 33 条
  • [1] Ali A, 2015, IEEE COMMUN MAG, V53, P18, DOI 10.1109/MCOM.2015.7263368
  • [2] Distributed Multiuser Computation Offloading for Cloudlet-Based Mobile Cloud Computing: A Game-Theoretic Machine Learning Approach
    Cao, Huijin
    Cai, Jun
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (01) : 752 - 764
  • [3] Cheng MX, 2018, ASIA S PACIF DES AUT, P129, DOI 10.1109/ASPDAC.2018.8297294
  • [4] Resource Allocation Algorithm With Multi-Platform Intelligent Offloading in D2D-Enabled vehicular Networks
    Cui, Yaping
    Liang, Yingjie
    Wang, Ruyan
    [J]. IEEE ACCESS, 2019, 7 : 21246 - 21253
  • [5] TOWARD MASSIVE MACHINE TYPE CELLULAR COMM UNICATIONS
    Dawy, Zaher
    Saad, Walid
    Ghosh, Arunabha
    Andrews, Jeffrey G.
    Yaacoub, Elias
    [J]. IEEE WIRELESS COMMUNICATIONS, 2017, 24 (01) : 120 - 128
  • [6] Foundations and Evolution of Modern Computing Paradigms: Cloud, IoT, Edge, and Fog
    De Donno, Michele
    Tange, Koen
    Dragoni, Nicola
    [J]. IEEE ACCESS, 2019, 7 : 150936 - 150948
  • [7] Eisen M., 2019, 2019 IEEE 20 INT WOR, P1
  • [8] Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach
    He, Ying
    Zhao, Nan
    Yin, Hongxi
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (01) : 44 - 55
  • [9] He YW, 2017, 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP)
  • [10] Ji L., 2018, P 2018 IEEE WIR COMM, P1, DOI [10.1109/WHISPERS.2018.8747245, DOI 10.1109/WHISPERS.2018.8747245]