A Deep Reinforcement Learning Approach Towards Computation Offloading for Mobile Edge Computing

被引:0
|
作者
Wang, Qing [1 ]
Tan, Wenan [1 ,2 ]
Qin, Xiaofan [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 211100, Peoples R China
[2] Shanghai Polytech Univ, Sch Comp & Informat Engn, Shanghai 201209, Peoples R China
来源
HUMAN CENTERED COMPUTING | 2019年 / 11956卷
基金
中国国家自然科学基金;
关键词
Mobile edge computing; Deep reinforcement learning; Computation offloading; Deep Q-learning; Cost minimization;
D O I
10.1007/978-3-030-37429-7_42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to improve the quality of service for users and reduce the energy consumption of the cloud computing environment, Mobile Edge Computing (MEC) is a promising paradigm by providing computing resources which is close to the end device in physical distance. Nevertheless, the computation offloading policy to satisfy the requirements of the service provider and consumer at the same time within a MEC system still remains challenging. In this paper, we propose an offloading decision policy with three-level structure for MEC system different from the traditional two-level architecture to formulate the offloading decision optimization problem by minimizing the total cost of energy consumption and delay time. Because the traditional optimization methods could not solve this dynamic system problem efficiently, Reinforcement Learning (RL) has been used in complex control systems in recent years. We design a deep reinforcement learning (DRL) approach to minimize the total cost by applying deep Q-learning algorithm to address the issues of too large system state dimension. The simulation results show that the proposed algorithm has nearly optimal performance than traditional methods.
引用
收藏
页码:419 / 430
页数:12
相关论文
共 50 条
  • [1] A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
    Zhang, Yameng
    Liu, Tong
    Zhu, Yanmin
    Yang, Yuanyuan
    2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,
  • [2] Deep reinforcement learning for computation offloading in mobile edge computing environment
    Chen, Miaojiang
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    COMPUTER COMMUNICATIONS, 2021, 175 (175) : 1 - 12
  • [3] Computation Offloading for Mobile Edge Computing: A Deep Learning Approach
    Yu, Shuai
    Wang, Xin
    Langar, Rami
    2017 IEEE 28TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2017,
  • [4] Wireless Power Assisted Computation Offloading in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Maray, Mohammed
    Mustafa, Ehzaz
    Shuja, Junaid
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2024, 14
  • [5] Decentralized computation offloading for multi-user mobile edge computing: a deep reinforcement learning approach
    Zhao Chen
    Xiaodong Wang
    EURASIP Journal on Wireless Communications and Networking, 2020
  • [6] Decentralized computation offloading for multi-user mobile edge computing: a deep reinforcement learning approach
    Chen, Zhao
    Wang, Xiaodong
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2020, 2020 (01)
  • [7] Computation Offloading in Edge Computing Based on Deep Reinforcement Learning
    Li, MingChu
    Mao, Ning
    Zheng, Xiao
    Gadekallu, Thippa Reddy
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION NETWORKS (ICCCN 2021), 2022, 394 : 339 - 353
  • [8] Dependency-Aware Computation Offloading in Mobile Edge Computing: A Reinforcement Learning Approach
    Pan, Shengli
    Zhang, Zhiyong
    Zhang, Zongwang
    Zeng, Deze
    IEEE ACCESS, 2019, 7 : 134742 - 134753
  • [9] Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Zhou, Huan
    Zhang, Zhenyu
    Wu, Yuan
    Dong, Mianxiong
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (02): : 950 - 961
  • [10] Multi-Agent Deep Reinforcement Learning for Efficient Computation Offloading in Mobile Edge Computing
    Jiao, Tianzhe
    Feng, Xiaoyue
    Guo, Chaopeng
    Wang, Dongqi
    Song, Jie
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (03): : 3585 - 3603