Edge intelligence computing for mobile augmented reality with deep reinforcement learning approach

被引:27
|
作者
Chen, Miaojiang [1 ]
Liu, Wei [2 ]
Wang, Tian [3 ]
Liu, Anfeng [1 ]
Zeng, Zhiwen [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
[2] Hunan Univ Chinese Med, Sch Informat, Changsha 410208, Peoples R China
[3] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China
基金
中国国家自然科学基金;
关键词
Beyond fifth-generation; Mobile augmented reality; Markov decision process; Deep reinforcement learning; Artificial intelligence; WIRELESS POWER TRANSFER; NETWORKING; OPTIMIZATION; MAXIMIZATION; INTERNET; THINGS; 5G;
D O I
10.1016/j.comnet.2021.108186
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Convergence of Augmented Reality (AR) and Next Generation Internet-of-Things (NG-IoT) can create new opportunities in many emerging areas, where the real-time data can be visualized on the devices. Integrated NG-IoT network, AR can improve efficiency in many fields such as mobile computing, smart city, intelligent transportation and telemedicine. However, limited by capability of mobile device, the reliability and latency requirements of AR applications is difficult to meet by local processing. To solve this problem, we study a binary offloading scheme for AR edge computing. Based on the proposed model, the parts of AR computing can offload to edge network servers, which is extend the computing capability of mobile AR devices. Moreover, a deep reinforcement learning offloading model is considered to acquire B5G network resource allocation and optimally AR offloading decisions. First, this offloading model does not need to solve combinatorial optimization, which is greatly reduced the computational complexity. Then the wireless channel gains and binary offloading states is modeled as a Markov decision process, and solved by deep reinforcement learning. Numerical results show that our scheme can achieve better performance compared with existing optimization methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Bayesian Reinforcement Learning and Bayesian Deep Learning for Blockchains With Mobile Edge Computing
    Asheralieva, Alia
    Niyato, Dusit
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (01) : 319 - 335
  • [22] Privacy-preserving task offloading in mobile edge computing: A deep reinforcement learning approach
    Xia, Fanglue
    Chen, Ying
    Huang, Jiwei
    SOFTWARE-PRACTICE & EXPERIENCE, 2024, 54 (09): : 1774 - 1792
  • [23] Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach
    Zhao, Junhui
    Quan, Haoyu
    Xia, Minghua
    Wang, Dongming
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5834 - 5848
  • [24] Wireless Power Assisted Computation Offloading in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Maray, Mohammed
    Mustafa, Ehzaz
    Shuja, Junaid
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2024, 14
  • [25] Deep Reinforcement Learning and Optimization Based Green Mobile Edge Computing
    Yang, Yang
    Hu, Yulin
    Gursoy, M. Cenk
    2021 IEEE 18TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2021,
  • [26] Task migration for mobile edge computing using deep reinforcement learning
    Zhang, Cheng
    Zheng, Zixuan
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 96 : 111 - 118
  • [27] Deep Graph Reinforcement Learning for Mobile Edge Computing: Challenges and Solutions
    Wang, Yixiao
    Wu, Huaming
    Li, Ruidong
    IEEE NETWORK, 2024, 38 (05): : 314 - 323
  • [28] Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems
    Tang, Ming
    Wong, Vincent W. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (06) : 1985 - 1997
  • [29] Deep Reinforcement Learning for Online VRC Deployment in Mobile Edge Computing
    Wu, Yuanzhuo
    Zhang, Shubin
    Shen, Guanqun
    Chen, Gang
    2022 IEEE 23RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE SWITCHING AND ROUTING (IEEE HPSR), 2022, : 271 - 276
  • [30] Deep reinforcement learning for computation offloading in mobile edge computing environment
    Chen, Miaojiang
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    COMPUTER COMMUNICATIONS, 2021, 175 (175) : 1 - 12