Edge intelligence computing for mobile augmented reality with deep reinforcement learning approach

被引:27
|
作者
Chen, Miaojiang [1 ]
Liu, Wei [2 ]
Wang, Tian [3 ]
Liu, Anfeng [1 ]
Zeng, Zhiwen [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
[2] Hunan Univ Chinese Med, Sch Informat, Changsha 410208, Peoples R China
[3] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China
基金
中国国家自然科学基金;
关键词
Beyond fifth-generation; Mobile augmented reality; Markov decision process; Deep reinforcement learning; Artificial intelligence; WIRELESS POWER TRANSFER; NETWORKING; OPTIMIZATION; MAXIMIZATION; INTERNET; THINGS; 5G;
D O I
10.1016/j.comnet.2021.108186
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Convergence of Augmented Reality (AR) and Next Generation Internet-of-Things (NG-IoT) can create new opportunities in many emerging areas, where the real-time data can be visualized on the devices. Integrated NG-IoT network, AR can improve efficiency in many fields such as mobile computing, smart city, intelligent transportation and telemedicine. However, limited by capability of mobile device, the reliability and latency requirements of AR applications is difficult to meet by local processing. To solve this problem, we study a binary offloading scheme for AR edge computing. Based on the proposed model, the parts of AR computing can offload to edge network servers, which is extend the computing capability of mobile AR devices. Moreover, a deep reinforcement learning offloading model is considered to acquire B5G network resource allocation and optimally AR offloading decisions. First, this offloading model does not need to solve combinatorial optimization, which is greatly reduced the computational complexity. Then the wireless channel gains and binary offloading states is modeled as a Markov decision process, and solved by deep reinforcement learning. Numerical results show that our scheme can achieve better performance compared with existing optimization methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Play to Earn in Augmented Reality With Mobile Edge Computing Over Wireless Networks: A Deep Reinforcement Learning Approach
    Chua, Terence Jie
    Yu, Wenhan
    Zhao, Jun
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2025, 24 (01) : 68 - 83
  • [2] A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing
    Wu, Jiaqi
    Lin, Huang
    Liu, Huaize
    Gao, Lin
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 601 - 606
  • [3] Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Wang, Jiadai
    Zhao, Lei
    Liu, Jiajia
    Kato, Nei
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2021, 9 (03) : 1529 - 1541
  • [4] Augmented Deep Reinforcement Learning for Online Energy Minimization of Wireless Powered Mobile Edge Computing
    Chen, Xiaojing
    Dai, Weiheng
    Ni, Wei
    Wang, Xin
    Zhang, Shunqing
    Xu, Shugong
    Sun, Yanzan
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (05) : 2698 - 2710
  • [5] User Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Panda, Subrat Prasad
    Banerjee, Ansuman
    Bhattacharya, Arani
    2021 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, ICWS 2021, 2021, : 447 - 458
  • [6] Service migration in mobile edge computing: A deep reinforcement learning approach
    Wang, Hongman
    Li, Yingxue
    Zhou, Ao
    Guo, Yan
    Wang, Shangguang
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2023, 36 (01)
  • [7] Age-Based Scheduling for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    He, Xingqiu
    You, Chaoqun
    Quek, Tony Q. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (10) : 9881 - 9897
  • [8] A Deep Reinforcement Learning Approach Towards Computation Offloading for Mobile Edge Computing
    Wang, Qing
    Tan, Wenan
    Qin, Xiaofan
    HUMAN CENTERED COMPUTING, 2019, 11956 : 419 - 430
  • [9] Task Assignment in Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach
    Feng, Mingjie
    Zhao, Qi
    Sullivan, Nichole
    Chen, Genshe
    Pham, Khanh
    Blasch, Erik
    SENSORS AND SYSTEMS FOR SPACE APPLICATIONS XIV, 2021, 11755
  • [10] A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
    Zhang, Yameng
    Liu, Tong
    Zhu, Yanmin
    Yang, Yuanyuan
    2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,