Edge intelligence computing for mobile augmented reality with deep reinforcement learning approach

被引:27
|
作者
Chen, Miaojiang [1 ]
Liu, Wei [2 ]
Wang, Tian [3 ]
Liu, Anfeng [1 ]
Zeng, Zhiwen [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
[2] Hunan Univ Chinese Med, Sch Informat, Changsha 410208, Peoples R China
[3] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China
基金
中国国家自然科学基金;
关键词
Beyond fifth-generation; Mobile augmented reality; Markov decision process; Deep reinforcement learning; Artificial intelligence; WIRELESS POWER TRANSFER; NETWORKING; OPTIMIZATION; MAXIMIZATION; INTERNET; THINGS; 5G;
D O I
10.1016/j.comnet.2021.108186
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Convergence of Augmented Reality (AR) and Next Generation Internet-of-Things (NG-IoT) can create new opportunities in many emerging areas, where the real-time data can be visualized on the devices. Integrated NG-IoT network, AR can improve efficiency in many fields such as mobile computing, smart city, intelligent transportation and telemedicine. However, limited by capability of mobile device, the reliability and latency requirements of AR applications is difficult to meet by local processing. To solve this problem, we study a binary offloading scheme for AR edge computing. Based on the proposed model, the parts of AR computing can offload to edge network servers, which is extend the computing capability of mobile AR devices. Moreover, a deep reinforcement learning offloading model is considered to acquire B5G network resource allocation and optimally AR offloading decisions. First, this offloading model does not need to solve combinatorial optimization, which is greatly reduced the computational complexity. Then the wireless channel gains and binary offloading states is modeled as a Markov decision process, and solved by deep reinforcement learning. Numerical results show that our scheme can achieve better performance compared with existing optimization methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [11] Task Assignment in Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach
    Feng, Mingjie
    Zhao, Qi
    Sullivan, Nichole
    Chen, Genshe
    Pham, Khanh
    Blasch, Erik
    SENSORS AND SYSTEMS FOR SPACE APPLICATIONS XIV, 2021, 11755
  • [12] A Deep Reinforcement Learning Approach for Online Computation Offloading in Mobile Edge Computing
    Zhang, Yameng
    Liu, Tong
    Zhu, Yanmin
    Yang, Yuanyuan
    2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,
  • [13] Augmented Deep Reinforcement Learning for Online Energy Minimization of Wireless Powered Mobile Edge Computing
    Chen, Xiaojing
    Dai, Weiheng
    Ni, Wei
    Wang, Xin
    Zhang, Shunqing
    Xu, Shugong
    Sun, Yanzan
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (05) : 2698 - 2710
  • [14] A Reinforcement Learning-based Orchestrator for Edge Computing Resource Allocation in Mobile Augmented Reality Systems
    Qian, Weiyang
    Coutinho, Rodolfo W. L.
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [15] Federated Learning for Online Resource Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Zheng, Jingjing
    Li, Kai
    Mhaisen, Naram
    Ni, Wei
    Tovar, Eduardo
    Guizani, Mohsen
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [16] Deep Reinforcement Learning Approach for UAV-Assisted Mobile Edge Computing Networks
    Hwang, Sangwon
    Park, Juseong
    Lee, Hoon
    Kim, Mintae
    Lee, Inkyu
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3839 - 3844
  • [17] Age-Based Scheduling for Mobile Edge Computing: A Deep Reinforcement Learning Approach
    He, Xingqiu
    You, Chaoqun
    Quek, Tony Q. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (10) : 9881 - 9897
  • [18] Sharding for Blockchain based Mobile Edge Computing System: A Deep Reinforcement Learning Approach
    Yuan, Shijing
    Li, Jie
    Liang, Jinghao
    Zhu, Yuxuan
    Yu, Xiang
    Chen, Jianping
    Wu, Chentao
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [19] iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks
    Chen, Jienan
    Chen, Siyu
    Wang, Qi
    Cao, Bin
    Feng, Gang
    Hu, Jianhao
    IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (04): : 7011 - 7024
  • [20] Graph Convolutional Network Augmented Deep Reinforcement Learning for Dependent Task Offloading in Mobile Edge Computing
    Mo, Chu-To
    Chen, Jia-Hong
    Liao, Wanjiun
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,