Edge intelligence computing for mobile augmented reality with deep reinforcement learning approach

被引:30
作者
Chen, Miaojiang [1 ]
Liu, Wei [2 ]
Wang, Tian [3 ]
Liu, Anfeng [1 ]
Zeng, Zhiwen [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
[2] Hunan Univ Chinese Med, Sch Informat, Changsha 410208, Peoples R China
[3] Huaqiao Univ, Coll Comp Sci & Technol, Xiamen 361021, Peoples R China
基金
中国国家自然科学基金;
关键词
Beyond fifth-generation; Mobile augmented reality; Markov decision process; Deep reinforcement learning; Artificial intelligence; WIRELESS POWER TRANSFER; NETWORKING; OPTIMIZATION; MAXIMIZATION; INTERNET; THINGS; 5G;
D O I
10.1016/j.comnet.2021.108186
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Convergence of Augmented Reality (AR) and Next Generation Internet-of-Things (NG-IoT) can create new opportunities in many emerging areas, where the real-time data can be visualized on the devices. Integrated NG-IoT network, AR can improve efficiency in many fields such as mobile computing, smart city, intelligent transportation and telemedicine. However, limited by capability of mobile device, the reliability and latency requirements of AR applications is difficult to meet by local processing. To solve this problem, we study a binary offloading scheme for AR edge computing. Based on the proposed model, the parts of AR computing can offload to edge network servers, which is extend the computing capability of mobile AR devices. Moreover, a deep reinforcement learning offloading model is considered to acquire B5G network resource allocation and optimally AR offloading decisions. First, this offloading model does not need to solve combinatorial optimization, which is greatly reduced the computational complexity. Then the wireless channel gains and binary offloading states is modeled as a Markov decision process, and solved by deep reinforcement learning. Numerical results show that our scheme can achieve better performance compared with existing optimization methods.
引用
收藏
页数:13
相关论文
共 52 条
[1]   UAVs for traffic monitoring: A sequential game-based computation offloading/sharing approach [J].
Alioua, Ahmed ;
Djeghri, Houssem-eddine ;
Cherif, Mohammed Elyazid Tayeb ;
Senouci, Sidi-Mohammed ;
Sedjelmaci, Hichem .
COMPUTER NETWORKS, 2020, 177
[2]   Power allocation and resource assignment for secure D2D communication underlaying cellular networks: A Tabu search approach [J].
Ashtiani, Amirhossein Feizi ;
Pierre, Samuel .
COMPUTER NETWORKS, 2020, 178
[3]   Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading [J].
Bi, Suzhi ;
Zhang, Ying Jun .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (06) :4177-4190
[4]   Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning [J].
Chen, Xianfu ;
Zhang, Honggang ;
Wu, Celimuge ;
Mao, Shiwen ;
Ji, Yusheng ;
Bennis, Mehdi .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4005-4018
[5]   Towards Accurate Prediction for High-Dimensional and Highly-Variable Cloud Workloads with Deep Learning [J].
Chen, Zheyi ;
Hu, Jia ;
Min, Geyong ;
Zomaya, Albert Y. ;
El-Ghazawi, Tarek .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2020, 31 (04) :923-934
[6]   Distributed Wireless Power Transfer System for Internet of Things Devices [J].
Choi, Kae Won ;
Aziz, Arif Abdul ;
Setiawan, Dedi ;
Nguyen Minh Tran ;
Ginting, Lorenz ;
Kim, Dong In .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (04) :2657-2671
[7]   Dynamic programming and mixed integer programming based algorithms for the online glass cutting problem with defects and production targets [J].
Durak, Bahadir ;
Aksu, Dilek Tuzun .
INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2017, 55 (24) :7398-7411
[8]   Toward Low-Latency and Ultra-Reliable Virtual Reality [J].
Elbamby, Mohammed S. ;
Perfecto, Cristina ;
Bennis, Mehdi ;
Doppler, Klaus .
IEEE NETWORK, 2018, 32 (02) :78-84
[9]   Secure Multiple Amplify-and-Forward Relaying Over Correlated Fading Channels [J].
Fan, Lisheng ;
Zhao, Rui ;
Gong, Feng-Kui ;
Yang, Nan ;
Karagiannidis, George K. .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2017, 65 (07) :2811-2820
[10]   Deep-Learning-Based Joint Optimization of Renewable Energy Storage and Routing in Vehicular Energy Network [J].
Fu, Tingting ;
Wang, Chaoyu ;
Cheng, Nan .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) :6229-6241