A Deep Reinforcement Learning-Based Optimal Computation Offloading Scheme for VR Video Transmission in Mobile Edge Networks

被引:4
作者
Xu, Xiangyang [1 ]
Song, Yu [2 ]
机构
[1] Henan Police Coll, Dept Cybersecur, Zhengzhou 450046, Peoples R China
[2] Zhengzhou Univ, Sch Comp & Artificial Intelligence, Zhengzhou 450001, Peoples R China
关键词
Virtual reality; Multi-access edge computing; Reinforcement learning; video transmission; computation offloading; mobile edge networks; reinforcement learning;
D O I
10.1109/ACCESS.2023.3327921
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Large bandwidth, Low latency and intensive computing are the main challenge in high-performance virtual reality (VR) video transmission. As mobile edge computing (MEC) can provide computation and storage resources closer to terminals, it has been a promising mode in VR video transmission to substantially improve communication quality. This work focuses on the autonomous perception ability in MEC-supported VR video transmission, and introduces deep reinforcement learning to investigate optimal task offloading solutions. Therefore, this paper proposes a deep reinforcement learning-based optimal computation offloading scheme for VR video transmission in mobile edge networks. Specifically, a Deep Deterministic Policy Gradient-based computation offloading algorithm in designed as the main technical framework. The optimal planning of computation offloading strategies is viewed as a Markov decision problem, and a deep Q-Network is employed to deal with it. Finally, the setting of MEC-supported VR video transmission scenes is simulated, in which the proposed scheme is implemented for evaluation. The results are displayed in visualization format and show that the proposed task computation scheme can possess proper performance results in MEC-supported VR video transmission scenes.
引用
收藏
页码:122772 / 122781
页数:10
相关论文
共 20 条
[1]   Lightweight Neural Network-Based Viewport Prediction for Live VR Streaming in Wireless Video Sensor Network [J].
Chen, Xiaolei ;
Cao, Baoning ;
Ahmad, Ishfaq .
MOBILE INFORMATION SYSTEMS, 2021, 2021
[2]   Design and Analysis of MEC- and Proactive Caching-Based 360° Mobile VR Video Streaming [J].
Cheng, Qi ;
Shan, Hangguan ;
Zhuang, Weihua ;
Yu, Lu ;
Zhang, Zhaoyang ;
Quek, Tony Q. S. .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :1529-1544
[3]   An MEC-Enabled Wireless VR Transmission System with View Synthesis-based Caching [J].
Dai, Jianmei ;
Liu, Danpu .
2019 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOP (WCNCW), 2019,
[4]   A View Synthesis-Based 360° VR Caching System Over MEC-Enabled C-RAN [J].
Dai, Jianmei ;
Zhang, Zhilong ;
Mao, Shiwen ;
Liu, Danpu .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (10) :3843-3855
[5]   MEC-Assisted Immersive VR Video Streaming Over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach [J].
Du, Jianbo ;
Yu, F. Richard ;
Lu, Guangyue ;
Wang, Junxuan ;
Jiang, Jing ;
Chu, Xiaoli .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) :9517-9529
[6]  
Feng XL, 2020, 2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR 2020), P800, DOI [10.1109/VR46266.2020.00005, 10.1109/VR46266.2020.1584727730619]
[7]   A Blockchain-Based Scheme for Secure Data Offloading in Healthcare With Deep Reinforcement Learning [J].
He, Qiang ;
Feng, Zheng ;
Fang, Hui ;
Wang, Xingwei ;
Zhao, Liang ;
Yao, Yudong ;
Yu, Keping .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (01) :65-80
[8]   Tile caching for scalable VR video streaming over 5G mobile networks* [J].
Liu, Kedong ;
Liu, Yanwei ;
Liu, Jinxia ;
Argyriou, Antonios .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 79 (79)
[9]   Rendering-Aware VR Video Caching Over Multi-Cell MEC Networks [J].
Liu, Yanwei ;
Liu, Jinxia ;
Argyriou, Antonios ;
Wang, Liming ;
Xu, Zhen .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (03) :2728-2742
[10]   Optimal Wireless Streaming of Multi-Quality 360 VR Video By Exploiting Natural, Relative Smoothness-Enabled, and Transcoding-Enabled Multicast Opportunities [J].
Long, Kaixuan ;
Cui, Ying ;
Ye, Chencheng ;
Liu, Zhi .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :3670-3683