Federated Deep Reinforcement Learning-Based Caching and Bitrate Adaptation for VR Panoramic Video in Clustered MEC Networks

被引:4
|
作者
Li, Yan [1 ,2 ]
机构
[1] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang 330032, Peoples R China
[2] Nanchang Inst Technol, Sch Informat Engn, Nanchang 330099, Peoples R China
基金
中国国家自然科学基金;
关键词
federated deep reinforcement learning; VR panoramic video; caching and bitrate adaptation; hierarchical clustered MEC network;
D O I
10.3390/electronics11233968
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Virtual reality (VR) panoramic video is more expressive and experiential than traditional video. With the accelerated deployment of 5G networks, VR panoramic video has experienced explosive development. The large data volume and multi-viewport characteristics of VR panoramic videos make it more difficult to cache and transcode them in advance. Therefore, VR panoramic video services urgently need to provide powerful caching and computing power over the edge network. To address this problem, this paper establishes a hierarchical clustered mobile edge computing (MEC) network and develops a data perception-driven clustered-edge transmission model to meet the edge computing and caching capabilities required for VR panoramic video services. The joint optimization problem of caching and bitrate adaptation can be formulated as a Markov Decision Process (MDP). The federated deep reinforcement learning (FDRL) algorithm is proposed to solve the problem of caching and bitrate adaptation (called FDRL-CBA) for VR panoramic video services. The simulation results show that FDRL-CBA can outperform existing DRL-based methods in the same scenarios in terms of cache hit rate and quality of experience (QoE). In conclusion, this work developed a FDRL-CBA algorithm based on a data perception-driven clustered-edge transmission model, called Hierarchical Clustered MEC Networks. The proposed method can improve the performance of VR panoramic video services.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Reinforcement Learning-Based Adaptive Bitrate Caching at MEC Server
    Lekharu, Anirban
    Chauhan, Annanya Pratap Singh
    Sur, Arijit
    Patra, Moumita
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (03): : 3292 - 3304
  • [2] Deep Reinforcement Learning-Based Collaborative Video Caching and Transcoding in Clustered and Intelligent Edge B5G Networks
    Wan, Zheng
    Li, Yan
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020 (2020):
  • [3] Deep Reinforcement Learning-Based Edge Caching in Wireless Networks
    Zhong, Chen
    Gursoy, M. Cenk
    Velipasalar, Senem
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2020, 6 (01) : 48 - 61
  • [4] Deep Reinforcement Learning-Based Edge Caching in Heterogeneous Networks
    Choi, Yoonjeong
    Lim, Yujin
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2022, 18 (06): : 803 - 812
  • [5] Federated deep reinforcement learning-based cost-efficient proactive video caching in energy-constrained mobile edge networks
    Qian, Zhen
    Li, Guanghui
    Qi, Tao
    Dai, Chenglong
    COMPUTER NETWORKS, 2025, 258
  • [6] Deep Reinforcement Learning-Based Task Scheduling in Heterogeneous MEC Networks
    Shang, Ying
    Li, Jinglei
    Qin, Meng
    Yang, Qinghai
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [7] Deep Reinforcement Learning-based Quantization for Federated Learning
    Zheng, Sihui
    Dong, Yuhan
    Chen, Xiang
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [8] Federated Deep Reinforcement Learning-Based Intelligent Dynamic Services in UAV-Assisted MEC
    Hou, Peng
    Jiang, Xiaohan
    Wang, Zongshan
    Liu, Sen
    Lu, Zhihui
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (23) : 20415 - 20428
  • [9] A Deep Reinforcement Learning-Based Caching Strategy for IoT Networks With Transient Data
    Wu, Hongda
    Nasehzadeh, Ali
    Wang, Ping
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (12) : 13310 - 13319
  • [10] A Deep Reinforcement Learning-Based Framework for Content Caching
    Zhong, Chen
    Gursoy, M. Cenk
    Velipasalar, Senem
    2018 52ND ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2018,