When Wireless Video Streaming Meets AI: A Deep Learning Approach

被引:29
|
作者
Liu, Lu [1 ,2 ]
Hu, Han [3 ]
Luo, Yong [4 ]
Wen, Yonggang [5 ]
机构
[1] Sichuan Normal Univ, Coll Movie & Media, Chengdu, Sichuan, Peoples R China
[2] Fudan Univ, Sch Journalism & Commun, Shanghai, Peoples R China
[3] Beijing Inst Technol, Sch Informat & Elect, Beijing, Peoples R China
[4] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
[5] Nanyang Technol Univ NTU, Coll Engn CoE, Res, Singapore, Singapore
基金
中国国家社会科学基金; 中国国家自然科学基金;
关键词
Streaming media; Wireless communication; Deep learning; Bit rate; Multimedia systems; Neural networks; Quality of service;
D O I
10.1109/MWC.001.1900220
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless multimedia big data contains valuable information on users' behavior, content characteristics and network dynamics, which can drive system design and optimization. The fundamental issue is how to mine data intelligence and further incorporate them into wireless multimedia systems. Motivated by the success of deep learning, in this work we propose and present an integration of wireless multimedia systems and deep learning. We start with decomposing a wireless multimedia system into three components, including end-users, network environment, and servers, and present several potential topics to embrace deep learning techniques. After that, we present deep learning based QoS/QoE prediction and bitrate adjustment as two case-studies. In the former case, we present an end-to-end and unified framework that consists of three phases, including data preprocessing, representation learning, and prediction. It achieves significant performance improvement in comparison to the best baseline algorithm (88 percent vs. 80 percent). In the latter case, we present a deep reinforcement learning based framework for bitrate adjustment. Evaluating the performance with a real wireless dataset, we show that the perceived video QoE average bitrate, rebuffering time and bitrate variation can be improved significantly.
引用
收藏
页码:127 / 133
页数:7
相关论文
共 50 条
  • [1] When architecture meets AI: A deep reinforcement learning approach for system of systems design
    Lin, Menglong
    Chen, Tao
    Chen, Honghui
    Ren, Bangbang
    Zhang, Mengmeng
    ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [2] QFlow: A Learning Approach to High QoE Video Streaming at the Wireless Edge
    Bhattacharyya, Rajarshi
    Bura, Archana
    Rengarajan, Desik
    Rumuly, Mason
    Xia, Bainan
    Shakkottai, Srinivas
    Kalathil, Dileep
    Mok, Ricky K. P.
    Dhamdhere, Amogh
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2022, 30 (01) : 32 - 46
  • [3] When Transfer Learning Meets Deep Learning
    Yang, Qiang
    CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 5 - 5
  • [4] Deep Reinforcement Learning-Based Approach for Video Streaming: Dynamic Adaptive Video Streaming over HTTP
    Souane, Naima
    Bourenane, Malika
    Douga, Yassine
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [5] When Edge Computing Meets Microgrid: A Deep Reinforcement Learning Approach
    Munir, Md. Shirajum
    Abedin, Sarder Fakhrul
    Tran, Nguyen H.
    Hong, Choong Seon
    IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (05) : 7360 - 7374
  • [6] When Video Streaming Meets Named Data Networking: A Case Study
    Wang, Lijing
    Moiseenko, Ilya
    Wang, Dongsheng
    PROCEEDINGS OF 2016 IEEE 18TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS; IEEE 14TH INTERNATIONAL CONFERENCE ON SMART CITY; IEEE 2ND INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2016, : 166 - 173
  • [7] Constrained Deep Reinforcement Learning for Low-Latency Wireless VR Video Streaming
    Li, Shaoang
    She, Changyang
    Li, Yonghui
    Vucetic, Branka
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [8] MEC-Assisted Immersive VR Video Streaming Over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach
    Du, Jianbo
    Yu, F. Richard
    Lu, Guangyue
    Wang, Junxuan
    Jiang, Jing
    Chu, Xiaoli
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) : 9517 - 9529
  • [9] Smart Streaming: Deep Learning Applications in Video Streaming Optimization
    Darwich, Mahmoud
    Khalil, Kasem
    Bayoumi, Magdy
    SOUTHEASTCON 2024, 2024, : 22 - 27
  • [10] Ensemble transfer learning meets explainable AI: A deep learning approach for leaf disease detection
    Raval, Hetarth
    Chaki, Jyotismita
    ECOLOGICAL INFORMATICS, 2024, 84