A Reinforcement Learning Framework for Multi-source Adaptive Streaming

被引:1
作者
Nguyen, Nghia T. [1 ,2 ]
Vo, Phuong L. [1 ,2 ]
Nguyen, Thi Thanh Sang [1 ,2 ]
Le, Quan M. [1 ,2 ]
Do, Cuong T. [3 ]
Nguyen, Ngoc-Thanh [4 ]
机构
[1] Int Univ, Ho Chi Minh City, Vietnam
[2] Vietnam Natl Univ, Ho Chi Minh City, Vietnam
[3] Kyung Hee Univ, Yongin, South Korea
[4] Wroclaw Univ Sci & Technol, Wroclaw, Poland
来源
COMPUTATIONAL COLLECTIVE INTELLIGENCE (ICCCI 2021) | 2021年 / 12876卷
关键词
Multi-source streaming; Reinforcement learning; Deep Q-learning; Dynamic adaptation streaming over HTTP; DASH;
D O I
10.1007/978-3-030-88081-1_31
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dynamic adaptive streaming over HTTP (DASH) is widely used in video streaming recently. With DASH, a video is stored in multiple equal-playing-time chunks with different quality levels. Video chunks are in-order delivered from a single source over a path in traditional DASH. The adaptation function in video player chooses a suitable quality level to request depending on current network status for each video chunk. In modern networks such as content delivery networks, edge caching, content-centric networks, etc., popular video contents are replicated at multiple cache nodes. Utilizing multiple sources for video streaming is investigated in this paper. We propose a reinforcement learning based algorithm, called RAMS, for rate adaptation in multi-source video streaming. The proposed algorithm outperforms the other notable adaptation methods.
引用
收藏
页码:416 / 426
页数:11
相关论文
共 15 条
[1]  
[Anonymous], 2012, P 3 MULT SYST C MMSY
[2]  
[Anonymous], 2017, Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2016-2021 White Paper
[3]  
[Anonymous], DASH REFERENCE CLIEN
[4]   DQ-DASH: A Queuing Theory Approach to Distributed Adaptive Video Streaming [J].
Bentaleb, Abdelhak ;
Yadav, Praveen Kumar ;
Ooi, Wei Tsang ;
Zimmermann, Roger .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)
[5]   MSPlayer: Multi-Source and Multi-Path Video Streaming [J].
Chen, Yung-Chih ;
Towsley, Don ;
Khalili, Ramin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2016, 34 (08) :2198-2206
[6]   Design and optimisation of a (FA)Q-learning-based HTTP adaptive streaming client [J].
Claeys, Maxim ;
Latre, Steven ;
Famaey, Jeroen ;
Wu, Tingyao ;
Van Leekwijck, Werner ;
De Turck, Filip .
CONNECTION SCIENCE, 2014, 26 (01) :25-43
[7]   D-DASH: A Deep Q-Learning Framework for DASH Video Streaming [J].
Gadaleta, Matteo ;
Chiariotti, Federico ;
Rossi, Michele ;
Zanella, Andrea .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2017, 3 (04) :703-718
[8]  
ISO Standard, 2014, 230091 ISO IEC
[9]   Neural Adaptive Video Streaming with Pensieve [J].
Mao, Hongzi ;
Netravali, Ravi ;
Alizadeh, Mohammad .
SIGCOMM '17: PROCEEDINGS OF THE 2017 CONFERENCE OF THE ACM SPECIAL INTEREST GROUP ON DATA COMMUNICATION, 2017, :197-210
[10]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533