A frame-level MLP-based bit-rate controller for real-time video transmission using VVC standard

被引:10
作者
Raufmehr, Farhad [1 ]
Salehi, Mohammad Reza [1 ,2 ]
Abiri, Ebrahim [1 ]
机构
[1] Shiraz Univ Technol, Dept Elect & Elect Engn, Shiraz, Iran
[2] Reg Informat Ctr Sci & Technol, Shiraz, Iran
关键词
Versatile video coding (VVC); Bit-rate; Buffer; Control; Quantization parameter (QP); Multi-layer perceptron (MLP); RATE CONTROL ALGORITHM; GAME-THEORY; HEVC; ALLOCATION; QUALITY; OPTIMIZATION;
D O I
10.1007/s11554-020-01018-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-time video transmission is one of the most popular applications that are included in the versatile video coding (VVC) standard. However, real-time applications are encountered with practical limitations, including the buffer size and available bandwidth. In these applications, the buffer overflow and underflow should be strictly prevented and also the bit-rate fluctuation should be suppressed. In this paper, a video bit-rate controller is proposed that completely conforms with the constraints of real-time applications. The proposed controller is based on a multi-layer perceptron (MLP) neural network which estimates the proper quantization parameter (QP) modification at the frame level. The buffer occupancy is directly included in the QP derivation process for robust buffer control. Experimental results show that the proposed bit-rate controller fulfils the buffering constraints and controls the bit-rate accurately. The average bit-rate error of the proposed method is 0.29% while providing a low initial buffering delay of about 0.21 s. Also, the rate-distortion analysis shows that the performance of the proposed method is close to those of the conventional algorithms.
引用
收藏
页码:751 / 763
页数:13
相关论文
共 38 条
[1]  
[Anonymous], 2015, High Efficiency Video Coding: Coding Tools and Specification
[2]  
[Anonymous], 2016, IEEE T CIRCUITS SYST, DOI DOI 10.1109/TCSVT.2016.2589878
[3]   General Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC [J].
Bross, Benjamin ;
Andersson, Kenneth ;
Blaser, Max ;
Drugeon, Virginie ;
Kim, Seung-Hwan ;
Lainema, Jani ;
Li, Jingya ;
Liu, Shan ;
Ohm, Jens-Rainer ;
Sullivan, Gary J. ;
Yu, Ruoyang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (05) :1226-1240
[4]   The Joint Exploration Model (JEM) for Video Compression With Capability Beyond HEVC [J].
Chen, Jianle ;
Karczewicz, Marta ;
Huang, Yu-Wen ;
Choi, Kiho ;
Ohm, Jens-Rainer ;
Sullivan, Gary J. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (05) :1208-1225
[5]   An Optimized Rate Control for Low-Delay H.265/HEVC [J].
Chen, Zhenzhong ;
Pan, Xiang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) :4541-4552
[6]   Pixel-Wise Unified Rate-Quantization Model for Multi-Level Rate Control [J].
Choi, Hyomin ;
Yoo, Jonghun ;
Nam, Junghak ;
Sim, Donggyu ;
Bajic, Ivan V. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2013, 7 (06) :1112-1123
[7]   Novel PID-Fuzzy Video Rate Controller for High-Delay Applications of the HEVC Standard [J].
Fani, Davoud ;
Rezaei, Mehdi .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (06) :1379-1389
[8]   Data-Driven Rate Control for Rate-Distortion Optimization in HEVC Based on Simplified Effective Initial QP Learning [J].
Gao, Wei ;
Kwong, Sam ;
Jiang, Qiuping ;
Fong, Chi-Keung ;
Wong, Peter H. W. ;
Yuen, Wilson Y. F. .
IEEE TRANSACTIONS ON BROADCASTING, 2019, 65 (01) :94-108
[9]   Joint Machine Learning and Game Theory for Rate Control in High Efficiency Video Coding [J].
Gao, Wei ;
Kwong, Sam ;
Jia, Yuheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (12) :6074-6089
[10]   SSIM-Based Game Theory Approach for Rate-Distortion Optimized Intra Frame CTU-Level Bit Allocation [J].
Gao, Wei ;
Kwong, Sam ;
Zhou, Yu ;
Yuan, Hui .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (06) :988-999