A frame-level MLP-based bit-rate controller for real-time video transmission using VVC standard

被引:10
作者
Raufmehr, Farhad [1 ]
Salehi, Mohammad Reza [1 ,2 ]
Abiri, Ebrahim [1 ]
机构
[1] Shiraz Univ Technol, Dept Elect & Elect Engn, Shiraz, Iran
[2] Reg Informat Ctr Sci & Technol, Shiraz, Iran
关键词
Versatile video coding (VVC); Bit-rate; Buffer; Control; Quantization parameter (QP); Multi-layer perceptron (MLP); RATE CONTROL ALGORITHM; GAME-THEORY; HEVC; ALLOCATION; QUALITY; OPTIMIZATION;
D O I
10.1007/s11554-020-01018-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-time video transmission is one of the most popular applications that are included in the versatile video coding (VVC) standard. However, real-time applications are encountered with practical limitations, including the buffer size and available bandwidth. In these applications, the buffer overflow and underflow should be strictly prevented and also the bit-rate fluctuation should be suppressed. In this paper, a video bit-rate controller is proposed that completely conforms with the constraints of real-time applications. The proposed controller is based on a multi-layer perceptron (MLP) neural network which estimates the proper quantization parameter (QP) modification at the frame level. The buffer occupancy is directly included in the QP derivation process for robust buffer control. Experimental results show that the proposed bit-rate controller fulfils the buffering constraints and controls the bit-rate accurately. The average bit-rate error of the proposed method is 0.29% while providing a low initial buffering delay of about 0.21 s. Also, the rate-distortion analysis shows that the performance of the proposed method is close to those of the conventional algorithms.
引用
收藏
页码:751 / 763
页数:13
相关论文
共 38 条
[11]   Inter-Block Dependency-Based CTU Level Rate Control for HEVC [J].
Guo, Hongwei ;
Zhu, Ce ;
Xu, Mai ;
Li, Shuai .
IEEE TRANSACTIONS ON BROADCASTING, 2020, 66 (01) :113-126
[12]  
Hagan M.T., 2014, Neural Networks Design
[13]   Efficient frame-level bit allocation algorithm for H.265/HEVC [J].
He, Jing ;
Yang, Fuzheng .
IET IMAGE PROCESSING, 2017, 11 (04) :245-257
[14]  
Humberto Ochoa Domnguez K.R.R, 2019, SIGNAL IMAGE SPEECH
[15]  
Joginipelly A, 2012, SE SYM SYS THRY, P78, DOI 10.1109/SSST.2012.6195131
[16]   Efficient separable convolution using field programmable gate arrays [J].
Joginipelly, Arjun Kumar ;
Charalampidis, Dimitrios .
MICROPROCESSORS AND MICROSYSTEMS, 2019, 71
[17]   A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for High Efficiency Video Coding [J].
Lee, Bumshik ;
Kim, Munchurl ;
Nguyen, Truong Q. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (03) :465-479
[18]   λ Domain Rate Control Algorithm for High Efficiency Video Coding [J].
Li, Bin ;
Li, Houqiang ;
Li, Li ;
Zhang, Jinlei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) :3841-3854
[19]   λ-Domain Optimal Bit Allocation Algorithm for High Efficiency Video Coding [J].
Li, Li ;
Li, Bin ;
Li, Houqiang ;
Chen, Chang Wen .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (01) :130-142
[20]   λ-Domain Rate Control Algorithm for HEVC Scalable Extension [J].
Li, Li ;
Li, Bin ;
Liu, Dong ;
Li, Houqiang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (10) :2023-2039