A frame-level MLP-based bit-rate controller for real-time video transmission using VVC standard

被引:0
作者
Farhad Raufmehr
Mohammad Reza Salehi
Ebrahim Abiri
机构
[1] Shiraz University of Technology,Department of Electrical and Electronics Engineering
[2] Regional Information Center for Science and Technology,undefined
来源
Journal of Real-Time Image Processing | 2021年 / 18卷
关键词
Versatile video coding (VVC); Bit-rate; Buffer; Control; Quantization parameter (QP); Multi-layer perceptron (MLP);
D O I
暂无
中图分类号
学科分类号
摘要
Real-time video transmission is one of the most popular applications that are included in the versatile video coding (VVC) standard. However, real-time applications are encountered with practical limitations, including the buffer size and available bandwidth. In these applications, the buffer overflow and underflow should be strictly prevented and also the bit-rate fluctuation should be suppressed. In this paper, a video bit-rate controller is proposed that completely conforms with the constraints of real-time applications. The proposed controller is based on a multi-layer perceptron (MLP) neural network which estimates the proper quantization parameter (QP) modification at the frame level. The buffer occupancy is directly included in the QP derivation process for robust buffer control. Experimental results show that the proposed bit-rate controller fulfils the buffering constraints and controls the bit-rate accurately. The average bit-rate error of the proposed method is 0.29% while providing a low initial buffering delay of about 0.21 s. Also, the rate-distortion analysis shows that the performance of the proposed method is close to those of the conventional algorithms.
引用
收藏
页码:751 / 763
页数:12
相关论文
共 110 条
[1]  
Sullivan GJ(2018)Video coding standards progress report: joint video experts team launches the versatile video coding project SMPTE Motion Imaging J. 127 94-98
[2]  
Chen J(2019)The joint exploration model (JEM) for video compression with capability beyond HEVC IEEE Trans. Circuits Syst. Video Technol. 30 1208-1225
[3]  
Karczewicz M(2019)General video coding technology in responses to the joint call for proposals on video compression with capability beyond HEVC IEEE Trans. Circuits Syst. Video Technol. 30 1226-1240
[4]  
Huang Y-W(2019)Efficient separable convolution using field programmable gate arrays Microprocess. Microsyst. 71 102852-1123
[5]  
Choi K(2013)Pixel-wise unified rate-quantization model for multi-level rate control IEEE J. Sel. Top. Signal Process. 7 1112-479
[6]  
Ohm J-R(2013)A frame-level rate control scheme based on texture and nontexture rate models for high efficiency video coding IEEE Trans. Circuits Syst. Video Technol. 24 465-2454
[7]  
Sullivan GJ(2013)Rate control for consistent objective quality in high efficiency video coding IEEE Trans. Image Process. 22 2442-1111
[8]  
Bross B(2013)Rate-GOP based rate control for high efficiency video coding IEEE J. Sel. Top. Signal Process. 7 1101-24560
[9]  
Joginipelly AK(2020)CTU layer rate control algorithm in scene change video for free-viewpoint video IEEE Access 8 24549-3854
[10]  
Charalampidis D(2014)λ-Domain rate control algorithm for high efficiency video coding IEEE Trans. Image Process. 23 3841-2039