Joint frame-level and CTU-level rate control based on constant perceptual quality

被引:0
|
作者
Yang, Changshui [1 ]
Liu, Yan [1 ]
Liu, Qiang [1 ]
Zhang, Chi [1 ]
Wang, Wenyong [1 ]
机构
[1] Macau Univ Sci & Technol, Ave Wai Long, Macau 999078, Peoples R China
关键词
Video coding; Rate control; Perceptual distortion; Constant perceptual quality; RATE-DISTORTION OPTIMIZATION; OPTIMAL BIT ALLOCATION; HEVC; ALGORITHM; MODEL;
D O I
10.1007/s00530-024-01329-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a given network bandwidth, optimizing the rate control to achieve the best compression performance is essential in video communication and storage. Besides the enhancement of the overall coding efficiency, the rate control algorithm for constant perceptual quality video coding is also a significant research topic in video coding. However, most existing constant perceptual quality rate control algorithms either emphasize on the frame level or the CTU level, which have not considered the local and global perceptual quality sufficiently. Therefore, this paper presents an improved joint frame-level and CTU-level constant perceptual quality rate control algorithm framework to further improve the quality consistence and compression performance. Firstly, we propose a frame-level constant perceptual quality rate control method based on just noticeable difference (JND) and game theory model. The method aims to effectively control the perceptual quality by optimizing the current frame-level Lagrange multiplier in the GOP (Group of Pictures). Secondly, taking into account the JND-based CTU-level spatial and temporal masking effects, we propose a joint intra-frame and inter-frame CTU-level perceptual rate control method. The method utilizes the frame-level Lagrange multiplier to generate the optimal perceptual coding performance for each CTU. Finally, by integrating the two levels of optimization, we develop an innovative constant perceptual quality rate control algorithm to efficiently balance the perceptual quality and rate control demands of video coding. Experiments demonstrate that the constant perceptual quality rate control algorithm proposed in this paper can achieve remarkable improvements in subjective and objective rate-distortion optimization performance, as well as quality constancy performance while ensuring the enhancement of rate control precision.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] A Modified Speaking Rate Estimation Based on Frame-Level LSTM
    Xiao, Yanhong
    Du, Shixuan
    Xie, Xiang
    Wang, Jing
    Zhan, Qingran
    PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 600 - 603
  • [22] ENHANCED CTU-LEVEL INTER PREDICTION WITH DEEP FRAME RATE UP-CONVERSION FOR HIGH EFFICIENCY VIDEO CODING
    Zhao, Lei
    Wang, Shiqi
    Zhang, Xinfeng
    Wang, Shanshe
    Ma, Siwei
    Gao, Wen
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 206 - 210
  • [23] GOP Level Quality Dependency Based Frame Level Rate Control Algorithm
    Zhang, Meng
    Zhang, Guanwen
    Wei, Henglu
    Zhou, Wei
    Duan, Zhemin
    2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,
  • [24] A Frame-Level Constant Bit-Rate Control Using Recursive Bayesian Estimation for Versatile Video Coding
    Hyun, Myung Han
    Lee, Bumshik
    Kim, Munchurl
    IEEE ACCESS, 2020, 8 : 227255 - 227269
  • [25] SNR-based frame-level video bit rate allocation
    Zhuang, Xinhua
    Liu, Li
    Lan, Junqiang
    2006 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-11, PROCEEDINGS, 2006, : 2869 - +
  • [26] Optimal CTU-level bit allocation in HEVC for low bit-rate applications
    Wang, Peng
    Ni, Cui
    Li, Zhe
    Zhang, Guangyuan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (16) : 23733 - 23747
  • [27] An Improved Parametric Bit Rate Model for Frame-level Rate Control in Video Coding
    Chen, Zhifeng
    Doken, Serhad
    Wu, Dapeng
    2011 DATA COMPRESSION CONFERENCE (DCC), 2011, : 451 - 451
  • [28] An Efficient Frame-Level Rate Control Algorithm for High Efficiency Video Coding
    Lin, Yubei
    Zhang, Xingming
    Xiao, Jianen
    Su, Shengkai
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2016, 10 (04): : 1877 - 1891
  • [29] Optimal CTU-level bit allocation in HEVC for low bit-rate applications
    Peng Wang
    Cui Ni
    Zhe Li
    Guangyuan Zhang
    Multimedia Tools and Applications, 2019, 78 : 23733 - 23747
  • [30] A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for High Efficiency Video Coding
    Lee, Bumshik
    Kim, Munchurl
    Nguyen, Truong Q.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (03) : 465 - 479