Region-of-Interest Based Coding Scheme for Live Videos

被引:0
作者
Dou, Xiuxin [1 ,2 ]
Cao, Xixin [1 ]
Zhang, Xianguo [2 ]
机构
[1] Peking Univ, Sch Software & Microelect, Beijing 100871, Peoples R China
[2] Tencent, Shannon Lab, Cloud Architecture & Platform Dept, Technol & Engn Grp, Shenzhen 100193, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 09期
关键词
video coding; rate control; ROI; live broadcast; high bit rate; ALLOCATION;
D O I
10.3390/app14093823
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In this paper, we introduce a novel rate control scheme specifically tailored for live broadcasting scenarios. Notably, in high-definition live transmissions of sports events and video game competitions that typically exceed 1080 p resolution and run at frame rates of 60 fps or higher, the transcoding speed of encoders often becomes a limiting factor, leading to streams with substantial bitrates but unsatisfactory quality metrics. To enhance the overall Quality of Service (QoS) without increasing the bitrate, it is essential to improve the quality of Regions of Interest (ROI).Our proposed solution presents an ROI-based rate reservoir model that ingeniously leverages Convolutional Neural Networks (CNNs) to predict rate control parameters. This approach aims to optimize the bitrate allocation within high bitrate live broadcasts, thus enhancing the image quality within ROIs. Experimental outcomes demonstrate that this algorithm manages to increase the bitrate by no more than 5%, effectively redistributing the reduced bitrate across the entire Group of Pictures (GOP). As a result, it ensures a gradual decrease in the quality of Regions of Uninterest (ROU), thereby maintaining a balanced quality experience throughout the broadcasted content.
引用
收藏
页数:13
相关论文
共 25 条
[1]   Region of interest enabled learned image coding for machines [J].
Ahonen, Jukka, I ;
Le, Nam ;
Zhang, Honglei ;
Cricri, Francesco ;
Rahtu, Esa .
2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,
[2]  
[Anonymous], 2013, Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools: Techniques and Tools
[3]  
Chen K, 2019, Arxiv, DOI arXiv:1906.07155
[4]  
Chen ML, 2014, IEEE INT CON MULTI
[5]   Region-of-interest video coding based on rate and distortion variations for H.263+ [J].
Chi, Ming-Chieh ;
Chen, Mei-Juan ;
Yeh, Chia-Hung ;
Jhu, Jyong-An .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2008, 23 (02) :127-142
[6]   REGION-OF-INTEREST BASED RATE CONTROL SCHEME WITH FLEXIBLE QUALITY ON DEMAND [J].
Chiang, Jui-Chiu ;
Hsieh, Cheng-Sheng ;
Chang, George ;
Jou, Fan-Di ;
Lie, Wen-Nung .
2010 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2010), 2010, :238-242
[7]  
Ching-Yu Wu, 2009, Proceedings of the 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing. IIH-MSP 2009, P194, DOI 10.1109/IIH-MSP.2009.114
[8]   Low bit-rate coding of image sequences using adaptive regions of interest [J].
Doulamis, N ;
Doulamis, A ;
Kalogeras, D ;
Kollias, S .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1998, 8 (08) :928-934
[9]   TRANSFORMER-BASED VARIABLE-RATE IMAGE COMPRESSION WITH REGION-OF-INTEREST CONTROL [J].
Kao, Chia-Hao ;
Weng, Ying-Chieh ;
Chen, Yi-Hsin ;
Chiu, Wei-Chen ;
Peng, Wen-Hsiao .
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, :2960-2964
[10]   λ Domain Rate Control Algorithm for High Efficiency Video Coding [J].
Li, Bin ;
Li, Houqiang ;
Li, Li ;
Zhang, Jinlei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) :3841-3854