Latitude-Based Flexible Complexity Allocation for 360-Degree Video Coding

被引:12
|
作者
Lin, Jielian [1 ]
Lin, Liqun [1 ]
Li, Weimeng [1 ]
Xu, Yiwen [1 ]
Zhao, Tiesong [1 ,2 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350116, Fujian, Peoples R China
[2] Peng Cheng Lab, Multimedia Signal Proc Studio, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Complexity theory; Encoding; Video coding; Resource management; Multimedia communication; Broadcasting; Optimization methods; 360-degree video; panoramic video; video coding; complexity optimization; SEARCH RANGE CONTROL; CU SIZE DECISION; MODE DECISION; ALGORITHM; PARTITION;
D O I
10.1109/TBC.2022.3174477
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The emerging 360-degree video has a good practical prospect in video broadcasting due to its more immersive experience than traditional videos. To maintain a high fidelity with panoramic vision, 360-degree video adopts a significantly increased resolution than planar videos, which also inevitably leads to higher encoding complexity. In this paper, we propose a flexible complexity optimization method for 360-degree video coding, in which the encoder is capable of adapting to different complexity constraints in diversified broadcasting scenarios. In particular, the proposed method is realized with a latitude-based computation complexity allocation. Firstly, it investigates the Coding Unit (CU) partition variation along the latitude (i.e., vertical axis) and divides each video frame into Largest CU (LCU)-based latitude regions. Then, it formulates the complexity allocation problem from the global complexity target to all latitude regions, by considering the intraframe dependencies and Rate-Distortion (RD) models. Finally, it calculates the solution to this complexity allocation problem and further employs it in 360-degree video coding. Comprehensive experiments on the standard dataset reveal the superiority of our method, which achieves a flexible computational time reduction from 14.53% to 68.36% whilst maintaining a high visual quality of compressed videos.
引用
收藏
页码:572 / 581
页数:10
相关论文
共 50 条
  • [1] Game-theory-based complexity allocation for 360-degree video coding
    Lin, Jielian
    Xing, Kaiying
    Xu, Yiwen
    SIGNAL PROCESSING, 2025, 230
  • [2] Latitude-Redundancy-Aware All-Zero Block Detection for Fast 360-Degree Video Coding
    Yu, Chang
    Fan, Xiaopeng
    Chen, Pengjin
    Ni, Yuxin
    Man, Hengyu
    Zhao, Debin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6129 - 6142
  • [3] Flexible Complexity Optimization in Multiview Video Coding
    Xu, Yiwen
    Xing, Kaiying
    Liu, Hang
    Zhao, Tiesong
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (10) : 4096 - 4106
  • [4] An Adaptive Quantization Method for 360-degree Video Coding
    Xiu, Xiaoyu
    He, Yuwen
    Ye, Yan
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLI, 2018, 10752
  • [5] Viewport-adaptive 360-degree video coding
    Hu, Qiang
    Zhou, Jun
    Zhang, Xiaoyun
    Shi, Zhiru
    Gao, Zhiyong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (17-18) : 12205 - 12226
  • [6] Viewport-adaptive 360-degree video coding
    Qiang Hu
    Jun Zhou
    Xiaoyun Zhang
    Zhiru Shi
    Zhiyong Gao
    Multimedia Tools and Applications, 2020, 79 : 12205 - 12226
  • [7] Analysis of Neural Video Compression Networks for 360-Degree Video Coding
    Regensky, Andy
    Brand, Fabian
    Kaup, Andre
    2024 PICTURE CODING SYMPOSIUM, PCS 2024, 2024,
  • [8] Hybrid Cubemap Projection Format for 360-degree Video Coding
    Fanyi Duanmu
    He, Yuwen
    Xiu, Xiaoyu
    Hanhart, Philippe
    Ye, Yan
    Wang, Yao
    2018 DATA COMPRESSION CONFERENCE (DCC 2018), 2018, : 404 - 404
  • [9] Game Theory-driven Rate Control for 360-Degree Video Coding
    Zhao, Tiesong
    Lin, Jielian
    Song, Yanjie
    Wang, Xu
    Niu, Yuzhen
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3998 - 4006
  • [10] Equirectangular Projection Oriented Intra Prediction for 360-Degree Video Coding
    Wang, Yingbin
    Chen, Zhenzhong
    Liu, Shan
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 483 - 486