Latitude-Based Flexible Complexity Allocation for 360-Degree Video Coding

被引:12
|
作者
Lin, Jielian [1 ]
Lin, Liqun [1 ]
Li, Weimeng [1 ]
Xu, Yiwen [1 ]
Zhao, Tiesong [1 ,2 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350116, Fujian, Peoples R China
[2] Peng Cheng Lab, Multimedia Signal Proc Studio, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Complexity theory; Encoding; Video coding; Resource management; Multimedia communication; Broadcasting; Optimization methods; 360-degree video; panoramic video; video coding; complexity optimization; SEARCH RANGE CONTROL; CU SIZE DECISION; MODE DECISION; ALGORITHM; PARTITION;
D O I
10.1109/TBC.2022.3174477
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The emerging 360-degree video has a good practical prospect in video broadcasting due to its more immersive experience than traditional videos. To maintain a high fidelity with panoramic vision, 360-degree video adopts a significantly increased resolution than planar videos, which also inevitably leads to higher encoding complexity. In this paper, we propose a flexible complexity optimization method for 360-degree video coding, in which the encoder is capable of adapting to different complexity constraints in diversified broadcasting scenarios. In particular, the proposed method is realized with a latitude-based computation complexity allocation. Firstly, it investigates the Coding Unit (CU) partition variation along the latitude (i.e., vertical axis) and divides each video frame into Largest CU (LCU)-based latitude regions. Then, it formulates the complexity allocation problem from the global complexity target to all latitude regions, by considering the intraframe dependencies and Rate-Distortion (RD) models. Finally, it calculates the solution to this complexity allocation problem and further employs it in 360-degree video coding. Comprehensive experiments on the standard dataset reveal the superiority of our method, which achieves a flexible computational time reduction from 14.53% to 68.36% whilst maintaining a high visual quality of compressed videos.
引用
收藏
页码:572 / 581
页数:10
相关论文
共 50 条
  • [41] A low-complexity rate allocation algorithm for joint source-channel video coding
    Milani, Simone
    Calvagno, Giancarlo
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2009, 24 (05) : 368 - 383
  • [42] Efficient Scalable UHD/360-Video Coding by Exploiting Common Information With Cuboid-Based Partitioning
    Afsana, Fariha
    Paul, Manoranjan
    Murshed, Manzur
    Taubman, David
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3961 - 3977
  • [43] REGION-BASED RATE CONTROL AND BIT ALLOCATION FOR VIDEO CODING
    Wang, Da-Yong
    Sun, Shi-Xin
    2008 INTERNATIONAL CONFERENCE ON APPERCEIVING COMPUTING AND INTELLIGENCE ANALYSIS (ICACIA 2008), 2008, : 147 - 151
  • [44] Complexity Control Based on a Fast Coding Unit Decision Method in the HEVC Video Coding Standard
    Jimenez-Moreno, Amaya
    Martinez-Enriquez, Eduardo
    Diaz-de-Maria, Fernando
    IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (04) : 563 - 575
  • [45] Energy-Efficient 360-Degree Video Rendering on FPGA via Algorithm-Architecture Co-Design
    Sun, Qiuyue
    Taherin, Amir
    Siatitse, Yawo
    Zhu, Yuhao
    2020 ACM/SIGDA INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE GATE ARRAYS (FPGA '20), 2020, : 97 - 103
  • [46] Computational complexity allocation and control for inter-coding of high efficiency video coding with fast coding unit split decision
    Fang, Jiunn-Tsair
    Chen, Zong-Yi
    Lai, Chang-Rui
    Chang, Pao-Chi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 40 : 34 - 41
  • [47] Live 360 Degree Video Delivery Based on User Collaboration in a Streaming Flock
    Sun, Liyang
    Mao, Yixiang
    Zong, Tongyu
    Liu, Yong
    Wang, Yao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2636 - 2647
  • [48] Low Complexity Coding Unit Decision for Video-Based Point Cloud Compression
    Gao, Wei
    Yuan, Hang
    Li, Ge
    Li, Zhu
    Yuan, Hui
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 149 - 162
  • [49] Rate-distortion optimal bit allocation for object-based video coding
    Wang, HH
    Schuster, GM
    Katsaggelos, AK
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2005, 15 (09) : 1113 - 1123
  • [50] Macroblock based bit allocation for snr scalable video coding with hierarchical B pictures
    Rusert, Thomas
    Ohm, Jens-Rainer
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 177 - +