Latitude-Based Flexible Complexity Allocation for 360-Degree Video Coding

被引:12
|
作者
Lin, Jielian [1 ]
Lin, Liqun [1 ]
Li, Weimeng [1 ]
Xu, Yiwen [1 ]
Zhao, Tiesong [1 ,2 ]
机构
[1] Fuzhou Univ, Fujian Key Lab Intelligent Proc & Wireless Transm, Fuzhou 350116, Fujian, Peoples R China
[2] Peng Cheng Lab, Multimedia Signal Proc Studio, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Complexity theory; Encoding; Video coding; Resource management; Multimedia communication; Broadcasting; Optimization methods; 360-degree video; panoramic video; video coding; complexity optimization; SEARCH RANGE CONTROL; CU SIZE DECISION; MODE DECISION; ALGORITHM; PARTITION;
D O I
10.1109/TBC.2022.3174477
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The emerging 360-degree video has a good practical prospect in video broadcasting due to its more immersive experience than traditional videos. To maintain a high fidelity with panoramic vision, 360-degree video adopts a significantly increased resolution than planar videos, which also inevitably leads to higher encoding complexity. In this paper, we propose a flexible complexity optimization method for 360-degree video coding, in which the encoder is capable of adapting to different complexity constraints in diversified broadcasting scenarios. In particular, the proposed method is realized with a latitude-based computation complexity allocation. Firstly, it investigates the Coding Unit (CU) partition variation along the latitude (i.e., vertical axis) and divides each video frame into Largest CU (LCU)-based latitude regions. Then, it formulates the complexity allocation problem from the global complexity target to all latitude regions, by considering the intraframe dependencies and Rate-Distortion (RD) models. Finally, it calculates the solution to this complexity allocation problem and further employs it in 360-degree video coding. Comprehensive experiments on the standard dataset reveal the superiority of our method, which achieves a flexible computational time reduction from 14.53% to 68.36% whilst maintaining a high visual quality of compressed videos.
引用
收藏
页码:572 / 581
页数:10
相关论文
共 50 条
  • [21] EPASS360: QoE-Aware 360-Degree Video Streaming Over Mobile Devices
    Zhang, Yuanxing
    Guan, Yushuo
    Bian, Kaigui
    Liu, Yunxin
    Tuo, Hu
    Song, Lingyang
    Li, Xiaoming
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (07) : 2338 - 2353
  • [22] The Effect of Chair Type on Users' Viewing Experience for 360-degree Video
    Hong, Yang
    MacQuarrie, Andrew
    Steed, Anthony
    24TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2018), 2018,
  • [23] A Hybrid Control Scheme for 360-Degree Dynamic Adaptive Video Streaming Over Mobile Devices
    Wei, Xuekai
    Zhou, Mingliang
    Kwong, Sam
    Yuan, Hui
    Jia, Weijia
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (10) : 3428 - 3442
  • [24] MM360: A GPS-assisted 360-degree Video Sharing System for Participatory Events
    Shibahara, Naoya
    Kondo, Ryoma
    Iwai, Masayuki
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 4123 - 4127
  • [25] SAD360: Spherical Viewport-Aware Dynamic Tiling for 360-Degree Video Streaming
    Li, Zhijun
    Wang, Yumei
    Liu, Yu
    2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [26] Tile-Based Wireless Streaming of 360-Degree Video With Rate Adaptation Using Viewport Estimation
    Im, Yeohee
    Qiu, Tian
    Milstein, Laurence B. B.
    Cosman, Pamela C. C.
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2707 - 2711
  • [27] Efficient Scalable 360-degree Video Compression Scheme using 3D Cuboid Partitioning
    Afsana, Fariha
    Paul, Manoranjan
    Murshed, Manzur
    Taubman, David
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 996 - 1000
  • [28] Non-Orthogonal Multiple Access Enhanced Scalable 360-Degree Video Multicast
    Gao, Nianzhen
    Liu, Guanghua
    Feng, Mingjie
    Hua, Xinhai
    Jiang, Tao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8488 - 8503
  • [29] Discrete Cosine Basis Oriented Motion Modeling for Fisheye and 360 Degree Video Coding
    Ahmmed, Ashek
    Paul, Manoranjan
    2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [30] DACOD360: Deadline-Aware Content Delivery for 360-Degree Video Streaming Over MEC Networks
    Tan, Xiaobin
    Wang, Shunyi
    Xu, Xiang
    Zheng, Quan
    Yang, Jian
    Chen, Shuangwu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4168 - 4182