Design Space Exploration of Practical VVC Encoding for Emerging Media Applications

被引:5
作者
Sainio, Joose [1 ]
Mercat, Alexandre [1 ]
Vanne, Jarno [1 ]
机构
[1] Tampere Univ, Ultra Video Grp, Tampere 33101, Finland
关键词
Encoding; Complexity theory; Artificial intelligence; Spatial resolution; Decoding; Streaming media; Video coding; Distortion measurement; Coding tree unit (CTU) structure; design space exploration (DSE); rate-distortion-complexity (RDC); video coding; versatile video coding (VVC); DISTORTION-COMPLEXITY ANALYSIS; HEVC;
D O I
10.1109/TCE.2022.3194596
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Versatile Video Coding (VVC/H.266) is the latest video coding standard designed for a broad range of next-generation media applications. This paper explores the design space of practical VVC encoding by profiling the Fraunhofer Versatile Video Encoder (VVenC). All experiments were conducted over five 2160p video sequences and their downsampled versions under the random access (RA) condition. The exploration was performed by analyzing the rate-distortion-complexity (RDC) of the VVC block structure and coding tools. First, VVenC was profiled to provide a breakdown of coding block distribution and coding tool utilization in it. Then, the usefulness of each VVC coding tool was analyzed for its individual impact on overall RDC performance. Finally, our findings were elevated to practical implementation guidelines: the highest coding gains come with the multi type tree (MTT) structure, adaptive loop filter (ALF), cross component linear model (CCLM), and bi-directional optical flow (BDOF) coding tools, whereas multi transform selection (MTS) and affine motion estimation are the primary candidates for complexity reduction. To the best of our knowledge, this is the first work to provide a comprehensive RDC analysis for practical VVC encoding. It can serve as a basis for practical VVC encoder implementation or optimization on various computing platforms.
引用
收藏
页码:387 / 400
页数:14
相关论文
共 41 条
  • [1] [Anonymous], SNAP
  • [2] [Anonymous], 2020, 230028 ISOIEC DTR
  • [3] [Anonymous], 2018, CISC VIS NETW IND GL
  • [4] [Anonymous], VVC REFERENCE SOFTWA
  • [5] Bjontegaard G., 2008, VCEGAI11 INT TEL UN
  • [6] Bossen F., 2020, JVETT2010 INT TEL UN
  • [7] Bossen F., 2021, JVETU0003 INT TEL UN
  • [8] VVC Complexity and Software Implementation Analysis
    Bossen, Frank
    Suehring, Karsten
    Wieckowski, Adam
    Liu, Shan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (10) : 3765 - 3778
  • [9] Brandenburg J., 2020, VVenC v1.2.0 document v1.
  • [10] Brandenburg J, 2020, IEEE INT WORKSH MULT