Region-Based Template Matching Prediction for Intra Coding

被引:2
作者
Venugopal, Gayathri [1 ]
Muller, Karsten [1 ]
Pfaff, Jonathan [1 ]
Schwarz, Heiko [1 ,2 ]
Marpe, Detlev [1 ]
Wiegand, Thomas [1 ,3 ]
机构
[1] Fraunhofer HHI, D-10587 Berlin, Germany
[2] Free Univ Berlin, D-14195 Berlin, Germany
[3] Tech Univ Berlin, Informat Technol, D-10623 Berlin, Germany
关键词
Decoding; Video coding; Image coding; Indexes; Encoding; Distortion; Prediction algorithms; Template matching; video coding; intra-picture prediction; AVC; HEVC; VVC; MOTION VECTOR DERIVATION; EFFICIENCY;
D O I
10.1109/TIP.2022.3233184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Copy prediction is a renowned category of prediction techniques in video coding where the current block is predicted by copying the samples from a similar block that is present somewhere in the already decoded stream of samples. Motion-compensated prediction, intra block copy, template matching prediction etc. are examples. While the displacement information of the similar block is transmitted to the decoder in the bit-stream in the first two approaches, it is derived at the decoder in the last one by repeating the same search algorithm which was carried out at the encoder. Region-based template matching is a recently developed prediction algorithm that is an advanced form of standard template matching. In this method, the reference area is partitioned into multiple regions and the region to be searched for the similar block(s) is conveyed to the decoder in the bit-stream. Further, its final prediction signal is a linear combination of already decoded similar blocks from the given region. It was demonstrated in previous publications that region-based template matching is capable of achieving coding efficiency improvements for intra as well as inter-picture coding with considerably less decoder complexity than conventional template matching. In this paper, a theoretical justification for region-based template matching prediction subject to experimental data is presented. Additionally, the test results of the aforementioned method on the latest H.266/Versatile Video Coding (VVC) test model (version VTM-14.0) yield an average Bjontegaard-Delta (BD) bit-rate savings of -0.75% using all intra (AI) configuration with 130% encoder run-time and 104% decoder run-time for a particular parameter selection.
引用
收藏
页码:779 / 790
页数:12
相关论文
共 50 条
  • [1] A UNIFIED REGION-BASED TEMPLATE MATCHING APPROACH FOR INTRA AND INTER PREDICTION IN VVC
    Venugopal, Gayathri
    Mueller, Karsten
    Marpe, Detlev
    Wiegand, Thomas
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4115 - 4119
  • [2] Adaptive Weighted Averaged Template Matching Prediction for Intra Coding
    Zhang, Yi
    Sun, Yucheng
    Zhang, Qing
    Yu, Lu
    2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [3] Region-based Template Matching for Decoder-Side Motion Vector Derivation
    Venugopal, Gayathri
    Marpe, Detlev
    Wiegand, Thomas
    2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
  • [4] Intra prediction by template matching
    Tan, Thiow Keng
    Boon, Choong Seng
    Suzuki, Yoshinori
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 1693 - 1696
  • [5] Hybrid Angular Intra/Template Matching Prediction for HEVC Intra Coding
    Zhang, Tao
    Chen, Haoming
    Sun, Ming-Ting
    Zhao, Debin
    Gao, Wen
    2015 VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2015,
  • [6] A SET OF TEMPLATE MATCHING PREDICTORS FOR INTRA VIDEO CODING
    Moinard, Matthieu
    Amonou, Isabelle
    Duhamel, Pierre
    Brault, Patrice
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 1422 - 1425
  • [7] Intra prediction by averaged template matching predictors
    Tan, Thiow Keng
    Boon, Choong Seng
    Slizuki, Yoshinori
    2007 4TH IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1-3, 2007, : 405 - +
  • [8] INTRA FRAME CODING WITH TEMPLATE MATCHING PREDICTION AND ADAPTIVE TRANSFORM
    Lan, Cuiling
    Xu, Jizheng
    Wu, Feng
    Shi, Guangming
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 1221 - 1224
  • [9] A region-based subband coding scheme
    Casas, JR
    Torres, L
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 1997, 10 (1-3) : 173 - 200
  • [10] Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction
    Luo, Dan
    Xiong, Shuhua
    Ren, Chao
    Sheriff, Raymond Edward
    He, Xiaohai
    SENSORS, 2022, 22 (16)