New Frame Rate Up-Conversion Algorithms with Low Computational Complexity

被引:61
作者
Kim, Un Seob [1 ]
Sunwoo, Myung Hoon [2 ]
机构
[1] Telechips Inc, Seoul, South Korea
[2] Ajou Univ, Sch Elect & Comp Engn, Suwon 442749, South Korea
关键词
Frame interpolation; frame rate up-conversion; H.264/AVC; High Efficiency Video Coding (HEVC); motion compensation; motion estimation; MOTION-COMPENSATED INTERPOLATION;
D O I
10.1109/TCSVT.2013.2278142
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a new frame rate up-conversion (FRUC) algorithm to reduce the computational complexity and to improve the peak signal-to-noise ratio (PSNR) performance. The proposed FRUC algorithm includes prediction-based motion vector smoothing (PMVS), partial average-based motion compensation (PAMC), and intrapredicted hole interpolation (IPHI). PMVS can efficiently remove outliers using motion vectors of neighboring blocks and PAMC performs motion compensation with the region-based partial average to reduce blocking artifacts of the interpolated frames. For hole interpolation, IPHI uses intraprediction of H.264/AVC to eliminate blurring and also uses the fixed weights implemented using only shift operations, which result in low computational complexity. Compared to the existing algorithms, which use bilateral motion estimation, the proposed algorithm improves the average PSNR of the interpolated frames by 3.44 dB and lowers PSNR performance only by 0.13 dB than the existing algorithm that employs unilateral ME; however, it can significantly reduce the computational complexity of FRUC about 89.3% based on the absolute difference.
引用
收藏
页码:384 / 393
页数:10
相关论文
共 21 条
  • [1] A new method for region-based depth ordering in a video sequence: Application to frame interpolation
    Benois-Pineau, J
    Nicolas, H
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2002, 13 (03) : 363 - 385
  • [2] Image inpainting
    Bertalmio, M
    Sapiro, G
    Caselles, V
    Ballester, C
    [J]. SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, : 417 - 424
  • [3] Advanced frame rate conversion and performance evaluation (Reprinted from IBC 2005 Conference Proceedings)
    Blanchfield, P.
    Wang, D.
    Vincent, A.
    Speranza, F.
    Renaud, R.
    [J]. SMPTE MOTION IMAGING JOURNAL, 2006, 115 (04): : 153 - 159
  • [4] Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation
    Choi, Byeong-Doo
    Han, Jong-Woo
    Kim, Chang-Su
    Ko, Sung-Jea
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2007, 17 (04) : 407 - 416
  • [5] Region filling and object removal by exemplar-based image inpainting
    Criminisi, A
    Pérez, P
    Toyama, K
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) : 1200 - 1212
  • [6] True-Motion Estimation with 3-D Recursive Search Block Matching
    de Haan, Gerard
    Biezen, Paul W. A. C.
    Huijgen, Henk
    Ojo, Olukayode A.
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1993, 3 (05) : 368 - +
  • [7] Motion compensated frame interpolation by new block-based motion estimation algorithm
    Ha, T
    Lee, S
    Kim, J
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2004, 50 (02) : 752 - 759
  • [8] Han SC, 1997, INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL I, P747, DOI 10.1109/ICIP.1997.648065
  • [9] Motion-compensated interpolation for scan rate up-conversion
    Huang, CL
    Chao, TT
    [J]. OPTICAL ENGINEERING, 1996, 35 (01) : 166 - 176
  • [10] Motion compensated frame rate up-conversion using extended bilateral motion estimation
    Kang, Suk-Ju
    Cho, Kyoung-Rok
    Kim, Young Hwan
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (04) : 1759 - 1767