New Frame Rate Up-Conversion Algorithms with Low Computational Complexity

被引:62
作者
Kim, Un Seob [1 ]
Sunwoo, Myung Hoon [2 ]
机构
[1] Telechips Inc, Seoul, South Korea
[2] Ajou Univ, Sch Elect & Comp Engn, Suwon 442749, South Korea
关键词
Frame interpolation; frame rate up-conversion; H.264/AVC; High Efficiency Video Coding (HEVC); motion compensation; motion estimation; MOTION-COMPENSATED INTERPOLATION;
D O I
10.1109/TCSVT.2013.2278142
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a new frame rate up-conversion (FRUC) algorithm to reduce the computational complexity and to improve the peak signal-to-noise ratio (PSNR) performance. The proposed FRUC algorithm includes prediction-based motion vector smoothing (PMVS), partial average-based motion compensation (PAMC), and intrapredicted hole interpolation (IPHI). PMVS can efficiently remove outliers using motion vectors of neighboring blocks and PAMC performs motion compensation with the region-based partial average to reduce blocking artifacts of the interpolated frames. For hole interpolation, IPHI uses intraprediction of H.264/AVC to eliminate blurring and also uses the fixed weights implemented using only shift operations, which result in low computational complexity. Compared to the existing algorithms, which use bilateral motion estimation, the proposed algorithm improves the average PSNR of the interpolated frames by 3.44 dB and lowers PSNR performance only by 0.13 dB than the existing algorithm that employs unilateral ME; however, it can significantly reduce the computational complexity of FRUC about 89.3% based on the absolute difference.
引用
收藏
页码:384 / 393
页数:10
相关论文
共 21 条
[1]   A new method for region-based depth ordering in a video sequence: Application to frame interpolation [J].
Benois-Pineau, J ;
Nicolas, H .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2002, 13 (03) :363-385
[2]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[3]   Advanced frame rate conversion and performance evaluation (Reprinted from IBC 2005 Conference Proceedings) [J].
Blanchfield, P. ;
Wang, D. ;
Vincent, A. ;
Speranza, F. ;
Renaud, R. .
SMPTE MOTION IMAGING JOURNAL, 2006, 115 (04) :153-159
[4]   Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation [J].
Choi, Byeong-Doo ;
Han, Jong-Woo ;
Kim, Chang-Su ;
Ko, Sung-Jea .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2007, 17 (04) :407-416
[5]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212
[6]   True-Motion Estimation with 3-D Recursive Search Block Matching [J].
de Haan, Gerard ;
Biezen, Paul W. A. C. ;
Huijgen, Henk ;
Ojo, Olukayode A. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1993, 3 (05) :368-+
[7]   Motion compensated frame interpolation by new block-based motion estimation algorithm [J].
Ha, T ;
Lee, S ;
Kim, J .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2004, 50 (02) :752-759
[8]  
Han SC, 1997, INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL I, P747, DOI 10.1109/ICIP.1997.648065
[9]   Motion-compensated interpolation for scan rate up-conversion [J].
Huang, CL ;
Chao, TT .
OPTICAL ENGINEERING, 1996, 35 (01) :166-176
[10]   Motion compensated frame rate up-conversion using extended bilateral motion estimation [J].
Kang, Suk-Ju ;
Cho, Kyoung-Rok ;
Kim, Young Hwan .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (04) :1759-1767