Motion-Compensated Temporal Frame Interpolation Algorithm Based on Global Entirety Unidirectional Motion Estimation and Local Fast Bidirectional Motion Estimation

被引:3
作者
Shi, Zhiyong [1 ,2 ]
Tian, Fengchun [1 ]
Deng, Minjun [1 ]
Liu, Depeng [1 ]
机构
[1] Chongqing Univ, Coll Commun Engn, 174 Shazhengjie, Chongqing 400030, Peoples R China
[2] Chongqing Commun Inst, A-1 Linyuan, Chongqing 400035, Peoples R China
基金
中国国家自然科学基金;
关键词
Global observation; local fast search; motion estimation; motion-compensated temporal frame interpolation (MCTFI); frame rate up-conversion (FRUC); exposure and occlusion; RATE UP-CONVERSION; LOW COMPUTATIONAL-COMPLEXITY; VECTOR;
D O I
10.1142/S0218001417580010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To solve the uncertainty of motion for objects displayed on liquid crystal display (LCD), the motion estimation (ME) algorithm on the basis of global entirety unidirectional motion and local fast bidirectional motion (GEU-LFB) is proposed for motion-compensated temporal frame interpolation (MCTFI). Firstly, by observing the moving objects in the scene, we will obtain a set of global motion vectors (MVs). Secondly, the fast local search based on the bidirectional ME is executed. Additionally, to make up for the defect of the bidirectional ME, a method to generate the exposure mask and the occlusion mask is proposed by cleverly using the matching criterion of absolute difference and the set of global MVs. Next, the optimal MV field is smoothed by the vector median filter. Finally, the temporal interpolation frame obtained through the weighted filtering compensation method is further improved by using masks. Overall, the experimental results show that the proposed algorithm has better performance than the existing methods in terms of objective and subjective criteria. Moreover, it can solve problems of exposure and occlusion, and get better frame interpolation for the video sequence with fast moving targets.
引用
收藏
页数:22
相关论文
共 25 条
[1]  
Akin A, 2010, IEEE INT CONF VLSI, P207, DOI 10.1109/VLSISOC.2010.5642661
[2]   VECTOR MEDIAN FILTERS [J].
ASTOLA, J ;
HAAVISTO, P ;
NEUVO, Y .
PROCEEDINGS OF THE IEEE, 1990, 78 (04) :678-689
[3]   Advanced frame rate conversion and performance evaluation (Reprinted from IBC 2005 Conference Proceedings) [J].
Blanchfield, P. ;
Wang, D. ;
Vincent, A. ;
Speranza, F. ;
Renaud, R. .
SMPTE MOTION IMAGING JOURNAL, 2006, 115 (04) :153-159
[4]   New frame rate up-conversion using bi-directional motion estimation [J].
Choi, BT ;
Lee, SH ;
Ko, SJ .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2000, 46 (03) :603-609
[5]  
Guo Y, 2013, INT CONF ACOUST SPEE, P1424, DOI 10.1109/ICASSP.2013.6637886
[6]   Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure [J].
Jeon, BW ;
Lee, GI ;
Lee, SH ;
Park, RH .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2003, 49 (03) :499-508
[7]  
Jung HS, 2012, EUR SIGNAL PR CONF, P385
[8]   Dual Motion Estimation for Frame Rate Up-Conversion [J].
Kang, Suk-Ju ;
Yoo, Sungjoo ;
Kim, Young Hwan .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2010, 20 (12) :1909-1914
[9]   Multiframe-based Bilateral Motion Estimation with Emphasis on Stationary Caption Processing for Frame Rate Up-Conversion [J].
Kang, Suk-Ju ;
Yoo, Dong-Gon ;
Lee, Sung-Kyu ;
Kim, Young Hwan .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2008, 54 (04) :1830-1838
[10]  
Kaup A., 1994, P INT C AC SPEECH SI, V5, P501