Quality, enhancement of frame rate up-converted video by adaptive frame skip and reliable motion extraction

被引:45
作者
Yang, Ya-Ting [1 ]
Tung, Yi-Shin
Wu, Ja-Ling
机构
[1] Natl Taiwan Univ, Dept Comp Sci & Engn, Commun & Multimedia Lab, Taipei 106, Taiwan
[2] Foxconn Corp, Hon Hai Percis Ind Co Ltd, Taipei 236, Taiwan
[3] Natl Taiwan Univ, Grad Inst Networking & Multimedia, Taipei 106, Taiwan
关键词
adaptive frame skip; frame rate up-conversion (FRUC); motion-compensated frame interpolation (MACFI);
D O I
10.1109/TCSVT.2007.903806
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Frame rate up-conversion is a postprocessing tool to convert the frame rate from a lower number to a higher one. It is a useful technique for a lot of practical applications, such as display format conversion, low bit rate video coding and slow motion playback. Unlike traditional approaches, such as frame repetition or linear frame interpolation, motion-compensated frame interpolation (MCFI) technique is more efficient since it takes block motion into account. In this paper, by considering the deficiencies of previous works, new criteria and coding schemes for improving motion derivation and interpolation processes are proposed. Next, for video coding applications, adaptive frame skip is executed at the encoder side to maximize the power of MCFI so that the quality of interpolated frames is guaranteed. Experimental results show that our proposal effectively enhances the overall quality of the frame rate up-converted video sequence, both subjectively and objectively.
引用
收藏
页码:1700 / 1713
页数:14
相关论文
共 28 条
[1]  
ALMUALLA ME, 2003, IEEE ISCAS MAY, V2, P652
[2]   A method for motion adaptive frame rate up-conversion [J].
Castagno, R ;
Haavisto, P ;
Ramponi, G .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1996, 6 (05) :436-446
[3]  
Chen T, 2002, 2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, P313
[4]   Frame-rate up-conversion using transmitted true motion vectors [J].
Chen, YK ;
Vetro, A ;
Sun, HF ;
Kung, SY .
1998 IEEE SECOND WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 1998, :622-627
[5]  
Chi Wah Tang, 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187), P122, DOI 10.1109/ISCAS.1998.698774
[6]   New frame rate up-conversion using bi-directional motion estimation [J].
Choi, BT ;
Lee, SH ;
Ko, SJ .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2000, 46 (03) :603-609
[7]  
Fu MF, 2002, 2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, P393, DOI 10.1109/ICIP.2002.1038988
[8]   Motion compensated frame interpolation by new block-based motion estimation algorithm [J].
Ha, T ;
Lee, S ;
Kim, J .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2004, 50 (02) :752-759
[9]   Using motion-compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences [J].
Hilman, K ;
Park, HW ;
Kim, Y .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2000, 10 (06) :869-877
[10]   Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure [J].
Jeon, BW ;
Lee, GI ;
Lee, SH ;
Park, RH .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2003, 49 (03) :499-508