Error concealment via Kalman filter for heavily corrupted videos in H.264/AVC

被引:3
作者
Cui, Shihua [1 ]
Cui, Huijuan [1 ]
Tang, Kun [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Error concealment; Kalman filter; Motion vector prediction; H.264/AVC; TRACKING SYSTEM; FRAME LOSSES;
D O I
10.1016/j.image.2013.02.001
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Error concealment at the decoder side is an economical approach to ensuring an acceptable and stable video quality in case of packet erasure or loss, and thus it has attracted lots of research interest. Current techniques mainly employ the spatial or temporal correlation to predict the motion vectors (MVs) of the missing blocks, and interpolation, extrapolation or boundary matching schemes are usually effective. However, for heavily corrupted sequences, e.g., with macroblock loss rate beyond 50%, most methods might perform less satisfactorily. Inspired by the tracking efficiency of Kalman filter (KF), in the present work, we adopted it to predict the missing MVs, and the unpredicted ones (minority) were recovered complementarily using the bilinear motion field interpolation (MFI) method. Since the KF prediction is independent of the loss rate, the present framework is especially robust for heavily corrupted videos. Experimental results on typical sequences reveal that the proposed algorithm outperforms the boundary matching algorithm embedded in the H.264/AVC reference code, the MFI algorithm in the literature, and some other existing techniques by up to about 5.68 dB. (c) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:430 / 440
页数:11
相关论文
共 33 条
[1]   Enhanced error concealment with mode selection [J].
Agrafiotis, Dimitris ;
Bull, David R. ;
Canagarajah, C. Nishan .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (08) :960-973
[2]  
Al-Mualla ME, 1998, 1998 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL 3, P512, DOI 10.1109/ICIP.1998.999039
[3]   Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation [J].
Belfiore, S ;
Grangetto, M ;
Magli, E ;
Olmo, G .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (02) :316-329
[4]  
Belfiore S, 2003, 2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL 3, PROCEEDINGS, P649
[5]   Highest density gates for target tracking [J].
Breidt, FJ ;
Carriquiry, AL .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2000, 36 (01) :47-55
[6]  
Chen Y., 2004, P IEEE PICT COD S
[7]   A robust finger tracking method for multimodal wearable computer interfacing [J].
Dominguez, Sylvia M. ;
Keaton, Trish ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON MULTIMEDIA, 2006, 8 (05) :956-972
[8]   Unscented feature tracking [J].
Dorini, Leyza Baldo ;
Goldenstein, Siome Klein .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2011, 115 (01) :8-15
[9]  
Gao J, 2006, COMPUT VIS IMAGE UND, V102, P259, DOI 10.1016/j.cviu.2004.10.005
[10]  
Gao ZW, 2004, 2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 2, PROCEEDINGS, P69