Hybrid error concealment method combining exemplar-based image inpainting and spatial interpolation

被引:17
作者
Chung, Byungjin [1 ]
Yim, Changhoon [1 ]
机构
[1] Konkuk Univ, Dept Internet & Multimedia Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
Image reconstruction; Error concealment; Image inpainting; Spatial interpolation; Video communication; OBJECT REMOVAL; VIDEO; FRAMEWORK;
D O I
10.1016/j.image.2014.09.009
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes an efficient error concealment method for the reconstruction of pixels that are lost in video communication. The proposed method is developed by combining exemplar-based image inpainting for patch reconstruction and spatial interpolation for pixel reconstruction using adaptive threshold by local complexity. By exemplar-based image inpainting, regions with regular structures are reconstructed. For complex regions with irregular structures, just one pixel is reconstructed using the proposed spatial interpolation method. The proposed spatial interpolation method performs reconstruction by selecting adaptively directional interpolation or neighbor interpolation based on gradient information. Simulation results show that the proposed hybrid method performs reconstruction with significantly improved subjective quality compared with the previous spatial error concealment and image inpainting methods. The proposed method also gives substantial improvements of PSNR compared with the previous methods. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:1121 / 1137
页数:17
相关论文
共 33 条
[1]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[2]  
Bertalmío M, 2001, PROC CVPR IEEE, P355
[3]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[4]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[5]   A multi-resolution, geometry-driven error concealment method for corrupted JPEG color images [J].
Bourdon, P ;
Augereau, B ;
Chatellier, C ;
Olivier, C .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2005, 20 (07) :681-694
[6]   A Comprehensive Framework for Image Inpainting [J].
Bugeau, Aurelie ;
Bertalmio, Marcelo ;
Caselles, Vicent ;
Sapiro, Guillermo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (10) :2634-2645
[7]   Hardware-oriented image inpainting for perceptual I-frame error concealment [J].
Chen, Ching-Yi ;
Wu, Guan-Lin ;
Chien, Shao-Yi .
PROCEEDINGS OF 2008 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-10, 2008, :836-+
[8]   A joint motion-image inpainting method for error concealment in video coding [J].
Chen, L. Y. ;
Chan, S. C. ;
Shum, H. Y. .
2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, :2241-+
[9]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212
[10]  
Criminisi A, 2003, PROC CVPR IEEE, P721