Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering

被引:117
作者
Ding, Ding [1 ]
Ram, Sundaresh [2 ,3 ]
Rodriguez, Jeffrey J. [1 ]
机构
[1] Univ Arizona, Dept Elect & Comp Engn, Tucson, AZ 85721 USA
[2] Univ Michigan, Dept Radiol, Ctr Mol Imaging, Ann Arbor, MI 48105 USA
[3] Univ Michigan, Dept Biomed Engn, Ann Arbor, MI 48105 USA
关键词
Exemplar-based image inpainting; nonlocal texture matching; texture synthesis; alpha-trimmed mean filter; object removal; OBJECT REMOVAL; FILLING-IN; COMPLETION; STATISTICS;
D O I
10.1109/TIP.2018.2880681
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonlocal texture similarity and local intensity smoothness are both essential for solving most image inpainting problems. In this paper, we propose a novel image inpainting algorithm that is capable of reproducing the underlying textural details using a nonlocal texture measure and also smoothing pixel intensity seamlessly in order to achieve natural-looking inpainted images. For matching texture, we propose a Gaussian-weighted nonlocal texture similarity measure to obtain multiple candidate patches for each target patch. To compute the pixel intensity, we apply the alpha-trimmed mean filter to the candidate patches to inpaint the target patch pixel-by-pixel. The proposed algorithm is compared with four current image inpainting algorithms under different scenarios, including object removal, texture synthesis, and error concealment. Experimental results show that the proposed algorithm outperforms the existing algorithms when inpainting large missing regions in images with texture and geometric structures.
引用
收藏
页码:1705 / 1719
页数:15
相关论文
共 60 条
[1]   Computational Perceptual Features for Texture Representation and Retrieval [J].
Abbadeni, Noureddine .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (01) :236-246
[2]  
[Anonymous], 2017, THESIS
[3]   A Variational Framework for Exemplar-Based Image Inpainting [J].
Arias, Pablo ;
Facciolo, Gabriele ;
Caselles, Vicent ;
Sapiro, Guillermo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :319-347
[4]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[5]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[6]   ALPHA-TRIMMED MEANS AND THEIR RELATIONSHIP TO MEDIAN FILTERS [J].
BEDNAR, JB ;
WATT, TL .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1984, 32 (01) :145-153
[7]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[8]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[9]  
Bertalmio M., 2001, P IEEE COMP SOC C CO, V1, P355, DOI DOI 10.1109/CVPR.2001.990497
[10]  
Bin Mansoor A, 2010, LECT NOTES COMPUT SC, V6474, P10, DOI 10.1007/978-3-642-17688-3_2