Structure-aware image inpainting using patch scale optimization

被引:22
作者
Chen, Zhihua [1 ]
Dai, Chao [1 ]
Jiang, Lei [1 ]
Sheng, Bin [2 ]
Zhang, Jing [1 ]
Lin, Weiyao [2 ]
Yuan, Yubo [1 ]
机构
[1] E China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Texture synthesis; Local structure multiplier; Patch scale optimization; COMPLETION; FRAMEWORK; INDEX;
D O I
10.1016/j.jvcir.2016.06.029
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting is widely used in many image processing applications such as image stitching, image editing and object removal. The main challenge stems from producing visually plausible results after reconstruction. Most of the image inpainting algorithms cannot maintain structure continuity and texture consistency precisely. To address this problem, we propose a robust exemplar-based inpainting algorithm. Firstly, we present local structure multiplier to contain sufficient structure information in the priority function which ensures the structure continuity. Secondly, we combine color feature and space distance between two patches to search for the optimized patch to avoid texture inconsistency. At last, we calculate the average pixel difference between two patches under each candidate scale, we select the scale which the minimal average pixel difference is to be the optimized scale. We copy the target patch with the optimized patch. Extensive experiments show the effectiveness of the proposed method. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:312 / 323
页数:12
相关论文
共 37 条
[1]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[2]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[3]   Fast image inpainting based on coherence transport [J].
Bornemann, Folkmar ;
Maerz, Tom .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2007, 28 (03) :259-278
[4]   A Comprehensive Framework for Image Inpainting [J].
Bugeau, Aurelie ;
Bertalmio, Marcelo ;
Caselles, Vicent ;
Sapiro, Guillermo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (10) :2634-2645
[5]   A Fast Optimization Transfer Algorithm for Image Inpainting in Wavelet Domains [J].
Chan, Raymond H. ;
Wen, You-Wei ;
Yip, Andy M. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (07) :1467-1476
[6]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212
[7]  
Darabi S., 2012, ACM T GRAPHIC, V32, P8201
[8]   A wavelet-laplace variational technique for image deconvolution and inpainting [J].
Dobrosotskaya, Julia A. ;
Bertozzi, Andrea L. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (05) :657-663
[9]  
Efros A. A., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P1033, DOI 10.1109/ICCV.1999.790383
[10]   Image Completion by Diffusion Maps and Spectral Relaxation [J].
Gepshtein, Shai ;
Keller, Yosi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (08) :2983-2994