Exemplar-Based Pixel by Pixel Inpainting Based on Patch Shift

被引:6
作者
Qiang, Zhenping [1 ,2 ]
He, Libo [1 ]
Xu, Dan [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, 2 Cuihubei Rd, Kunming 650091, Yunnan, Peoples R China
[2] Southwest Forestry Univ, Dept Comp & Informat Sci, Kunming, Yunnan, Peoples R China
来源
COMPUTER VISION, PT II | 2017年 / 772卷
基金
中国国家自然科学基金;
关键词
Image inpainting; Patch shift; Exemplar-based image inpainting; Object removal; IMAGE COMPLETION; FRAMEWORK;
D O I
10.1007/978-981-10-7302-1_31
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel exemplar-based image inpainting method. It performs patch-shift based information statistics and incorporates the result into the data filling process. The central idea to ensure the confidence pixel value to fill is based on patch shift that captures the statistic information from the expanded filling patches' most similar patches. Our approach outperforms the original exemplar-based inpainting in a large number of examples on removing large occluding objects and thin scratches in real and synthetic images, at the cost of some additional computation. It inherits well-known advantages of the exemplar-based inpainting method, such as the capability of maintaining the integrity and consistency of image structure information, and the adaptability to many application scenarios. Experiments on synthetic and natural images show the advantages of our approach, especially, in the big target removing task our method yields generally better results.
引用
收藏
页码:370 / 382
页数:13
相关论文
共 30 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]  
[Anonymous], 2006, 2006 IEEE COMP SOC C
[3]   A Variational Framework for Exemplar-Based Image Inpainting [J].
Arias, Pablo ;
Facciolo, Gabriele ;
Caselles, Vicent ;
Sapiro, Guillermo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :319-347
[4]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[5]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[6]  
Bertalmío M, 2001, PROC CVPR IEEE, P355
[7]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[8]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[9]   Fast image inpainting based on coherence transport [J].
Bornemann, Folkmar ;
Maerz, Tom .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2007, 28 (03) :259-278
[10]   A Comprehensive Framework for Image Inpainting [J].
Bugeau, Aurelie ;
Bertalmio, Marcelo ;
Caselles, Vicent ;
Sapiro, Guillermo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (10) :2634-2645