Exemplar-based inpainting using local binary patterns

被引:1
作者
Voronin, V. V. [1 ]
Marchuk, V. I. [1 ]
Gapon, N. V. [1 ]
Sizyakin, R. A. [1 ]
Sherstobitov, A. I. [1 ]
Egiazarian, K. O. [2 ]
机构
[1] Don State Tech Univ, Dept Radioelect Syst, Shakhty, Russia
[2] Tampere Univ Technol, Dept Signal Proc, Tampere, Finland
来源
IMAGE PROCESSING: ALGORITHMS AND SYSTEMS XII | 2014年 / 9019卷
关键词
image inpainting; interpolation; exemplar-based method; local binary pattern; texture synthesis; TEXTURE SYNTHESIS; IMAGE; INTERPOLATION;
D O I
10.1117/12.2038556
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
This paper focuses on novel image reconstruction method based on modified exemplar-based technique. The basic idea is to find an example (patch) from an image using local binary patterns, and replacing non-existed (`lost') data with it. We propose to use multiple criteria for a patch similarity search since often in practice existed exemplar-based methods produce unsatisfactory results. The criteria for searching the best matching uses several terms, including Euclidean metric for pixel brightness and Chi-squared histogram matching distance for local binary patterns. A combined use of textural geometric characteristics together with color information allows to get more informative description of the patches. Texture synthesis method proposed by Efros and Freeman for patch restoration is utilized in the proposed method. It allows optimizing an overlap region between patches using minimum error boundary cut. Several examples considered in this paper show the effectiveness of the proposed approach for large objects removal as well as recovery of small regions on several test images.
引用
收藏
页数:12
相关论文
共 39 条
[1]  
[Anonymous], 2011, P 18 IEEE ICIP
[2]   A Variational Framework for Exemplar-Based Image Inpainting [J].
Arias, Pablo ;
Facciolo, Gabriele ;
Caselles, Vicent ;
Sapiro, Guillermo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :319-347
[3]   EXEMPLAR-BASED INPAINTING FROM A VARIATIONAL POINT OF VIEW [J].
Aujol, Jean-Francois ;
Ladjal, Said ;
Masnou, Simon .
SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2010, 42 (03) :1246-1285
[4]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[5]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[6]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[7]  
Bertalmio M., 2001, PROC CVPR IEEE, V1, pI, DOI [10.1109/cvpr.2001.990497, DOI 10.1109/CVPR.2001.990497]
[8]   Geometrically Guided Exemplar-Based Inpainting [J].
Cao, Frederic ;
Gousseau, Yann ;
Masnou, Simon ;
Perez, Patrick .
SIAM JOURNAL ON IMAGING SCIENCES, 2011, 4 (04) :1143-1179
[9]   Mathematical models for local nontexture inpaintings [J].
Chan, TF ;
Shen, JH .
SIAM JOURNAL ON APPLIED MATHEMATICS, 2002, 62 (03) :1019-1043
[10]   Sketch-guided texture-based image inpainting [J].
Chen, Yan ;
Luan, Qing ;
Li, Houqiang ;
Au, Oscar .
2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, :1997-+