Image inpainting via modified exemplar-based inpainting with two-stage structure tensor and image sparse representation

被引:4
作者
Yodjai, Petcharaporn [1 ]
Kumam, Poom [1 ,2 ]
Martinez-Moreno, Juan [3 ]
Jirakitpuwapat, Wachirapong [4 ]
机构
[1] King Mongkuts Univ Technol Thonburi KMUTT, Fac Sci, Dept Math, KMUTT Fixed Point Res Lab, Sci Lab Bldg, Bangkok 10140, Thailand
[2] King Mongkuts Univ Technol Thonburi KMUTT, Fac Sci, Ctr Excellence Theoret & Computat Sci TaCS CoE, 126 Pracha Uthit Rd, Bangkok 10140, Thailand
[3] Univ Jaen, Dept Math, Jaen, Spain
[4] King Mongkuts Univ Technol North Bangkok, Fac Sci Energy & Environm, Rayong, Thailand
关键词
exemplar-based inpainting; image inpainting problem; sparse representation; structure tensor; texture synthesis;
D O I
10.1002/mma.10058
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The approach described in this research is an exemplar-based inpainting problem that combines a two-stage structure tensor and image sparse representation to fill in any missing pixels. An important step is to select the filling order and local intensity smoothness, as well as to ensure that the structure is not destroyed. We employ a two-stage structure tensor-based priority for the filling order: finding the candidate patches and determining the appropriate weight of each candidate patch under the constraint of local patch consistency, then applying a blend of a sparse linear combination of candidate patches to fill in the missing region of the image. In addition, this technique may also be used for object removal. The proposed method yields results that are visually natural and qualitative.
引用
收藏
页码:9027 / 9045
页数:19
相关论文
共 30 条
[1]   A Variational Framework for Exemplar-Based Image Inpainting [J].
Arias, Pablo ;
Facciolo, Gabriele ;
Caselles, Vicent ;
Sapiro, Guillermo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :319-347
[2]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[3]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[4]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[5]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[6]   Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions [J].
Buyssens, Pierre ;
Daisy, Maxime ;
Tschumperle, David ;
Lezoray, Olivier .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (06) :1809-1824
[7]  
Chan T. F., 2002, SIAM Journal on Applied Mathematics, V63, P564
[8]   Nontexture inpainting by curvature-driven diffusions [J].
Chan, TF .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2001, 12 (04) :436-449
[9]   Mathematical models for local nontexture inpaintings [J].
Chan, TF ;
Shen, JH .
SIAM JOURNAL ON APPLIED MATHEMATICS, 2002, 62 (03) :1019-1043
[10]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212