Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions

被引:89
作者
Buyssens, Pierre [1 ]
Daisy, Maxime [1 ]
Tschumperle, David [1 ]
Lezoray, Olivier [1 ]
机构
[1] Univ Caen Basse Normandie, GREYC Lab, F-14032 Caen, France
关键词
Exemplar-based image inpainting; structure tensor analysis; patch lookup strategy; anisotropic spatial patch blending; IMAGE COMPLETION; OBJECT REMOVAL; PROPAGATION; FRAMEWORK; FIELDS; COLOR;
D O I
10.1109/TIP.2015.2411437
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a technical review of exemplar-based inpainting approaches with a particular focus on greedy methods. Several comparative and illustrative experiments are provided to deeply explore and enlighten these methods, and to have a better understanding on the state-of-the-art improvements of these approaches. From this analysis, three improvements over Criminisi et al. algorithm are then presented and detailed: 1) a tensor-based data term for a better selection of pixel candidates to fill in; 2) a fast patch lookup strategy to ensure a better global coherence of the reconstruction; and 3) a novel fast anisotropic spatial blending algorithm that reduces typical block artifacts using tensor models. Relevant comparisons with the state-of-the-art inpainting methods are provided that exhibit the effectiveness of our contributions.
引用
收藏
页码:1809 / 1824
页数:16
相关论文
共 54 条
[1]   Interactive digital photomontage [J].
Agarwala, A ;
Dontcheva, M ;
Agrawala, M ;
Drucker, S ;
Colburn, A ;
Curless, B ;
Salesin, D ;
Cohen, M .
ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03) :294-302
[2]  
[Anonymous], 2001, Schooling for Tomorrow
[3]  
[Anonymous], 2003, APPL COMPUT MATH-BAK
[4]   ANALYSIS OF A VARIATIONAL FRAMEWORK FOR EXEMPLAR-BASED IMAGE INPAINTING [J].
Arias, P. ;
Caselles, V. ;
Facciolo, G. .
MULTISCALE MODELING & SIMULATION, 2012, 10 (02) :473-514
[5]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[6]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[7]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[8]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[9]  
Bornard R., 2002, P ACM INT C MULTIMED, P355
[10]   Fast image inpainting based on coherence transport [J].
Bornemann, Folkmar ;
Maerz, Tom .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2007, 28 (03) :259-278