Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions

被引:89
作者
Buyssens, Pierre [1 ]
Daisy, Maxime [1 ]
Tschumperle, David [1 ]
Lezoray, Olivier [1 ]
机构
[1] Univ Caen Basse Normandie, GREYC Lab, F-14032 Caen, France
关键词
Exemplar-based image inpainting; structure tensor analysis; patch lookup strategy; anisotropic spatial patch blending; IMAGE COMPLETION; OBJECT REMOVAL; PROPAGATION; FRAMEWORK; FIELDS; COLOR;
D O I
10.1109/TIP.2015.2411437
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a technical review of exemplar-based inpainting approaches with a particular focus on greedy methods. Several comparative and illustrative experiments are provided to deeply explore and enlighten these methods, and to have a better understanding on the state-of-the-art improvements of these approaches. From this analysis, three improvements over Criminisi et al. algorithm are then presented and detailed: 1) a tensor-based data term for a better selection of pixel candidates to fill in; 2) a fast patch lookup strategy to ensure a better global coherence of the reconstruction; and 3) a novel fast anisotropic spatial blending algorithm that reduces typical block artifacts using tensor models. Relevant comparisons with the state-of-the-art inpainting methods are provided that exhibit the effectiveness of our contributions.
引用
收藏
页码:1809 / 1824
页数:16
相关论文
共 54 条
[21]  
Daisy Maxime, 2013, SIGGRAPH ASIA 2013 T, P1
[22]   A NOTE ON THE GRADIENT OF A MULTIIMAGE [J].
DIZENZO, S .
COMPUTER VISION GRAPHICS AND IMAGE PROCESSING, 1986, 33 (01) :116-125
[23]   Fragment-based image completion [J].
Drori, I ;
Cohen-Or, D ;
Yeshurun, H .
ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03) :303-312
[24]  
Efros A. A., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P1033, DOI 10.1109/ICCV.1999.790383
[25]   Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) [J].
Elad, M ;
Starck, JL ;
Querre, P ;
Donoho, DL .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2005, 19 (03) :340-358
[26]   Image editing in the contour domain [J].
Elder, JH ;
Goldberg, RM .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (03) :291-296
[27]   Object removal and loss concealment using neighbor embedding methods [J].
Guillemot, Christine ;
Turkan, Mehmet ;
Le Meur, Olivier ;
Ebdelli, Mounira .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2013, 28 (10) :1405-1419
[28]   Image Inpainting [J].
Guillemot, Christine ;
Le Meur, Olivier .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (01) :127-144
[29]   Statistics of Patch Offsets for Image Completion [J].
He, Kaiming ;
Sun, Jian .
COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 :16-29
[30]  
He KM, 2012, PROC CVPR IEEE, P111, DOI 10.1109/CVPR.2012.6247665