Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions

被引:81
作者
Buyssens, Pierre [1 ]
Daisy, Maxime [1 ]
Tschumperle, David [1 ]
Lezoray, Olivier [1 ]
机构
[1] Univ Caen Basse Normandie, GREYC Lab, F-14032 Caen, France
关键词
Exemplar-based image inpainting; structure tensor analysis; patch lookup strategy; anisotropic spatial patch blending; IMAGE COMPLETION; OBJECT REMOVAL; PROPAGATION; FRAMEWORK; FIELDS; COLOR;
D O I
10.1109/TIP.2015.2411437
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a technical review of exemplar-based inpainting approaches with a particular focus on greedy methods. Several comparative and illustrative experiments are provided to deeply explore and enlighten these methods, and to have a better understanding on the state-of-the-art improvements of these approaches. From this analysis, three improvements over Criminisi et al. algorithm are then presented and detailed: 1) a tensor-based data term for a better selection of pixel candidates to fill in; 2) a fast patch lookup strategy to ensure a better global coherence of the reconstruction; and 3) a novel fast anisotropic spatial blending algorithm that reduces typical block artifacts using tensor models. Relevant comparisons with the state-of-the-art inpainting methods are provided that exhibit the effectiveness of our contributions.
引用
收藏
页码:1809 / 1824
页数:16
相关论文
共 54 条
  • [1] Interactive digital photomontage
    Agarwala, A
    Dontcheva, M
    Agrawala, M
    Drucker, S
    Colburn, A
    Curless, B
    Salesin, D
    Cohen, M
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03): : 294 - 302
  • [2] [Anonymous], 2001, Schooling for Tomorrow
  • [3] [Anonymous], 2003, APPL COMPUT MATH-BAK
  • [4] ANALYSIS OF A VARIATIONAL FRAMEWORK FOR EXEMPLAR-BASED IMAGE INPAINTING
    Arias, P.
    Caselles, V.
    Facciolo, G.
    [J]. MULTISCALE MODELING & SIMULATION, 2012, 10 (02) : 473 - 514
  • [5] Filling-in by joint interpolation of vector fields and gray levels
    Ballester, C
    Bertalmio, M
    Caselles, V
    Sapiro, G
    Verdera, J
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) : 1200 - 1211
  • [6] PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing
    Barnes, Connelly
    Shechtman, Eli
    Finkelstein, Adam
    Goldman, Dan B.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [7] Simultaneous structure and texture image inpainting
    Bertalmio, M
    Vese, L
    Sapiro, G
    Osher, S
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) : 882 - 889
  • [8] Image inpainting
    Bertalmio, M
    Sapiro, G
    Caselles, V
    Ballester, C
    [J]. SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, : 417 - 424
  • [9] Bornard R., 2002, P ACM INT C MULTIMED, P355
  • [10] Fast image inpainting based on coherence transport
    Bornemann, Folkmar
    Maerz, Tom
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2007, 28 (03) : 259 - 278