Image Completion using Belief Propagation Based on Planar Priorities

被引:5
作者
Xiao, Mang [1 ,2 ]
Li, Guangyao [1 ]
Jiang, Yinyu [3 ]
Xie, Li [1 ]
He, Ye [1 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Shanghai, Peoples R China
[2] Shanghai Inst Technol, Sch Comp Sci & Informat Engn, Shanghai 201418, Peoples R China
[3] Yangtze Normal Univ, Coll Mech & Elect Engn, Chongqing, Peoples R China
来源
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS | 2016年 / 10卷 / 09期
关键词
Image completion; image inpainting; belief propagation; markov random fields; guided synthesis;
D O I
10.3837/tiis.2016.09.021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Automatic image completion techniques have difficulty processing images in which the target region has multiple planes or is non-facade. Here, we propose a new image completion method that uses belief propagation based on planar priorities. We first calculate planar information, which includes planar projection parameters, plane segments, and repetitive regularity extractions within the plane. Next, we convert this planar information into planar guide knowledge using the prior probabilities of patch transforms and offsets. Using the energy of the discrete Markov Random Field (MRF), we then define an objective function for image completion that uses the planar guide knowledge. Finally, in order to effectively optimize the MRF, we propose a new optimization scheme, termed Planar Priority-belief propagation that includes message-scheduling-based planar priority and dynamic label cropping. The results of experiment show that our approach exhibits advanced performance compared with existing approaches.
引用
收藏
页码:4405 / 4418
页数:14
相关论文
共 18 条
  • [1] [Anonymous], 1999, IEEE INT C COMP VIS, V2, P1033
  • [2] PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing
    Barnes, Connelly
    Shechtman, Eli
    Finkelstein, Adam
    Goldman, Dan B.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [3] Image inpainting
    Bertalmio, M
    Sapiro, G
    Caselles, V
    Ballester, C
    [J]. SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, : 417 - 424
  • [4] Nontexture inpainting by curvature-driven diffusions
    Chan, TF
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2001, 12 (04) : 436 - 449
  • [5] Mathematical models for local nontexture inpaintings
    Chan, TF
    Shen, JH
    [J]. SIAM JOURNAL ON APPLIED MATHEMATICS, 2002, 62 (03) : 1019 - 1043
  • [6] Region filling and object removal by exemplar-based image inpainting
    Criminisi, A
    Pérez, P
    Toyama, K
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) : 1200 - 1212
  • [7] Image Melding: Combining Inconsistent Images using Patch-based Synthesis
    Darabi, Soheil
    Shechtman, Eli
    Barnes, Connelly
    Goldman, Dan B.
    Sen, Pradeep
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04):
  • [8] Efficient belief propagation for early vision
    Felzenszwalb, Pedro F.
    Huttenlocher, Daniel P.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2006, 70 (01) : 41 - 54
  • [9] Learning low-level vision
    Freeman, WT
    Pasztor, EC
    Carmichael, OT
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2000, 40 (01) : 25 - 47
  • [10] Statistics of Patch Offsets for Image Completion
    He, Kaiming
    Sun, Jian
    [J]. COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 : 16 - 29