An image inpainting method for object removal based on difference degree constraint

被引:0
作者
Lei Zhang
Minhui Chang
机构
[1] Yuncheng University,School of Mathematics and Information Technology
来源
Multimedia Tools and Applications | 2021年 / 80卷
关键词
Image inpainting; Object removal; Exemplar; Difference degree;
D O I
暂无
中图分类号
学科分类号
摘要
In the inpainting method for object removal, SSD (Sum of Squared Differences) is commonly used to measure the degree of similarity between the exemplar patch and the target patch, which has a very important impact on the restoration results. Although the matching rule is relatively simple, it is likely to lead to the occurrence of mismatch error. Even worse, the error may be accumulated along with the process continues. Finally some unexpected objects may be introduced into the target region, making the result unable to meet the requirements of visual consistency. In view of these problems, we propose an inpainting method for object removal based on difference degree constraint. Firstly, we define the MSD (Mean of Squared Differences) and use it to measure the degree of differences between corresponding pixels at known positions in the target patch and the exemplar patch. Secondly, we define the SMD (Square of Mean Differences) and use it to measure the degree of differences between the pixels at known positions in the target patch and the pixels at unknown positions in the exemplar patch. Thirdly, based on MSD and SMD, we define a new matching rule and use it to find the most similar exemplar patch in the source region. Finally, we use the exemplar patch to restore the target patch. Experimental results show that the proposed method can effectively prevent the occurrence of mismatch error and improve the restoration effect.
引用
收藏
页码:4607 / 4626
页数:19
相关论文
共 115 条
[1]  
Aharon M(2006)K-SVD: an algorithm for designing over-complete dictionaries for sparse representation IEEE Trans Signal Process 54 4311-4322
[2]  
Elad M(2011)Contour eetection and hierarchical image segmentation IEEE Trans Pattern Anal Mach Intell 33 898-916
[3]  
Bruckstein A(2015)Self-content-based audio inpainting Signal Process 111 61-72
[4]  
Arbelaez P(2014)A comparative study of existing exemplar based region filling algorithms Int J Current Eng Technol 4 3532-3539
[5]  
Maire M(2001)Nontexture inpainting by curvature-driven diffusions J Vis Commun Image Represent 12 436-449
[6]  
Fowlkes C(2002)Mathematical models for local nontexture inpaintings SIAM J Appl Math 62 1019-1043
[7]  
Malik J(2019)An image inpainting technique on chinese paintings J Comput (Taiwan) 29 121-135
[8]  
Bahat Y(2004)Region filling and object removal by exemplar-based image inpainting IEEE Trans Image Process 13 1200-1212
[9]  
Schechner YY(2015)Exemplar-based image inpainting using a modified priority definition PLOS one 10 1-18
[10]  
Elad M(2019)Learning-Based Texture synthesis and automatic inpainting using support vector machines IEEE Trans Ind Electron 66 4777-4787