Inpainted Image Quality Evaluation Based on Saliency Map Features

被引:13
作者
Amirkhani, Dariush [1 ]
Bastanfard, Azam [2 ]
机构
[1] Iran Broadcasting Univ, Dept Engn & Media, Tehran, Iran
[2] Islamic Azad Univ Karaj, Dept Mechatron Engn, Karaj, Iran
来源
2019 5TH IRANIAN CONFERENCE ON SIGNAL PROCESSING AND INTELLIGENT SYSTEMS (ICSPIS 2019) | 2019年
关键词
Image inpainting; Objective evaluation; Saliency map; Image quality evaluation; FRAMEWORK; COMPLETION; FIELDS;
D O I
10.1109/icspis48872.2019.9066140
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Digital image inpainting is one of the most important areas in image processing science. Digital image inpainting is a set of methods to inpaint or refill the damaged areas of the images. Given the increasing use of image inpainting and the lack of a good metric for evaluating image inpainting, there is a challenge in this field. In this study an objective evaluation method for image inpainting is developed. In the proposed method, first, 100 images were inpainted using exemplar-based algorithm, then, the saliency map and its complementary region in the original image are obtained and based on saliency map features, a new objective measure for evaluation of inpainted images is proposed. A term called compensation have been taken into account. To assess the performance of the proposed objective measure, inpainted images are also evaluated using a subjective test. The experiments demonstrate that the proposed objective measure correlates with qualitative opinion in a human observer study. Finally, the objective measure is compared against three other measures and the results show that our proposed objective measure is better than the others.
引用
收藏
页数:6
相关论文
共 53 条
[1]  
[Anonymous], 2000, NEW ORL P SIGGRAPH
[2]  
[Anonymous], 2002, Itu-R Bt.500-11, V211, P1
[3]  
Ardis P., 2009, P SPIE IS T ELECT IM, V7257
[4]   ANALYSIS OF A VARIATIONAL FRAMEWORK FOR EXEMPLAR-BASED IMAGE INPAINTING [J].
Arias, P. ;
Caselles, V. ;
Facciolo, G. .
MULTISCALE MODELING & SIMULATION, 2012, 10 (02) :473-514
[5]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[6]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[7]  
Bertalmio M., 2001, PROCESSING FLAT NONF
[8]   Fast image inpainting based on coherence transport [J].
Bornemann, Folkmar ;
Maerz, Tom .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2007, 28 (03) :259-278
[9]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[10]   Geometrically Guided Exemplar-Based Inpainting [J].
Cao, Frederic ;
Gousseau, Yann ;
Masnou, Simon ;
Perez, Patrick .
SIAM JOURNAL ON IMAGING SCIENCES, 2011, 4 (04) :1143-1179