MACHINE LEARNING APPROACH FOR OBJECTIVE INPAINTING QUALITY ASSESSMENT

被引:5
作者
Frantc, V. A. [1 ]
Voronin, V. V. [1 ]
Marchuk, V. I. [1 ]
Sherstobitov, A. I. [1 ]
Agaian, S. [2 ]
Egiazarian, K. [3 ]
机构
[1] Don State Tech Univ, Dept Radioelect Syst, Shakhty, Russia
[2] Univ Texas San Antonio, San Antonio, TX 78712 USA
[3] Tampere Univ Technol, Dept Signal Proc, Tampere, Finland
来源
MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2014 | 2014年 / 9120卷
关键词
inpainting; quality assessment; image quality; SVR;
D O I
10.1117/12.2063664
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on a machine learning approach for objective inpainting quality assessment. Inpainting has received a lot of attention in recent years and quality assessment is an important task to evaluate different image reconstruction approaches. Quantitative metrics for successful image inpainting currently do not exist; researchers instead are relying upon qualitative human comparisons in order to evaluate their methodologies and techniques. We present an approach for objective inpainting quality assessment based on natural image statistics and machine learning techniques. Our method is based on observation that when images are properly normalized or transferred to a transform domain, local descriptors can be modeled by some parametric distributions. The shapes of these distributions are different for non-inpainted and inpainted images. Approach permits to obtain a feature vector strongly correlated with a subjective image perception by a human visual system. Next, we use a support vector regression learned on assessed by human images to predict perceived quality of inpainted images. We demonstrate how our predicted quality value repeatably correlates with a qualitative opinion in a human observer study.
引用
收藏
页数:9
相关论文
共 17 条
[1]  
[Anonymous], 2010, ACM MULTIMEDIA 2010
[2]  
Ardis Paul A., 2009, IS T SPIE ELECT IMAG
[3]  
Bertalmio M., 2001, P IEEE COMPUTER VISI, P213
[4]   State-of-the-Art in Visual Attention Modeling [J].
Borji, Ali ;
Itti, Laurent .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :185-207
[5]   Sparse Feature Fidelity for Perceptual Image Quality Assessment [J].
Chang, Hua-Wen ;
Yang, Hua ;
Gan, Yong ;
Wang, Ming-Hui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (10) :4007-4018
[6]   Efficient object-based video inpainting [J].
Cheung, Sen-Ching S. ;
Zhao, Jian ;
Venkatesh, M. Vijay .
2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, :705-+
[7]  
Dang TT, 2013, IEEE IMAGE PROC, P398, DOI 10.1109/ICIP.2013.6738082
[8]  
Gastaldo P., 2012, 6 INT WORKSH VID PRO, V12
[9]   Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality [J].
Moorthy, Anush Krishna ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (12) :3350-3364
[10]   Super-resolution for simultaneous realization of resolution enhancement and motion blur removal based on adaptive prior settings [J].
Ogawa, Takahiro ;
Izumi, Daisuke ;
Yoshizaki, Akane ;
Haseyama, Miki .
EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2013, :1-17