Full Reference Quality Assessment for Image Retargeting Based on Natural Scene Statistics Modeling and Bi-Directional Saliency Similarity

被引:30
作者
Chen, Zhibo [1 ]
Lin, Jianxin [1 ]
Liao, Ning [1 ]
Chen, Chang Wen [2 ]
机构
[1] Univ Sci & Technol China, Hefei 230026, Peoples R China
[2] SUNY Buffalo, Dept Comp Sci & Engn, Buffalo, NY 14260 USA
关键词
Image quality assessment; image retargeting; natural scene statistics; bi-directional salient information loss measurement; DISTANCE;
D O I
10.1109/TIP.2017.2736422
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image retargeting technology has been widely studied to adapt images for the devices with heterogeneous screen resolutions. Meanwhile effective objective retargeting quality assessment algorithms are also very important for optimizing and selecting favorable retargeting methods. Unlike previous assessment algorithms which rely on image local structure features and unidirectional prediction of information loss, we propose a bi-directional natural salient scene distortion model (BNSSD) including image natural scene statistics (NSS) measurement, salient global structure distortion measurement, and bi-directional salient information loss measurement. First, we propose a new NSS model in log-Gabor domain and verify its effectiveness in reflecting nature scene statistical distortions introduced during the retargeting process. Second, the concept of salient global structure distortion is proposed to measure the global structure uniformity in the corresponding salient regions between original and retargeted images. Finally, we propose a bidirectional salient information loss metric to measure the information loss between salient areas in original image and retargeted image. The effectiveness of the BNSSD model is verified on two widely recognized public databases, and the experimental results show that our method outperforms the state-of-the-art algorithms under different statistical assessment criteria.
引用
收藏
页码:5138 / 5148
页数:11
相关论文
共 42 条
[1]  
[Anonymous], PROC 22 ACM INT
[2]  
[Anonymous], 2007, 2007 IEEE 11 INT C C, DOI DOI 10.1109/ICCV.2007.4409010
[3]   Seam carving for content-aware image resizing [J].
Avidan, Shai ;
Shamir, Ariel .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[4]   UNCERTAINTY RELATION FOR RESOLUTION IN SPACE, SPATIAL-FREQUENCY, AND ORIENTATION OPTIMIZED BY TWO-DIMENSIONAL VISUAL CORTICAL FILTERS [J].
DAUGMAN, JG .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1985, 2 (07) :1160-1169
[5]   Visual saliency estimation by nonlinearly integrating features using region covariances [J].
Erdem, Erkut ;
Erdem, Aykut .
JOURNAL OF VISION, 2013, 13 (04)
[6]   Objective Quality Assessment for Image Retargeting Based on Structural Similarity [J].
Fang, Yuming ;
Zeng, Kai ;
Wang, Zhou ;
Lin, Weisi ;
Fang, Zhijun ;
Lin, Chia-Wen .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2014, 4 (01) :95-105
[7]   Distributed Hierarchical Processing in the Primate Cerebral Cortex [J].
Felleman, Daniel J. ;
Van Essen, David C. .
CEREBRAL CORTEX, 1991, 1 (01) :1-47
[8]   RELATIONS BETWEEN THE STATISTICS OF NATURAL IMAGES AND THE RESPONSE PROPERTIES OF CORTICAL-CELLS [J].
FIELD, DJ .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1987, 4 (12) :2379-2394
[9]   DeepSim: Deep similarity for image quality assessment [J].
Gao, Fei ;
Wang, Yi ;
Li, Panpeng ;
Tan, Min ;
Yu, Jun ;
Zhu, Yani .
NEUROCOMPUTING, 2017, 257 :104-114
[10]   Biologically inspired image quality assessment [J].
Gao, Fei ;
Yu, Jun .
SIGNAL PROCESSING, 2016, 124 :210-219