Objective quality assessment of retargeted images based on RBF neural network with structural distortion and content change

被引:0
作者
Zhou, Bin [1 ]
Liu, Ze'an [1 ]
Ji, Jiayu [1 ]
Wang, Xuanyin [1 ]
机构
[1] Zhejiang Univ, State Key Lab Fluid Power & Mechatron Syst, 38 Zheda Rd, Hangzhou 310027, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Image retargeting quality assessment; RBF neural network; Feature matching; Visual saliency; VISUAL-ATTENTION; COLOR;
D O I
10.1007/s11042-022-13662-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective quality assessment of retargeted images aims to find the best retargeting method for showing an image on different display terminals. This paper uses a Radial Basis Function (RBF) neural network to assess the quality of retargeted images. First, invariant feature points in the original image and their counterparts in the retargeted image are matched in a spatial order-preserving manner. Feature points centered local patches are extracted from original and retargeted images. Then, multi-scale local structural similarity and multi-scale local HSV color histograms difference of matched local patches are measured. A saliency map is employed as the weights of the local patches for evaluating the structural distortion and content change. Finally, the overall assessment of the retargeted image quality can be obtained by the RBF neural network. Experimental results on a benchmark test show the high consistency between the proposed objective assessment and subjective evaluations, and our method is closer to the practical application due to its simplicity compared with those complex ones.
引用
收藏
页码:7463 / 7477
页数:15
相关论文
共 41 条
[1]  
[Anonymous], 2008, COMPUT VIS IMAGE UND
[2]   Seam carving for content-aware image resizing [J].
Avidan, Shai ;
Shamir, Ariel .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[3]   GENERALIZING THE HOUGH TRANSFORM TO DETECT ARBITRARY SHAPES [J].
BALLARD, DH .
PATTERN RECOGNITION, 1981, 13 (02) :111-122
[4]  
Broomhead D. S., 1988, Complex Systems, V2, P321
[5]  
Castillo S, 2011, P ACM SIGGRAPH S APP, P7, DOI [10.1145/2077451.2077453, DOI 10.1145/2077451.2077453]
[6]   Image quality assessment based on a degradation model [J].
Damera-Venkata, N ;
Kite, TD ;
Geisler, WS ;
Evans, BL ;
Bovik, AC .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (04) :636-650
[7]   Optimized Image Resizing Using Seam Carving and Scaling [J].
Dong, Weiming ;
Zhou, Ning ;
Paul, Jean-Claude ;
Zhang, Xiaopeng .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (05) :1-10
[8]   Objective Quality Assessment for Image Retargeting Based on Structural Similarity [J].
Fang, Yuming ;
Zeng, Kai ;
Wang, Zhou ;
Lin, Weisi ;
Fang, Zhijun ;
Lin, Chia-Wen .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2014, 4 (01) :95-105
[9]   RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY [J].
FISCHLER, MA ;
BOLLES, RC .
COMMUNICATIONS OF THE ACM, 1981, 24 (06) :381-395
[10]  
Girod Bernd, 1993, P207