Influence of Spatial Resolution on State-of-the-Art Saliency Models

被引:2
作者
Che, Zhaohui [1 ]
Zhai, Guangtao [1 ]
Min, Xiongkuo [1 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Commun & Informat Proc, Shanghai 200030, Peoples R China
来源
ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2015, PT II | 2015年 / 9315卷
关键词
Saliency model; Spatial multi-resolutions; Down-sample; Average gradient;
D O I
10.1007/978-3-319-24078-7_8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual attention has been widely investigated and applied in recent decades. Various computation models have been proposed to modeling visual attention, but most researches are conducted under the assumption that given images have few limited spatial resolutions. Spatial resolution is an important feature of image. Image resolution may have some influence on visual attention, and it may also affect the effectiveness of visual attention models. The influence of spatial resolution on saliency models has not been systematically investigated before. In this paper, we discuss two problems related to image resolution and saliency: (1) Most saliency models contain down-sampling function which changes the resolution of original images to lower the computational complexity and keep the formalization of the algorithm. In the first part, we discuss the influence of the down-sampling ratio on the effectiveness of classic saliency models. (2) In the second part, we investigate the effectiveness of saliency models in images of various resolutions. A dataset which provides images and corresponding eye movement data in various spatial resolutions is used in this part. We apply the default rescaling parameters and keep them unchanged. Then we analyze the performance of classic models on 8 resolution levels. In summary, we systematically investigate and analyze problems concerning spatial resolution in the research of saliency modeling. The results of this work can provide a guide to the use of classic models in images of different resolutions and they are helpful to computational complexity optimization.
引用
收藏
页码:74 / 83
页数:10
相关论文
共 17 条
[1]  
[Anonymous], IEEE 12 INT C COMP V
[2]  
[Anonymous], 2010, P IEEE C COMP VIS PA
[3]  
[Anonymous], 2009, P IEEE C COMP VIS PA
[4]   State-of-the-Art in Visual Attention Modeling [J].
Borji, Ali ;
Itti, Laurent .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :185-207
[5]  
Bruce N., 2005, NIPS
[6]  
Chu W. T., 2013, P ACM MULT
[7]   Visual saliency estimation by nonlinearly integrating features using region covariances [J].
Erdem, Erkut ;
Erdem, Aykut .
JOURNAL OF VISION, 2013, 13 (04)
[8]   On the relationship between optical variability, visual saliency, and eye fixations: A computational approach [J].
Garcia-Diaz, Anton ;
Leboran, Ctor ;
Fdez-Vidal, Xose R. ;
Pardo, Xose M. .
JOURNAL OF VISION, 2012, 12 (06)
[9]  
Harel J., 2006, Graph-Based Visual Saliency, V19, DOI DOI 10.7551/MITPRESS/7503.003.0073
[10]   Image Signature: Highlighting Sparse Salient Regions [J].
Hou, Xiaodi ;
Harel, Jonathan ;
Koch, Christof .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (01) :194-201