Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum

被引:126
作者
Fang, Yuming [1 ]
Lin, Weisi [1 ]
Lee, Bu-Sung [1 ]
Lau, Chiew-Tong [1 ]
Chen, Zhenzhong [2 ]
Lin, Chia-Wen [3 ]
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Amplitude spectrum; Fourier transform; human visual sensitivity; saliency detection; visual attention; GUIDED SEARCH; TOP-DOWN; ATTENTION; COLOR; IMAGE; GUIDANCE; SCENE;
D O I
10.1109/TMM.2011.2169775
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the wide applications of saliency information in visual signal processing, many saliency detection methods have been proposed. However, some key characteristics of the human visual system (HVS) are still neglected in building these saliency detection models. In this paper, we propose a new saliency detection model based on the human visual sensitivity and the amplitude spectrum of quaternion Fourier transform (QFT). We use the amplitude spectrum of QFT to represent the color, intensity, and orientation distributions for image patches. The saliency value for each image patch is calculated by not only the differences between the QFT amplitude spectrum of this patch and other patches in the whole image, but also the visual impacts for these differences determined by the human visual sensitivity. The experiment results show that the proposed saliency detection model outperforms the state-of-the-art detection models. In addition, we apply our proposed model in the application of image retargeting and achieve better performance over the conventional algorithms.
引用
收藏
页码:187 / 198
页数:12
相关论文
共 49 条
  • [1] [Anonymous], 2007, P IEEE INT C COMP VI
  • [2] [Anonymous], 2002, ITU-R BT.500-11
  • [3] [Anonymous], Digital Image Processing
  • [4] [Anonymous], 2007, 2007 IEEE 11 INT C C, DOI DOI 10.1109/ICCV.2007.4409010
  • [5] Seam carving for content-aware image resizing
    Avidan, Shai
    Shamir, Ariel
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03):
  • [6] VISION OUTSIDE THE FOCUS OF ATTENTION
    BRAUN, J
    SAGI, D
    [J]. PERCEPTION & PSYCHOPHYSICS, 1990, 48 (01): : 45 - 58
  • [7] Bruce N.D., 2006, Adv. Neural Inf. Process. Syst., V18, P5
  • [8] A visual attention model for adapting images on small displays
    Chen, LQ
    Xie, X
    Fan, X
    Ma, WY
    Zhang, HJ
    Zhou, HQ
    [J]. MULTIMEDIA SYSTEMS, 2003, 9 (04) : 353 - 364
  • [9] Perceptually-Friendly H.264/AVC Video Coding Based on Foveated Just-Noticeable-Distortion Model
    Chen, Zhenzhong
    Guillemot, Christine
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2010, 20 (06) : 806 - 819
  • [10] Hypercomplex Fourier transforms of color images
    Ell, Todd A.
    Sangwine, Stephen J.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (01) : 22 - 35