Low-level and high-level prior learning for visual saliency estimation

被引:24
|
作者
Song, Mingli [1 ]
Chen, Chun [1 ]
Wang, Senlin [1 ]
Yang, Yezhou [2 ]
机构
[1] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Zhejiang, Peoples R China
[2] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA
关键词
Visual saliency estimation; Low-level prior learning; High-level prior learning; SUPPORT VECTOR MACHINES; SCENE; ATTENTION; FEATURES; PREDICT;
D O I
10.1016/j.ins.2013.09.036
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual saliency estimation is an important issue in multimedia modeling and computer vision, and constitutes a research field that has been studied for decades. Many approaches have been proposed to solve this problem. In this study, we consider the visual attention problem blue with respect to two aspects: low-level prior learning and high-level prior learning. On the one hand, inspired by the concept of chance of happening, the low-level priors, i.e., Color Statistics-based Priors (CSP) and Spatial Correlation-based Priors (SCP), are learned to describe the color distribution and contrast distribution in natural images. On the other hand, the high-level priors, i.e., the relative relationships between objects, are learned to describe the conditional priority between different objects in the images. In particular, we first learn the low-level priors that are statistically based on a large set of natural images. Then, the high-level priors are learned to construct a conditional probability matrix blue that reflects the relative relationship between different objects. Subsequently, a saliency model is presented by integrating the low-level priors, the high-level priors and the Center Bias Prior (CBP), in which the weights that correspond to the low-level priors and the high-level priors are learned based on the eye tracking data set. The experimental results demonstrate that our approach outperforms the existing techniques. (C) 2013 Elsevier Inc. All rights reserved.
引用
收藏
页码:573 / 585
页数:13
相关论文
共 50 条
  • [41] The Rapid Extraction of Gist-Early Neural Correlates of High-level Visual Processing
    Oppermann, Frank
    Hassler, Uwe
    Jescheniak, Joerg D.
    Gruber, Thomas
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2012, 24 (02) : 521 - 529
  • [42] "Scene" from inside: The representation of Observer's space in high-level visual cortex
    Chaisilprungraung, Thitaporn
    Park, Soojin
    NEUROPSYCHOLOGIA, 2021, 161
  • [43] Learning High-level Features for Satellite Image Classification With Limited Labeled Samples
    Yang, Wen
    Yin, Xiaoshuang
    Xia, Gui-Song
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (08): : 4472 - 4482
  • [44] Training on Movement Figure-Ground Discrimination Remediates Low-Level Visual Timing Deficits in the Dorsal Stream, Improving High-Level Cognitive Functioning, Including Attention, Reading Fluency, and Working Memory (vol 11, 236, 2017)
    Lawton, Teri
    Shelley-Tremblay, John
    FRONTIERS IN HUMAN NEUROSCIENCE, 2018, 12
  • [45] Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video
    Li, Jia
    Tian, Yonghong
    Huang, Tiejun
    Gao, Wen
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 90 (02) : 150 - 165
  • [46] IS THE EARLY VISUAL ERP SENSITIVE TO LOW-LEVEL VISUAL STIMULUS PROPERTIES? A TEST OF LUMINANCE VS. COGNITIVE FACTORS
    Segalowitz, Sidney
    Callegari, Jessica
    Chattha, Osama
    Smith, Blayne
    PSYCHOPHYSIOLOGY, 2017, 54 : S133 - S133
  • [47] High-level Microsatellite Instability in Appendiceal Carcinomas
    Taggart, Melissa W.
    Galbincea, John
    Mansfield, Paul F.
    Fournier, Keith F.
    Royal, Richard E.
    Overman, Michael J.
    Rashid, Asif
    Abraham, Susan C.
    AMERICAN JOURNAL OF SURGICAL PATHOLOGY, 2013, 37 (08) : 1192 - 1200
  • [48] Pupillometric decoding of high-level musical imagery
    Kang, Olivia
    Banaji, Mahzarin R.
    CONSCIOUSNESS AND COGNITION, 2020, 77
  • [49] Pupil responses to high-level image content
    Naber, Marnix
    Nakayama, Ken
    JOURNAL OF VISION, 2013, 13 (06):
  • [50] Do we understand high-level vision?
    Cox, David Daniel
    CURRENT OPINION IN NEUROBIOLOGY, 2014, 25 : 187 - 193