Merging fixation for saliency detection in a multilayer graph

被引:8
作者
Li, Shiqi [1 ]
Zeng, Cheng [1 ]
Liu, Shiping [1 ]
Fu, Yan [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Mech Sci & Engn, Wuhan 430074, Peoples R China
基金
美国国家科学基金会;
关键词
Fixation prediction; Saliency detection; Multilayer graph; Superpixel; REGION DETECTION; OBJECT DETECTION; VISUAL SALIENCY; COLOR; MODEL; ATTENTION;
D O I
10.1016/j.neucom.2016.12.026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a multilayer graph-based saliency detection algorithm by merging fixation is proposed to effectively detect salient objects in complex scenes. First, the fixation location of an image is acquired by using fixation prediction models. This is based on a motivation that human visual attention system would quickly focus on salient regions before further processing. Then, by merging the fixation saliency map into an over segmented region map, we can obtain a coarse detection result which most likely contains salient objects. To further improve the performance of our saliency detection, the next key idea is to leverage color contrast between superpixels as features in CIE-Lab space and resolve saliency estimation of coarse regions via a multilayer graph-based framework. The final saliency detection is achieved by combining the coarse detection result with multilayer saliency maps. Extensive experiments are conducted on five benchmark datasets. Experimental results show that the proposed method yields comparable or better results in terms of PR curve, ROC curve, and F-measure, and is robust to deal with both cluttered and clean scenes.
引用
收藏
页码:173 / 183
页数:11
相关论文
共 54 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
  • [3] [Anonymous], 2007, PROC IEEE C COMPUT V, DOI 10.1109/CVPR.2007.383267
  • [4] [Anonymous], 2014, COMPUT VISUAL MEDIA
  • [5] Salient Object Detection: A Benchmark
    Borji, Ali
    Cheng, Ming-Ming
    Jiang, Huaizu
    Li, Jia
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 5706 - 5722
  • [6] What is a Salient Object? A Dataset and a Baseline Model for Salient Object Detection
    Borji, Ali
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (02) : 742 - 756
  • [7] State-of-the-Art in Visual Attention Modeling
    Borji, Ali
    Itti, Laurent
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) : 185 - 207
  • [8] Borji A, 2012, PROC CVPR IEEE, P478, DOI 10.1109/CVPR.2012.6247711
  • [9] A scale invariant measure of clutter
    Bravo, Mary J.
    Farid, Hany
    [J]. JOURNAL OF VISION, 2008, 8 (01):
  • [10] Bruce N., 2005, ADV NEURAL INFORM PR, V18, P155