Global Contrast Based Salient Region Detection

被引:972
作者
Cheng, Ming-Ming [1 ]
Mitra, Niloy J. [2 ]
Huang, Xiaolei [3 ]
Torr, Philip H. S. [4 ]
Hu, Shi-Min [5 ]
机构
[1] Nankai Univ, Dept Comp Sci, Tianjin 300071, Peoples R China
[2] UCL, Dept Comp Sci, London WC1E 6BT, England
[3] Lehigh Univ, Dept Comp Sci & Engn, Bethlehem, PA 18015 USA
[4] Univ Oxford, Dept Engn, Oxford OX1 2JD, England
[5] Tsinghua Univ, Dept Comp Sci & Technol, TNList, Beijing 100084, Peoples R China
基金
英国工程与自然科学研究理事会;
关键词
Salient object detection; visual attention; saliency map; unsupervised segmentation; image retrieval; VISUAL-ATTENTION; IMAGE SEGMENTATION; OBJECT; SCENE; RECOGNITION; EXTRACTION; SEARCH; MODEL;
D O I
10.1109/TPAMI.2014.2345401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic estimation of salient object regions across images, without any prior assumption or knowledge of the contents of the corresponding scenes, enhances many computer vision and computer graphics applications. We introduce a regional contrast based salient object detection algorithm, which simultaneously evaluates global contrast differences and spatial weighted coherence scores. The proposed algorithm is simple, efficient, naturally multi-scale, and produces full-resolution, high-quality saliency maps. These saliency maps are further used to initialize a novel iterative version of GrabCut, namely SaliencyCut, for high quality unsupervised salient object segmentation. We extensively evaluated our algorithm using traditional salient object detection datasets, as well as a more challenging Internet image dataset. Our experimental results demonstrate that our algorithm consistently outperforms 15 existing salient object detection and segmentation methods, yielding higher precision and better recall rates. We also show that our algorithm can be used to efficiently extract salient object masks from Internet images, enabling effective sketch-based image retrieval (SBIR) via simple shape comparisons. Despite such noisy internet images, where the saliency regions are ambiguous, our saliency guided image retrieval achieves a superior retrieval rate compared with state-of-the-art SBIR methods, and additionally provides important target object region information.
引用
收藏
页码:569 / 582
页数:14
相关论文
共 89 条
[1]  
Achanta R, 2008, LECT NOTES COMPUT SC, V5008, P66
[2]   SALIENCY DETECTION USING MAXIMUM SYMMETRIC SURROUND [J].
Achanta, Radhakrishna ;
Suesstrunk, Sabine .
2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, :2653-2656
[3]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[4]   Measuring the Objectness of Image Windows [J].
Alexe, Bogdan ;
Deselaers, Thomas ;
Ferrari, Vittorio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2189-2202
[5]  
Alpert S., 2007, PROC IEEE C COMPUT V, P1
[6]  
[Anonymous], 2011, IEEE T VIS COMPUT GR, DOI DOI 10.1109/TVCG.2010.266
[7]  
[Anonymous], VIS COMPUT
[8]  
[Anonymous], 2003, P 11 ACM INT C MULT
[9]  
[Anonymous], VISUAL COMPUTER
[10]  
[Anonymous], 2007, Advances in Neural Information Processing Systems