A novel graph-based optimization framework for salient object detection

被引:49
作者
Zhang, Jinxia [1 ,2 ]
Ehinger, Krista A. [3 ,4 ]
Wei, Haikun [1 ]
Zhang, Kanjian [1 ]
Yang, Jingyu [2 ]
机构
[1] Southeast Univ, Sch Automat, Key Lab Measurement & Control CSE, Minist Educ, Nanjing 210096, Jiangsu, Peoples R China
[2] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens In, Minist Educ, Nanjing 210094, Jiangsu, Peoples R China
[3] Brigham & Womens Hosp, Visual Attent Lab, Cambridge, MA 02139 USA
[4] Harvard Med Sch, Cambridge, MA 02139 USA
关键词
Optimization framework; Multiple graphs; Visual rarity; Saliency detection; REGION; MODEL; IMAGE; ATTENTION;
D O I
10.1016/j.patcog.2016.10.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In traditional graph-based optimization framework for salient object detection, an image is over-segmented into superpixels and mapped to one single graph. The saliency value of each superpixel is then computed based on the similarity between connected nodes and the saliency related queries. When applying the traditional graph based optimization framework to the salient object detection problem in natural scene images, we observe at least two limitations: only one graph is employed to describe the information contained in an image and no cognitive property about visual saliency is explicitly modeled in the optimization framework. In this work, we propose a novel graph-based optimization framework for salient object detection. Firstly, we employ multiple graphs in our optimization framework. A natural scene image is usually complex, employing multiple graphs from different image properties can better describe the complex information contained in the image. Secondly, we model one popular cognitive property about visual saliency (visual rarity) in our graph-based optimization framework, making this framework more suitable for saliency detection problem. Specifically, we add a regularization term to constrain the saliency value of each superpixel according to visual rarity in our optimization framework. Our experimental results on four benchmark databases with comparisons to fifteen representative methods demonstrate that our graph-based optimization framework is effective and computationally efficient.
引用
收藏
页码:39 / 50
页数:12
相关论文
共 60 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[3]   EXTRACTION OF EARLY PERCEPTUAL STRUCTURE IN DOT PATTERNS - INTEGRATING REGION, BOUNDARY, AND COMPONENT GESTALT [J].
AHUJA, N ;
TUCERYAN, M .
COMPUTER VISION GRAPHICS AND IMAGE PROCESSING, 1989, 48 (03) :304-356
[4]  
[Anonymous], 2006, P CVPR
[5]  
[Anonymous], IEEE COMP SOC WORKSH
[6]  
Batra D., 2010, Computer Vision and Pattern Recognition
[7]  
Borji A., 2012, EUR C COMP VIS
[8]  
Borji A., 2012, INT C COMP VIS PATT
[9]   State-of-the-Art in Visual Attention Modeling [J].
Borji, Ali ;
Itti, Laurent .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :185-207
[10]  
Bruce N., 2005, NIPS, P155, DOI DOI 10.5555/2976248.2976268