Saliency Tree: A Novel Saliency Detection Framework

被引:222
作者
Liu, Zhi [1 ,2 ]
Zou, Wenbin [3 ,4 ]
Le Meur, Olivier [5 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[2] Inst Rech Informat & Syst Aleatoires, F-35042 Rennes, France
[3] Shenzhen Univ, Coll Informat Engn, Shenzhen 518060, Peoples R China
[4] European Univ Brittany, Natl Inst Appl Sci Rennes, F-35708 Rennes, France
[5] Univ Rennes 1, F-35042 Rennes, France
基金
中国国家自然科学基金;
关键词
Saliency tree; saliency detection; saliency model; saliency map; regional saliency measure; region merging; salient node selection; VISUAL-ATTENTION; OBJECT DETECTION; MODEL; IMAGE; SEGMENTATION; MAXIMIZATION; COLOR; VIDEO;
D O I
10.1109/TIP.2014.2307434
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel saliency detection framework termed as saliency tree. For effective saliency measurement, the original image is first simplified using adaptive color quantization and region segmentation to partition the image into a set of primitive regions. Then, three measures, i.e., global contrast, spatial sparsity, and object prior are integrated with regional similarities to generate the initial regional saliency for each primitive region. Next, a saliency-directed region merging approach with dynamic scale control scheme is proposed to generate the saliency tree, in which each leaf node represents a primitive region and each non-leaf node represents a non-primitive region generated during the region merging process. Finally, by exploiting a regional center-surround scheme based node selection criterion, a systematic saliency tree analysis including salient node selection, regional saliency adjustment and selection is performed to obtain final regional saliency measures and to derive the high-quality pixel-wise saliency map. Extensive experimental results on five datasets with pixel-wise ground truths demonstrate that the proposed saliency tree model consistently outperforms the state-of-the-art saliency models.
引用
收藏
页码:1937 / 1952
页数:16
相关论文
共 61 条
[1]   SALIENCY DETECTION USING MAXIMUM SYMMETRIC SURROUND [J].
Achanta, Radhakrishna ;
Suesstrunk, Sabine .
2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, :2653-2656
[2]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[3]  
Alexe B, 2010, PROC CVPR IEEE, P73, DOI 10.1109/CVPR.2010.5540226
[4]  
Alpert S., 2007, P IEEE CVPR, P1
[5]  
[Anonymous], 2011, P IEEE MTT S INT MIC
[6]  
[Anonymous], 2010, INT J COMPUT VISION, DOI DOI 10.1007/s11263-009-0275-4
[7]  
[Anonymous], 2007, PROC IEEE C COMPUT V, DOI 10.1109/CVPR.2007.383267
[8]  
[Anonymous], 2007, Computer Vision and Pattern Recognition (CVPR), IEEE Conference on
[9]   Contour Detection and Hierarchical Image Segmentation [J].
Arbelaez, Pablo ;
Maire, Michael ;
Fowlkes, Charless ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) :898-916
[10]   Esaliency (Extended Saliency): Meaningful Attention Using Stochastic Image Modeling [J].
Avraham, Tamar ;
Lindenbaum, Michael .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (04) :693-708