Saliency Detection for Stereoscopic Images Based on Depth Confidence Analysis and Multiple Cues Fusion

被引:216
作者
Cong, Runmin [1 ]
Lei, Jianjun [1 ]
Zhang, Changqing [2 ]
Huang, Qingming [3 ]
Cao, Xiaochun [4 ]
Hou, Chunping [1 ]
机构
[1] Tianjin Univ, Sch Elect Informat Engn, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
[3] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China
关键词
Color and depth-based compactness; depth confidence measure; multiple cues; saliency detection; VISUAL-ATTENTION;
D O I
10.1109/LSP.2016.2557347
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Stereoscopic perception is an important part of human visual system that allows the brain to perceive depth. However, depth information has not been well explored in existing saliency detection models. In this letter, a novel saliency detection method for stereoscopic images is proposed. First, we propose a measure to evaluate the reliability of depth map, and use it to reduce the influence of poor depth map on saliency detection. Then, the input image is represented as a graph, and the depth information is introduced into graph construction. After that, a new definition of compactness using color and depth cues is put forward to compute the compactness saliency map. In order to compensate the detection errors of compactness saliency when the salient regions have similar appearances with background, foreground saliency map is calculated based on depth-refined foreground seeds' selection (DRSS) mechanism and multiple cues contrast. Finally, these two saliency maps are integrated into a final saliency map through weighted-sum method according to their importance. Experiments on two publicly available stereo data sets demonstrate that the proposed method performs better than other ten state-of-the-art approaches.
引用
收藏
页码:819 / 823
页数:5
相关论文
共 32 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Measuring the Objectness of Image Windows [J].
Alexe, Bogdan ;
Deselaers, Thomas ;
Ferrari, Vittorio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2189-2202
[3]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[4]   Depth really Matters: Improving Visual Salient Region Detection with Depth [J].
Desingh, Karthik ;
Krishna, K. Madhava ;
Rajan, Deepu ;
Jawahar, C. V. .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2013, 2013,
[5]   Visual acuity inspired saliency detection by using sparse features [J].
Fang, Yuming ;
Lin, Weisi ;
Fang, Zhijun ;
Chen, Zhenzhong ;
Lin, Chia-Wen ;
Deng, Chenwei .
INFORMATION SCIENCES, 2015, 309 :1-10
[6]   Video Saliency Incorporating Spatiotemporal Cues and Uncertainty Weighting [J].
Fang, Yuming ;
Wang, Zhou ;
Lin, Weisi ;
Fang, Zhijun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) :3910-3921
[7]   Saliency Detection for Stereoscopic Images [J].
Fang, Yuming ;
Wang, Junle ;
Narwaria, Manish ;
Le Callet, Patrick ;
Lin, Weisi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (06) :2625-2636
[8]  
FU HZ, 2015, PROC CVPR IEEE, P4428, DOI DOI 10.1109/CVPR.2015
[9]   Physical Metaphor for Streaming Media Retargeting [J].
Gallea, Roberto ;
Ardizzone, Edoardo ;
Pirrone, Roberto .
IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (04) :971-979
[10]   Database Saliency for Fast Image Retrieval [J].
Gao, Yuan ;
Shi, Miaojing ;
Tao, Dacheng ;
Xu, Chao .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (03) :359-369