Stereoscopic saliency model using contrast and depth-guided-background prior

被引:47
作者
Liang, Fangfang [1 ]
Duan, Lijuan [1 ]
Ma, Wei [1 ]
Qiao, Yuanhua [2 ]
Cai, Zhi [1 ]
Qing, Laiyun [3 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
[2] Beijing Univ Technol, Appl Sci, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereoscopic saliency analysis; 3D images; Depth-guided-background prior; Saliency based on disparity; VISUAL-ATTENTION; QUALITY ASSESSMENT; OBJECT DETECTION; INTEGRATION; OPTIMIZATION; DISPARITY; IMAGES;
D O I
10.1016/j.neucom.2017.10.052
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many successful models of saliency have been proposed to detect salient regions for 2D images. Because stereopsis, with its distinctive depth information, influences human viewing, it is necessary for stereoscopic saliency detection to consider depth information as an additional cue. In this paper, we propose a 3D stereoscopic saliency model based on both contrast and depth-guided-background prior. First, a depth-guided-background prior is specifically detected from a disparity map apart from the conventional prior, assuming boundary super-pixels as background. Then, saliency based on disparity with the help of the proposed prior is proposed to prioritize the contrasts among super-pixels. In addition, a scheme to combine the contrast of disparity and the contrast of color is presented. Finally, 2D spatial dissimilarity features are further employed to refine the saliency map. Experimental results on the PSU stereo saliency benchmark dataset (SSB) show that the proposed method performs better than existing saliency models. (c) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:2227 / 2238
页数:12
相关论文
共 63 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
[Anonymous], 2011, 2011 17 INT C DIG SI, DOI DOI 10.1109/ICDSP.2011.6004985
[3]  
[Anonymous], P IS T SPIE EL IM IN
[4]  
[Anonymous], 2010, ACM INT C MULT
[5]  
[Anonymous], MULTIMEDIA TOOLS APP
[6]  
Borji A., 2012, CVPR, DOI DOI 10.1109/CVPR.2012.6247706
[7]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Sihite, Dicky N. ;
Itti, Laurent .
COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 :414-429
[8]  
Chamaret C., 2010, P IS T SPIE EL IM IN
[9]   Active contours without edges [J].
Chan, TF ;
Vese, LA .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (02) :266-277
[10]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416