Stereoscopic video saliency detection based on spatiotemporal correlation and depth confidence optimization

被引:6
作者
Zhang, Ping [1 ]
Liu, Jingwen [1 ]
Wang, Xiaoyang [1 ]
Pu, Tian [1 ]
Fei, Chun [1 ]
Guo, Zhengkui [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Photoelect Sci & Engn, Hefei, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereoscopic video; Saliency detection; Spatiotemporal correlation; Cepth confidence optimization; VISUAL-ATTENTION; MODEL; SEGMENTATION; CONTRAST; IMAGE;
D O I
10.1016/j.neucom.2019.10.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Effective stereoscopic video saliency detection is challenging due to the diversity of visual contrast and the variability of object motion. In this paper, we propose a novel stereoscopic video saliency detection method based on spatiotemporal correlation and depth confidence optimization. First, spatial saliency is obtained by color contrast computation and further enhancing spatial correlation between neighbors. Second, temporal saliency is calculated by propagating motion information between frames. The special propagation in sequential frames and reverse sequential frames augments the temporal correlation. Furthermore, a depth confidence optimization is proposed to fuse the spatial saliency and temporal saliency to generate optimal saliency map adaptively. Experimental results on three datasets demonstrate the efficiency of the proposed saliency method. (c) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:256 / 268
页数:13
相关论文
共 68 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
  • [3] [Anonymous], 2010, SEGMENTING SALIENT O
  • [4] [Anonymous], 2014, 2014 INT C LEARNING
  • [5] Active contours without edges
    Chan, TF
    Vese, LA
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (02) : 266 - 277
  • [6] Global Contrast based Salient Region Detection
    Cheng, Ming-Ming
    Zhang, Guo-Xin
    Mitra, Niloy J.
    Huang, Xiaolei
    Hu, Shi-Min
    [J]. 2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, : 409 - 416
  • [7] Dai JF, 2016, ADV NEUR IN, V29
  • [8] Shifting More Attention to Video Salient Object Detection
    Fan, Deng-Ping
    Wang, Wenguan
    Cheng, Ming-Ming
    Shen, Jianbing
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8546 - 8556
  • [9] Fan Q., 2015, NEUROCOMPUTING, P175
  • [10] Saliency Detection for Stereoscopic Images
    Fang, Yuming
    Wang, Junle
    Narwaria, Manish
    Le Callet, Patrick
    Lin, Weisi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (06) : 2625 - 2636