A spatial-frequency-temporal domain based saliency model for low contrast video sequences

被引:2
作者
Mu, Nan [1 ]
Xu, Xin [1 ,2 ]
Zhang, Xiaolong [1 ,2 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430065, Hubei, Peoples R China
[2] Wuhan Univ Sci & Technol, Hubei Prov Key Lab Intelligent Informat Proc & Re, Wuhan 430065, Hubei, Peoples R China
关键词
Salient object detection; Low contrast videos; Multimodal fusion; Region covariance; Incremental learning; LOW-RANK; OBJECT DETECTION; OPTIMIZATION;
D O I
10.1016/j.jvcir.2018.11.012
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The last few decades have witnessed rapid development of visual saliency detection, as it can detect object-of-interest from clutter environments to substantially facilitate a wide range of applications. However, traditional visual saliency detection models primarily rely on image features, which may face great challenges in low contrast video stream captured from low lighting scenarios. This paper proposes a dynamic multimodal fusion based visual saliency detection model towards low contrast videos, which combines saliency information from spatial, frequency, and temporal domains. In spatial domain, super-pixel covariance is utilized to compute the region dissimilarity under low lighting scenarios; in frequency domain, the amplitude spectrum tuned method is used to suppress the background noise; in temporal domain, the incremental learning is employed to efficiently update background model from high dimensional video streams. Extensive experiments have been conducted to validate the effectiveness of the proposed model. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:79 / 88
页数:10
相关论文
共 58 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
  • [3] Fully Automatic Extraction of Salient Objects from Videos in Near Real Time
    Akamine, Kazuma
    Fukuchi, Ken
    Kimura, Akisato
    Takagi, Shigeru
    [J]. COMPUTER JOURNAL, 2012, 55 (01) : 3 - 14
  • [4] [Anonymous], 2018, IEEE Trans. Circuits Syst. Video Technol.
  • [5] [Anonymous], P IEEE INT C SIGN PR
  • [6] [Anonymous], 2000, P EUR C COMP VIS
  • [7] [Anonymous], SPIE IS T ELECT IMAG
  • [8] [Anonymous], 2007, PROC IEEE C COMPUT V, DOI 10.1109/CVPR.2007.383267
  • [9] Video Saliency Detection via Spatial-Temporal Fusion and Low-Rank Coherency Diffusion
    Chen, Chenglizhao
    Li, Shuai
    Wang, Yongguang
    Qin, Hong
    Hao, Aimin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (07) : 3156 - 3170
  • [10] Micro Tells Macro: Predicting the Popularity of Micro-Videos via a Transductive Model
    Chen, Jingyuan
    Song, Xuemeng
    Nie, Liqiang
    Wang, Xiang
    Zhang, Hanwang
    Chua, Tat-Seng
    [J]. MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 898 - 907