Water detection through spatio-temporal invariant descriptors

被引:24
|
作者
Mettes, Pascal [1 ,2 ]
Tan, Robby T. [1 ,3 ]
Veltkamp, Remco C. [1 ]
机构
[1] Univ Utrecht, Dept Informat & Comp Sci, Utrecht, Netherlands
[2] Univ Amsterdam, Intelligent Syst Lab Amsterdam, Amsterdam, Netherlands
[3] SIM Univ, Multimedia Technol & Design Programme, Singapore, Singapore
关键词
Water detection; Spatio-temporal descriptors; Fourier analysis; Invariants; Markov random fields; LOCAL BINARY PATTERNS; SEGMENTATION; RECOGNITION;
D O I
10.1016/j.cviu.2016.04.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we aim to segment and detect water in videos. Water detection is beneficial for appllications such as video search, outdoor surveillance, and systems such as unmanned ground vehicles and unmanned aerial vehicles. The specific problem, however, is less discussed compared to general texture recognition. Here, we analyze several motion properties of water. First, we describe a video preprocessing step, to increase invariance against water reflections and water colours. Second, we investigate the temporal and spatial properties of water and derive corresponding local descriptors. The descriptors are used to locally classify the presence of water and a binary water detection mask is generated through spatio-temporal Markov Random Field regularization of the local classifications. Third, we introduce the Video Water Database, containing several hours of water and non-water videos, to validate our algorithm. Experimental evaluation on the Video Water Database and the DynTex database indicates the effectiveness of the proposed algorithm, outperforming multiple algorithms for dynamic texture recognition and material recognition. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:182 / 191
页数:10
相关论文
共 50 条
  • [11] Video retrieval of near-duplicates using κ-nearest neighbor retrieval of spatio-temporal descriptors
    DeMenthon, Daniel
    Doermann, David
    MULTIMEDIA TOOLS AND APPLICATIONS, 2006, 30 (03) : 229 - 253
  • [12] Video retrieval of near-duplicates using κ-nearest neighbor retrieval of spatio-temporal descriptors
    Daniel DeMenthon
    David Doermann
    Multimedia Tools and Applications, 2006, 30 : 229 - 253
  • [13] Relevance Detection in Cataract Surgery Videos by Spatio-Temporal Action Localization
    Ghamsarian, Negin
    Taschwer, Mario
    Putzgruber-Adamitsch, Doris
    Sarny, Stephanie
    Schoeffmann, Klaus
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10720 - 10727
  • [14] Abnormal Events Detection Based on Spatio-Temporal Co-occurences
    Benezeth, Y.
    Jodoin, P. -M.
    Saligrama, V.
    Rosenberger, C.
    CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 2450 - +
  • [15] Coherency Based Spatio-Temporal Saliency Detection for Video Object Segmentation
    Mahapatra, Dwarikanath
    Gilani, Syed Omer
    Saini, Mukesh Kumar
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2014, 8 (03) : 454 - 462
  • [16] Spatio-Temporal Detection of Fine-Grained Dyadic Human Interactions
    van Gemeren, Coert
    Poppe, Ronald
    Veltkamp, Remco C.
    HUMAN BEHAVIOR UNDERSTANDING, 2016, 9997 : 116 - 133
  • [17] Line Scratch Detection Using Spatio-Temporal Regularity Flow Vectors
    Kumar, Rupesh
    Gupta, Sumana
    Venkatesh, K. S.
    2014 19TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2014, : 36 - 41
  • [18] Occlusion event detection using geometric features in spatio-temporal volumes
    Marquis-Bolduc, Mathieu
    Deschenes, Francois
    MACHINE VISION AND APPLICATIONS, 2010, 21 (06) : 841 - 853
  • [19] STARE: Spatio-Temporal Attention Relocation for Multiple Structured Activities Detection
    Lee, Kyuhwa
    Ognibene, Dimitri
    Chang, Hyung Jin
    Kim, Tae-Kyun
    Demiris, Yiannis
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 5916 - 5927
  • [20] Moving target detection approach based on spatio-temporal salient perception
    Jin, Gang
    Li, Zhengzhou
    Gu, Yuanshan
    Li, Jialing
    Cao, Dong
    Liu, Linyan
    OPTIK, 2014, 125 (22): : 6681 - 6686