Water detection through spatio-temporal invariant descriptors

被引:24
|
作者
Mettes, Pascal [1 ,2 ]
Tan, Robby T. [1 ,3 ]
Veltkamp, Remco C. [1 ]
机构
[1] Univ Utrecht, Dept Informat & Comp Sci, Utrecht, Netherlands
[2] Univ Amsterdam, Intelligent Syst Lab Amsterdam, Amsterdam, Netherlands
[3] SIM Univ, Multimedia Technol & Design Programme, Singapore, Singapore
关键词
Water detection; Spatio-temporal descriptors; Fourier analysis; Invariants; Markov random fields; LOCAL BINARY PATTERNS; SEGMENTATION; RECOGNITION;
D O I
10.1016/j.cviu.2016.04.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we aim to segment and detect water in videos. Water detection is beneficial for appllications such as video search, outdoor surveillance, and systems such as unmanned ground vehicles and unmanned aerial vehicles. The specific problem, however, is less discussed compared to general texture recognition. Here, we analyze several motion properties of water. First, we describe a video preprocessing step, to increase invariance against water reflections and water colours. Second, we investigate the temporal and spatial properties of water and derive corresponding local descriptors. The descriptors are used to locally classify the presence of water and a binary water detection mask is generated through spatio-temporal Markov Random Field regularization of the local classifications. Third, we introduce the Video Water Database, containing several hours of water and non-water videos, to validate our algorithm. Experimental evaluation on the Video Water Database and the DynTex database indicates the effectiveness of the proposed algorithm, outperforming multiple algorithms for dynamic texture recognition and material recognition. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:182 / 191
页数:10
相关论文
共 50 条
  • [1] HOG and HOOF Spatio-Temporal Descriptors for Gesture Recognition
    Agab, Salah Eddine
    Chelali, Fatma Zohra
    2018 INTERNATIONAL CONFERENCE ON SIGNAL, IMAGE, VISION AND THEIR APPLICATIONS (SIVA), 2018,
  • [2] Micro-Facial Movements: An Investigation on Spatio-Temporal Descriptors
    Davison, Adrian K.
    Yap, Moi Hoon
    Costen, Nicholas
    Tan, Kevin
    Lansley, Cliff
    Leightley, Daniel
    COMPUTER VISION - ECCV 2014 WORKSHOPS, PT II, 2015, 8926 : 111 - 123
  • [3] RECOGNIZING HUMAN ACTIONS BY FUSING SPATIO-TEMPORAL APPEARANCE AND MOTION DESCRIPTORS
    Ballan, Lamberto
    Bertini, Marco
    Del Bimbo, Alberto
    Seidenari, Lorenzo
    Serra, Giuseppe
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 3569 - 3572
  • [4] Crowd Anomaly Detection in Public Surveillance via Spatio-temporal Descriptors and Zero-Shot Classifier
    Abdullah, Faisal
    Javeed, Madiha
    Jalal, Ahmad
    4TH INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING (IC)2, 2021, : 990 - 997
  • [5] On Pain Assessment from Facial Videos Using Spatio-Temporal Local Descriptors
    Yang, Ruijing
    Tong, Shujun
    Bordallo, Miguel
    Boutellaa, Elhocine
    Peng, Jinye
    Feng, Xiaoyi
    Hadid, Abdenour
    2016 SIXTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2016,
  • [6] Spatio-temporal modeling of lung images for cancer detection
    Shen, L
    Zheng, W
    Gao, L
    Huang, H
    Makedon, F
    Pearlman, J
    ONCOLOGY REPORTS, 2006, 15 : 1085 - 1089
  • [7] Spatio-temporal segmentation
    Swain, C
    Puri, A
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING '99, PARTS 1-2, 1998, 3653 : 1233 - 1236
  • [8] DepMSTAT: Multimodal Spatio-Temporal Attentional Transformer for Depression Detection
    Tao, Yongfeng
    Yang, Minqiang
    Li, Huiru
    Wu, Yushan
    Hu, Bin
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (07) : 2956 - 2966
  • [9] Efficient Online Spatio-Temporal Filtering for Video Event Detection
    Yan, Xinchen
    Yuan, Junsong
    Liang, Hui
    COMPUTER VISION - ECCV 2014 WORKSHOPS, PT I, 2015, 8925 : 769 - 785
  • [10] A Spatio-Temporal Framework for Moving Object Detection in Outdoor Scene
    Rout, Deepak Kumar
    Puhan, Sharmistha
    GLOBAL TRENDS IN INFORMATION SYSTEMS AND SOFTWARE APPLICATIONS, PT 2, 2012, 270 : 494 - +