Dynamic texture description using adapted bipolar-invariant and blurred features

被引:2
作者
Thanh Tuan Nguyen [1 ,2 ]
Thanh Phuong Nguyen [1 ]
Bouchara, Frederic [1 ]
机构
[1] Univ Toulon & Var, Aix Marseille Univ, LIS, CNRS, Marseille, France
[2] HCMC Univ Technol & Educ, Fac IT, Ho Chi Minh City, Vietnam
关键词
Dynamic textures; Bipolar-invariant; Feature extraction; DoG; LOCAL BINARY COUNT; PATTERNS; VIDEO; CLASSIFICATION; REPRESENTATION; SCHEME; SPACE; SCALE; FLOW;
D O I
10.1007/s11045-022-00826-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Encoding turbulent properties of dynamic textures (DTs) is a challenging issue of video understanding for various applications in computer vision. It is partly due to the negative impacts of noise, changes of illumination, and scales. In order to deal with those influences, this paper proposes a new approach in which local adapted features of multi-Gaussian-filtered outcomes are exploited for DT representation against the well-known problems. To this end, we firstly take multi-scale 2D/3D Gaussian-based filtering kernels into account video analysis in order to correspondingly obtain Gaussian-based filtered outcomes of which the blurred and bipolar-invariant characteristics are complementary. Secondly, due to the sensitivity to noise and near-uniform regions in the encoding of bipolar-invariant features, we propose an essential modification for completed local binary pattern operator to form a more discriminative operator, named Completed AdaptIve Pattern, so that it can be in accordance with the perplexity. Finally, a prominent framework is introduced to efficiently capture DTs' shape and motion clues in Gaussian-based filtered results. The proposed descriptors are verified on benchmark datasets for DT classification task. Experimental results have validated the interest of our method.
引用
收藏
页码:945 / 979
页数:35
相关论文
共 87 条
[1]   Dynamic texture recognition using local tetra pattern-three orthogonal planes (LTrP-TOP) [J].
Amit ;
Raman, Balasubramanian ;
Sadhya, Debanjan .
VISUAL COMPUTER, 2020, 36 (03) :579-592
[2]   Convolutional neural network on three orthogonal planes for dynamic texture classification [J].
Andrearczyk, Vincent ;
Whelan, Paul F. .
PATTERN RECOGNITION, 2018, 76 :36-49
[3]  
[Anonymous], 2010, LECT NOTES COMPUT SC
[4]   Sparse binarised statistical dynamic features for spatio-temporal texture analysis [J].
Arashloo, Shervin Rahimzadeh .
SIGNAL IMAGE AND VIDEO PROCESSING, 2019, 13 (03) :575-582
[5]   Dynamic texture representation using a deep multi-scale convolutional network [J].
Arashloo, Shervin Rahimzadeh ;
Amirani, Mehdi Chehel ;
Noroozi, Ardeshir .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 43 :89-97
[6]   Dynamic Texture Recognition Using Multiscale Binarized Statistical Image Features [J].
Arashloo, Shervin Rahimzadeh ;
Kittler, Josef .
IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (08) :2099-2109
[7]   Discriminative Non-Linear Stationary Subspace Analysis for Video Classification [J].
Baktashmotlagh, Mahsa ;
Harandi, Mehrtash ;
Lovell, Brian C. ;
Salzmann, Mathieu .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (12) :2353-2366
[8]  
Chan AB, 2007, PROC CVPR IEEE, P208
[9]   Modeling, clustering, and segmenting video with mixtures of dynamic textures [J].
Chan, Antoni B. ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (05) :909-926
[10]   A learning-based approach for leaf detection in traffic surveillance video [J].
Chen, Li ;
Peng, Xiaoping ;
Tian, Jing ;
Liu, Jiaxiang .
MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2018, 29 (04) :1895-1904