Hierarchical Gaussian descriptor based on local pooling for action recognition

被引:8
作者
Nguyen, Xuan Son [1 ]
Mouaddib, Abdel-Illah [1 ]
Thanh Phuong Nguyen [2 ,3 ]
机构
[1] Univ Caen Basse Normandie, CNRS, UMR 6072, GREYC, F-14000 Caen, France
[2] Aix Marseille Univ, CNRS, UMR 7296, ENSAM,LSIS, F-13397 Marseille, France
[3] Univ Toulon & Var, CNRS, UMR 7296, LSIS, F-83957 La Garde, France
关键词
Action recognition; Covariance descriptor; Gaussian descriptor; Riemannian manifold; Lie group; Symmetric Positive Definite matrices; REGION COVARIANCE; DEPTH; REPRESENTATION; CLASSIFICATION; POSE;
D O I
10.1007/s00138-018-0989-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a new approach based on Gaussian descriptors for action recognition. We first develop a feature representation technique that encodes high-order statistics of local features in two levels, where single Gaussians are used to capture the distributions involved. To deal with the possible loss of information about the distribution of features caused by heterogeneous feature vectors when summarizing them, we use K-means clustering and Sparse Coding to construct some sets of feature vectors over which the summarization is performed. We then present two methods based on depth images and pose data for action recognition. In both methods, the proposed feature representation technique is applied to effectively obtain discriminative action descriptors. Experimental evaluation on the seven benchmark datasets, i.e., MSRAction3D, MSRGesture3D, DHA, SKIG, Florence, UTKinect, and HDM05, shows that our methods achieve very promising results on all the datasets.
引用
收藏
页码:321 / 343
页数:23
相关论文
共 92 条
[1]  
[Anonymous], 2018, AAAI
[2]  
[Anonymous], 2008, PROC BRIT MACH VIS C
[3]  
[Anonymous], 2013, P 23 INT JOINT C ART
[4]  
[Anonymous], TPAMI
[5]  
[Anonymous], 2014, SPAMS: a SPArse Modeling Software
[6]  
[Anonymous], 2017, CVPR
[7]   Geometric means in a novel vector space structure on symmetric positive-definite matrices [J].
Arsigny, Vincent ;
Fillard, Pierre ;
Pennec, Xavier ;
Ayache, Nicholas .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2007, 29 (01) :328-347
[8]  
Bilinski P, 2015, PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), P2140
[9]  
Boureau YL, 2011, IEEE I CONF COMP VIS, P2651, DOI 10.1109/ICCV.2011.6126555
[10]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310