3D human action analysis and recognition through GLAC descriptor on 2D motion and static posture images

被引:12
作者
Bulbul, Mohammad Farhad [1 ]
Islam, Saiful [2 ]
Ali, Hazrat [3 ]
机构
[1] Jashore Univ Sci & Technol, Dept Math, Jashore, Bangladesh
[2] Bangabandhu Sheikh Mujibur Rahman Sci & Technol U, Dept Math, Gopalganj, Bangladesh
[3] COMSATS Univ Islamabad, Dept Elect & Comp Engn, Abbottabad Campus, Abbottabad, Pakistan
关键词
Human action recognition; l2-CRC; Motion history images; Static history images; REPRESENTATION; GRADIENTS; FUSION; HISTOGRAMS; ENSEMBLE; NETWORK; VISION; SCALE; POSE;
D O I
10.1007/s11042-019-7365-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present an approach for identification of actions within depth action videos. First, we process the video to get motion history images (MHIs) and static history images (SHIs) corresponding to an action video based on the use of 3D Motion Trail Model (3DMTM). We then characterize the action video by extracting the Gradient Local Auto-Correlations (GLAC) features from the SHIs and the MHIs. The two sets of features i.e., GLAC features from MHIs and GLAC features from SHIs are concatenated to obtain a representation vector for action. Finally, we perform the classification on all the action samples by using the l2-regularized Collaborative Representation Classifier (l2-CRC) to recognize different human actions in an effective way. We perform evaluation of the proposed method on three action datasets, MSR-Action3D, DHA and UTD-MHAD. Through experimental results, we observe that the proposed method performs superior to other approaches.
引用
收藏
页码:21085 / 21111
页数:27
相关论文
共 67 条
[11]   Action recognition from depth sequences using weighted fusion of 2D and 3D auto-correlation of gradients features [J].
Chen, Chen ;
Zhang, Baochang ;
Hou, Zhenjie ;
Jiang, Junjun ;
Liu, Mengyuan ;
Yang, Yun .
MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (03) :4651-4669
[12]   Gradient Local Auto-Correlations and Extreme Learning Machine for Depth-Based Activity Recognition [J].
Chen, Chen ;
Hou, Zhenjie ;
Zhang, Baochang ;
Jiang, Junjun ;
Yang, Yun .
ADVANCES IN VISUAL COMPUTING, PT I (ISVC 2015), 2015, 9474 :613-623
[13]  
Chen C, 2015, IEEE IMAGE PROC, P168, DOI 10.1109/ICIP.2015.7350781
[14]   Action Recognition from Depth Sequences Using Depth Motion Maps-based Local Binary Patterns [J].
Chen, Chen ;
Jafari, Roozbeh ;
Kehtarnavaz, Nasser .
2015 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2015, :1092-1099
[15]   Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors [J].
Chen, Chen ;
Jafari, Roozbeh ;
Kehtarnavaz, Nasser .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (01) :51-61
[16]  
Chen C, 2014, IEEE ENG MED BIO, P4135, DOI 10.1109/EMBC.2014.6944534
[17]  
Chen C, 2014, IEEE ENG MED BIO, P4983, DOI 10.1109/EMBC.2014.6944743
[18]   Reconstruction of Hyperspectral Imagery From Random Projections Using Multihypothesis Prediction [J].
Chen, Chen ;
Li, Wei ;
Tramel, Eric W. ;
Fowler, James E. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01) :365-374
[19]   Real-time human action recognition based on depth motion maps [J].
Chen, Chen ;
Liu, Kui ;
Kehtarnavaz, Nasser .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2016, 12 (01) :155-163
[20]  
Chen C, 2012, CONF REC ASILOMAR C, P608, DOI 10.1109/ACSSC.2012.6489079