Action recognition by using kernels on aclets sequences

被引:15
作者
Brun, Luc [2 ]
Percannella, Gennaro [1 ]
Saggese, Alessia [1 ]
Vento, Mario [1 ]
机构
[1] Univ Salerno, Dept Informat & Elect Engn & Appl Math, Via Giovanni Paolo 2, I-84084 Fisciano, SA, Italy
[2] ENSICAEN Univ Caen Basse Normandie, GREYC UMR CNRS 6072, F-14050 Caen, France
关键词
Human action recognition; Strings; String kernel; Soft assignment; MOTION; MODEL;
D O I
10.1016/j.cviu.2015.09.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we propose a method for human action recognition based on a string kernel framework. An action is represented as a string, where each symbol composing it is associated to an aclet, that is an atomic unit of the action encoding a feature vector extracted from raw data. In this way, measuring similarities between actions leads to design a similarity measure between strings. We propose to define this string's similarity using the global alignment kernel framework. In this context, the similarity between two aclets is computed by a novel soft evaluation method based on an enhanced gaussian kernel. The main advantage of the proposed approach lies in its ability to effectively deal with actions of different lengths or different temporal scales as well as with noise introduced during the features extraction step. The proposed method has been tested over three publicly available datasets, namely the MIVIA, the CAD and the MHAD, and the obtained results, compared with several state of the art approaches, confirm the effectiveness and the applicability of our system in real environments, where unexperienced operators can easily configure it. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:3 / 13
页数:11
相关论文
共 52 条
[1]   Human activity recognition from 3D data: A review [J].
Aggarwal, J. K. ;
Xia, Lu .
PATTERN RECOGNITION LETTERS, 2014, 48 :70-80
[2]   Human Activity Analysis: A Review [J].
Aggarwal, J. K. ;
Ryoo, M. S. .
ACM COMPUTING SURVEYS, 2011, 43 (03)
[3]  
Aizerman M. A., 1964, Automation and Remote Control, V25, P821
[4]  
[Anonymous], 2009, BMVC
[5]  
[Anonymous], P VISAPP 2015
[6]  
[Anonymous], P IEEE CVPRW
[7]  
[Anonymous], PATTERN RECOGN LETT
[8]  
[Anonymous], P WACV
[9]   ACTION CATEGORIZATION IN SOCCER VIDEOS USING STRING KERNELS [J].
Ballan, Lamberto ;
Bertini, Marco ;
Del Bimbo, Alberto ;
Serra, Giuseppe .
CBMI: 2009 INTERNATIONAL WORKSHOP ON CONTENT-BASED MULTIMEDIA INDEXING, 2009, :13-18
[10]   Augmenting Bag-of-Words: Data-Driven Discovery of Temporal and Structural Information for Activity Recognition [J].
Bettadapura, Vinay ;
Schindler, Grant ;
Ploetz, Thomas ;
Essa, Irfan .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :2619-2626