Spatio-temporal information for human action recognition

被引:18
|
作者
Yao, Li [1 ,2 ]
Liu, Yunjian [3 ]
Huang, Shihui [3 ]
机构
[1] Southeast Univ, Minist Educ, Key Lab Comp Network & Informat Integrat, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Jiangsu, Peoples R China
[3] Southeast Univ, Comp Sci & Engn Coll, Dongnandaxue Rd 2, Nanjing, Jiangsu, Peoples R China
基金
中国博士后科学基金;
关键词
Spatio-temporal; Video representation; Multi-feature fusion; Human action recognition; REPRESENTATION; CONTEXT;
D O I
10.1186/s13640-016-0145-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Human activity recognition in videos is important for content-based videos indexing, intelligent monitoring, human-machine interaction, and virtual reality. This paper uses the low-level feature-based framework for human activity recognition which includes feature extraction and descriptor computing, early multi-feature fusion, video representation, and classification. This paper improves the first two steps. We propose a spatio-temporal bigraph-based multi-feature fusion algorithm to capture the useful visual information for recognition. Meanwhile, we introduce a compressed spatio-temporal video representation to bag of words representation. Our experiments on two popular datasets show efficient performance.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Spatio-Temporal Analysis for Human Action Detection and Recognition in Uncontrolled Environments
    Liu, Dianting
    Yan, Yilin
    Shyu, Mei-Ling
    Zhao, Guiru
    Chen, Min
    INTERNATIONAL JOURNAL OF MULTIMEDIA DATA ENGINEERING & MANAGEMENT, 2015, 6 (01): : 1 - 18
  • [42] Human action recognition using Local Spatio-Temporal Discriminant Embedding
    Jia, Kui
    Yeung, Dit-Yan
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 3040 - +
  • [43] Exploring hybrid spatio-temporal convolutional networks for human action recognition
    Hao Wang
    Yanhua Yang
    Erkun Yang
    Cheng Deng
    Multimedia Tools and Applications, 2017, 76 : 15065 - 15081
  • [44] Human Action Recognition in Video by Fusion of Structural and Spatio-temporal Features
    Borzeshi, Ehsan Zare
    Concha, Oscar Perez
    Piccardi, Massimo
    STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, 2012, 7626 : 474 - 482
  • [45] Local Spatio-Temporal Interest Point Detection for Human Action Recognition
    Li, Feng
    Du, Jixiang
    2012 IEEE FIFTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2012, : 579 - 582
  • [46] Robust human action recognition based on spatio-temporal descriptors and motion temporal templates
    Dou, Jianfang
    Li, Jianxun
    OPTIK, 2014, 125 (07): : 1891 - 1896
  • [47] Detecting Human Action as the Spatio-Temporal Tube of Maximum Mutual Information
    Wang, Taiqing
    Wang, Shengjin
    Ding, Xiaoqing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (02) : 277 - 290
  • [48] Projection transform on spatio-temporal context for action recognition
    Wanru Xu
    Zhenjiang Miao
    Qiang Zhang
    Multimedia Tools and Applications, 2015, 74 : 7711 - 7728
  • [49] Spatio-Temporal Covariance Descriptors for Action and Gesture Recognition
    Sanin, Andres
    Sanderson, Conrad
    Harandi, Mehrtash T.
    Lovell, Brian C.
    2013 IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION (WACV), 2013, : 103 - 110
  • [50] A Spatio-Temporal Deep Learning Approach For Human Action Recognition in Infrared Videos
    Shah, Anuj K.
    Ghosh, Ripul
    Akula, Aparna
    OPTICS AND PHOTONICS FOR INFORMATION PROCESSING XII, 2018, 10751